Become a Data Engineer for InfoTrie

Responsibilities:

  • Scrape, retrieve and clean data from a variety of unstructured sources (web, text)
  • Help build data processing pipelines, optimize and maintain our big data platform
  • Develop and improve our APIs and document them properly
  • Develop web application UI and visualization
  • Build prototypes to support our sales and business development which will then be integrated by our main tech team in our core system/web sites

 

Requirements:

  • Experience with Java, Python
  • Javascript and d3.js library
  • HTML, CSS
  • Relational database and SQL
  • Linux system management and shell programming
  • Effective communication skill and ability of independent study and research

 

Desirable skills:

  • Perl, R, Scala
  • Knowledge of statistics, machine learning, and text mining
  • NoSQL databases: MongoDB, Time Series DB, Redis
  • Hadoop, Spark, Storm, Kafka
  • Distributed search engine: Solr, Elasticsearch
  • Multiple languages (other than English) capability

More Positions