Previous Job
Previous
Sr. Data Engineer
Ref No.: 17-00801
Location: Sunnyvale, California
Position Type:Contract
Data Engineer Job Description
 
About the Role
Because we work on the cutting edge of a lot of technologies, we need someone who is a creative problem solver, resourceful in getting things done, and productive working independently or collaboratively. This person would also take on the following responsibilities:
  • Gather and process raw data at scale (including writing scripts, web scraping, calling APIs, write SQL queries, etc.).
  • Work closely with our engineering team to integrate your amazing innovations and algorithms into our production systems.
  • Perform ETL for various datasets with complex data transformation logic in batches as well as in real-time
  • Build scalable search and indexing capability to navigate and retrieve data
  • Process unstructured data into a form suitable for analysis – and then do the analysis.
  • Support business decisions with ad hoc analysis as needed.
 
About You
  • Programming experience in Python
  • Hands-on Experience in data modeling and data model optimization
  • Deep knowledge and hands on experience in ETL into and from RDBMS, preferable with PostgreSQL and Oracle DB. Experience with open-source ETL tools such as Pentahol and Talend is a plus
  • Proficient in writing SQL queries
  • Experience processing large amounts of structured and unstructured data.  Spark and MapReduce experience is a plus.
  • Excellent programming knowledge to clean and scrub noisy datasets.
  • Deep knowledge in data mining, machine learning, natural language processing, or information retrieval is a plus
  • Strong knowledge of and experience with statistics; potentially other advanced math as well.
  • An excellent team player and communicator who can work effectively with cross functional teams.