Previous Job
Previous
Data Engineer - Bradenton, FL ( Full time)
Ref No.: 18-03254
Location: Bradenton, Florida
Job Title : Data Engineer - Bradenton, FL
Duration : Long term contract or Full time Plus benefits
Location : Bradenton, FL
Salary / Rate : DOE plus Benefits

US Citizens, Green cards, EAD candidates preferred, Visa sponsorship (H1b Transfer) may be available for Right candidate - No third party c2c or Agencies.

Roles & Responsibilities
  • Expertise working with large scale distributed systems (Hadoop, Spark).
  • Strong understanding of the big data cluster, and its architecture
  • Experience building and optimizing big data ETL pipelines.
  • Advanced programming skills with Python, Java, Scala
  • Good knowledge of spark internals and performance tuning of spark jobs.
  • Strong SQL skills and is comfortable operating with relational data models and structure.
  • Capable of accessing data via a variety of API/RESTful services.
  • Experience with messaging systems like Kafka.
  • Experience with No SQL databases. Neo4j, mongo, etc.
  • Expertise with Continuous Integration/Continuous Delivery workflows and supporting applications.
  • Exposure to cloud environments and architectures. (preferably Azure)
  • Ability to work collaboratively with other teams.
  • Experience with containerization using tools such as Docker.
  • Strong knowledge of Linux and Bash. Can interact with the OS at the command line and create shell scripts to automate workflows.
  • Advanced understanding of software development and collaboration, including experience with tools such as Git.
  • Excellent written and verbal communication skills, comfortable presenting in front of non-technical audiences.
  • Essential Responsibilities include but not limited to:
  • Design and develop ETL workflows to migrate data from varied data sources including SQL Server, Natuzzi, Kafka etc. in batch and real-time.
  • Develop checks and balances to ensure integrity of the ingested data.
  • Design and Develop Spark jobs as per requirements for data processing needs.
  • Work with Analysts and Data Scientists to assist them in building scalable data products.
  • Designs systems, alerts, and dashboards to monitor data products in production