Previous Job
Previous
Hadoop Developer
Ref No.: 18-01544
Location: Wilmington, Delaware
Hadoop Developer in Wilmington, DE 19801

Interview Logistics:
Phone screened followed by
Onsite Face to Face
Required Skills Set:
Years of Experience: 5 plus years of Hadoop Development experience.
Education Required: Bachelors Degree
Develop highly scalable and extensible Big Data platform(Cloudera), which enables collection, storage, modeling, and analysis of massive data sets from numerous channels Loading from disparate data sets ETL coding using Hive and Spark.
Translate complex functional and technical requirements into detailed design.
Maintain security, data privacy and data quality.
Continuously evaluate new technologies, innovate and deliver solution for business critical applications Test prototypes and oversee handover to operational teams.
Propose best practices/standards.
Mandatory experience
Working with Hadoop
Writing HQL and Spark Code
Loading data into Hadoop
Working with job scheduling tools
Knowledge in Hadoop
Writing high-performance, reliable and maintainable code.
Ability to write Spark jobs.
Good knowledge of database structures, theories, principles, and practices.
Proficiency in writing SQL including HiveQL.
Knowledge of workflow schedulers
Analytical and problem solving skills, applied to Big Data domain Proven understanding of Hadoop SQL base tools such as Hive & Impala.
Good aptitude in multi-threading, concurrency and distributed processing concepts.
Additional Preferred Skills:
Preferred Experience
Reading and writing data to Kafka
Processing real time data with Spark Streaming or other technology.
Working with Financial data especially Credit Cards
Preferred Skills
Familiarity with data loading tools such Flume and Sqoop.
Familiar with real time streaming tools such as Kafka and Spark Streaming.
Understanding of file formats such as Avro and Parquet including serialization/deserialization Understanding NoSQL technologies such as HBase, MongoDB and Cassandra.
Solid understanding of Data Warehousing concepts.
Project Description:
Migrating Data out of the current Oracle Environment into the Hadoop Cluster.
Physical Environment and Working Conditions:
• Ability to work on site in Wilmington, DE
• Must be able to demonstrate high degree of attention to detail, accuracy and deadlines.