Previous Job
Previous
Spark Developer
Ref No.: 18-00360
Location: New Jersey
Position Type:Contract
Start Date: 07/12/2018
Title :  Spark Developer
Location :  Roseland, NJ
Duration :  6+ months
Bill Rate :  W2  $46/hour - $59/hour (assuming no benefits)


 
Job Description:
  • Strong experience in Java, Python, SPARK and KAFKA experience.
  •  
  • Strong experience in developing Spring Boot micro services on Pivotal platform (using Pivotal Cloud Foundry, Pivotal Application Services).
  •  
  • Experience with medium-to-large data pipelines: implementing, testing and deploying.
  •  
  • Experience with stream processing using Kafka.
  •  
  • Experience with automated unit and integration testing for Kafka and Py Spark.
  •  
  • Experience with Kafka Connect.
  •  
  • Execute strategic engineering proof of concepts and product evaluations.
  •  
  • Develop monitoring strategies for infrastructure, platforms and applications aligning with enterprise strategy and overall industry trends.
  •  

 
Kafka
  • Experience in developing large Kafka clusters
  •  
  • Executing partitioning strategy
  •  
  • Implementing security & authorization (permission based) on Kafka cluster
  •  
  • Implementing ingestion services (to connect to RDBMS, Mainframe, Webservice, etc.) using Kafka producer API's / Kafka Connect
  •  
  • Preferable – Knowledge in implementation of Confluent Kafka – Data Streaming Platform
  •  

 
Spring Boot
  • Experience in developing Spring Boot Microservices
  •  
  • Working experience on Pivotal platform (PCF and Client)
  •  
  • Working experience on developing pipelines using Spring Cloud Data Flow (aka Spring Cloud)
  •  

 
Spark
  • HDFS, Spark, Hbase, Hive, Sqoop, Kafka, Storm, YARN, HiveQL, SparkSQL. Python experience is a plus.
  •  
  • Experience in developing Orchestration / Data Pipelines in Py Spark.
  •  
  • Strong Knowledge in developing Py Spark connectors (to RDBMS, Mainframe applications, Web service, MQ, Kafka).
  •  
  • Worked in large data processing, real-time streaming and scalable architectures.
  •  

 
 
Job Position Spark Developer
Full Name  
Current location:  
Contact Number  
Email Id  
Visa Status  
Interview availability:  
Start Availability:  
Wage rate  
IBM Bill Rate  
OT rate  
Mark Up