Previous Job
Spark Developer
Ref No.: 18-00360
Location: New Jersey
Position Type:Contract
Start Date: 07/12/2018
Title :  Spark Developer
Location :  Roseland, NJ
Duration :  6+ months
Bill Rate :  W2  $46/hour - $59/hour (assuming no benefits)

Job Description:
  • Strong experience in Java, Python, SPARK and KAFKA experience.
  • Strong experience in developing Spring Boot micro services on Pivotal platform (using Pivotal Cloud Foundry, Pivotal Application Services).
  • Experience with medium-to-large data pipelines: implementing, testing and deploying.
  • Experience with stream processing using Kafka.
  • Experience with automated unit and integration testing for Kafka and Py Spark.
  • Experience with Kafka Connect.
  • Execute strategic engineering proof of concepts and product evaluations.
  • Develop monitoring strategies for infrastructure, platforms and applications aligning with enterprise strategy and overall industry trends.

  • Experience in developing large Kafka clusters
  • Executing partitioning strategy
  • Implementing security & authorization (permission based) on Kafka cluster
  • Implementing ingestion services (to connect to RDBMS, Mainframe, Webservice, etc.) using Kafka producer API's / Kafka Connect
  • Preferable – Knowledge in implementation of Confluent Kafka – Data Streaming Platform

Spring Boot
  • Experience in developing Spring Boot Microservices
  • Working experience on Pivotal platform (PCF and Client)
  • Working experience on developing pipelines using Spring Cloud Data Flow (aka Spring Cloud)

  • HDFS, Spark, Hbase, Hive, Sqoop, Kafka, Storm, YARN, HiveQL, SparkSQL. Python experience is a plus.
  • Experience in developing Orchestration / Data Pipelines in Py Spark.
  • Strong Knowledge in developing Py Spark connectors (to RDBMS, Mainframe applications, Web service, MQ, Kafka).
  • Worked in large data processing, real-time streaming and scalable architectures.

Job Position Spark Developer
Full Name  
Current location:  
Contact Number  
Email Id  
Visa Status  
Interview availability:  
Start Availability:  
Wage rate  
IBM Bill Rate  
OT rate  
Mark Up