Previous Job
Previous
Technology Lead | Big Data - Data Processing | Spark - Richardson, TX
Ref No.: 18-00820
Location: Richardson, Texas
Job Title : Technology Lead | Big Data - Data Processing | Spark
Location : Richardson, TX
Position : Contract
Rate : DOE


No visa sponsorship available for this job. No third-party C2C.

Job description:
Must Have Skills
  • Must have extensive experience in Writing ingestion and curation process on hive, hbase using sqoop, spark scala, kafka
  • Performance tuning
  • Development using, JAVA, Shell script

Nice to have skills (Top 2 only)
  • Good working knowledge of Cloudera big data platform (Cloudera Hadoop implementation on Oracle BDA onprem)
  • Good working knowledge of AWS platform and components

Detailed Job Description:
  • 6 years of software development experience in a big data environment.
  • Include development, requirements gathering and documentation, well versed with code reviews, testing, and deployments.
  • Must have extensive experience in Writing ingestion and curation process on hive, hbase using sqoop, spark scala, kafka,
  • Performance tuning Development using, JAVA, Shell script
  • Good working knowledge of UNIX Linux OS Good working knowledge of Cloudera big data platform Cloudera Hadoop implementation on Oracle BDA

Top 3 responsibilities you would expect the Subcon to shoulder and execute*:
  1. Query and data pipeline performance tuning
  2. Build processes for data ingestion, curation
  3. Work on failed jobs and rerun them accordingly