Previous Job
Previous
GCP Cloud Engineer
Ref No.: 20-01393
Location: NYC, New York
Position Type:Contract
  • Mandatory Skills:
  • Candidate Should be Hands on GCP Hadoop Data Migration.
  • BigTable, BigQuery, CloudSQL, Cloud Dataproc
  • Hadoop and Data Lake
Position GCP Cloud Engineer/ Lead
Location NYC, NY
Job Type Fulltime Permanent/ Contract
Job Description
  • 7+ years of experience in data area like Cloud (GCP/AWS/Azure), Data warehouse, big data lake, ETL, data quality & etc.
  • 3+ years of strong GCP Data background (BigTable, BigQuery, CloudSQL)
  • Work with Data architects & SME's of current Hadoop data lake to understand the current & to be Google Cloud Platform (GCP) architecture and overall migration approach.
  • Analyze existing Hadoop data lake & data flow jobs developed Spark and MapReduce.
  • Migrate on-premise Hadoop data lake workloads to GCP using BigQuery, Cloud Dataproc, CloudSQL & etc.
  • Migrate history data from Hadoop data lake to GCP using gateway like DistCp(Distributed Copy).
  • Tune the existing jobs to provide better performance in Dataproc of cloud platform.
  • Support testing of new and existing workloads migrated to GCP.
  • Support data validation efforts.
  • Collaborate with the stakeholders to create the Go-live plan and participate in production release.
  • Support and participate in Product deployment planning and execution
  • Create Run book & support other documentation.