Previous Job
Previous
Data Engineer-Atlanta, GA
Ref No.: 18-04173
Location: Atlanta, Georgia
 
Data Engineer
Location: Atlanta, GA or Austin, TX
Duration: Full Time
Salary plus Benefits
 
US citizen, Green Card and EAD preferred.
 
Technical/Functional Skills:
·         Google Big query (to build analytical datasets).
·         Google Storage ( File system and this is the port of entry for all the data that lift from bastion as per the standard)
·         Google Bitable & Data Store for application logs and stats.
·         Oracle runs in google engine as a Controller for Job scheduling.
·         Google App engine (Data processing)
·         Compute Engine (Data processing and Application platform)
·         Jenkins (To build a pipelines and CICD)
·         Concourse - CICD
·         FLOW (inbuilt tool for automated deployment)
·         Google Dataflow (Data pipeline to read from Pub/Sub).
·         Google Pub/Sub ( as Queues in google cloud)
·         Python
·         Java
·         Groovy
·         Shell scripting
 
Roles & Responsibilities:
Work on the following tasks for moving data to the Cloud:
·         Build the process required for optimal extraction, transformation, and loading of data from a wide variety of data sources to google cloud.
·         Create and maintain optimal data pipeline architecture replicating the existing process.
·         Analyze, explore and select the appropriate tools for data migration and transformation.
·         Assemble large, complex data sets that meet functional / non-functional business requirements.
·         Keep data separated and secured using masking and encryption.
·         Work with data and analytics experts to strive for greater functionality in data systems.
·         Identify, design, and implement internal process improvements: automating manual processes, optimizing data delivery, re-designing infrastructure for greater scalability, etc.
 
Generic Skills:
·         Good written/Oral Communication, Presentation, Interactive skills for interacting with IT, Business and other Vendors.
·         Flexible to work with an Agile Co-located team.
·         Experienced in Agile processes and DevOps methodologies.