Previous Job
Previous
Associate Technical Architect
Ref No.: 20-00654
Location: Denver, Colorado
Position Type:Contract
Visa: No Student VISA and No H1B Transfers
Primary Skill: Data Engineering
Other Mandatory Skills : Job Duties and Responsibilities (6-7 years of experience) 10+ preferred
Primary responsibilities fall into the following categories:

Deploy Enterprise data-oriented solutions leveraging Data Warehouse, Big Data and Machine Learning frameworks
Optimizing data engineering and machine learning pipelines
Support data and cloud transformation initiatives
Contribute to our cloud strategy based on prior experience
Understand the latest technologies in a rapidly innovative marketplace
Independently work with all stakeholders across the organization to deliver point and strategic solutions


Skills - Experience and Requirements

A successful Technology Transformation Architect will have the following:

Should have prior experience in working as Data warehouse/Big-data architect. Experience in advanced Apache Spark processing framework, spark programming using Scala or Python with knowledge in shell scripting.
Coding experience in Java and/or Scala is a must.
Experience in using AWS APIs ( e.g., JavaAPI, Boto3, etc.) to integrate different services
Should have experience in both functional programming and Spark SQL programming dealing with processing terabytes of data
Specifically, this experience must be in writing Big-data data engineering jobs for large scale data integration in AWS. Prior experience in writing Machine Learning data pipeline using Spark programming language is an added advantage.
Advanced SQL experience including SQL performance tuning is a must.
Experience in logical & physical table design in Big data environment to suit processing frameworks
Knowledge of using, setting up and tuning Spark on EMR using resource management framework such as Yarn or standalone spark.
Experience in writing spark streaming jobs (producers/consumers) using Apache Kafka or AWS Kinesis is required
Should have knowledge in variety of data platforms such as Redshift, S3, DynamoDB, MySQL/PostgreSQL
Experience in AWS services such as EMR, Glue, Athena, IAM, Lambda, Cloud watch and Data pipeline
Experience in AWS cloud transformation projects are required.