Sr AWS Data Engineer
Position 2
Location: Malvern or charlotte (Day 1 Onsite)
Responsibilities:
· Provides expert level development, system analysis, design and implementation of applications using AWS services specifically using Python for Lambda
· Translates technical specifications, and/or design models into code for new or enhancement projects (for internal or external clients).
· Develops code that reuses objects, is well structured, includes sufficient comments, and is easy to maintain
· Provides follow up Production support when needed. Submits change control requests and documents.
· Participates in design, code, and test inspections throughout life cycle to identify issues and ensure methodology compliance.
· Participates in systems analysis activities, including system requirements analysis and definition, e.g. prototyping. Participates in other meetings, such as those for use case creation and analysis.
· Performs unit testing and writes appropriate unit test plans to ensure requirements are satisfied. Assists in integration, systems, acceptance, and other related testing as needed.
· Ensures developed code is optimized in order to meet client performance specifications associated with page rendering time by completing page performance tests.

Technical Skills Required

1. Experience in building large scale batch and data pipelines with data processing frameworks in AWS cloud platform using PySpark (on EMR) & Glue ETL
2. Deep experience in developing data processing data manipulation tasks using PySpark such as reading data from external sources merge data perform data enrichment and load in to target data destinations.
3. Experience in deployment and operationalizing the code using CI/CD tools Bitbucket and Bamboo
4. Strong AWS cloud computing experience. Extensive experience in Lambda, S3, EMR, Redshift
5. Should have worked on Data Warehouse/Database technologies for at least 8 years.
6. Any AWS certification will be an added advantage.