Previous Job
Previous
AWS Data engineer
Ref No.: 22-02239
Location: Malvern, Pennsylvania
Position Type:Contract
Role AWS Data Engineer
Location: Malvern or charlotte Tuesday, Wednesday, Thursday (Day 1 Onsite)
Coding on code war in python and PySpark with glue and AWS.-
Responsibilities :
  • Provides expert level development, system analysis, design and implementation of applications using AWS services specifically using Python for Lambda
  • Translates technical specifications, and/or design models into code for new or enhancement projects (for internal or external clients).
  • Develops code that reuses objects, is well structured, includes sufficient comments, and is easy to maintain
  • Provides follow up Production support when needed. Submits change control requests and documents.
  • Participates in design, code, and test inspections throughout life cycle to identify issues and ensure methodology compliance.
  • Participates in systems analysis activities, including system requirements analysis and definition, e.g. prototyping. Participates in other meetings, such as those for use case creation and analysis.
  • Performs unit testing and writes appropriate unit test plans to ensure requirements are satisfied.
  • Assists in integration, systems, acceptance, and other related testing as needed.
  • Ensures developed code is optimized in order to meet client performance specifications associated with page rendering time by completing page performance tests.
Technical Skills Required:
  • Experience in building large scale batch and data pipelines with data processing frameworks in
  • AWS cloud platform using PySpark (on EMR) & Glue ETL
  • Deep experience in developing data processing data manipulation tasks using PySpark such as reading data from external sources merge data perform data enrichment and load in to target data destinations.
  • Experience in deployment and operationalizing the code using CI/CD tools Bitbucket and Bamboo
  • Strong AWS cloud computing experience. Extensive experience in Lambda, S3, EMR, Redshift
  • Should have worked on Data Warehouse/Database technologies for at least 8 years.
  • Any AWS certification will be an added advantage