JOB DESCRIPTION
Responsibilities
Support to large analytic teams and data scientists; advise analytical team and data scientists on correct data stores and environments for their needs.
Roadmap architecture and recommend toolsets to ensure analytical team and data scientists future needs will be met
Work with the Product Owners and other stakeholders to ensure suitable data will be available when needed for defined product releases
Collaborate with Software Engineering and other Data Engineering peers as needed
Candidate will explore new tools or architecture as early as possible and bring that to architecture meeting instead of data analysts going through all the hurdles to identify the solution and then reaching out to architecture in later phase. This role will work with analysts at early stages with the expected outcome of expediting the delivery of analytical solutions.

Must-have skills:
Extensive experience with AWS based Big Data environments and following AWS services: EMR, Glue, Athena,, Lake Formation, lambda
PySpark
Experience with AWS solution architecture and serverless services; ability to do recommendations to help with long-term roadmap
Extensive experience with analytics, fine tuning large queries, data exploration/cleansing/quality/ transformation
Experience with high volume Operational datastores

Nice-to-have:
Talend Big Data (big plus)
Experience with cloud-based Kafka or other messaging infrastructure
Understanding of CI/CD automations
SageMaker