Previous Job
Previous
Data Engineer - AWS
Ref No.: 22-01071
Location: Wayne, New Jersey
JOB DESCRIPTION
"Primary Responsibilities:
Analyze business requirements and outline solutions.
Analyze data requirements, complex source data, data models, and determine the best methods in extracting, transforming and loading the data into the data staging, warehouse and other system integration projects.
Designs, develops and documents ETL solutions using data warehouse design best practices
Provide technical assistance in identifying, evaluating, and developing systems and procedures.
Design, Develop, Test, Adapt ETL code & jobs to accommodate changes in source data and new business requirements.
Create or update technical documentation for transition to support teams.
Provides senior technical leadership to design, architecture, integration and support of the entire data sourcing platform with a focus on high availability, performance, scalability and maintainability
Manage automation of file processing as well as all ETL processes within a job workflow.
Develop, Contribute and adhere to the development of standards and sound procedural practices.
Effectively communicate status and workloads, offers to assist other areas.
Proactively communicate innovative ideas, solutions, and capabilities over and above the specific task request
Collaboratively work with a team and independently. Continuously strive for high performing business solutions
Perform and coordinate unit and system integration testing.
Ensure data quality throughout entire ETL process, including audits and feedback loops to sources of truth.
Participate in design review sessions and ensure all solutions are aligned to pre-defined architectural specifications.

Competencies & Experience Required/Desired:
10+ years of advanced SQL experience (Oracle, SQL Server, Redshift, etc.)
6+ years of Data Engineering experience in ETL design, Architecture, Modelling, development, optimization & testing using native SQL, SAP Data Services (BODS) or Talend on database like Oracle, HANA, Redshift, Aurora etc
3+ years of experience with AWS tools such as S3, EC2, ECS, EKS, SageMaker, Aurora, Redshift, RDS, Lambda Functions AMI, ELB, ALB, NLB, VPC, Auto Scaling configurations, DMS, Amazon FW, API Gateway, ELB, IAM, CloudTrail, and CloudFront.
2+ years of experience with CI/CD tools like Jenkins, GIT, Java and Shell scripting
Proficiency with modern software development methodologies such as Agile, source control, CI/CD, project management and issue tracking with JIRA
Strong problem-solving capabilities. Results oriented. Relies on fact-based logic for decision-making.
Ability to work with multiple projects and work streams at one time. Must be able to deliver results based upon project deadlines.
Willing to flex daily work schedule to allow for time-zone differences for global team communications
Strong interpersonal and communication skills
Nice to Have
Knowledge of SAP
Visualization tool experience, especially with Tableau or Power BI
AWS Certification
Education
A master's or bachelor's degree in computer science, applied mathematics, software engineering, physics, or related quantitative discipline. "