ETL Developer Lead
JOB DESCRIPTION:
ETL and Database Developer Lead Responsible for the technical design, development, testing and operational support and maintenance of a Data Warehouse consisting of Talend ETL jobs and Oracle Database. Implement Agile Methodologies & Dev/Ops deployment cycles. Develop and maintain ETL (Talend) jobs and Oracle/SQL databases, tables/indexes/triggers, complex queries, stored procedures and scheduled jobs. Worked with data integration process and work alongside business analysts for various project needs. Support break-fix, ETL framework and data quality enhancements. Develop and maintain documents for data, mapping, data dictionaries, and data transformation processes. Maintain reliability of database by developing and implementing standards and/or process for database maintenance, documentation, and configuration. The ETL /DB Developer Lead will be responsible for the support and minor enhancements of the Novelis North America Data Warehouse Responsibilities: Daily and month end support activities: - Proactively identifies issues : Daily and month end ETL job monitoring, debugging and fixing for data load and transformations - Perform root cause analysis - Provide end user functional and technical support for break-fix incidents - Fix issues encountered during daily job execution (ETL and Database). - Work with appropriate technical teams (service providers, Novelis and/or third party contractors) to ensure minimum impact of system upgrades, patch fixes, etc. - Responsible for fixing data quality issues working together with data analyst and data architect Minor enhancements related to: - Participates in analysis, design, and ETL/SQL development as part of Agile / Scrum Develop Team - Provides direction on complex assignments, projects, and/or initiatives to build and enhance the capability of his/her assigned area(s) of responsibility. - Designs systems and programs to meet complex business needs. - Prepares detailed technical specifications from which programs are developed and coded. - Ensures programs meet standards and technical specifications; performs technical analysis and component delivery. - Gathers information from existing systems, analyzes program and time requirements. - Assists project manager in preparing time estimates and justification for assigned tasks. - Extracting and Loading additional data into new or existing tables - Creating ETL to clean and transform the data , writing complex queries - Scheduling ETL jobs - Creating db views to provide to end users based on requirements. Required Skills: • Extensive experience in Talend ETL Mapping design, Implementation, Performance Tuning and Debugging. • Experience with design and implementation of ETL/ELT framework for complex warehouses/marts. • Good understanding of Data models, Data integration, Data Quality and data architecture. • Ability to develop complex mappings and workflows in accordance with requirements. • Strong data analytical skills are required. • Knowledge of large data sets and experience with performance tuning and troubleshooting. • Ability to effectively communicate with people at all levels of the enterprise from executives to developers to shopfloor operators • Experience with Lean / Agile development methodologies. Preferred Qualifications: • Hands-on development, with a willingness to troubleshoot and solve complex problems. • Experience with Power BI interface is desired. • Good expertise in impact analysis due to changes or issues • Experience in preparing test scripts and test cases to validate data and maintaining data quality | ||||