Previous Job
Previous
Software Engineering - Senior Software Engineer - Level 7
Ref No.: 26-00255
Location: Pune, Maharashtra
Start Date: 01/07/2026
   
 
Job Description
Job Description

As the Data Engineer, you will own the development and execution of innovative data products, solutions, and frameworks. Your expertise will ensure effective democratization of Client's data using well-designed data products and solutions. You will collaborate with cross-functional teams and implement data-related best practices in alignment with Client standards.

Key Responsibilities:
• Design, develop, and maintain new data products, solutions, and infrastructure
• Create new data pipelines and compliance-oriented infrastructure to facilitate seamless data hydration in AWS Databricks environment.
• Collaborate with technical teams and business stakeholders to understand data requirements and translate them into technical solutions.
• Work with large card payment datasets, ensuring data quality, accuracy, and performance.
• Build and maintain data quality checks and pipeline monitoring (e.g., validation rules, anomaly detection, alerts, and dashboards) to ensure reliable, timely data delivery.
• Implement data transformation, integration, and validation processes to support analytics and BI reporting needs.
• Optimize and fine-tune data pipelines for improved speed, reliability, and efficiency.
• Troubleshoot and resolve data-related issues, collaborating with the team to identify root causes.
• Document data processes, data lineage, and technical specifications for future reference.
• Participate in code reviews, ensuring adherence to coding standards and best practices.
• Collaborate with DevOps teams to automate deployment and monitoring of data pipelines.

Qualifications
• Bachelor's degree in computer science, Engineering, Data Science, or a related field.
• 6 to 8 years of experience as a Data Engineer or similar role, implementing multiple end-to-end data engineering, data lake, and data warehousing projects in a big data environment, with a strong command of data integration techniques and data quality management.
• Strong experience building Spark data pipelines using Python in Databricks
• Deep understanding & expertise in data engineering, ETL/ELT processes, data warehousing, and data modelling.
• Experience automating data pipelines in a Databricks environment using Delta Live Tables or similar tools.
• Strong experience with data technologies such as Databricks, Spark, Python, and SQL, as well as cloud platforms and services such as AWS.
• Excellent analytical, problem-solving skills and ability to provide innovative data solutions.
• Motivated initiative-taker with ability to excel at multi-tasking in a challenging environment and able to function under pressure with a high degree of initiative to drive results.
• Exceptional people skills with proven experience in relationship building and partnering, must work well in both team/individual settings and must be able to work with a geographically dispersed team.
• Strong written and oral communication skills with attention to detail
• Flexibility to work as a member of a matrix-based diverse and geographically distributed project team.
• Experience working in Agile teams.
Story Behind the Need – Business Group & Key Projects
  • Surrounding team & key projects
  • Purpose/Size of this team
  • Reason for the request
  • Motivators for this need
  • Increase Staff Need/ Replacement?
  • Project?
  • B&MI – Operational Reports Nextgen reporting
  •  
  • Need immediate contractors with DE skills
  •  
  • N/A
  •  
Typical Day in the Role
  • Hours/Shift worked
  • Key tasks and rhythm
  • Interaction with outside the team
  • Interaction level with others (clients)
  • Required to travel or work remotely (expenses required?)
  • 45 hrs/Regular shift
  • Development
  • On need basis
  • Daily basis
  • NO
Compelling Story & Candidate Value Proposition
  • What makes this role interesting?
  • Competitive market comparison
  • Unique selling points
  • Value added or experience gained
  • Required
  • Required
  • Required
  • Required
Candidate Requirements
  • Top 3 must-have HARD skills
  • Depth of experience with each
  • Stack-ranked
1 Pyspark
2 Databricks
3 Python
  • Top 3 must-have SOFT skills
  • Depth of experience with each
  • Stack-ranked
1  
2  
3  
  • Years of experience required
  • Key performance measurements
  • Degrees or certifications required
  • Disqualifiers
  • 6-7 yrs
  • Hands on experience with domain knowledge
  •  
  •  
  • Language/Communication Level
Rate (1= Not Important / 5= Integral)
  • English required
  • Other language(s) required
  • 4/5
  • Yes