Previous Job
Previous
Lead Data Engineer
Ref No.: 26-00488
Location: San Francisco, California
Position Type:Contract
Title: Lead Data Engineer
Location: Remote
Duration: Contract
Job Description Summary Roles Needed:
Senior Data Engineer The supplier will serve the Data Strategy and Operations function within UKS, establishing new data integration patterns into Data 360 from third-party vendors and managing ingestion from existing sources. Engineers will own pipeline monitoring, KPI tracking, and egress management to multiple downstream destinations.

Scope of Work:
  • Manage all new data ingestions for UKS operational needs
  • Build new data integrations for all new data sources and providers, including third-party data providers
  • Manage new data egress patterns to send/share data outputs from Data 360 to multiple destinations
  • Ingest new data via existing ingestion pipelines
  • Monitor, maintain, and troubleshoot data pipelines
  • Track and report statistics including data volume, number of data streams, and other ingestion KPIs Near-Term Priorities (First 30 Days)
  • Ingest an additional dataset from Moody's (integration already established)
  • Manage other third-party vendor data sources as assigned
Required Skills & Qualifications
  • Strong experience in data engineering, ETL (preferably Informatica), and data architecture
  • Experience working with Salesforce platforms and data models
  • Hands-on experience with Airflow and MuleSoft
  • Strong SQL skills with Snowflake and other relational databases
  • Experience writing complex Python modules for custom ETL workflows
  • Expertise in building batch and real-time data pipelines
  • Experience with dbt for data transformation and modeling
  • Familiarity with AWS/GCP and distributed/event-driven architectures
  • Strong understanding of data modeling, data warehousing, and big data processing
  • Experience with data quality, monitoring, and pipeline orchestration frameworks
  • Ability to work closely with Product, Data Science, and Analytics teams
Experience working on Salesforce Flows and Apex is a plus