ETL Team Lead

ETL Team Lead

Location: Greenville, SC (Onsite preferred; qualified U.S.-based remote candidates considered)

ABOUT THE CLIENT

Our client is an established commercial transportation insurer headquartered in downtown Greenville, SC, with 80+ years in the industry. They are in the middle of a data platform modernization, moving from a legacy SQL Server/SSIS/Guidewire environment to a modern Azure and Microsoft Fabric stack. This role becomes the long-term technical owner of the entire data operations layer through that move.

THE ROLE

This is not a traditional batch ETL developer role. The ETL Team Lead owns production support for the current data stack while leading the build of a modern, real-time Azure platform. You will lead onshore and offshore developers, partner with the AMS support team, and make sure critical reporting and financial close data lands on time, every time.

WHAT YOU'LL DO

- Own daily ETL operations across SQL Agent jobs, SSIS packages, and Guidewire DataHub/InfoCenter (DHIC)

- Troubleshoot pipeline failures, performance issues, and schema and permission problems, then drive root-cause fixes

- Make sure SLAs are met for critical reporting datasets, including month-end and quarter-end financial cycles

- Refactor or retire outdated and redundant ETL processes

- Build and improve runbooks, SOPs, monitoring dashboards, and incident response workflows

- Coordinate production releases, validate deployments, and help run the on-call rotation for critical pipelines

- Serve as technical lead for onshore/offshore developers: code reviews, best practices, mentoring

- Partner with Enterprise Architecture to move workloads to Delta Lake, Medallion Architecture (Bronze/Silver/Gold), and Fabric Lakehouse

- Build scalable ingestion pipelines with Azure Data Factory, Fabric, Databricks, and Synapse for Guidewire, HubSpot, Telematics, and external integrations

- Design real-time and event-driven pipelines (Event Hub, Fabric Real-Time Analytics, Databricks Structured Streaming, KQL) for telematics alerting, FNOL automation, and fraud detection

- Deliver curated, analytics-ready datasets for Power BI and operational reporting

- Set up data quality, validation, alerting, and observability frameworks, and support data governance tooling

REQUIRED

- 10+ years of ETL/data engineering experience

- Recent experience in an ETL Lead or Data Engineering Lead role

- Hands-on real-time, streaming, and event-driven data engineering experience

- Demonstrated leadership on a modern Azure data stack (Fabric, ADF, etc.)

- Strong SQL and ETL/ELT engineering (SQL Server, T-SQL, SSIS)

- Experience owning production data environments: monitoring, incident response, root-cause analysis, SLA delivery

- Proven ability to lead and coordinate onshore and offshore teams

- Experience working in Agile delivery

STRONG ADVANTAGES

- Guidewire DataHub and InfoCenter

- Databricks (including Structured Streaming)

- Azure Event Hub and KQL

- Property and casualty insurance data experience (preferred, not required)

NICE TO HAVE

- Oracle PL/SQL, PostgreSQL, and PowerShell

- SAP BusinessObjects Data Services (BODS)

- Medallion Architecture, Delta Lake, and Fabric Lakehouse/Warehouse/Eventhouse

- Building ML-ready datasets for pricing, risk, fraud, or underwriting