Lead Data Engineer – Azure Databricks & GenAI/LLM

About this kind of role

What a Lead Data Engineer – Azure Databricks & GenAI/LLM usually does. The employer's own details are in the listing.

Typically does: A Lead Data Engineer designs, builds, and maintains data pipelines and infrastructure, often focusing on large-scale data processing and machine learning applications. This role involves collaborating with data scientists, analysts, and other engineers to ensure data quality, accessibility, and performance. They are responsible for implementing best practices for data governance, security, and scalability, and may lead a small team of data engineers. The Lead Data Engineer also contributes to architectural decisions and evaluates new technologies.

Tools and skills: Proficiency in Azure cloud services, Databricks, Python, SQL, data warehousing concepts, and experience with Generative AI/LLM frameworks is typically required.

Good fit for: Individuals with strong analytical and problem-solving skills, a passion for data, and experience leading technical projects thrive in this role.