Staff Data Engineer (Azure Databricks Platform)

For our client, we are seeking a Staff Data Engineer (Azure Databricks Platform) to join the team of a leader in the Healthcare space.

This role will own the reliability, governance, and evolution of a cloud-based data platform that supports large-scale analytics and data engineering work. You will partner closely with data engineers, security, and cross-functional business and technology teams to improve platform capabilities, operational stability, and developer productivity. The position is highly focused on Azure-native data infrastructure, automation, and modern data platform best practices to support secure, scalable, and cost-effective data processing.

Location: Remote

Compensation: $130,295 – $260,590 annually

Responsibilities

• Oversee the operational health of the data platform, improving monitoring and incident response
• Define and maintain the strategic roadmap for the cloud data environment, adopting new features and best practices
• Manage data security and governance policies, ensuring compliance and fine-grained access control
• Implement cost management and performance tuning strategies for clusters and workloads
• Enhance automated solutions for provisioning and managing resources using Infrastructure as Code
• Serve as a mentor and subject matter expert for data engineers, advocating for best practices and providing technical support
• Collaborate with cross-functional teams to understand needs and enhance the platform accordingly
  
  

Qualifications

• 8+ years of hands-on engineering experience in cloud data platforms and distributed systems
• Deep expertise in Azure Databricks, including administration and key features like Delta Lake and Unity Catalog
• Expert-level knowledge of the Azure ecosystem, including Azure Data Lake Storage and Azure Active Directory
• Strong proficiency in Terraform, Python, Apache Spark/PySpark, SQL, and Shell scripting
• Proven experience with Infrastructure as Code tools and CI/CD pipelines for deployments
• Strong understanding of distributed computing principles and large-scale data system architecture
• Exceptional analytical and problem-solving skills
  
  

Benefits

• Comprehensive medical, dental, and vision coverage
• Paid time off to support work-life balance
• Retirement savings options to secure your financial future
• Wellness programs promoting physical and emotional well-being
• Additional resources based on eligibility
  
  

Our client is an equal opportunity employer. We encourage you to apply even if you don’t meet every qualification—your background could be exactly what this team needs.