Data Bricks Devops Engineer

This job was posted over 30 days ago, so it has most likely closed. See newer jobs like it.

About this kind of role

What a Data Bricks Devops Engineer usually does. The employer's own details are in the listing.

Typically does: This role focuses on automating and streamlining the deployment and management of data engineering pipelines and infrastructure, often using Apache Spark and related technologies. Responsibilities include building and maintaining continuous integration and continuous delivery (CI/CD) pipelines, monitoring system performance, and troubleshooting issues within the data environment. They collaborate closely with data engineers and software developers to ensure efficient and reliable data processing workflows. Automation of infrastructure provisioning and configuration management is also a key aspect of the position.

Tools and skills: Proficiency in cloud platforms (like AWS, Azure, or Google Cloud), containerization technologies (Docker, Kubernetes), scripting languages (Python, Bash), configuration management tools (Ansible, Terraform), and experience with Apache Spark and Databricks is generally required.

Good fit for: Individuals with a strong background in DevOps practices and a passion for data engineering technologies often thrive in this role.