Azure Databricks DevOps Engineer / 100% Remote / Only USC or GC Can Apply / No OPT or H1B

This job was posted over 30 days ago, so it has most likely closed. See newer jobs like it.

Written by AI from the job title and company, not by Stash Talent Services, so some details may not match this job. The employer's own page has the real description.

Job Overview

The Azure Databricks DevOps Engineer will play a pivotal role in ensuring the seamless integration and operation of cloud-based data solutions within our organization. This position is responsible for managing and optimizing our Databricks environment, developing CI/CD pipelines, and automating deployment processes. The ideal candidate will collaborate closely with data engineers, data scientists, and other IT teams to enhance productivity and streamline workflows, all while adhering to best practices governing security, performance, and scalability.

Job Responsibilities

• Design, implement, and maintain CI/CD pipelines for Databricks and related services.
• Automate deployment processes using tools like Azure DevOps and Terraform.
• Monitor and optimize Databricks performance, ensuring high availability and reliability.
• Collaborate with data engineering and data science teams to facilitate seamless data processes.
• Implement security best practices to protect data and cloud resources.
• Coordinate with IT support and operations teams to troubleshoot issues and improve system health.
• Participate in incident response and provide support for production environments.

Qualifications

• Bachelor’s degree in Computer Science, Information Technology, or a related field.
• Minimum of 3 years of experience in DevOps, particularly with Azure and Databricks.
• Strong proficiency in scripting languages such as Python, Bash, or PowerShell.
• Experience with CI/CD tools and practices, particularly in Azure DevOps.
• Familiarity with infrastructure as code (IaC) tools such as Terraform.
• Understanding of cloud technologies and services, primarily Azure.
• Solid knowledge of containerization technologies (e.g., Docker, Kubernetes) is a plus.

Technologies & Tools

The role requires proficiency in a variety of technologies, including but not limited to Azure Databricks, Azure DevOps, Terraform, Git, and scripting languages like Python and Bash. Familiarity with data processing frameworks and cloud-based architectures will also be essential for success in this position. Knowledge of container orchestration tools like Kubernetes is considered beneficial.

Ideal Candidates

Ideal candidates will possess a proactive attitude and demonstrated ability to work independently in a fully remote environment. They should exhibit strong problem-solving skills, excellent communication abilities, and a collaborative mindset. A deep commitment to quality and best practices in DevOps processes, along with a willingness to continuously learn and adapt, will contribute to the overall success in this role.