Senior DevOps Engineer / Datsbricks / Infrastructure-as-Code

This job was posted over 30 days ago, so it has most likely closed. See newer jobs like it.

Written by AI from the job title and company, not by Motion Recruitment, so some details may not match this job. The employer's own page has the real description.

Job Overview

The Senior DevOps Engineer at Motion Recruitment will play a pivotal role in enhancing the company's infrastructure landscapes, specializing in Databricks and Infrastructure-as-Code practices. This position will involve collaboration with cross-functional teams to streamline application deployments, automate systems, and optimize performance, while ensuring best practices in deployment and operations are adhered to. The successful candidate will be tasked with building and managing an efficient and scalable infrastructure that enables data processing and analytics, ultimately contributing to the company’s goals of innovation and excellence.

Job Responsibilities

• Design, implement, and manage scalable infrastructure on Databricks with an emphasis on Infrastructure-as-Code.
• Collaborate with software engineering teams to streamline their development and deployment processes.
• Automate monitoring and reporting of system performance to ensure uptime and reliability.
• Implement CI/CD pipelines to enable continuous integration and delivery of applications.
• Develop and maintain documentation supporting system architectures, processes, and procedures.
• Ensure security best practices are followed in all deployments and infrastructure configurations.
• Support troubleshooting and problem resolution of infrastructure and application-related issues.
• Participate in on-call rotation for production support.

Qualifications

• Bachelor's degree in Computer Science, Information Technology, or a related field.
• 5+ years of experience in a DevOps role or similar position.
• Extensive experience with Databricks and Infrastructure-as-Code tools, such as Terraform or CloudFormation.
• Proficiency in scripting languages such as Python, Bash, or similar.
• Strong knowledge of cloud platforms such as AWS, GCP, or Azure.
• Understanding of containerization and orchestration technologies, such as Docker and Kubernetes.
• Experience with monitoring and logging tools such as Prometheus, Grafana, or ELK stack.
• Exceptional problem-solving skills and capability to work independently and as part of a team.

Technologies & Tools

The Senior DevOps Engineer will engage with a variety of technologies and tools, including but not limited to Databricks for data engineering and analytics, Terraform for Infrastructure-as-Code management, AWS or other cloud provider services for hosting, Docker for containerization, and Jenkins or GitLab CI for continuous integration and deployment pipelines. Proficiency in monitoring systems will also be essential, with tools such as Prometheus, Grafana, and the ELK stack being integral to daily operations.

Ideal Candidates

The ideal candidate for this position is a proactive and results-driven engineer who thrives in a fast-paced environment. They possess a strong understanding of both development and operational processes and have a keen eye for optimization. Excellent communication skills are crucial for collaborating with various teams and stakeholders. A willingness to learn and adapt to new technologies alongside a passion for infrastructure and automation will closely align with the company’s commitment to innovation and quality in its operations.