Azure and Databricks cloud engineer

This job was posted over 30 days ago, so it has most likely closed. See newer jobs like it.

Written by AI from the job title and company, not by Jobs via Dice, so some details may not match this job. The employer's own page has the real description.

Job Overview

The Azure and Databricks Cloud Engineer will play a crucial role in designing, implementing, and managing cloud-based solutions on Microsoft Azure and Databricks. This position will involve collaborating with cross-functional teams to ensure data integrity and security while optimizing performance and scalability of cloud resources. The ideal candidate will demonstrate a thorough understanding of cloud architectures and data pipelines, applying industry best practices to enhance the overall cloud infrastructure and allow for robust data analytics capabilities.

Job Responsibilities

• Design, develop, and maintain ETL (Extract, Transform, Load) processes utilizing Azure Data Factory and Databricks.
• Implement machine learning models and analytics workflows in Databricks.
• Manage Azure cloud infrastructure through tools such as Azure Portal, Azure DevOps, and Resource Manager.
• Optimize cloud services and data storage solutions for performance and cost-effectiveness.
• Monitor and troubleshoot cloud environments to ensure high availability and security of data operations.
• Collaborate with data scientists and analysts to provide scalable and reliable data solutions.
• Maintain documentation related to cloud architecture, processes, and data flows.
• Stay updated with the latest Azure and Databricks features and functionalities to effectively leverage them for business needs.

Qualifications

• Bachelor’s degree in Computer Science, Information Technology or a related field.
• Minimum of 3 years of experience working with Azure cloud services and Databricks.
• Proficiency in programming languages such as Python, Scala, or SQL.
• Hands-on experience with Azure Data Factory, Azure Functions, and Azure SQL Database.
• Knowledge of data warehousing concepts and experience with tools such as Snowflake or similar.
• Strong understanding of cloud security best practices and compliance requirements.
• Experience in CI/CD (Continuous Integration and Continuous Deployment) pipelines and code versioning using Git.
• Excellent problem-solving skills and ability to work independently or as part of a team.

Technologies & Tools

The Azure and Databricks Cloud Engineer will frequently work with various technologies and tools including Microsoft Azure services such as Azure Data Factory, Azure Functions, Azure SQL Database, and Azure DevOps. Proficiency in Databricks for data engineering and machine learning applications is essential, along with experience in programming languages like Python and SQL for data manipulation and analytics. Familiarity with CI/CD pipelines and version control systems such as Git will enhance collaboration and project efficiency.

Ideal Candidates

Ideal candidates for this position will exhibit a strategic mindset with a strong technical acumen specifically within cloud technologies. They should possess excellent communication skills to effectively relay complex technical information to non-technical stakeholders. A proactive attitude towards continuous learning and adapting to new technologies is crucial, alongside a proven ability to work collaboratively in a fast-paced, agile work environment. Candidates should also demonstrate effective time management skills and a commitment to delivering high-quality results on schedule.