Azure Databrick Engineer

This job was posted over 30 days ago, so it has most likely closed. See newer jobs like it.

Written by AI from the job title and company, not by Talent Groups, so some details may not match this job. The employer's own page has the real description.

Overview

As an Azure Databricks Engineer at Talent Groups, you will be responsible for designing, implementing, and maintaining scalable data solutions using Azure Databricks. Your role will involve collaborating with data scientists and analysts to develop robust data pipelines, optimize performance, and ensure data quality. You will leverage Azure Databricks for big data processing, machine learning workflows, and advanced analytics, driving the company's data-driven initiatives while adhering to best practices in data architecture and cloud technologies.

Job Responsibilities

• Design and implement data pipelines using Azure Databricks to support analytics and machine learning processes.
• Develop and optimize SQL queries and Spark jobs for efficient data processing.
• Collaborate with data scientists and stakeholders to understand requirements and deliver high-quality data solutions.
• Ensure data integrity, security, and compliance with organizational policies and industry standards.
• Monitor performance and implement enhancements to existing data processing workflows.
• Document data architecture, workflows, and procedures for future reference.
• Stay updated with Azure Databricks features and best practices to drive continuous improvement.

Qualifications

• Bachelor's degree in Computer Science, Information Technology, Data Science, or a related field.
• Proven experience with Azure Databricks and big data technologies.
• Strong programming skills in Python, Scala, or Java.
• Comprehensive knowledge of SQL and relational database systems.
• Experience with data engineering tools and ETL/ELT processes.
• Familiarity with Azure cloud services and data storage solutions.
• Solid understanding of data modeling, data warehousing, and data lakes.

Technologies & Tools

The Azure Databricks Engineer position utilizes a range of technologies and tools, including Azure Databricks for big data processing, Azure Data Lake Storage for scalable storage solutions, and Azure Synapse Analytics for integrated analytics. The role also requires proficiency with data processing languages such as Python and SQL, along with familiarity with data visualization tools like Power BI or Tableau.

Ideal Candidates

The ideal candidate for the Azure Databricks Engineer position is a detail-oriented individual with a strong analytical mindset and a passion for data. They possess excellent problem-solving skills and the ability to work collaboratively in a team environment. A candidate must demonstrate adaptability to new technologies, an eagerness to stay abreast of industry trends, and the strong communication skills necessary to convey complex technical concepts to non-technical stakeholders.