Azure Databricks Engineer

This job was posted over 30 days ago, so it has most likely closed. See newer jobs like it.

Written by AI from the job title and company, not by Jconnect Infotech, so some details may not match this job. The employer's own page has the real description.

Job Overview

As an Azure Databricks Engineer at Jconnect Infotech, you will be responsible for designing, implementing, and maintaining data processing solutions using Azure Databricks. You will utilize your expertise in cloud data architecture and big data technologies to optimize data analysis workflows, enhance data integration processes, and support business intelligence initiatives. Your role will include working closely with data engineers, data scientists, and business stakeholders to ensure effective data utilization and visualizations across the organization.

Job Responsibilities

• Design and implement data processing pipelines using Azure Databricks to support analytics and reporting capabilities.
• Collaborate with cross-functional teams to gather requirements and deliver solutions aligned with business needs.
• Optimize existing data processes for performance, scalability, and efficiency within the Azure environment.
• Maintain and enhance data ingestion processes, ensuring high-quality data across various sources.
• Develop and document best practices for data engineering and analytics workflows.
• Monitor and troubleshoot production data pipelines to ensure continuous operation and quality control.
• Provide support in data governance, compliance, and security measures related to data access and storage.

Qualifications

• Bachelor's degree in Computer Science, Information Technology, or a related field.
• Minimum of 3 years of experience with Azure Databricks and data engineering.
• Proficiency in programming languages such as Python, Scala, or Java.
• Strong understanding of data warehousing concepts and ETL processes.
• Experience with cloud services in Azure, including Azure Data Factory, Azure SQL Database, and Azure Storage.
• Familiarity with data visualization tools like Power BI or Tableau is a plus.
• Excellent analytical, problem-solving, and communication skills.

Technologies & Tools

In this role, you will work extensively with Azure Databricks for data processing and analytics tasks. You will also employ Azure Data Factory for data integration and orchestration, alongside Azure SQL Database for data storage needs. Familiarity with data transformation tools and environments, as well as experience with Spark, is essential for effectively handling large datasets and complex workflows.

Ideal Candidates

The ideal candidate for this position possesses a solid blend of technical expertise and strong interpersonal skills. They are detail-oriented, able to think critically, and exhibit a proactive approach to problem-solving. Successful candidates should thrive in a collaborative environment, demonstrating the ability to communicate effectively with both technical and non-technical stakeholders. A genuine passion for data analysis and a commitment to continuous learning will greatly support their success in this role.