AI/ML Azure Data Engineer

This job was posted over 30 days ago, so it has most likely closed. See newer jobs like it.

Written by AI from the job title and company, not by Quadrant Technologies, so some details may not match this job. The employer's own page has the real description.

Job Overview

Quadrant Technologies is seeking a highly skilled AI/ML Azure Data Engineer to join our growing team. The successful candidate will be responsible for designing, implementing, and maintaining scalable data systems and pipelines while leveraging cloud-based architectures, predominantly on Microsoft Azure. This role will involve collaborating closely with data scientists and analysts to enhance data analysis and automated processes. You will also be tasked with ensuring data integrity, optimizing performance, and enabling efficient data flow for advanced machine learning models and AI applications.

Job Responsibilities

• Design and implement data pipelines for large-scale data processing using Azure Data Factory and Azure Databricks.
• Develop machine learning models and algorithms, optimizing data preprocessing and transformation procedures.
• Collaborate with data scientists to deploy and maintain scalable ML models in the Azure environment.
• Ensure data quality and integrity by implementing robust data validation methodologies and monitoring systems.
• Utilize Azure SQL Database and Azure Blob Storage for data storage and retrieval solutions.
• Document data engineering processes and development practices for cross-team knowledge sharing.
• Stay updated with the latest data engineering trends and Azure technologies to enhance project outcomes.

Qualifications

• Bachelor’s degree in Computer Science, Data Engineering, or a related field; Master's degree preferred.
• Minimum of 3 years of experience in data engineering, preferably in an Azure environment.
• Proficient in programming languages such as Python, SQL, or Scala.
• Experience with Azure services such as Azure Machine Learning, Azure Data Lake, and Azure Synapse Analytics.
• Strong understanding of data structures, algorithms, and data modeling.
• Familiarity with big data technologies like Apache Spark and Hadoop.
• Excellent problem-solving skills and attention to detail.

Technologies & Tools

The position requires proficiency with a variety of technologies and tools essential for data engineering in an AI/ML context. Notably, candidates should be well-versed in Azure services such as Azure Data Factory, Azure Databricks, and Azure Machine Learning. Familiarity with data storage solutions like Azure SQL Database and Azure Blob Storage is essential. Additionally, knowledge of big data frameworks such as Apache Spark and programming languages like Python and SQL is expected. Experience with version control systems, CI/CD tools, and data visualization tools will be advantageous.

Ideal Candidates

The ideal candidate for the AI/ML Azure Data Engineer position will possess a strong analytical mindset, coupled with excellent communication skills and a collaborative spirit. They should be proactive and adaptable, able to manage multiple tasks efficiently while demonstrating a solid work ethic. A genuine passion for working with data and technology is crucial for driving innovation and achieving results in a dynamic environment. Being a continuous learner, staying updated with industry trends, and sharing knowledge with peers will also define the success of potential candidates in this role.