Azure Data Engineer Senior/Lead

This job was posted over 30 days ago, so it has most likely closed. See newer jobs like it.

Written by AI from the job title and company, not by The Principal TAG, so some details may not match this job. The employer's own page has the real description.

Job Overview

The Azure Data Engineer Senior/Lead at The Principal TAG will play a pivotal role in the development, optimization, and maintenance of our data infrastructure on the Azure platform. This individual will be responsible for designing efficient data models, ensuring the reliability and accuracy of our data pipelines, and collaborating with cross-functional teams to support data-driven decision-making processes. As a senior member of the team, the candidate will also mentor junior engineers, lead projects, and drive best practices within the organization.

Job Responsibilities

• Design, implement, and optimize scalable data architectures on Microsoft Azure.
• Develop and maintain ETL processes to support data integration from multiple sources.
• Collaborate with data analysts and data scientists to ensure data availability and usability.
• Monitor and troubleshoot data pipelines to ensure high levels of performance and reliability.
• Implement security measures and data governance policies to protect sensitive information.
• Mentor junior data engineers and provide guidance on best practices in data engineering.
• Stay updated with emerging technologies and trends in Azure data services to continuously improve our data strategy.

Qualifications

• Bachelor's or master's degree in Computer Science, Information Technology, or a related field.
• A minimum of 5 years of experience in data engineering, preferably with a focus on Azure technologies.
• Strong proficiency in Azure Data Factory, Azure Data Lake Storage, and Azure SQL Database.
• Experience with programming languages such as Python or SQL for data manipulation and analysis.
• Knowledge of big data technologies such as Hadoop or Spark is a plus.
• Proven experience in designing and implementing data models and schemas.
• Excellent analytical and problem-solving skills with attention to detail.

Technologies & Tools

The ideal candidate will work primarily with a variety of technologies and tools, including Microsoft Azure services such as Azure Data Factory, Azure Data Lake, and Azure SQL Database. Familiarity with DevOps tools for CI/CD processes, as well as data visualization tools like Power BI, is highly advantageous. Proficiency in programming languages such as Python and SQL is essential for effective data manipulation and engineering tasks.

Ideal Candidates

Ideal candidates for the Azure Data Engineer Senior/Lead position will possess strong technical acumen combined with excellent communication skills. They should be proactive problem solvers, capable of working autonomously as well as part of a team. A deep understanding of cloud technologies, particularly Azure, and a passion for optimizing data processes will further set them apart. The ability to mentor and inspire junior team members, alongside a commitment to best practices in data engineering, is also highly desired.