Lead Data Engineer

This job was posted over 30 days ago, so it has most likely closed. See newer jobs like it.

Written by AI from the job title and company, not by DTN, so some details may not match this job. The employer's own page has the real description.

Job Overview

DTN is seeking a highly skilled Lead Data Engineer to join our dynamic team. In this pivotal role, the candidate will be responsible for designing, constructing, and maintaining robust data infrastructure and pipelines that support organizational goals. You will collaborate with cross-functional teams to ensure efficient data flow and access, enabling the development of insightful analytics and innovative data-driven solutions. The Lead Data Engineer will also lead projects from conception to execution, ensuring best practices in data management and governance are followed.

Job Responsibilities

• Design, develop, and maintain scalable data pipelines to facilitate real-time and batch data processing.
• Collaborate with data scientists, analysts, and business stakeholders to understand data needs and translate them into technical requirements.
• Implement and optimize data storage solutions, ensuring data consistency, quality, and security.
• Monitor data pipeline performance and troubleshoot issues to ensure the reliability of data systems.
• Lead and mentor a team of data engineers, providing guidance on best practices and technology adoption.
• Evaluate and integrate new tools and technologies to improve data management processes.
• Develop and enforce data governance and compliance policies.

Qualifications

• Bachelor’s or Master’s degree in Computer Science, Information Technology, Data Engineering, or a related field.
• Minimum of 5 years of experience in data engineering or a related field.
• Proficiency in programming languages such as Python, Java, or Scala.
• Experience with data warehousing solutions and ETL processes.
• Knowledge of SQL and NoSQL databases, including but not limited to PostgreSQL, MongoDB, and others.
• Familiarity with big data technologies like Apache Hadoop, Spark, or Kafka.
• Strong problem-solving skills and the ability to work both independently and in a team environment.

Technologies & Tools

The Lead Data Engineer at DTN will work with a variety of technologies and tools essential for data processing and analysis. This includes cloud platforms such as AWS or Azure, data orchestration tools like Apache Airflow, visualization software like Tableau or Power BI, and programming environments conducive to writing data manipulation scripts. The ideal candidate will be comfortable navigating and utilizing these technologies to create a seamless data environment.

Ideal Candidates

The ideal candidates for the Lead Data Engineer position will exhibit qualities such as strong analytical thinking, leadership acumen, and exceptional communication skills. They should demonstrate a passion for data and staying current with industry trends. Furthermore, candidates must have proven capabilities in managing complex projects while cultivating a collaborative atmosphere within their teams. A proactive attitude toward problem-solving and continuous learning will set high performing individuals apart in this role.