Lead Data Engineer

This job was posted over 30 days ago, so it has most likely closed. See newer jobs like it.

Written by AI from the job title and company, not by NextGen | GTA: A Kelly Telecom Company, so some details may not match this job. The employer's own page has the real description.

Job Overview

As a Lead Data Engineer at NextGen | GTA: A Kelly Telecom Company, you will play a pivotal role in designing, implementing, and maintaining our data infrastructure. You will lead a team of data engineers to create scalable data pipelines which will support ongoing analytics and reporting initiatives. This encompasses optimizing our data architecture, ensuring data quality, and collaborating closely with data scientists and analysts to address their needs. Your expertise will be critical in leveraging new data technologies to achieve a competitive edge in our telecommunications operations.

Job Responsibilities

• Design, develop, and maintain efficient data pipelines and ETL processes.
• Lead and mentor a team of data engineers, fostering an environment of continuous learning and collaboration.
• Collaborate with data scientists and analysts to understand and fulfill data requirements.
• Optimize existing data processes for performance and scalability.
• Ensure data quality and integrity through rigorous testing and monitoring.
• Implement best practices for data governance and security.
• Research and recommend new data technologies and methodologies to enhance our data ecosystem.

Qualifications

• Bachelor’s degree in Computer Science, Engineering, Data Science, or a related field; Master’s preferred.
• 5+ years of experience in data engineering with a robust understanding of database management systems.
• Proficient in programming languages such as Python, Java, or Scala.
• Experience with big data technologies including Hadoop, Spark, and Hive.
• Strong knowledge of SQL and data modeling techniques.
• Familiarity with cloud platforms such as AWS, Google Cloud, or Azure.
• Excellent problem-solving skills and attention to detail.

Technologies & Tools

The Lead Data Engineer position requires proficiency with a variety of technologies and tools essential for effective data management and analysis. Key technologies include Apache Hadoop, Apache Spark, AWS, Google Cloud Platform, Airflow, SQL databases (PostgreSQL, MySQL), NoSQL databases (MongoDB, Cassandra), and data visualization tools. Familiarity with CI/CD tools and version control systems like Git is also expected to streamline our deployment processes.

Ideal Candidates

The ideal candidate for the Lead Data Engineer position should possess a blend of technical expertise and leadership capabilities. They should demonstrate a proactive attitude towards adopting new innovations and have a passion for leveraging data to drive business outcomes. Successful candidates will exhibit strong communication skills, enabling them to translate complex data concepts into actionable insights for stakeholders across the organization. A collaborative spirit and the ability to thrive in a fast-paced environment will further enhance their fit for this role.