Lead Data Engineer

This job was posted over 30 days ago, so it has most likely closed. See newer jobs like it.

Written by AI from the job title and company, not by Largeton Group, so some details may not match this job. The employer's own page has the real description.

Job Overview

The Lead Data Engineer at Largeton Group will oversee the development, implementation, and maintenance of data engineering processes and architectures. This role requires a strategic vision for data solutions and the ability to lead projects from inception through delivery. The ideal candidate will collaborate with cross-functional teams to transform data into valuable insights and drive data-centric decision-making across the organization. This position demands strong technical capabilities as well as excellent leadership and communication skills to mentor junior engineers and coordinate with stakeholders.

Job Responsibilities

• Design, construct, install, and maintain data systems and architectures.
• Lead data integration projects and develop data pipelines that ensure the accessibility and usability of data.
• Optimize data storage and processing to enable real-time capabilities.
• Collaborate with data scientists and analysts to create robust data solutions for analytical and operational needs.
• Oversee the data modeling process and ensure it aligns with business requirements.
• Implement data governance and ensure compliance with data privacy regulations.
• Mentor junior data engineers and provide guidance on best practices in data engineering.
• Continuously research and evaluate new data technologies and tools to enhance team capabilities.

Qualifications

• Bachelor's degree in Computer Science, Data Engineering, or a related field; Master's degree preferred.
• 5+ years of experience in data engineering or related roles, with a proven track record of leading data projects.
• Strong proficiency in SQL and experience with relational and non-relational databases.
• Experience with data pipeline and workflow management tools (e.g., Apache Airflow, Talend).
• Familiarity with big data technologies (e.g., Hadoop, Spark) and cloud data solutions (e.g., AWS, Azure).
• Solid understanding of data warehousing concepts and ETL processes.
• Excellent problem-solving skills and a strong attention to detail.
• Outstanding communication and organizational skills, capable of working effectively in a collaborative team environment.

Technologies & Tools

The Lead Data Engineer will utilize a range of technologies and tools to support data engineering tasks. Key technologies include SQL databases such as PostgreSQL and MySQL, as well as NoSQL solutions like MongoDB and Cassandra. Familiarity with data processing frameworks such as Apache Spark and tools for workflow management like Apache Airflow are essential. Additionally, cloud platforms like Amazon Web Services (AWS) and Microsoft Azure will be leveraged to ensure scalable data solutions.

Ideal Candidates

The ideal candidate for the Lead Data Engineer role will exhibit a profound passion for data and a pragmatic approach to solving complex data challenges. They will possess strong analytical and creative thinking capabilities, allowing them to design innovative data solutions. A successful candidate will be an effective communicator, able to translate technical concepts to non-technical stakeholders, and display exceptional leadership qualities to inspire and guide their team towards achieving organizational objectives.