Lead Data Platform Engineer

This job was posted over 30 days ago, so it has most likely closed. See newer jobs like it.

Written by AI from the job title and company, not by Jobot, so some details may not match this job. The employer's own page has the real description.

Job Overview

The Lead Data Platform Engineer at Jobot will be responsible for guiding the architectural design and implementation of data platform solutions that drive analytical insights and support business strategies. This role requires a thorough understanding of big data technologies, cloud platforms, and engineering best practices. The ideal candidate will lead a team of data engineers, collaborating with data scientists and other stakeholders to create scalable data pipelines, optimize data accessibility, and ensure high data quality across various systems.

Job Responsibilities

• Architect, design, and implement robust data platform solutions that meet business requirements.
• Lead and mentor a team of data engineers, fostering a culture of best practices, and continuous improvement.
• Develop and optimize data pipelines for extraction, transformation, and loading (ETL) processes.
• Collaborate with data scientists and analysts to ensure data availability and quality.
• Monitor system performance and troubleshoot data-related issues as they arise.
• Evaluate and implement new data management tools and technologies.
• Implement best data governance practices and ensure compliance with data regulations.

Qualifications

• Bachelor's or Master's degree in Computer Science, Engineering, or a related field.
• Minimum of 5 years of experience in data engineering or a related field.
• Proficiency in programming languages such as Python, Java, or Scala.
• Strong experience with data warehousing solutions like Snowflake, Redshift, or BigQuery.
• Hands-on experience with big data technologies such as Hadoop, Spark, or Kafka.
• Familiarity with cloud platforms like AWS, Azure, or Google Cloud Platform.
• Strong understanding of SQL and data modeling concepts.
• Excellent problem-solving abilities and a proactive approach to challenges.

Technologies & Tools

The Lead Data Platform Engineer will work extensively with various technologies and tools, including cloud services (AWS, Azure, GCP), big data frameworks (Hadoop, Spark), and databases (SQL, NoSQL). Familiarity with data orchestration tools (Apache Airflow, Luigi), containerization platforms (Docker, Kubernetes), and CI/CD practices will also be essential for ensuring a smooth development lifecycle and effective deployment of data solutions.

Ideal Candidates

The ideal candidate for the Lead Data Platform Engineer position is a strategic thinker with a strong technical background in data engineering. They should exhibit exceptional leadership skills, inspiring their team while encouraging innovation and collaboration. Strong communicators who can articulate complex technical concepts to non-technical stakeholders will thrive in this role. Moreover, candidates passionate about data, with a proactive mindset and the ability to adapt in a fast-paced environment, will be highly regarded.