Lead Data Platform Engineer

This job was posted over 30 days ago, so it has most likely closed. See newer jobs like it.

Written by AI from the job title and company, not by Jobot, so some details may not match this job. The employer's own page has the real description.

Job Overview

The Lead Data Platform Engineer at Jobot will play a pivotal role in the design, implementation, and maintenance of large-scale data processing systems. This individual will be responsible for overseeing data architecture, ensuring data quality, and implementing strategies that enhance data accessibility and usability across the organization. The ideal candidate will collaborate with cross-functional teams to optimize data workflows, drive performance improvements, and support data-driven decision-making processes while leading a team of engineers to achieve excellence in data platform development and operations.

Job Responsibilities

• Design, develop, and deploy robust data pipelines to support the analytics needs of the organization.
• Lead and mentor a team of data engineers, fostering knowledge sharing and professional growth.
• Implement best practices for data modeling, extraction, transformation, and loading (ETL) processes.
• Collaborate with data scientists and analysts to identify data requirements and deliver solutions that meet their needs.
• Monitor and optimize the performance of data systems and workflows to ensure high availability and reliability.
• Establish data governance frameworks to ensure data quality, integrity, and security.
• Stay updated with emerging data technologies and evaluate their application within the organization.

Qualifications

• Proven experience as a Data Engineer or in a similar role, with a minimum of 5 years in data platform development.
• Bachelor’s degree in Computer Science, Information Technology, or a related field; Master’s degree preferred.
• Strong proficiency in programming languages such as Python, Java, or Scala.
• Extensive experience with data warehousing solutions and big data technologies (e.g., Hadoop, Spark).
• In-depth knowledge of SQL and experience with database management systems (e.g., PostgreSQL, MySQL).
• Familiarity with cloud platforms (e.g., AWS, Azure, Google Cloud) and their data-related services.
• Excellent problem-solving skills and ability to work collaboratively in a fast-paced environment.

Technologies & Tools

The Lead Data Platform Engineer will work with a variety of technologies and tools essential for data management and analysis. Key technologies include cloud platforms like AWS or Google Cloud, distributed computing frameworks such as Apache Spark and Hadoop, data warehousing solutions, and database systems including SQL-based and NoSQL databases. Additionally, proficiency in tools for CI/CD, version control (such as Git), and monitoring systems will also be essential for successful project execution.

Ideal Candidates

Ideal candidates for this position will possess a strong passion for data and technology, demonstrating an analytical mindset and attention to detail. They will have demonstrated leadership abilities, effective communication skills, and the ability to foster a collaborative team environment. A proactive approach to problem-solving, a willingness to embrace new challenges, and the drive to innovate and improve processes will make them stand out. Furthermore, candidates should exhibit adaptability and eagerness to stay ahead in the rapidly evolving data landscape.