Lead Data Platform Engineer

This job was posted over 30 days ago, so it has most likely closed. See newer jobs like it.

Written by AI from the job title and company, not by Jobot, so some details may not match this job. The employer's own page has the real description.

Overview

The Lead Data Platform Engineer at Jobot will play a pivotal role in designing and developing our data architecture to support scalable and high-performance data processing workflows. The candidate will lead a team of engineers in leveraging cutting-edge technologies while ensuring the integrity and security of our data platforms. This individual will collaborate cross-functionally to define data strategies and implement effective solutions that address business requirements, ultimately enabling data-driven decision making across the organization.

Job Responsibilities

• Design, implement, and maintain robust data platforms and architectures.
• Lead the data engineering team to develop and optimize ETL processes and data pipelines.
• Collaborate with data scientists and analytics teams to understand data requirements and provide suitable solutions.
• Ensure data quality, integrity, and security through best practices and monitoring tools.
• Manage and enhance data governance protocols and policies within the organization.
• Stay updated with emerging technologies and trends to continually improve data strategies.
• Mentor and train team members, fostering an environment of learning and growth.

Qualifications

• Bachelor's degree in Computer Science, Data Science, Information Technology, or a related field.
• Minimum of 5 years of experience in data engineering or related roles.
• Proficient in programming languages such as Python or Scala.
• Experience with cloud platforms (AWS, Azure, or Google Cloud Platform) and big data technologies (Hadoop, Spark, etc.).
• Strong understanding of databases (SQL and NoSQL) and data modeling concepts.
• Knowledge of data warehousing solutions and distributed computing frameworks.
• Excellent analytical and problem-solving skills with attention to detail.
• Strong interpersonal and communication skills to collaborate effectively across teams.

Technologies & Tools

The Lead Data Platform Engineer will utilize a variety of technologies and software to fulfill their responsibilities. This includes cloud-based data storage solutions such as Amazon S3 and Google BigQuery, data processing frameworks like Apache Spark and Apache Kafka, as well as database management systems like PostgreSQL and MongoDB. The engineer will also leverage data orchestration tools like Apache Airflow and CI/CD practices to ensure efficient deployment and operation of data pipelines.

Ideal Candidates

Ideal candidates for the Lead Data Platform Engineer position will possess a proactive and innovative mindset, constantly seeking opportunities to enhance data processes and functionalities. They should demonstrate strong leadership qualities, fostering collaboration and delivering results in a fast-paced environment. Candidates should also have a passion for leveraging data to drive business outcomes, along with a commitment to maintaining high standards of performance and efficiency within their teams.