Lead Data Platform Engineer

This job was posted over 30 days ago, so it has most likely closed. See newer jobs like it.

Written by AI from the job title and company, not by Jobot, so some details may not match this job. The employer's own page has the real description.

Job Overview

The Lead Data Platform Engineer at Jobot will play a pivotal role in designing and implementing robust data platform solutions that enhance data accessibility, quality, and integration across the organization. This position demands a strategic thinker with a strong technical background, capable of leading a team of data engineers while collaborating closely with data scientists and analysts to optimize the data infrastructure. The Lead Data Platform Engineer will also be responsible for developing best practices in data management, ensuring data security, and facilitating data governance initiatives, thereby driving data-driven decision-making throughout the company.

Job Responsibilities

• Design and implement scalable data architecture to support diverse data sources and workflows.
• Lead a team of data engineers, mentoring and guiding them through best practices in data platform engineering.
• Collaborate with stakeholders to gather requirements and translate them into effective data solutions.
• Establish data quality metrics and ensure rigorous adherence to data integrity standards.
• Develop and enforce data governance policies and processes to ensure compliance with regulatory standards.
• Manage the deployment and operation of data platforms, including monitoring system performance and troubleshooting issues.
• Drive innovation by staying abreast of industry trends and emerging technologies in the data engineering field.

Qualifications

• Bachelor's degree in Computer Science, Data Science, or a related field; a Master's degree is preferred.
• Minimum of 5 years of experience in data engineering, with at least 2 years in a leadership role.
• Proficient in programming languages such as Python, Java, or Scala.
• Experience with cloud platforms (e.g., AWS, Azure, Google Cloud) and data storage solutions (e.g., SQL, NoSQL).
• Strong understanding of ETL processes and data warehousing concepts.
• Familiarity with data visualization tools and techniques, as well as statistical analysis.
• Excellent problem-solving skills and the ability to work in a fast-paced environment.

Technologies & Tools

The Lead Data Platform Engineer will engage with a variety of technologies and tools including, but not limited to, cloud services like AWS and Google Cloud Platform, data processing frameworks such as Apache Spark and Hadoop, as well as database management systems like PostgreSQL and MongoDB. Familiarity with CI/CD tools, Docker for containerization, and orchestration technologies like Kubernetes is also essential for managing data pipelines efficiently.

Ideal Candidates

The ideal candidate for the Lead Data Platform Engineer position at Jobot will possess a strong blend of technical expertise and leadership ability. They should be innovative, proactive, and capable of effectively communicating complex technical concepts to non-technical stakeholders. A passion for driving data initiatives, combined with a commitment to quality and efficiency, will be key characteristics of a successful applicant. Furthermore, candidates should demonstrate resilience in the face of challenges and a commitment to fostering a collaborative team environment.