Lead Data Platform Engineer

This job was posted over 30 days ago, so it has most likely closed. See newer jobs like it.

Written by AI from the job title and company, not by Jobot, so some details may not match this job. The employer's own page has the real description.

Overview

The Lead Data Platform Engineer at Jobot will play a critical role in spearheading the design, development, and optimization of robust data infrastructure and data-driven applications. This position requires a strategic thinker who possesses advanced technical skills and will lead a talented team to facilitate the seamless integration and management of data solutions while ensuring high performance, scalability, and security within our data ecosystems. The ideal candidate will collaborate cross-functionally to meet business objectives, implement innovative data technologies, and enhance overall organizational data capabilities.

Job Responsibilities

• Design and implement data platform architectures that meet scalability and performance requirements.
• Lead the development and deployment of data pipelines and ETL processes to ensure data availability for analytical and operational needs.
• Manage and mentor a team of data engineers, enhancing their skills and ensuring best practices in data engineering are adopted.
• Oversee the integration of various data sources, ensuring data quality and consistency throughout the data lifecycle.
• Collaborate with software engineering, data science, and product teams to support data-driven initiatives.
• Evaluate and recommend data technologies and tools that align with evolving business needs.
• Implement and enforce data governance policies to ensure data security and compliance with regulatory standards.

Qualifications

• Bachelor’s degree in Computer Science, Engineering, or a related field; Master’s degree preferred.
• Minimum of 5 years of experience in data engineering or a related field, with at least 2 years in a lead role.
• Strong experience with data modeling, ETL processes, and database management systems.
• Proficiency in programming languages such as Python, Java, or Scala.
• Extensive knowledge of big data frameworks such as Hadoop, Spark, or Kafka.
• Experience with cloud data services (e.g., AWS, Azure, GCP).
• Solid understanding of data governance principles and best practices.
• Exceptional analytical and problem-solving skills, with a strong attention to detail.

Technologies & Tools

The Lead Data Platform Engineer will work with a variety of advanced technologies and tools, including cloud platforms such as AWS and Azure, data processing frameworks like Apache Spark, and data warehousing solutions including Snowflake or Redshift. Additionally, proficiency in SQL and NoSQL databases, as well as the use of data orchestration tools, is essential. Familiarity with version control systems like Git and containerization tools such as Docker will also be advantageous in managing the data lifecycle efficiently.

Ideal Candidates

The ideal candidate for the Lead Data Platform Engineer role will possess a balance of technical acumen and leadership qualities. They will be proactive, demonstrating a passion for emerging technologies and data strategy. Strong communication and interpersonal skills are essential, as this individual will need to collaborate effectively with diverse teams and convey complex data concepts to non-technical stakeholders. A problem-solving mindset, a detail-oriented approach, and a commitment to maintaining high-quality data standards will further contribute to their success in this position.