Sr Lead Data Platform Engineer, Shopping (Remote-Eligible)

This job was posted over 30 days ago, so it has most likely closed. See newer jobs like it.

Written by AI from the job title and company, not by ClickJobs.io, so some details may not match this job. The employer's own page has the real description.

Job Overview

The Senior Lead Data Platform Engineer for Shopping at ClickJobs.io will play a pivotal role in architecting and optimizing data solutions that enhance the shopping experience for our users. This position requires an innovative thinker and a proactive leader who can manage complex data systems and foster collaboration among cross-functional teams. The successful candidate will be responsible for the development, integration, and management of robust data pipelines and platforms that drive analytics and reporting capabilities, while also ensuring data quality and governance across the organization.

Job Responsibilities

• Design and implement scalable data architectures to support the shopping ecosystem.
• Lead the development of data models, ETL processes, and data integration workflows.
• Collaborate with product teams to identify data requirements and deliver high-quality data solutions.
• Monitor system performance and optimize data processing workflows for efficiency.
• Establish data quality metrics and perform regular data audits to ensure accuracy and consistency.
• Provide guidance and mentorship to junior engineers and data analysts.
• Stay updated on industry trends and recommend new technologies and methodologies to improve the data platform.
• Document data architecture, workflows, and best practices for internal stakeholders.

Qualifications

• Bachelor's or Master’s degree in Computer Science, Data Science, or a related field.
• Minimum of 5 years of experience in data engineering or similar roles.
• Proven experience with data warehousing solutions and big data technologies.
• Strong proficiency in SQL and experience with programming languages such as Python or Java.
• Hands-on experience with data integration tools (e.g., Apache Kafka, Talend).
• Familiarity with cloud platforms such as AWS, GCP, or Azure.
• Experience working in Agile environments and familiarity with CI/CD practices.
• Excellent problem-solving skills and the ability to work under pressure.

Technologies & Tools

The Senior Lead Data Platform Engineer will utilize a variety of technologies and tools including, but not limited to, cloud data platforms (AWS, GCP, Azure), data processing frameworks (Apache Spark, Hadoop), ETL tools (Apache NiFi, Talend), and database management systems (SQL Server, PostgreSQL). An understanding of containerization technologies such as Docker and orchestration tools like Kubernetes is also essential for the role.

Ideal Candidates

Ideal candidates for the Senior Lead Data Platform Engineer position will possess a strong analytical mindset and demonstrate a passion for leveraging data to drive business outcomes. They should have excellent communication skills to effectively collaborate with diverse teams and stakeholders. The ability to mentor and lead others is crucial, as is a commitment to quality and continuous improvement. Candidates should thrive in a dynamic environment and be eager to embrace new technologies and methodologies that enhance the data ecosystem.