Sr Lead Data Platform Engineer, Shopping (Remote-Eligible)

This job was posted over 30 days ago, so it has most likely closed. See newer jobs like it.

Written by AI from the job title and company, not by RemoteWorker CA, so some details may not match this job. The employer's own page has the real description.

Job Overview

The Sr Lead Data Platform Engineer for Shopping at RemoteWorker CA will be responsible for designing and implementing advanced data platform solutions that enable data-driven decision-making across the organization. This position requires a blend of technical proficiency in data engineering, architectural design, and leadership skills to guide a team of engineers while collaborating with cross-functional teams. The ideal candidate will develop robust data pipelines, ensure high availability and performance of the platform, and contribute to the overall strategy for data management and analysis.

Job Responsibilities

• Lead the design and architecture of scalable data platforms for e-commerce applications.
• Develop, test, and implement data pipelines that efficiently process large datasets.
• Collaborate with product managers and data scientists to define data requirements and specifications.
• Optimize data storage and retrieval processes to enhance performance.
• Ensure the reliability, availability, and security of data systems through best practices and monitoring solutions.
• Mentor junior engineers and lead technical initiatives to foster innovation and continuous improvement.
• Work with cloud services and on-premises solutions to integrate data technologies.
• Participate in the development of data governance strategies and frameworks.

Qualifications

• Bachelor's degree in Computer Science, Engineering, or a related field; Master's degree preferred.
• 7+ years of experience in data engineering or related fields, with a focus on large-scale systems.
• Strong proficiency in SQL and experience with NoSQL databases.
• Expertise in data processing frameworks such as Apache Spark, Hadoop, or similar technologies.
• Experience with cloud platforms such as AWS, Google Cloud, or Azure.
• Proficient in programming languages like Python, Java, or Scala.
• Excellent problem-solving and analytical skills, with a detail-oriented mindset.
• Strong communication and leadership skills to effectively engage with stakeholders.

Technologies & Tools

This position utilizes a variety of modern technologies and tools to support data engineering tasks. Key technologies include cloud services such as AWS, Google Cloud, or Azure for data storage and processing, frameworks like Apache Spark and Hadoop for batch processing, and programming languages such as Python and Java for data manipulation. Additionally, tools for CI/CD pipelines and container orchestration (Docker, Kubernetes) are essential for deployment and operational management.

Ideal Candidates

The ideal candidate for the Sr Lead Data Platform Engineer will possess strong technical acumen coupled with a passion for data and innovation. Candidates should demonstrate an ability to work collaboratively in a team environment, showcasing strong leadership qualities and the capability to mentor others. Adaptability and a proactive approach to tackling challenges in data architecture will be essential. Furthermore, successful candidates will have a strong customer-focused mindset, striving to understand client needs and translating them into actionable data solutions.