Sr Lead Data Platform Engineer, Shopping (Remote-Eligible)

This job was posted over 30 days ago, so it has most likely closed. See newer jobs like it.

Written by AI from the job title and company, not by RemoteWorker CA, so some details may not match this job. The employer's own page has the real description.

Job Overview

The Sr Lead Data Platform Engineer, Shopping at RemoteWorker CA is tasked with designing, building, and maintaining data platforms that serve the shopping domain. This role entails working closely with cross-functional teams to develop scalable data solutions, ensuring the integrity and accessibility of data across the organization. The ideal candidate will employ their expertise in data engineering to facilitate data-driven decision-making processes, optimize data workflows, and enhance user experience across our shopping platforms.

Job Responsibilities

• Lead the design and implementation of robust data platforms for shopping applications that support high availability and performance.
• Collaborate with product managers, data scientists, and software engineers to understand data requirements and integrate data solutions.
• Develop and maintain ETL processes to ensure timely and accurate data availability.
• Optimize data models and workflows to enhance data retrieval and processing efficiency.
• Implement best practices for data governance and security to protect sensitive customer information.
• Monitor and troubleshoot data pipeline issues, ensuring minimal downtime and optimal performance.
• Mentor and guide junior engineers in data engineering methodologies and tools.

Qualifications

• Bachelor’s degree in Computer Science, Engineering, or a related field; Master’s degree preferred.
• A minimum of 5 years of experience in data engineering or related roles.
• Proficiency in programming languages such as Python, Java, or Scala.
• Extensive experience with data warehousing solutions, ETL frameworks, and data modeling.
• Strong knowledge of SQL and experience with big data technologies such as Hadoop, Spark, or Kafka.
• Familiarity with cloud platforms, especially AWS, Azure, or Google Cloud Platform.
• Excellent analytical, troubleshooting, and problem-solving skills.

Technologies & Tools

This position utilizes a variety of advanced technologies and tools in data engineering, including but not limited to cloud services such as AWS, Azure, or Google Cloud, data processing frameworks like Apache Spark and Apache Kafka, as well as relational and NoSQL databases. Proficient use of workflows and orchestration tools such as Apache Airflow is also essential, alongside data visualization tools to support analytics initiatives.

Ideal Candidates

The ideal candidate for the Sr Lead Data Platform Engineer role will possess a strong blend of technical expertise, leadership skills, and a passion for driving data initiatives. They will be adept at communicating complex technical concepts to non-technical stakeholders and working collaboratively within teams. A proactive mindset, eagerness to learn and adapt, and a commitment to delivering high-quality data solutions are essential traits for success in this role.