Sr Lead Data Platform Engineer, Shopping (Remote-Eligible)

This job was posted over 30 days ago, so it has most likely closed. See newer jobs like it.

Written by AI from the job title and company, not by RemoteWorker CA, so some details may not match this job. The employer's own page has the real description.

Job Overview

As a Senior Lead Data Platform Engineer in the Shopping division at RemoteWorker CA, you will play a pivotal role in designing, building, and maintaining robust data platforms that support our shopping services. Your expertise in data architecture will facilitate the development of scalable data solutions that enhance the user experience and optimize operational efficiency. This position requires strong leadership abilities, as you will mentor junior engineers and collaborate with cross-functional teams to drive data-driven decision-making across the organization.

Job Responsibilities

• Lead the design and implementation of scalable data platforms that support various shopping functionalities.
• Collaborate with data scientists, analysts, and product management teams to determine data requirements and solutions.
• Mentor junior engineers and facilitate knowledge sharing to promote a culture of continuous learning.
• Conduct performance tuning, troubleshooting, and optimization of existing data systems.
• Establish best practices for data governance, data quality, and data security.
• Stay current with industry trends and emerging technologies to continuously improve our data capabilities.

Qualifications

• Bachelor’s degree in Computer Science, Information Technology, or a related field; a Master’s degree is preferred.
• At least 7 years of experience in data engineering, with a focus on scalable data platform architecture.
• Proficient in programming languages such as Python, Java, or Scala.
• Experience with big data technologies including Apache Hadoop, Spark, and Kafka.
• Strong knowledge of SQL and experience with relational databases (MySQL, PostgreSQL) and NoSQL databases (MongoDB, Cassandra).
• Experience in cloud platforms like AWS, Azure, or Google Cloud.
• Excellent problem-solving skills and the ability to work in a fast-paced environment.

Technologies & Tools

The Senior Lead Data Platform Engineer will utilize a variety of technologies and tools, including but not limited to Apache Kafka for streaming data, Apache Spark for large-scale data processing, and cloud services from AWS or Google Cloud. Familiarity with ETL tools and data wrangling techniques is essential, along with experience in SQL databases and NoSQL databases for handling structured and unstructured data.

Ideal Candidates

The ideal candidate for this position will possess a blend of technical expertise and strong leadership abilities. They should have excellent communication skills to effectively articulate complex data concepts to stakeholders of varying technical backgrounds. A proactive attitude, a passion for innovation, and a commitment to the highest standards of data quality and governance will make you a standout fit for this role. The ability to navigate challenges and drive projects to completion while fostering an inclusive team environment is essential.