Sr Lead Data Platform Engineer, Shopping (Remote-Eligible)

This job was posted over 30 days ago, so it has most likely closed. See newer jobs like it.

Written by AI from the job title and company, not by ClickJobs.io, so some details may not match this job. The employer's own page has the real description.

Overview

The Sr Lead Data Platform Engineer will play a pivotal role in shaping and enhancing the data ecosystem for our shopping division at ClickJobs.io. This position entails designing, building, and maintaining large-scale data platforms that drive business insights and decision-making. The candidate will collaborate with cross-functional teams to implement data models and facilitate data sharing, ensuring optimal performance and security in a cloud-based environment. Ultimately, the Sr Lead Data Platform Engineer will lead initiatives to improve data accessibility and usability, fostering a data-driven culture within the organization.

Job Responsibilities

• Design and architect scalable data platforms to support data analytics and business intelligence initiatives.
• Lead a team of engineers in the development and implementation of data pipelines and ETL processes.
• Collaborate with data scientists, analysts, and other stakeholders to identify business requirements and translate them into technical specifications.
• Ensure data quality and integrity through validation and monitoring of data workflows.
• Implement security protocols and best practices to safeguard sensitive data.
• Stay current with industry trends and evolving technologies to drive continuous improvement in data platform capabilities.
• Mentor and guide junior engineers, fostering a collaborative and innovative team environment.

Qualifications

• Bachelor’s degree in Computer Science, Engineering, or a related field; Master’s degree preferred.
• 7+ years of experience in data engineering or a related field, with a focus on data platform architecture.
• Proficiency in programming languages such as Python, Java, or Scala.
• Experience with cloud platforms, especially AWS, Azure, or Google Cloud Platform.
• Strong knowledge of SQL and NoSQL databases.
• Familiarity with data warehousing solutions and big data technologies, such as Hadoop or Spark.
• Excellent analytical and problem-solving skills, with a keen attention to detail.

Technologies & Tools

The Sr Lead Data Platform Engineer will primarily utilize cloud services (AWS, Azure, or Google Cloud Platform), data integration tools such as Apache Kafka or Informatica, and database management systems including both SQL (PostgreSQL, MySQL) and NoSQL (MongoDB, Cassandra). Familiarity with data processing frameworks, such as Apache Spark or Apache Hive, is essential to effectively manage large datasets. Additionally, version control systems such as Git will be employed to facilitate collaborative development practices.

Ideal Candidates

An ideal candidate for the Sr Lead Data Platform Engineer position at ClickJobs.io is someone who possesses strong leadership qualities and a passion for data innovation. This individual should be adept at synthesizing complex technical information and conveying it clearly to stakeholders across various departments. A strategic thinker who is proactive in identifying opportunities for leveraging data to drive business success will excel in this role. Furthermore, resilience in the face of challenges and an eagerness to mentor others will contribute to fostering a positive and productive work atmosphere.