Sr. Staff Software Engineer, Batch & Stream Processing

This job was posted over 30 days ago, so it has most likely closed. See newer jobs like it.

Written by AI from the job title and company, not by Pinterest, so some details may not match this job. The employer's own page has the real description.

Job Overview

The Sr. Staff Software Engineer, Batch & Stream Processing at Pinterest is a pivotal role responsible for designing, developing, and optimizing infrastructure for data processing systems that handle large volumes of batch and streaming data. This position involves collaborating with cross-functional teams to define architectural specifications, implementing robust data processing pipelines, and innovating solutions that enhance the performance and scalability of data-driven applications. The ideal candidate will leverage advanced programming skills and deep knowledge of data technologies to deliver high-impact results across the organization.

Job Responsibilities

• Design and implement scalable batch and real-time data processing solutions.
• Optimize existing data processing workflows and improve system performance.
• Collaborate with product teams to define data requirements and ensure alignment with business objectives.
• Conduct code reviews and mentor junior engineers to foster professional growth within the team.
• Identify and troubleshoot complex technical challenges, ensuring high availability and reliability of data services.
• Stay updated with industry trends and technologies to drive innovation within data processing frameworks.

Qualifications

• Bachelor’s or Master’s degree in Computer Science, Engineering, or a related field.
• 10+ years of experience in software engineering with a focus on data processing technologies.
• Proficiency in programming languages such as Java, Scala, or Python.
• Strong experience with big data technologies such as Apache Spark, Apache Flink, or similar frameworks.
• Deep understanding of data modeling, storage, and ETL processes.
• Excellent problem-solving skills, with a proven ability to troubleshoot complex issues in production environments.
• Experience working in a cloud-based environment (AWS, Google Cloud, etc.) is preferred.

Technologies & Tools

The Sr. Staff Software Engineer will utilize a diverse array of technologies and tools aimed at enhancing data processing capabilities. Key technologies include Apache Spark for batch processing, Apache Kafka for stream processing, Hadoop for data storage, along with cloud platforms such as AWS or Google Cloud for scalable infrastructure. Familiarity with SQL and NoSQL databases is essential, as is experience with data visualization tools to gather insights from complex data sets.

Ideal Candidates

The ideal candidate for this position is a strategic thinker with exceptional analytical skills and a strong background in software engineering and data technologies. They possess effective communication abilities to collaborate across multiple teams and exhibit a passion for data-driven solutions. Quality-driven, they seek to improve processes continually and demonstrate a proactive approach to overcoming challenges. A growth mindset and an eagerness to learn new technologies and methodologies are also essential attributes for success in this role.