Staff Software Engineer, Data Processing Infrastructure

This job was posted over 30 days ago, so it has most likely closed. See newer jobs like it.

Written by AI from the job title and company, not by Pinterest, so some details may not match this job. The employer's own page has the real description.

Job Overview

The Staff Software Engineer in Data Processing Infrastructure at Pinterest will play a pivotal role in enhancing and scaling the data processing systems that underpin our platform. This position involves collaborating with cross-functional teams to design, develop, and maintain high-performance data processing pipelines, ensuring that they meet the demands of a rapidly evolving ecosystem. The successful candidate will leverage their extensive technical expertise to implement innovative solutions that optimize data flow and processing efficiency, while also addressing challenges related to data integrity and system reliability.

Job Responsibilities

• Design, build, and maintain scalable data processing infrastructure using industry best practices.
• Develop and optimize data pipelines to ensure efficient data ingestion, transformation, and storage.
• Collaborate with data scientists and analysts to understand data requirements and enhance existing solutions.
• Monitor system performance and make necessary adjustments to optimize throughput and minimize latency.
• Create and maintain robust documentation for software and processes to facilitate knowledge sharing.
• Lead troubleshooting efforts, identifying system bottlenecks and implementing corrective measures.
• Contribute to architectural discussions and provide technical leadership within project teams.

Qualifications

• Bachelor’s or Master's degree in Computer Science, Engineering, or a related field.
• 7+ years of experience in software engineering, with a focus on data processing infrastructures.
• Proficient in programming languages such as Java, Scala, or Python.
• Experience with distributed data processing frameworks like Apache Spark or Hadoop.
• Strong understanding of database systems, both SQL and NoSQL.
• Excellent problem-solving skills and ability to work in a fast-paced environment.
• Strong communication skills and ability to collaborate with cross-functional teams.

Technologies & Tools

The Staff Software Engineer will primarily work with tools and technologies including Apache Spark, Hadoop, Kafka, AWS, and various SQL and NoSQL databases. Familiarity with containerization technologies such as Docker and orchestration platforms like Kubernetes will also be beneficial as these are essential for deploying scalable data solutions in cloud environments.

Ideal Candidates

Ideal candidates for this position exhibit a strong analytical mindset coupled with a passion for technology and innovation. They thrive in collaborative environments and are eager to tackle complex challenges. A proactive approach to identifying opportunities for improvement, exceptional time management skills, and the ability to articulate technical concepts clearly will set the successful candidate apart. Additionally, a commitment to fostering an inclusive culture within the team will be highly valued.