Sr. Staff Software Engineer, Batch & Stream Processing

This job was posted over 30 days ago, so it has most likely closed. See newer jobs like it.

Written by AI from the job title and company, not by Pinterest, so some details may not match this job. The employer's own page has the real description.

Job Overview

The Sr. Staff Software Engineer, Batch & Stream Processing at Pinterest will play a key role in developing and enhancing scalable data processing systems. This position entails designing robust and efficient data pipelines, improving processing techniques, and collaborating cross-functionally with various teams to ensure high-quality data management. The ideal candidate will leverage their expertise to influence architectural decisions, create efficient algorithms, and mentor junior engineers, ensuring Pinterest’s data processing capabilities align with its strategic objectives.

Job Responsibilities

• Design, implement, and optimize batch and stream processing architectures to handle large-scale data sets.
• Collaborate with data scientists and analytics teams to understand and translate business requirements into technical specifications.
• Develop and maintain robust data quality and governance practices across data pipelines.
• Lead code reviews and provide constructive feedback to ensure high code quality and adherence to industry standards.
• Mentor junior engineers, fostering their professional development and technical skills.
• Evaluate and recommend new technologies and tools to improve data processing efficiency.
• Monitor system performance and troubleshoot any issues that arise during processing.
• Work closely with cross-functional teams to support data-driven decision-making across the organization.

Qualifications

• Bachelor’s or advanced degree in Computer Science, Engineering, or a related field.
• Minimum of 8 years of experience in software engineering with a focus on data processing.
• Proficient in programming languages such as Java, Scala, or Python.
• Extensive experience with big data frameworks like Apache Spark and Apache Flink.
• Strong understanding of data warehousing concepts and experience working with databases (SQL and NoSQL).
• Proven experience in designing and implementing high-throughput, fault-tolerant systems.
• Excellent problem-solving skills and ability to work collaboratively in a team environment.
• Demonstrated ability to communicate complex technical concepts to non-technical stakeholders.

Technologies & Tools

This position will utilize a variety of cutting-edge technologies and tools, including but not limited to Apache Spark, Apache Kafka, Hadoop, SQL-based databases, NoSQL databases, Kubernetes, and cloud platforms such as AWS and GCP. Familiarity with data modeling, ETL processes, and data visualization tools will also be essential in effectively executing the required tasks.

Ideal Candidates

Ideal candidates for the Sr. Staff Software Engineer role should demonstrate exceptional technical skills coupled with a strategic mindset. You should possess a strong passion for data and technology, showcasing a continuous desire to innovate and optimize processes. A proactive attitude, excellent communication abilities, and a collaborative spirit are essential for fostering teamwork and driving project success. Additionally, candidates should be adaptable, capable of navigating complex challenges in a fast-paced environment while demonstrating a commitment to mentorship and developing the talents of junior colleagues.