Staff Software Engineer, Data Processing Infrastructure

This job was posted over 30 days ago, so it has most likely closed. See newer jobs like it.

Written by AI from the job title and company, not by Pinterest, so some details may not match this job. The employer's own page has the real description.

Job Overview

The Staff Software Engineer, Data Processing Infrastructure at Pinterest will play a critical role in the development and enhancement of our data processing systems. This position involves designing and implementing scalable data processing frameworks, collaborating closely with cross-functional teams to ensure that our infrastructure meets the growing analytical demands of the business. The ideal candidate will possess a deep understanding of data engineering principles and will be responsible for fostering innovation while maintaining high standards of reliability and performance within our systems.

Job Responsibilities

• Design, develop, and maintain scalable data processing infrastructures for analytics and product features.
• Collaborate with data scientists, analysts, and product teams to understand and implement data requirements.
• Enhance existing data processing systems to improve performance, reliability, and scalability.
• Implement best practices for data management, ETL processes, and data quality assurance.
• Mentor junior engineers, providing guidance on coding practices and project implementation.
• Participate in code reviews and contribute to architecting solutions that solve complex data challenges.
• Conduct performance tuning and optimization of data processing jobs and queries.
• Stay informed about industry trends and emerging technologies to enhance our data processing capabilities.

Qualifications

• Bachelor’s degree in Computer Science, Engineering, or a related field; advanced degree preferred.
• Minimum of 5 years of software engineering experience, with a focus on data processing or data infrastructure.
• Proficiency in programming languages such as Java, Scala, or Python.
• Strong experience with distributed computing frameworks like Apache Spark, Hadoop, or Flink.
• Solid understanding of database technologies, both SQL and NoSQL.
• Experience with cloud platforms (AWS, Google Cloud, or Azure) and their data services.
• Familiarity with CI/CD practices and tools.
• Excellent problem-solving skills and a strong attention to detail.

Technologies & Tools

The Staff Software Engineer will engage with a variety of technologies and tools, primarily focusing on big data processing frameworks such as Apache Spark and Hadoop. Additional tools may include Kafka for data streaming, relational databases like Postgres, and cloud services such as AWS S3 and Redshift. Familiarity with containerization tools like Docker and orchestration technologies such as Kubernetes will also be beneficial for our operational practices.

Ideal Candidates

The ideal candidate for the Staff Software Engineer role is a proactive problem solver who thrives in dynamic environments. They possess strong communication skills, allowing them to collaborate effectively across departments. An innovative mindset, along with a passion for leveraging technology to enhance data processing efficiency and drive business impact, are essential characteristics. Furthermore, a commitment to mentoring and developing team members is highly valued in our collaborative culture at Pinterest.