Senior Software Engineer (Batch Infrastructure)

This job was posted over 30 days ago, so it has most likely closed. See newer jobs like it.

Written by AI from the job title and company, not by Affirm, so some details may not match this job. The employer's own page has the real description.

Job Overview

As a Senior Software Engineer (Batch Infrastructure) at Affirm, you will play a crucial role in designing, implementing, and maintaining scalable batch processing systems that drive our backend operations. You will collaborate closely with cross-functional teams to enhance our data infrastructure, ensuring that our solutions meet the high standards of performance and reliability. In this role, your expertise will contribute to the optimization of data workflows while fostering a culture of continuous improvement and innovation within the engineering team.

Job Responsibilities

• Design, implement, and maintain robust batch processing systems and frameworks.
• Optimize data workflows for performance and scalability while ensuring data integrity.
• Collaborate with data science, analytics, and product teams to gather requirements and deliver effective data solutions.
• Debug and troubleshoot production issues, providing timely resolutions and preventive measures.
• Conduct code reviews, providing constructive feedback to peers to enhance code quality.
• Leverage best practices in software development, including CI/CD, test automation, and deployment strategies.
• Mentor junior engineers, sharing expertise and fostering their professional growth.

Qualifications

• Bachelor’s degree in Computer Science, Engineering, or a related field; Master's degree preferred.
• 5+ years of experience in software engineering, with a focus on batch processing and distributed systems.
• Proficiency in programming languages such as Java, Scala, or Python.
• Strong understanding of data storage and processing technologies, including Hadoop, Spark, or similar frameworks.
• Experience with cloud services such as AWS, Google Cloud Platform, or Azure.
• Solid understanding of database technologies including SQL and NoSQL databases.
• Excellent problem-solving skills and the ability to work in a fast-paced, team-oriented environment.

Technologies & Tools

The Senior Software Engineer (Batch Infrastructure) will work with a variety of technologies and tools to achieve optimal performance in batch processing. These include but are not limited to Hadoop, Apache Spark, AWS services (such as S3, EMR, and Lambda), Kafka for real-time data streams, and relational/non-relational database management systems. Familiarity with containerization tools like Docker and orchestration tools such as Kubernetes is also highly beneficial.

Ideal Candidates

Ideal candidates for this position will possess strong analytical and technical skills, with a natural curiosity for learning and problem-solving. They should demonstrate effective communication abilities, enabling them to articulate complex concepts clearly to both technical and non-technical stakeholders. A passion for innovation, coupled with a dedication to delivering high-quality solutions, will set a successful candidate apart. Furthermore, candidates who value collaboration and contribute positively to team dynamics will thrive in a fast-paced and evolving work environment.