Senior Software Engineer, Spark Platform

About this kind of role

What a Senior Software Engineer, Spark Platform usually does. The employer's own details are in the listing.

Typically does: A Senior Software Engineer on a Spark Platform develops, tests, and maintains data processing pipelines and applications using Apache Spark. This role involves optimizing Spark jobs for performance and scalability, and collaborating with data scientists and other engineers to integrate Spark into larger data systems. Responsibilities often include designing and implementing new features, troubleshooting production issues, and contributing to the overall architecture of the Spark platform. They may also mentor junior engineers and participate in code reviews.

Tools and skills: Proficiency in Scala or Python, experience with Apache Spark, Hadoop, distributed computing concepts, and SQL is generally required, alongside familiarity with cloud platforms and version control systems.

Good fit for: Individuals with strong problem-solving abilities, a passion for data engineering, and a desire to build robust and scalable data processing solutions are typically successful in this role.