Senior Lead Software Engineer - Python, PySpark, Big Data, Data pipeline, ML/AI

About this kind of role

What a Senior Lead Software Engineer - Python, PySpark, Big Data, Data pipeline, ML/AI usually does. The employer's own details are in the listing.

Typically does: Designs, develops, and maintains complex software solutions, often involving large datasets and machine learning applications. This role focuses on building and optimizing data pipelines, ensuring data quality, and integrating machine learning models into production systems. Senior Lead Software Engineers mentor junior engineers and contribute to architectural decisions, ensuring scalability and reliability. They collaborate with data scientists, product managers, and other engineers to deliver impactful data-driven products.

Tools and skills: Proficiency in Python, Pyspark, big data technologies (like Hadoop or Spark), data pipeline orchestration tools (e.g., Airflow), and experience with machine learning frameworks is generally required.

Good fit for: Individuals with strong software engineering fundamentals, a passion for data, and a desire to lead and mentor others thrive in this role.