Lead Data Engineer (Databricks, Big Data)

About this kind of role

What a Lead Data Engineer (Databricks, Big Data) usually does. The employer's own details are in the listing.

Typically does: A Data Engineer designs, builds, and maintains data infrastructure to support data analysis and machine learning. This involves developing and implementing ETL (Extract, Transform, Load) processes to move data from various sources into a centralized data warehouse or data lake. They also optimize data pipelines for performance and reliability, ensuring data quality and accessibility for data scientists and analysts. Data Engineers often collaborate with other engineers and stakeholders to understand data needs and translate them into technical solutions.

Tools and skills: Proficiency in programming languages like Python or Scala, experience with big data technologies such as Spark and Hadoop, and familiarity with cloud platforms like Databricks are commonly required.

Good fit for: Individuals with strong analytical and problem-solving skills, a passion for data, and the ability to work effectively in a collaborative environment often thrive in this role.