Lead Data Engineer - Remote

This job was posted over 30 days ago, so it has most likely closed. See newer jobs like it.

Written by AI from the job title and company, not by Austin International, so some details may not match this job. The employer's own page has the real description.

Position Overview

Austin International is seeking a highly skilled Lead Data Engineer to join our dynamic team in a fully remote capacity. The candidate will play a critical role in designing and implementing robust data architectures that enable data-driven decision-making across the organization. You will lead a team of data engineers, ensuring the effective utilization of data to enhance business processes and support strategic initiatives. Your expertise will contribute to data modeling, ETL processes, and architecture optimization, fostering a culture of innovation and excellence in data management.

Job Responsibilities

• Design and develop scalable data pipelines and ETL processes to support data ingestion and transformation.
• Lead architectural discussions and establish best practices for data engineering and data management.
• Oversee and mentor a team of data engineers, providing technical guidance and support.
• Collaborate with data scientists and analysts to ensure data availability and integrity.
• Implement data governance policies to enhance data quality and compliance.
• Utilize big data technologies for efficient data processing and analytics.
• Continuously monitor and optimize data systems for improved performance and reliability.

Qualifications

• Bachelor’s or Master’s degree in Computer Science, Data Engineering, or a related field.
• A minimum of 5 years of experience in data engineering or a similar role.
• Proficiency in programming languages such as Python, Java, or Scala.
• Strong experience with SQL and familiarity with NoSQL databases.
• Hands-on experience with big data technologies such as Apache Hadoop, Spark, and Kafka.
• Excellent knowledge of data warehousing solutions and cloud platforms (AWS, GCP, or Azure).
• Demonstrated ability to lead complex projects and manage cross-functional teams.

Technologies & Tools

As a Lead Data Engineer, you will work with a diverse array of technologies including, but not limited to, Apache Hadoop, Apache Spark, Kafka, SQL databases, and various cloud platforms such as AWS, Google Cloud Platform (GCP), and Microsoft Azure. Familiarity with data orchestration tools like Apache Airflow and ETL frameworks will also be essential in managing workflows effectively.

Ideal Candidates

The ideal candidate for this position will be a proactive and analytical thinker with a strong passion for data. You should demonstrate excellent problem-solving abilities and possess outstanding communication skills to convey complex concepts clearly. Your leadership skills should inspire team collaboration and drive strategic initiatives. A commitment to continuous improvement and a strong desire to stay abreast of industry trends in data engineering are also essential qualities that will lead to your success in this role at Austin International.