Lead Data Engineer - GenAI (Hybrid or Remote)

This job was posted over 30 days ago, so it has most likely closed. See newer jobs like it.

Written by AI from the job title and company, not by Jobs via eFinancialCareers, so some details may not match this job. The employer's own page has the real description.

Job Overview

The Lead Data Engineer - GenAI position is a pivotal role within our organization, responsible for architecting and engineering data solutions that harness the power of Generative AI. The successful candidate will lead a team of data professionals and collaborate closely with cross-functional teams to design and implement advanced data pipelines and systems. This hybrid or remote position requires a deep understanding of data engineering principles and extensive experience with Generative AI technologies, enabling the organization to transform data into actionable insights and innovative solutions.

Job Responsibilities

• Lead the design, development, and implementation of scalable data architectures and workflows that optimize data processing for Generative AI applications.
• Manage and mentor a team of data engineers, ensuring adherence to best practices in data management and engineering.
• Collaborate with data scientists, analysts, and product teams to understand their data needs and deliver sophisticated data solutions.
• Create and maintain documentation related to data pipelines, schemas, and data governance policies.
• Integrate diverse data sources, ensuring data quality, accuracy, and accessibility for machine learning models and analytical purposes.
• Stay abreast of industry trends in data engineering and Generative AI, recommending innovative tools and technologies for adoption.

Qualifications

• Bachelor's or Master's degree in Computer Science, Information Technology, or a related field.
• Minimum of 5 years' experience in data engineering, with a focus on Generative AI technologies.
• Proficiency in programming languages such as Python, Java, or Scala.
• Strong experience with ETL tools and data integration techniques.
• Familiarity with big data technologies such as Hadoop, Spark, or Kafka.
• Experience with cloud platforms such as AWS, GCP, or Azure.
• Knowledge of data modeling and database design, particularly with relational and non-relational databases.
• Exceptional problem-solving skills and ability to work in a collaborative environment.

Technologies & Tools

The Lead Data Engineer - GenAI will work with a variety of technologies and tools, including but not limited to data processing frameworks such as Apache Spark and Hadoop, cloud computing services like AWS and Azure, and database management systems such as PostgreSQL and MongoDB. Familiarity with machine learning platforms and tools is also essential, as the role involves working closely with Generative AI frameworks and models to extract and harness valuable insights from large datasets.

Ideal Candidates

Ideal candidates for the Lead Data Engineer - GenAI position are those who possess a unique blend of technical expertise and leadership capabilities. They are proactive problem-solvers, capable of navigating complex data architectures and delivering results in high-pressure environments. A strong communicator with a collaborative mindset, they excel in working with cross-functional teams to drive projects to successful completion. Adaptive to new challenges and technologies, they are passionate about leveraging data to innovate and create meaningful impact within the organization.