Director of Data Engineering

This job was posted over 30 days ago, so it has most likely closed. See newer jobs like it.

Written by AI from the job title and company, not by GrabaJobs - Job Search Automation AI, so some details may not match this job. The employer's own page has the real description.

Job Overview

The Director of Data Engineering at GrabaJobs - Job Search Automation AI will be responsible for leading a team of data engineers in the design, development, and maintenance of data infrastructures that support our innovative job search automation platform. This role encompasses the strategic planning and execution of data acquisition, storage, processing, and analysis, ensuring that the infrastructure supports advanced data analytics and business intelligence functions. The ideal candidate will possess a strong technical background, outstanding leadership skills, and a deep understanding of data engineering principles and best practices.

Job Responsibilities

• Lead a team of data engineers in the development and implementation of scalable data pipelines.
• Design and optimize robust data architectures that enhance data accessibility and quality for analytics.
• Collaborate with data scientists and business stakeholders to define data requirements and ensure alignment with business objectives.
• Develop and enforce best practices for data engineering, including coding standards, testing strategies, and performance optimization.
• Oversee data governance initiatives to ensure data integrity, security, and compliance with relevant regulations.
• Monitor and guide the team in using the latest tools and technologies in data engineering to innovate and improve processes.
• Provide mentorship and professional development opportunities for the data engineering team.
• Coordinate with cross-functional teams to ensure successful integration of data engineering initiatives with other company projects.

Qualifications

• Bachelor’s or Master’s degree in Computer Science, Information Technology, Engineering, or related field.
• Minimum of 7 years of experience in data engineering or related roles, with at least 3 years in a leadership position.
• Proficiency in programming languages such as Python, Java, or Scala.
• Hands-on experience with data storage and processing frameworks, including SQL databases, NoSQL databases, and data warehousing solutions.
• Familiarity with big data technologies, such as Hadoop, Spark, or Kafka.
• Strong understanding of ETL processes and data pipeline architecture.
• Excellent analytical, problem-solving, and communication skills.
• Experience with cloud computing platforms (e.g., AWS, Google Cloud, Azure) is highly desirable.

Technologies & Tools

The Director of Data Engineering will be proficient with a variety of technologies and tools that are critical to our operations. This includes data warehousing solutions like Amazon Redshift or Google BigQuery, ETL tools such as Apache NiFi or Talend, and programming languages like Python and SQL. Additionally, familiarity with cloud computing services and big data technologies, including AWS or Google Cloud's ecosystem, Hadoop, and Apache Spark, will be essential in driving the data engineering efforts of the company.

Ideal Candidates

The ideal candidate for this position should exhibit strong leadership qualities, with a proven ability to guide diverse teams towards achieving common goals. They should have a strategic mindset, capable of thinking critically about data challenges and opportunities. Excellent communication skills, both verbal and written, are necessary to effectively interact with stakeholders across the organization. Furthermore, the candidate should demonstrate a willingness to adapt to evolving technologies and an innovative approach to problem-solving, all while fostering a collaborative team environment.