Full Time

Data Engineering Lead

Diamondpick
$110,000 - $150,000* / year (about $53–$72 an hour)

Job Description

This job was posted over 30 days ago, so it has most likely closed. See newer jobs like it.

Written by AI from the job title and company, not by Diamondpick, so some details may not match this job. The employer's own page has the real description.

Job Overview

As a Data Engineering Lead at Diamondpick, you will be responsible for guiding a team of data engineers in the design, development, and maintenance of robust data pipelines. The role emphasizes strategic oversight and leadership to ensure efficient data integration, enhancing data accessibility and analytics capabilities across the organization. You will collaborate with cross-functional teams to foster data-driven decision-making while mentoring junior team members and driving best practices in data engineering.



Job Responsibilities

  • Lead the design and implementation of scalable data architectures and pipelines.
  • Oversee the integration of data from various sources, ensuring data quality and consistency.
  • Manage and mentor a team of data engineers, providing guidance on technical and professional growth.
  • Collaborate with data scientists and analysts to understand data needs and enhance data usability.
  • Implement best practices for data governance and compliance, ensuring data privacy and security.
  • Track and optimize data infrastructure performance, recommending upgrades or changes as necessary.
  • Develop and maintain documentation for data architecture, processes, and workflows.


Qualifications

  • Bachelor's or Master's degree in Computer Science, Data Engineering, or a related field.
  • Minimum of 5 years of experience in data engineering or related roles.
  • Proficient in programming languages such as Python, Java, or Scala.
  • Strong experience with data modeling, ETL processes, and data warehousing solutions.
  • Knowledge of cloud platforms such as AWS, Google Cloud, or Azure.
  • Familiarity with big data technologies, including Hadoop, Spark, or Kafka.
  • Excellent problem-solving skills and ability to work in a fast-paced environment.


Technologies & Tools

As a Data Engineering Lead, you will engage with a range of technologies and tools that facilitate data processing and management. This includes cloud platforms such as AWS and Google Cloud, programming languages like Python and Scala, as well as big data processing frameworks including Apache Spark and Hadoop. Familiarity with data visualization tools and SQL databases will be essential for this role as well.



Ideal Candidates

The ideal candidates for this position will embody a combination of technical acumen and strong leadership capabilities. They should possess a keen analytical mindset with a passion for problem-solving and data optimization. Excellent communication skills are essential for effective collaboration across teams, along with the ability to mentor and inspire a growing team of data engineers. A proactive approach to embracing new technologies and a commitment to continuous improvement will also characterize the standout candidate for this role.

In Iowa, the weekly job search for unemployment is 4 reemployment activities a week (at least 3 of them job applications), its agency says. What it asks →

View Similar Jobs

Matches Jobs

Similar jobs which you may be interested in. Typically using your existing skillset.