Full Time

Principal Data Engineer, Environment - Development

Quest Diagnostics
$120,000 - $160,000* / year (about $58–$77 an hour)

Job Description

This job was posted over 30 days ago, so it has most likely closed. See newer jobs like it.

Written by AI from the job title and company, not by Quest Diagnostics, so some details may not match this job. The employer's own page has the real description.


Job Overview


The Principal Data Engineer, Environment - Development at Quest Diagnostics plays a crucial role in designing, developing, and implementing scalable data architectures and solutions. This position focuses on enhancing data processing capabilities and ensuring data quality and integrity while collaborating with cross-functional teams to support analytical and business objectives. The individual will leverage advanced engineering practices to optimize performance and facilitate data-driven decision-making across the organization.



Job Responsibilities

  • Design and implement data pipelines and architectures to support large-scale data processing.
  • Collaborate with data scientists, analysts, and other stakeholders to understand data needs and deliver appropriate solutions.
  • Monitor, optimize, and troubleshoot data workflows and performance issues.
  • Ensure data integrity and quality across all datasets and establish best practices for data management.
  • Stay current with industry trends and emerging technologies to proactively introduce new capabilities.
  • Mentor and lead a team of data engineers, fostering a culture of innovation and continuous improvement.
  • Document processes, methodologies, and technical specifications for future reference and training.


Qualifications

  • Bachelor's or Master's degree in Computer Science, Engineering, Data Science, or a related field.
  • 8+ years of experience in data engineering or a related field, with significant exposure to data architecture and ETL processes.
  • Proficiency in programming languages such as Python, Java, or Scala.
  • Experience with big data technologies (e.g., Hadoop, Spark) and cloud platforms (e.g., AWS, Azure).
  • Strong understanding of relational and NoSQL database structures and data warehousing solutions.
  • Excellent problem-solving skills and the ability to work under pressure in a fast-paced environment.
  • Strong communication skills to effectively collaborate with both technical and non-technical teams.


Technologies & Tools


The Principal Data Engineer will utilize a variety of technologies and tools including, but not limited to, Apache Hadoop, Apache Spark, AWS services (e.g., S3, EMR, Redshift), and SQL & NoSQL databases such as MySQL and MongoDB. Familiarity with ETL tools like Talend or Informatica, as well as data visualization platforms, will also be essential in this role to ensure seamless data integration and reporting functionalities.



Ideal Candidates


Ideal candidates for the Principal Data Engineer position will be innovative thinkers who possess a strong analytical mindset and have a collaborative spirit. They should demonstrate a commitment to best practices in data management while being adaptable to changing technologies and business needs. Leadership qualities, bolstered by a proactive approach to mentoring and knowledge sharing, will enhance their capacity to drive team performance and foster an environment of continuous learning and improvement.


In September, US employers made hires equal to 3.4% of all jobs, and layoffs equal to 1%, says the Bureau of Labor Statistics. The job market now →

View Similar Jobs

Matches Jobs

Similar jobs which you may be interested in. Typically using your existing skillset.