Sr. Data Engineer

This job was posted over 30 days ago, so it has most likely closed. See newer jobs like it.

Written by AI from the job title and company, not by Compass Group USA, so some details may not match this job. The employer's own page has the real description.

Overview

The Senior Data Engineer at Compass Group USA will play a pivotal role in the management and optimization of our data infrastructure. This position involves designing, constructing, and maintaining scalable data pipelines that support various business initiatives. The ideal candidate will collaborate with business stakeholders to understand their data needs, implement best practices for data processing, and ensure the availability of high-quality data for analysis and reporting. This role requires strong technical expertise and an emphasis on developing solutions that enhance operational efficiency and decision-making capabilities within the organization.

Job Responsibilities

• Design, build, and maintain robust data pipelines to collect and process large volumes of data.
• Develop data models, data transformation processes, and ETL workflows to ensure data quality and integrity.
• Collaborate with data scientists, analysts, and business leaders to understand data requirements and deliver effective data solutions.
• Monitor and optimize data infrastructure performance, making adjustments as necessary to ensure reliability.
• Implement data governance practices to ensure compliance with policies and regulations.
• Document procedures, processes, and data flow diagrams for transparency and training purposes.
• Stay updated on advancements in data engineering technologies and methodologies to enhance team capabilities.

Qualifications

• Bachelor’s degree in Computer Science, Information Technology, or a related field; Master's degree preferred.
• A minimum of 5 years of experience in data engineering or a related role, with a strong background in data management.
• Proficiency in programming languages such as Python, Java, or Scala.
• Experience with data warehousing solutions like Snowflake, Redshift, or similar technologies.
• Knowledge of SQL and experience with RDBMS and NoSQL databases.
• Familiarity with data visualization tools such as Tableau, Power BI, or similar platforms.
• Strong analytical and problem-solving skills, with the ability to work under tight deadlines.
• Excellent communication skills, both written and verbal, to convey complex data concepts to non-technical stakeholders.

Technologies & Tools

The Senior Data Engineer will utilize a variety of technologies and tools to fulfill their responsibilities. This includes data processing frameworks such as Apache Spark or Kafka, cloud services like AWS, Azure, or GCP, and container orchestration tools like Docker and Kubernetes. Additionally, experience with version control systems like Git will be essential for managing code and collaboration within the team. Knowledge of orchestration tools such as Apache Airflow or similar will also be crucial for automating data workflows.

Ideal Candidates

Ideal candidates for the Senior Data Engineer position at Compass Group USA will exhibit a strong blend of technical expertise, innovative thinking, and effective collaboration skills. They should be detail-oriented, with a passion for data and its ability to drive business success. The ability to effectively communicate complex data concepts to diverse teams is essential. Candidates should also be proactive in seeking improvements to processes and technologies, contributing positively to a culture of continuous improvement and teamwork.