Cloud Data Engineer III

This job was posted over 30 days ago, so it has most likely closed. See newer jobs like it.

Written by AI from the job title and company, not by Shift4, so some details may not match this job. The employer's own page has the real description.

Job Overview

The Cloud Data Engineer III at Shift4 is responsible for the design, development, and optimization of our cloud-based data infrastructure. This role involves collaborating with cross-functional teams to ensure the efficient flow of data across platforms and to support big data initiatives. The ideal candidate will have a solid foundation in data engineering, along with an expertise in cloud technologies to deliver scalable solutions that bolster our data-driven decision-making processes.

Job Responsibilities

• Design and implement data pipelines for ingestion, transformation, and loading of data in a cloud environment.
• Optimize data storage and retrieval processes to enhance performance and reduce costs.
• Collaborate with data scientists and analysts to understand their data needs and translate them into technical specifications.
• Monitor and troubleshoot data processing workflows to ensure seamless operation.
• Implement data models and structures that support analytics and reporting.
• Conduct code reviews and mentor junior data engineers to promote best practices and continuous improvement.
• Stay updated with emerging cloud technologies and propose enhancements to the data engineering processes.

Qualifications

• Bachelor's degree in Computer Science, Engineering, or a related field; Master's degree preferred.
• 5+ years of experience in data engineering or a related field.
• Strong knowledge of cloud platforms, preferably AWS, Azure, or Google Cloud.
• Proficiency in SQL and programming languages such as Python, Java, or Scala.
• Experience with data warehousing solutions and ETL processes.
• Familiarity with Big Data tools like Hadoop, Spark, or Kafka.
• Strong analytical and troubleshooting skills with attention to detail.
• Excellent communication skills and the ability to work collaboratively within a team.

Technologies & Tools

The Cloud Data Engineer III will utilize a variety of technologies and tools including cloud computing platforms (AWS, Azure), data modeling and ETL tools (Apache Nifi, Talend), databases (PostgreSQL, Redshift), and Big Data frameworks (Apache Spark, Hadoop). Familiarity with Docker and Kubernetes for container management may also be required for certain projects.

Ideal Candidates

The ideal candidate for the Cloud Data Engineer III position is detail-oriented, proactive, and capable of working in a fast-paced environment. Strong problem-solving abilities and a passion for data are crucial, along with a continuous learning mindset to keep abreast of technological advancements. The candidate should also possess strong interpersonal skills to foster collaboration between technical and non-technical teams, demonstrating leadership in driving data-related initiatives.