Sr Data Engineer (AWS/DevOps)

This job was posted over 30 days ago, so it has most likely closed. See newer jobs like it.

Written by AI from the job title and company, not by Concentrix Catalyst, so some details may not match this job. The employer's own page has the real description.

Position Overview

As a Senior Data Engineer at Concentrix Catalyst, you will leverage your expertise in AWS and DevOps to design, implement, and maintain scalable data pipelines and infrastructure. You will be responsible for collaborating with cross-functional teams to gather data requirements, optimize data flow, and ensure data integrity across various platforms. Your role will also involve mentoring junior team members and contributing to the development of best practices for data engineering.

Job Responsibilities

• Design and implement robust data pipelines and systems in AWS to facilitate real-time data analytics.
• Collaborate with data scientists, analysts, and business stakeholders to gather requirements and deliver high-quality data solutions.
• Ensure data quality and integrity through thorough validation and testing processes.
• Optimize existing data solutions for performance and scalability.
• Utilize DevOps practices to automate deployment, monitoring, and maintenance of data infrastructure.
• Mentor junior engineers by providing guidance on best practices and fostering a culture of continuous learning.
• Stay up-to-date with industry trends, technologies, and best practices in data engineering.

Qualifications

• Bachelor's degree in Computer Science, Information Technology, or a related field.
• 5+ years of experience in data engineering, with a strong emphasis on AWS technologies.
• Proficiency in programming languages such as Python, Java, or Scala.
• Experience with data warehousing solutions and ETL processes.
• Strong understanding of database technologies, including SQL and NoSQL databases.
• Familiarity with DevOps practices and CI/CD tools.
• Excellent problem-solving skills and the ability to work independently as well as in a team.

Technologies & Tools

In this position, you will work closely with various technologies and tools including AWS services (such as S3, Lambda, Redshift, and Glue), Apache Spark, Docker, Kubernetes, and SQL-oriented technologies. Familiarity with data visualization tools and data processing frameworks will also be valuable in fulfilling your role effectively.

Ideal Candidates

The ideal candidate for this position is a proactive, analytical thinker who possesses a deep passion for data and innovation. You should display a strong aptitude for problem-solving and be comfortable working in a fast-paced environment. A commitment to continuous learning and adaptability to new challenges will be key traits that contribute to your success in this role.