AWS DevOps Engineer (Data Cataloguing)

This job was posted over 30 days ago, so it has most likely closed. See newer jobs like it.

Written by AI from the job title and company, not by AI TalentFlow, so some details may not match this job. The employer's own page has the real description.

Job Overview

AI TalentFlow is seeking an experienced AWS DevOps Engineer specializing in Data Cataloguing to join our dynamic team. This role will encompass the design, implementation, and management of distributed data cataloguing solutions on the AWS platform. The successful candidate will work closely with cross-functional teams to streamline data ingestion, ensure data quality, and enhance data discoverability, thereby contributing significantly to our data-driven initiatives.

Job Responsibilities

• Design and implement AWS data cataloguing solutions in line with organizational goals.
• Collaborate with data engineers and analysts to ensure seamless data integration and accessibility.
• Manage and optimize cloud-based infrastructure to ensure high availability and performance.
• Develop automation scripts for continuous integration and deployment (CI/CD) processes.
• Monitor and maintain the health of data services, performing troubleshooting as required.
• Establish data governance processes and ensure compliance with best practices.
• Document architecture, processes, and data sources in a coherent manner.
• Provide support and training to team members on data cataloguing practices.

Qualifications

• Bachelor's degree in Computer Science, Information Technology, or a related field.
• 5+ years of experience in DevOps engineering with a focus on AWS technologies.
• Proficiency in data cataloguing tools and practices, specifically within AWS (e.g., AWS Glue, AWS Lake Formation).
• Strong understanding of CI/CD tools including Jenkins, GitLab, or similar platforms.
• Experience with scripting languages such as Python, Bash, or Java.
• Knowledge of containerization technologies such as Docker and Kubernetes.
• Familiarity with data governance frameworks and best data management practices.
• Excellent problem-solving skills and ability to work under pressure.

Technologies & Tools

In this role, the AWS DevOps Engineer will utilize a variety of technologies and tools, including but not limited to AWS services such as S3, RDS, Lambda, and IAM, as well as data cataloguing tools like AWS Glue. Familiarity with CI/CD tools like Jenkins, container orchestration with Kubernetes, and version control systems like Git will also be essential to ensure the robustness and efficiency of the data cataloguing processes.

Ideal Candidates

The ideal candidate for this position will possess a strong analytical mindset, be detail-oriented, and demonstrate a passion for working with data. They should have exceptional communication skills to effectively collaborate with diverse teams and stakeholders. A proactive approach to problem-solving and an eagerness to learn new technologies will greatly enhance the candidate's success in this dynamic environment. Strong organizational skills, along with an ability to prioritize and manage multiple tasks, are essential in a fast-paced setting.