Senior Hadoop SRE Engineer - SVP

This job was posted over 30 days ago, so it has most likely closed. See newer jobs like it.

Written by AI from the job title and company, not by Citi, so some details may not match this job. The employer's own page has the real description.

Position Overview

The Senior Hadoop SRE Engineer - SVP at Citi will play a crucial role in ensuring the reliability, availability, and performance of the Hadoop ecosystem utilized across the organization. The successful candidate will lead initiatives to enhance operational efficiency, troubleshoot complex issues, and contribute to the strategic direction of the cloud-native infrastructure. This role requires collaboration with development teams, effective incident management, and a proactive approach to optimizing HDFS, YARN, and related technologies to meet the demands of high-volume data processing.

Job Responsibilities

• Design, implement, and manage scalable Hadoop infrastructure to support large data workloads.
• Perform regular system monitoring, performance tuning, and capacity planning for Hadoop clusters.
• Develop and maintain automation scripts for system deployments, monitoring, and recovery mechanisms.
• Collaborate with software development teams to integrate Hadoop with various data sources and services.
• Lead incident management, performing root cause analysis and ensuring timely resolution of issues.
• Implement best practices for data security, data governance, and compliance within the Hadoop framework.
• Provide technical mentorship and guidance to junior engineers and operational staff.
• Participate in on-call support and maintain high service availability standards.

Qualifications

• Bachelor's degree in Computer Science, Information Technology, or a related field; Master's degree preferred.
• Minimum of 7 years of experience in infrastructure engineering, specifically with Hadoop ecosystems.
• Strong expertise in Hadoop components including HDFS, YARN, MapReduce, Hive, and HBase.
• Proficient in scripting languages such as Python, Bash, or Perl.
• Experience with monitoring tools such as Cloudera Manager, Ambari, or similar.
• Solid understanding of cloud platforms (AWS, Azure, or Google Cloud) and their integration with Hadoop.
• Effective communication and collaboration skills, with the ability to work in a fast-paced environment.

Technologies & Tools

The Senior Hadoop SRE Engineer will work extensively with technologies such as Apache Hadoop, Cloudera, Apache Hive, Apache Pig, and Apache Spark, as well as integration tools like Apache Kafka and NiFi. Familiarity with data orchestration tools, containerization technologies (e.g., Docker and Kubernetes), and cloud services such as AWS or Azure is essential for maximizing the efficiency and performance of the ecosystem.

Ideal Candidates

Ideal candidates for this position are individuals who possess a strong analytical mindset and are results-oriented. They should demonstrate resilience and adaptability in high-pressure situations while showcasing a passion for data-driven decision-making and continuous improvement. A collaborative spirit and excellent communication skills are essential, as the role involves interfacing with multiple stakeholders. Candidates should also exhibit a commitment to learning new technologies and methodologies to advance the operational capabilities of the Hadoop environment.