Sr. Big Data/Spark Engineer

This job was posted over 30 days ago, so it has most likely closed. See newer jobs like it.

Written by AI from the job title and company, not by R1 RCM, so some details may not match this job. The employer's own page has the real description.

Job Overview

As a Senior Big Data/Spark Engineer at R1 RCM, you will be pivotal in designing, implementing, and maintaining scalable big data solutions that support our healthcare data analytics initiatives. You will leverage your expertise in Spark and big data technologies to optimize our data processing frameworks, ensuring effective extraction, transformation, and loading of vast datasets. Your responsibilities will include collaborating with data scientists and analysts to turn complex data sets into actionable insights, maintaining high-quality data pipelines, and contributing to the development of innovative analytics tools.

Job Responsibilities

• Design, develop, and implement robust data processing frameworks using Apache Spark.
• Collaborate with cross-functional teams to gather requirements and translate them into technical specifications.
• Optimize existing Spark jobs for performance improvements and cost reductions.
• Monitor and troubleshoot data pipeline issues to ensure data integrity and availability.
• Evaluate and integrate new big data technologies and tools to enhance processing capabilities.
• Document data architecture and processes to facilitate knowledge sharing within the team.

Qualifications

• Bachelor’s or Master’s degree in Computer Science, Engineering, or a related field.
• 5+ years of experience working with big data technologies, specifically Apache Spark.
• Proficient in programming languages such as Python, Scala, or Java.
• Strong understanding of data manipulation, ETL processes, and data warehousing solutions.
• Experience with cloud-based data platforms (e.g., AWS, Azure, GCP) is highly desirable.
• Excellent analytical and problem-solving skills, with a keen attention to detail.

Technologies & Tools

In this role, the incumbent will utilize a wide range of technologies and tools including, but not limited to, Apache Spark, Hadoop, Apache Kafka, and various cloud services such as AWS EMR. Familiarity with data visualization tools like Tableau or Power BI, as well as SQL and NoSQL databases, will be essential to effectively manage and analyze large datasets.

Ideal Candidates

Ideal candidates for the Senior Big Data/Spark Engineer position are detail-oriented professionals with a strong analytical mindset and a passion for leveraging data to solve complex business problems. They demonstrate proficiency in big data technologies and exhibit excellent communication skills to work effectively within cross-functional teams. A successful candidate is proactive, eager to learn, and willing to innovate in a fast-paced environment while adhering to R1 RCM's commitment to quality and integrity in data analytics.