Senior Data Engineer/Scala (Remote)

This job was posted over 30 days ago, so it has most likely closed. See newer jobs like it.

Written by AI from the job title and company, not by ICF, so some details may not match this job. The employer's own page has the real description.

Job Overview

ICF is seeking a highly skilled Senior Data Engineer with proficiency in Scala to join our dynamic team in a remote capacity. The successful candidate will play a crucial role in architecting, developing, and maintaining efficient data pipelines and solutions to support analytical insights and business operations. This position requires collaboration with cross-functional teams to implement data models and ensure the integrity and availability of data across various platforms, enabling ICF to harness the power of data effectively.

Job Responsibilities

• Design, develop, and optimize data pipelines using Scala for processing large datasets.
• Implement and maintain ETL processes and data integration workflows to support analytics and reporting initiatives.
• Collaborate with data scientists and analysts to understand data requirements and transform raw data into usable formats.
• Ensure data accuracy and quality through rigorous testing and validation processes.
• Monitor and troubleshoot data pipeline performance issues, implementing solutions to facilitate continuous improvement.
• Document data flows, architecture, and processes to ensure transparency and facilitate knowledge sharing.
• Research and implement new data technologies and frameworks to improve data processing capabilities.
• Mentor junior data engineers and assist with their professional development.

Qualifications

• Bachelor's degree in Computer Science, Engineering, Information Technology, or a related field.
• Minimum of 5 years of experience in data engineering, with a strong focus on Scala and related technologies.
• Proficient in data modeling, ETL processes, and data warehousing concepts.
• Experience with cloud platforms such as AWS, Azure, or Google Cloud.
• Familiarity with Apache Spark and distributed computing concepts.
• Strong SQL skills and experience with database technologies like PostgreSQL, MySQL, or similar.
• Excellent analytical and problem-solving skills, with an emphasis on attention to detail.
• Effective communication and collaboration skills to work with cross-functional teams.

Technologies & Tools

This position will utilize a range of technologies and tools, including Scala for data pipeline development, Apache Spark for distributed data processing, relational databases such as PostgreSQL, and cloud services like AWS or Azure for deployment and scalability. Familiarity with data visualization tools and scripting languages such as Python or R will be advantageous in supporting analytics and reporting tasks.

Ideal Candidates

The ideal candidate is a proactive and analytical individual who thrives in a collaborative environment and has a passion for data engineering. They possess strong technical skills and are eager to tackle complex data challenges while adhering to best practices. A commitment to continuous learning, adaptability to changing technologies, and an ability to mentor less experienced team members will enhance their fit within our innovative team at ICF.