Sr Data Engineer - Remote

This job was posted over 30 days ago, so it has most likely closed. See newer jobs like it.

Written by AI from the job title and company, not by NiSource, so some details may not match this job. The employer's own page has the real description.

Job Overview

The Senior Data Engineer at NiSource will play a vital role in the organization by designing, building, and maintaining scalable data pipelines and architectures that facilitate the collection, storage, and processing of data. This remote position demands a proactive individual capable of collaborating with cross-functional teams to implement data-driven solutions tailored to meet organizational goals. The successful candidate will be instrumental in optimizing data processes and ensuring the reliability and performance of data systems.

Job Responsibilities

• Develop and implement robust data pipelines that handle large volumes of data efficiently and accurately.
• Collaborate with data scientists and analysts to understand data needs and optimize the flow of information.
• Design and maintain ETL processes for data ingestion, transformation, and loading into data warehouses.
• Ensure data quality and integrity by implementing monitoring and monitoring standards.
• Work closely with IT and software development teams to integrate data solutions with existing systems.
• Document data pipelines, processes, and architecture for internal knowledge sharing.
• Identify opportunities for process improvement and cost optimization related to data handling.

Qualifications

• Bachelor's degree in Computer Science, Information Technology, or a related field; Master’s degree preferred.
• Minimum of 5 years of experience in data engineering or related roles.
• Proficient in SQL and scripting languages such as Python or Java.
• Experience with data warehousing solutions and architectures, such as Snowflake or AWS Redshift.
• Familiarity with big data technologies such as Hadoop, Spark, or similar frameworks.
• Understanding of data modeling concepts and data governance practices.
• Excellent problem-solving skills and ability to work in a fast-paced environment.

Technologies & Tools

The Senior Data Engineer will leverage a variety of technologies and tools to execute their responsibilities effectively. This includes, but is not limited to, data warehousing solutions such as Amazon Redshift, ETL tools like Apache NiFi or Talend, big data frameworks such as Apache Hadoop and Spark, as well as cloud platforms including AWS or Azure. Familiarity with containerization technologies like Docker and orchestration tools like Kubernetes will also be beneficial to ensure efficient deployment and management of data pipelines.

Ideal Candidates

An ideal candidate for the Senior Data Engineer position at NiSource will possess not only the technical expertise but also a keen analytical mindset and a passion for data. They should exhibit strong communication skills to engage with various stakeholders, showcasing their ability to translate complex data concepts into actionable insights. A self-motivated individual who thrives in collaborative environments, embraces challenges, and demonstrates a continuous drive to learn and innovate will excel in this role.