Sr Data Engineer - Remote

This job was posted over 30 days ago, so it has most likely closed. See newer jobs like it.

Written by AI from the job title and company, not by NiSource, so some details may not match this job. The employer's own page has the real description.

Job Overview

The Senior Data Engineer at NiSource will play a pivotal role in designing, building, and maintaining robust data infrastructures that support the organization’s analytics initiatives. This position demands a strong technical background coupled with the ability to collaborate across various teams to drive data-driven decision-making processes. The successful candidate will be responsible for optimizing data flow, developing data models, and ensuring the integrity and accessibility of data across platforms while adhering to best practices in data management and governance.

Job Responsibilities

• Design and implement scalable data processing systems to handle large volumes of data efficiently.
• Collaborate with data scientists and analysts to understand data requirements and deliver optimal solutions.
• Develop and maintain frameworks for ETL (Extract, Transform, Load) processes to ensure high-quality data delivery.
• Monitor and troubleshoot data pipeline performance, implementing necessary improvements.
• Participate in data governance initiatives to ensure compliance with data standards and best practices.
• Document processes and data flow to ensure transparency and facilitate onboarding for team members.
• Stay updated on emerging technologies and propose solutions to leverage innovations in data engineering.

Qualifications

• Bachelor’s degree in Computer Science, Data Engineering, or a related field; Master’s degree preferred.
• Minimum of 5 years of experience in data engineering, database management, or a related role.
• Proficiency in programming languages such as Python, Java, or Scala.
• Experience with relational and non-relational database systems (e.g., SQL Server, PostgreSQL, MongoDB).
• Strong knowledge of data warehousing solutions and ETL tools (e.g., Apache Airflow, Talend).
• Familiarity with cloud platforms (e.g., AWS, Azure, Google Cloud) and data lake architectures.
• Solid understanding of data modeling, data architecture, and data governance principles.

Technologies & Tools

This position will leverage a variety of technologies and tools, including but not limited to: Apache Spark for large-scale data processing, cloud services such as AWS or Azure for hosting and data storage, programming languages like Python and SQL for data manipulation and querying, and tools such as Apache Kafka for real-time data streaming. Familiarity with data visualization tools may also be beneficial in providing analytical insights.

Ideal Candidates

Ideal candidates for this position will possess a strong analytical mindset and problem-solving capabilities. They should excel in a collaborative environment, demonstrating effective communication skills that facilitate interaction with technical and non-technical stakeholders alike. A proactive approach to innovation and a passion for continuous learning are essential traits, along with an inherent ability to adapt to rapidly changing technologies and business needs.