Sr Data Engineer - Remote

This job was posted over 30 days ago, so it has most likely closed. See newer jobs like it.

Written by AI from the job title and company, not by NiSource, so some details may not match this job. The employer's own page has the real description.

Job Overview

The Senior Data Engineer at NiSource plays a crucial role in the design, construction, integration, and management of data pipelines and databases that support the organization’s analytics and business intelligence needs. This position involves collaborating with cross-functional teams to identify data requirements and ensure the efficient processing and availability of high-quality data. The Senior Data Engineer will be responsible for implementing data integrations, optimizing data flows, and providing support for data extraction, transformation, and loading (ETL) processes that enable the organization to make data-driven decisions.

Job Responsibilities

• Design, build, and maintain scalable data pipelines that enable efficient data processing and analytics.
• Collaborate with data architects, analysts, and business stakeholders to gather requirements and translate them into technical specifications.
• Implement and manage data integration processes for sourcing data from multiple systems.
• Optimize existing data pipelines to improve performance and reduce costs.
• Ensure data quality and integrity through validation and testing methodologies.
• Monitor and troubleshoot data pipeline issues, ensuring minimal downtime and disruption.
• Stay up-to-date with industry trends and best practices in data engineering and recommend innovations.

Qualifications

• Bachelor's degree in Computer Science, Information Technology, Data Science, or a related field.
• 5+ years of experience in data engineering or a related role, with proven experience managing large datasets.
• Strong proficiency in SQL and database management systems such as MySQL, PostgreSQL, or Microsoft SQL Server.
• Experience with data warehousing concepts and technologies (e.g., Snowflake, Amazon Redshift).
• Proficiency in programming languages such as Python, Java, or Scala.
• Familiarity with ETL tools and frameworks, such as Apache NiFi, Talend, or Informatica.
• Solid understanding of cloud platforms (AWS, Google Cloud, Azure) and their data services.
• Strong analytical and problem-solving skills, with the ability to communicate complex concepts clearly.

Technologies & Tools

The Senior Data Engineer will work with a variety of technologies and tools, including but not limited to SQL-based databases, cloud platforms such as AWS or Azure, ETL tools like Apache NiFi or Informatica, and programming languages including Python and Java. Familiarity with data visualization tools and frameworks is also beneficial to support collaborative reporting efforts with business stakeholders.

Ideal Candidates

Ideal candidates for the Senior Data Engineer position at NiSource will possess a strong blend of technical expertise and interpersonal skills. They should exhibit a passion for data and a commitment to quality and efficiency. Strong communicators who can articulate technical concepts to non-technical stakeholders will thrive in this role. Additionally, individuals who demonstrate adaptability, critical thinking, and innovative problem-solving abilities will contribute significantly to the team's success and support the organization's goals.