Sr Data Engineer - Remote

This job was posted over 30 days ago, so it has most likely closed. See newer jobs like it.

Written by AI from the job title and company, not by NiSource, so some details may not match this job. The employer's own page has the real description.

Job Overview

The Senior Data Engineer at NiSource will play a critical role in the design, development, and implementation of scalable data solutions that support our data analytics and business intelligence efforts. This position requires a proactive individual with a strong background in data engineering, who will work collaboratively with cross-functional teams to ensure data integrity, efficiency, and accessibility. The ideal candidate will be responsible for creating robust data pipelines, enhancing data architecture, and optimizing data storage solutions while adhering to best industry practices and standards.

Job Responsibilities

• Design, develop, and maintain scalable data pipelines to process large datasets from various sources.
• Ensure data integrity and reliability by implementing data validation and error-checking processes.
• Collaborate with data scientists, analysts, and other stakeholders to determine data needs and build solutions.
• Optimize existing data infrastructure and workflows to improve performance and reduce costs.
• Manage and monitor data systems for availability, performance, and security.
• Document data processes, architecture, and models to maintain knowledge continuity.
• Stay up-to-date with emerging technologies and best practices in data engineering.

Qualifications

• Bachelor's degree in Computer Science, Information Technology, or a related field.
• Minimum of 5 years of experience in data engineering or a similar role.
• Proficiency in programming languages such as Python, Java, or Scala.
• Extensive experience with data warehousing solutions and ETL tools.
• Strong familiarity with database technologies including SQL, NoSQL, and cloud-based data storage solutions.
• Knowledge of big data technologies such as Hadoop, Spark, or Kafka is desirable.
• Excellent problem-solving capabilities and attention to detail.

Technologies & Tools

In this role, the Senior Data Engineer will utilize a range of technologies and tools, including cloud platforms like AWS or Azure, data processing tools such as Apache Spark, and databases like PostgreSQL or MongoDB. Additional tools may include ETL frameworks, data visualization software, and version control systems to support collaborative development processes.

Ideal Candidates

The ideal candidate for the Senior Data Engineer position at NiSource will possess an analytical mindset with a strong aptitude for problem-solving and a deep understanding of the data lifecycle. They should exhibit excellent communication skills and the ability to work collaboratively within a team-based environment. A commitment to continuous improvement, adaptability to changing technologies, and a proactive approach to challenges will make someone a valuable asset to our team.