Sr Data Engineer - Remote

This job was posted over 30 days ago, so it has most likely closed. See newer jobs like it.

Written by AI from the job title and company, not by NiSource, so some details may not match this job. The employer's own page has the real description.

Job Overview

The Sr Data Engineer at NiSource will play a pivotal role in the design, development, and optimization of data pipelines and architectures. This position requires the candidate to collaborate with cross-functional teams to implement data solutions that improve data accessibility and usability, enabling the company to make informed decisions. The ideal candidate will leverage their expertise in data engineering to troubleshoot and resolve data-related issues while ensuring compliance with data governance policies.

Job Responsibilities

• Design and implement scalable data pipelines that facilitate data ingestion, transformation, and storage.
• Optimize existing data processes and pipelines for efficiency and performance improvements.
• Collaborate with data scientists and analysts to understand data requirements and deliver appropriate solutions.
• Implement data governance, quality, and security protocols to ensure integrity and compliance.
• Troubleshoot and resolve data-related issues, ensuring minimal impact on operational effectiveness.
• Maintain comprehensive documentation for data architecture, including data flow diagrams and technical specifications.
• Stay current with industry best practices and emerging technologies in data engineering.

Qualifications

• Bachelor’s degree in Computer Science, Engineering, or a related field; a Master’s degree is preferred.
• Minimum of 5 years of experience in data engineering, ETL development, or a similar role.
• Proficient in programming languages such as Python, Java, or Scala.
• Strong experience with data warehousing solutions and big data technologies such as Hadoop, Spark, or Kafka.
• In-depth knowledge of SQL and experience with relational databases such as PostgreSQL or MySQL.
• Familiarity with cloud-based data services (e.g., AWS, Azure, Google Cloud Platform).
• Excellent problem-solving skills and attention to detail.
• Effective communication skills, with the ability to convey technical concepts to non-technical stakeholders.

Technologies & Tools

The Sr Data Engineer will work with a variety of technologies and tools including data warehousing solutions such as Amazon Redshift and Snowflake, big data frameworks like Apache Hadoop and Apache Spark, ETL tools, and programming languages such as Python and SQL. Familiarity with cloud platforms such as AWS, Google Cloud, or Azure is also critical for optimizing data storage and processing capabilities.

Ideal Candidates

The ideal candidates for the Sr Data Engineer position will possess a blend of technical prowess and strong analytical thinking. They should be proactive problem solvers who thrive in a collaborative environment and are capable of managing multiple priorities efficiently. A passion for data and a continuous learning attitude are essential for adapting to the evolving landscape of data engineering technologies and practices.