Sr Data Engineer - Remote

This job was posted over 30 days ago, so it has most likely closed. See newer jobs like it.

Written by AI from the job title and company, not by NiSource, so some details may not match this job. The employer's own page has the real description.

Position Overview

The Senior Data Engineer at NiSource will be responsible for designing, developing, and maintaining scalable data pipelines and systems that enable efficient data processing and analytics. This role involves collaborating with cross-functional teams to understand data requirements, implementing data architecture principles, and ensuring data quality and integrity. The ideal candidate will leverage their expertise in data engineering to enhance data-driven decision-making while promoting best practices in data governance and architecture.

Job Responsibilities

• Design and implement robust data pipelines for the collection, storage, and processing of large datasets.
• Collaborate with data analysts and data scientists to facilitate access to data and develop data products.
• Ensure data quality and reliability through data validation techniques and monitoring systems.
• Maintain and improve existing data infrastructure while exploring new technologies for data storage and processing.
• Develop ETL processes to support business requirements and analytics initiatives.
• Document data workflows and maintain metadata for compliance and governance purposes.
• Mentor junior engineers and provide guidance on best practices in data engineering.

Qualifications

• Bachelor's degree in Computer Science, Data Engineering, or a related field; Master’s degree preferred.
• Minimum of 5 years of experience in data engineering or a related role.
• Proficient in programming languages such as Python, Java, or Scala.
• Extensive experience with cloud platforms (e.g., AWS, Azure, Google Cloud) and their data services.
• Strong understanding of data modeling, ETL processes, and data pipeline orchestration.
• Experience with SQL and NoSQL databases (e.g., PostgreSQL, MongoDB, Cassandra).
• Familiarity with big data technologies such as Apache Spark, Hadoop, or Kafka is preferred.
• Knowledge of data governance and data security practices.

Technologies & Tools

The Senior Data Engineer position utilizes a variety of technologies and tools to manage and manipulate data effectively. Proficiency in data warehousing solutions, data processing frameworks, and cloud computing platforms is essential. In addition, familiarity with orchestration tools such as Apache Airflow, and knowledge of containerization technologies (e.g., Docker, Kubernetes) are advantageous for streamlining data workflows.

Ideal Candidates

Ideal candidates for the Senior Data Engineer role at NiSource will possess a strong analytical mindset and problem-solving skills, enabling them to navigate complex data challenges effectively. They should exhibit a profound commitment to data integrity, governance, and best practices while showcasing exceptional communication skills to collaborate with diverse teams. A proactive attitude towards continuous learning and adapting to emerging technologies will distinguish the best candidates in this evolving field.