Senior Data Platform Engineer- Remote

This job was posted over 30 days ago, so it has most likely closed. See newer jobs like it.

Written by AI from the job title and company, not by Energy Jobline, so some details may not match this job. The employer's own page has the real description.

Job Overview

The Senior Data Platform Engineer at Energy Jobline will play a pivotal role in enhancing and maintaining our cutting-edge data infrastructure. This remote position calls for an experienced engineer to design, implement, and optimize data pipelines and platforms that ensure the seamless gathering and processing of large volumes of data. The ideal candidate will work closely with cross-functional teams to deliver high-quality data solutions that align with business objectives while ensuring optimal performance, scalability, and security of the data environment.

Job Responsibilities

• Design and implement scalable data architecture and pipelines to support various data-driven applications.
• Collaborate with data scientists and analysts to understand data requirements and deliver high-quality datasets.
• Monitor and optimize existing data workflows to ensure high performance and reliability.
• Develop and maintain documentation for data processes, architectures, and best practices.
• Conduct data quality assessments and troubleshoot data-related issues across multiple platforms.
• Implement security measures to safeguard sensitive data and comply with relevant regulations.
• Evaluate and recommend new technologies and tools to enhance data processing capabilities.

Qualifications

• Bachelor's or Master's degree in Computer Science, Data Engineering, or a related field.
• A minimum of 5 years of experience in data engineering or related fields.
• Proficiency in SQL and programming languages such as Python, Java, or Scala.
• Experience with cloud-based data platforms (e.g., AWS, GCP, Azure).
• Familiarity with data processing frameworks like Apache Spark or Kafka.
• Strong understanding of database management systems, ETL processes, and data warehousing concepts.
• Excellent problem-solving skills and ability to work in a fast-paced environment.

Technologies & Tools

The Senior Data Platform Engineer will work with a variety of technologies and tools to support data processing and analysis. Key technologies include cloud platforms such as Amazon Web Services (AWS) and Google Cloud Platform (GCP), data processing frameworks like Apache Spark and Apache Kafka, and database management systems such as PostgreSQL and MongoDB. Proficiency with version control systems such as Git, as well as knowledge of DevOps practices for deployment and monitoring, will be essential for success in this role.

Ideal Candidates

The ideal candidates for the Senior Data Platform Engineer position will possess a blend of technical expertise and strong interpersonal skills. They will be characterized by their analytical mindset, attention to detail, and a proactive approach to problem-solving. A commitment to continuous improvement and staying updated on the latest industry trends in data engineering is essential. Furthermore, effective communication skills and the ability to work collaboratively within cross-functional teams will be crucial for successfully contributing to the organization’s data initiatives.