SR. Data Platform Engineer

This job was posted over 30 days ago, so it has most likely closed. See newer jobs like it.

Written by AI from the job title and company, not by Blackapple Solutions LLC, so some details may not match this job. The employer's own page has the real description.

Overview

As a Sr. Data Platform Engineer at Blackapple Solutions LLC, you will play a critical role in designing, implementing, and optimizing robust data architectures aimed at supporting advanced analytics and business intelligence initiatives. Your expertise will guide the integration of diverse data sources while ensuring scalability, reliability, and performance of data systems. You will collaborate with cross-functional teams to identify user needs, develop data models, and promote best practices governing data management, ensuring that our data platform adheres to the highest standards of quality and security.

Job Responsibilities

• Design and implement scalable and efficient data pipelines and workflows that integrate various data sources.
• Manage and optimize data storage solutions, ensuring high availability and performance.
• Collaborate with data scientists and business analysts to understand data needs and provide actionable insights.
• Monitor and maintain data integrity, security, and compliance within the platform.
• Develop and implement data governance practices to ensure consistency and accuracy of data.
• Stay updated on the latest industry trends and technologies related to data engineering and analytics.
• Troubleshoot and resolve data-related issues as they arise, providing timely support to stakeholders.

Qualifications

• Bachelor's degree in Computer Science, Information Technology, or a related field; Master’s degree preferred.
• Minimum of 5 years of experience in data engineering, with a strong emphasis on data platform development.
• Proficiency in programming languages such as Python, Java, or Scala.
• Extensive experience with data warehousing solutions (e.g., AWS Redshift, Google BigQuery).
• Familiarity with ETL tools and data integration technologies (e.g., Apache Kafka, Talend, Apache NiFi).
• Strong understanding of database technologies (e.g., SQL, NoSQL) and data modeling principles.
• Proven experience with cloud platforms (e.g., AWS, Azure, GCP) in data-related roles.
• Excellent problem-solving skills and ability to work in a collaborative team environment.

Technologies & Tools

In this role, you will leverage a variety of technologies and tools to develop and maintain the data platform. Some of the key technologies include relational and NoSQL databases such as PostgreSQL and MongoDB, data processing frameworks like Apache Spark, and cloud services including AWS and Google Cloud Platform. Additional tools may include Apache Airflow for workflow management and various monitoring tools to ensure optimal system performance and reliability.

Ideal Candidates

The ideal candidates for the Sr. Data Platform Engineer position possess strong analytical skills and an unwavering commitment to detail. They demonstrate the ability to work proactively in a fast-paced environment, communicating effectively with both technical and non-technical stakeholders. Exceptional problem-solving abilities, a keen interest in continuous learning, and staying abreast of industry innovations are key traits, along with a collaborative spirit that fosters teamwork and creativity within the organization.