Data Platform Engineer with Databricks

This job was posted over 30 days ago, so it has most likely closed. See newer jobs like it.

Written by AI from the job title and company, not by Peritus Inc, so some details may not match this job. The employer's own page has the real description.

Job Overview

The Data Platform Engineer with Databricks at Peritus Inc. will play a pivotal role in designing, implementing, maintaining, and optimizing our data platform solutions. This position involves leveraging advanced technologies to build scalable data integrations and pipelines, ensuring efficient processing and accessibility of data across various departmental applications. The selected candidate will collaborate closely with data scientists, analysts, and other stakeholders to drive data-driven decision-making within the organization while ensuring data integrity and security standards are maintained.

Job Responsibilities

• Design, develop, and manage data pipelines and ETL processes using Databricks and Apache Spark.
• Optimize data storage solutions and ensure data quality across all platforms.
• Collaborate with data scientists and analysts to transform raw data into insightful analytical datasets.
• Implement robust data governance and security measures to protect sensitive information.
• Monitor system performance and troubleshoot data-related issues to ensure the smooth operation of data applications.
• Stay updated with the latest industry trends, tools, and technologies to continually enhance the data platform.

Qualifications

• Bachelor's degree in Computer Science, Information Technology, or a related field.
• Proven experience in data engineering, with a minimum of 3 years working with Databricks and Apache Spark.
• Strong proficiency in SQL and programming languages such as Python or Scala.
• Experience in cloud platforms (AWS, Azure, GCP) and data warehousing solutions.
• Solid understanding of data modeling, ETL processes, and data governance practices.
• Excellent problem-solving skills and attention to detail.

Technologies & Tools

The Data Platform Engineer will utilize a range of advanced technologies and tools, including Databricks, Apache Spark, SQL databases, cloud platforms such as AWS or Azure, and various data integration and ETL tools. Familiarity with data visualization tools and data lakes is also desirable to effectively present and manage data.

Ideal Candidates

Ideal candidates for the Data Platform Engineer position should possess a strong technical background alongside excellent communication and collaboration skills. They should demonstrate a proactive and innovative mindset, continuously seeking ways to enhance data processes and solutions. A strong analytical mindset, coupled with the ability to work under pressure and meet tight deadlines, will set them apart as exemplary contributors to the Peritus team.