Certified data bricks Senior Data Engineer

This job was posted over 30 days ago, so it has most likely closed. See newer jobs like it.

Written by AI from the job title and company, not by Rackera Inc, so some details may not match this job. The employer's own page has the real description.

Job Overview

Rackera Inc. is seeking a Certified Data Bricks Senior Data Engineer to join our innovative team. The ideal candidate will be responsible for designing and implementing scalable data pipelines, optimizing ETL processes, and ensuring high-quality data delivery for analytics and reporting. The selected individual will drive the evolution of our data architecture and collaborate closely with data scientists and analysts to support data-driven decision-making across the organization. Strong expertise in Databricks and data engineering best practices will be essential to succeed in this role.

Job Responsibilities

• Design, develop, and maintain data pipelines using Databricks and Apache Spark.
• Implement ETL processes to ensure data integrity and efficiency.
• Collaborate with data scientists to develop models and algorithms based on complex datasets.
• Optimize data workflows and performance for improved data retrieval and processing speeds.
• Manage data storage solutions and ensure best practices are followed for data security and governance.
• Conduct data analysis and provide insights to support strategic initiatives across the business.
• Document data pipeline architectures and processes to ensure clarity and knowledge sharing across the team.
• Stay updated on emerging trends in data engineering and analytics to recommend improvements and innovations.

Qualifications

• Bachelor’s degree in Computer Science, Information Technology, or a related field.
• Minimum of 5 years of experience in data engineering or a related capacity.
• Certification in Databricks or equivalent platforms is required.
• Strong proficiency in SQL and Python for data manipulation and scripting.
• Experience with data modeling, data warehousing concepts, and ETL tools.
• Familiarity with cloud platforms such as AWS, Azure, or Google Cloud.
• Excellent analytical skills with the ability to work with complex datasets.
• Prior experience with data visualization tools is a plus.

Technologies & Tools

In this role, the candidate will work extensively with Databricks and Apache Spark, leveraging their capabilities for data processing and real-time analytics. Familiarity with SQL databases, cloud computing platforms (such as AWS or Azure), and various ETL tools will be crucial. Additionally, data modeling software and BI tools may be utilized to support data visualization and analysis processes.

Ideal Candidates

The ideal candidate for the Certified Data Bricks Senior Data Engineer position should be a proactive and detail-oriented individual with strong problem-solving skills. They should possess excellent communication abilities to articulate technical concepts to non-technical stakeholders. A collaborative mindset is essential, as the role will involve frequent interactions with cross-functional teams. Additionally, a passion for continuous learning and staying abreast of industry advancements will be vital for driving innovation within the team.