Databricks Engineers

This job was posted over 30 days ago, so it has most likely closed. See newer jobs like it.

Written by AI from the job title and company, not by Syntricate Technologies, so some details may not match this job. The employer's own page has the real description.

Job Overview

As a Databricks Engineer at Syntricate Technologies, you will be responsible for designing, implementing, and optimizing data processing pipelines and analytics solutions on the Databricks platform. You will collaborate closely with cross-functional teams to ensure seamless data integration, support data-driven decision-making, and drive innovative analytics solutions that meet the evolving needs of our organization. Your expertise will be essential in utilizing cloud technologies to enhance data solutions and improve operational efficiency.

Job Responsibilities

• Design and implement scalable data pipelines on Databricks to support business intelligence and analytical reporting.
• Optimize Spark jobs and manage Spark clusters to enhance performance and cost efficiency.
• Collaborate with data scientists and analysts to enable advanced analytics and machine learning projects.
• Implement data governance and security best practices to ensure data integrity and compliance.
• Produce technical documentation for data processing methodologies and workflows.
• Participate in code reviews, providing constructive feedback to enhance quality and maintainability of the codebase.
• Monitor and troubleshoot data pipeline performance issues, providing timely resolutions.

Qualifications

• Bachelor's degree in Computer Science, Information Technology, or a related field.
• 4+ years of experience in data engineering, with a focus on the Databricks platform.
• Proficiency in Apache Spark, with a strong understanding of Spark optimization techniques.
• Experience with SQL, Python, or Scala programming languages.
• Familiarity with cloud platforms such as AWS, Azure, or Google Cloud.
• Knowledge of data warehousing solutions and ETL processes.
• Strong analytical skills and problem-solving abilities.

Technologies & Tools

The Databricks Engineer position primarily utilizes Databricks for data processing and analytics, along with other technologies and tools such as Apache Spark for big data processing, SQL for querying databases, and Python or Scala for developing data pipelines. Familiarity with cloud platforms like AWS or Azure will also be essential, as well as experience with data visualization tools such as Tableau or Power BI to enhance the analytics capabilities of the organization.

Ideal Candidates

The ideal candidates for this position will possess a strong analytical mindset coupled with an innovative approach to problem-solving. They should demonstrate excellent communication skills, enabling effective collaboration with diverse teams. A proactive attitude, along with a desire to continuously learn and adapt within a dynamic environment, will further distinguish successful candidates. Strong attention to detail and a passion for leveraging data to drive business outcomes are essential characteristics for excelling in this role.