Databricks Architect

About Our Client:

The organization is a technology services company focused on delivering IT and data solutions to clients across various industries. It addresses challenges in implementing modern technology by providing expertise in data engineering and IT services. The team emphasizes collaboration and career growth within a remote work environment.

About the Opportunity:

The DATABRICKS ARCHITECT role is centered on designing and maintaining scalable data pipelines using Databricks and Apache Spark. This position is responsible for building optimized ETL/ELT workflows, managing Databricks clusters, and ensuring data reliability through Delta Lake architecture. The role supports data-driven decision-making by collaborating with data scientists, analysts, and business stakeholders, and contributes to efficient data integration across cloud platforms.

Responsibilities:

• Design, develop, and maintain scalable data pipelines using Databricks and Apache Spark
• Build and optimize ETL/ELT workflows for data ingestion, transformation, and delivery
• Collaborate with data scientists, analysts, and business stakeholders to deliver solutions
• Manage and monitor Databricks clusters, notebooks, and job scheduling for performance and cost efficiency
• Implement Delta Lake architecture and best practices for data reliability and governance
• Integrate Databricks with cloud platforms such as AWS, Azure, or GCP and enterprise data sources
• Troubleshoot and resolve data pipeline issues to ensure high availability and data quality

Requirements:

• Proven experience as a Databricks Engineer or Data Engineer with hands-on Databricks platform expertise
• Strong proficiency in Apache Spark, PySpark, and SQL
• Experience with Delta Lake, Lakehouse architecture, and data modeling
• Familiarity with cloud platforms (AWS, Azure, or GCP) and cloud-native data services
• Experience building and managing ETL/ELT pipelines at scale
• Knowledge of Python, Scala, or other relevant programming languages
• Strong problem-solving skills and ability to work collaboratively in a fast-paced environment

Pay Range and Compensation Package:

• The pay range and compensation package for this role will be determined based on the candidate's experience, skills, and other relevant factors.

Equal Opportunity Statement: Our client is an equal opportunity employer. They celebrate diversity and are committed to creating an inclusive environment for all employees. All qualified applicants will receive consideration for employment without regard to race, color, religion, gender, gender identity or expression, sexual orientation, or national origin.

Note:

RemoteHunter is a recruitment partner of this role. Please note that all employment decisions, including candidate assessment, interviews, hiring, compensation, and employment terms, are made exclusively by the hiring employer.