Remote (Only W2 role) :: Data Platform Engineer with Azure Databricks and Unity Catalog. (Min 9+ year exp required) :: Seattle ,WA :: contract

This job was posted over 30 days ago, so it has most likely closed. See newer jobs like it.

Written by AI from the job title and company, not by Visionary Innovative Technology Solutions LLC, so some details may not match this job. The employer's own page has the real description.

Overview

Visionary Innovative Technology Solutions LLC is seeking a highly experienced Data Platform Engineer with a strong background in Azure Databricks and Unity Catalog. This remote role is focused on leveraging advanced analytics and data engineering techniques to design, develop, and maintain robust data platforms. The selected candidate will work closely with cross-functional teams to enhance data accessibility and usability, enabling data-driven decision-making throughout the organization.

Job Responsibilities

• Design, implement, and optimize data pipelines utilizing Azure Databricks and Unity Catalog.
• Collaborate with data scientists, analysts, and other stakeholders to understand data requirements and deliver data solutions.
• Ensure data governance and data quality practices are integrated into the data engineering processes.
• Monitor and troubleshoot data platform performance, ensuring high availability and reliability of data services.
• Develop and maintain documentation for data workflows, architecture, and best practices.
• Conduct code reviews and mentor junior engineers in best practices related to data engineering and analytics.

Qualifications

• Minimum of 9 years of experience in data engineering, data architecture, or related roles.
• Expertise in Azure Databricks and Unity Catalog.
• Strong programming skills in Python or Scala.
• Proficient in SQL and data modeling techniques.
• Experience with data warehousing solutions and big data technologies.
• Bachelor’s or higher degree in Computer Science, Information Technology, or a related field.
• Solid understanding of data governance, security, and compliance practices.

Technologies & Tools

This position requires proficiency in a variety of technologies and tools, including Azure Databricks for big data processing, Unity Catalog for data governance, and SQL for data querying. Familiarity with cloud platforms, data warehousing solutions, and programming languages such as Python and Scala is essential for this role. Additional experience with tools such as Apache Spark, Azure Data Lake, and ETL tools will be beneficial.

Ideal Candidates

The ideal candidate will possess a strong analytical mindset with a keen attention to detail and a passion for leveraging technology to drive data solutions. They will be proactive in seeking improvements to data processes and possess excellent communication skills to collaborate with diverse teams. A thorough understanding of data governance and an innovative approach to problem-solving will be essential traits for success in this role.