AWS Databricks Cloud Data Engineer - Remote - 1960

This job was posted over 30 days ago, so it has most likely closed. See newer jobs like it.

Written by AI from the job title and company, not by Cyrten, so some details may not match this job. The employer's own page has the real description.

Job Overview

The AWS Databricks Cloud Data Engineer at Cyrten will play a critical role in architecting and implementing data pipelines, ensuring data integrity, and optimizing data storage solutions in the cloud environment. This position requires a proficient understanding of AWS and Databricks technologies, with additional responsibilities that include collaborating with data scientists, analysts, and other stakeholders to streamline data processes and deliver actionable insights. The role is fully remote, presenting an opportunity to work in a dynamic environment while contributing to strategic data projects.

Job Responsibilities

• Design, develop, and implement scalable data processing pipelines using AWS services and Databricks.
• Ensure data quality, integrity, and security across all data management processes.
• Collaborate with cross-functional teams to gather and analyze requirements for data-driven projects.
• Optimize existing data processes and recommend improvements to enhance performance and reduce costs.
• Monitor and troubleshoot data pipelines, ensuring timely data delivery and resolving issues as they arise.
• Document data architecture, processes, and systems to align with best practices and compliance standards.
• Stay current with industry trends and technologies, continuously improving skills and applying new techniques as appropriate.

Qualifications

• Bachelor's degree in Computer Science, Engineering, or a related field.
• Proven experience in cloud data engineering, specifically with AWS and Databricks.
• Strong proficiency in SQL and data modeling principles.
• Experience with ETL processes and tools, including data wrangling and transformation techniques.
• Understanding of data pipeline orchestration tools like Apache Airflow or similar.
• Familiarity with data warehousing solutions and big data technologies such as Apache Spark.
• Excellent problem-solving skills and ability to work independently in a remote team environment.

Technologies & Tools

The candidate will primarily work with Amazon Web Services (AWS) to leverage cloud storage, compute, and database services. Key tools and software include Databricks for unified data analytics, Apache Spark for large-scale data processing, and SQL for querying and managing relational databases. Additionally, knowledge of data visualization tools and ETL orchestrators will be beneficial to enhance data usability and streamline workflows.

Ideal Candidates

The ideal candidate will possess a strong analytical mindset with an eagerness to tackle complex data challenges. They should demonstrate excellent communication and collaboration skills to effectively engage with diverse teams and stakeholders. A proactive attitude towards learning and adapting to new tools and technologies is essential, along with a commitment to delivering high-quality solutions in a fast-paced environment. Exceptional time management and organizational skills will be important for balancing multiple projects and meeting deadlines.