AWS Databricks Cloud Data Engineer - Remote - 1960

This job was posted over 30 days ago, so it has most likely closed. See newer jobs like it.

Written by AI from the job title and company, not by Cyrten, so some details may not match this job. The employer's own page has the real description.

Job Overview

As an AWS Databricks Cloud Data Engineer at Cyrten, you will play a pivotal role in designing, developing, and maintaining data pipelines and architectures on the Databricks platform, leveraging AWS cloud services. You will collaborate with cross-functional teams to ensure high-quality data processing, scalability, and reliability, ultimately enabling data-driven decision-making across the organization. Your expertise will contribute to the transformation of raw data into actionable insights, driving business growth and efficiency.

Job Responsibilities

• Design and implement data pipelines in AWS using Databricks, ensuring optimal performance and scalability.
• Collaborate with data scientists and analysts to understand business requirements and translate them into technical specifications.
• Develop and maintain ETL processes that clean, transform, and load data from various sources into cloud-based data warehouses.
• Monitor data pipeline performance and troubleshoot issues to ensure data accuracy and availability.
• Optimize and maintain existing data workflows, identifying opportunities for improvement.
• Utilize AWS tools such as S3, Redshift, Glue, and Lambda to integrate with Databricks effectively.
• Document the architecture, processes, and data lineage for current and future reference.
• Stay updated on industry trends and best practices for data engineering and cloud solutions.

Qualifications

• Bachelor’s degree in Computer Science, Information Technology, or a related field.
• Minimum of 3 years of experience in data engineering, with a focus on AWS and Databricks.
• Proficient in SQL and experience with programming languages such as Python or Scala.
• Strong understanding of data modeling concepts and data warehousing principles.
• Experience with data integration tools and ETL processes.
• Familiarity with AWS services: S3, Redshift, Glue, and Lambda.
• Strong analytical and problem-solving skills.
• Excellent communication and collaboration abilities.

Technologies & Tools

The AWS Databricks Cloud Data Engineer position will utilize a variety of technologies and tools including Amazon Web Services (AWS) platform, Databricks for advanced analytics and data integration, SQL for database management, and programming languages such as Python and Scala for data processing tasks. Familiarity with tools like Apache Spark, Apache Airflow, and data visualization software will also be beneficial in executing the responsibilities associated with this role.

Ideal Candidates

The ideal candidate for the AWS Databricks Cloud Data Engineer position at Cyrten is a proactive and detail-oriented individual with a strong foundation in cloud data engineering. They demonstrate a robust analytical mindset, are passionate about data technologies, and have an aptitude for problem-solving. The best fit will possess excellent communication skills, which allow for effective collaboration within multidisciplinary teams, and a willingness to learn and adapt in a fast-paced environment.