[Remote] Senior Data Engineer (Google Cloud Platform exp req)

This job was posted over 30 days ago, so it has most likely closed. See newer jobs like it.

Written by AI from the job title and company, not by #twiceasnice Recruiting, so some details may not match this job. The employer's own page has the real description.

Job Overview

As a Senior Data Engineer at #twiceasnice Recruiting, you will leverage your expertise in Google Cloud Platform to design, build, and maintain robust data pipelines and architectures that facilitate data-driven decision-making across the organization. Your primary focus will be on ensuring data quality, optimizing data processing solutions, and collaborating with cross-functional teams to implement scalable data solutions that meet the strategic objectives of the company.

Job Responsibilities

• Design, build, and maintain scalable data pipelines and ETL processes using Google Cloud Platform tools.
• Collaborate with data scientists and analysts to understand data requirements and deliver data solutions that meet their needs.
• Monitor and optimize data processes for performance, reliability, and cost efficiency.
• Implement best practices for data management, governance, and security.
• Develop and maintain documentation for data architectures, processes, and pipelines.
• Engage in code reviews and contribute to team knowledge sharing and mentorship.
• Stay up-to-date with industry trends and emerging technologies in data engineering and cloud computing.

Qualifications

• Bachelor's degree in Computer Science, Engineering, or a related field.
• Minimum of 5 years of experience in data engineering with a focus on Google Cloud Platform.
• Proficiency in programming languages such as Python, Java, or Scala.
• Experience with data modeling, ETL processes, and data warehousing solutions.
• Strong knowledge of Google Cloud services, including BigQuery, Dataflow, and Pub/Sub.
• Familiarity with Linux-based environments and version control systems (e.g., Git).
• Excellent problem-solving skills and the ability to work independently as well as part of a team.

Technologies & Tools

In this role, you will work with a range of technologies and tools, primarily focusing on Google Cloud Platform offerings such as BigQuery, Dataflow, Dataproc, Cloud Storage, and Pub/Sub. Additional tools may include Apache Kafka for real-time data processing, and Airflow for orchestration of data workflows. Familiarity with containerization technologies like Docker and orchestration platforms such as Kubernetes will be beneficial.

Ideal Candidates

The ideal candidate for this position will possess a strong analytical mindset and a passion for data. You should be detail-oriented, with a commitment to quality and a proactive approach to problem-solving. Excellent communication skills and the ability to collaborate effectively with various stakeholders are essential. A desire to continuously learn and adapt in the fast-evolving landscape of data engineering and cloud technologies will distinguish you as an exceptional fit for our team.