[Remote] Senior Data Engineer (Google Cloud Platform exp req)

This job was posted over 30 days ago, so it has most likely closed. See newer jobs like it.

Written by AI from the job title and company, not by #twiceasnice Recruiting, so some details may not match this job. The employer's own page has the real description.

Job Overview

As a Senior Data Engineer at #twiceasnice Recruiting, you will play a pivotal role in the design, build, and maintenance of data processing systems on the Google Cloud Platform (GCP). Your responsibilities will involve orchestrating data flow, ensuring data accuracy, and developing robust data infrastructure to support analytical and operational needs. You will collaborate with cross-functional teams to transform raw data into meaningful insights, leading projects aimed at optimizing data performance and reliability.

Job Responsibilities

• Design and implement data pipelines on GCP, ensuring efficient data collection and processing.
• Develop and optimize SQL and NoSQL databases for scalable access and processing of large datasets.
• Collaborate with data scientists and analysts to understand data requirements and deliver high-quality solutions.
• Monitor and troubleshoot data workflows, identifying bottlenecks and areas for improvement.
• Utilize GCP services such as BigQuery, Dataflow, and Cloud Storage to manage and analyze data.
• Document data architecture and processes, ensuring alignment with organizational best practices.
• Mentor junior data engineers, providing guidance on best practices in data engineering.

Qualifications

• Bachelor's degree in Computer Science, Engineering, or a related field; Master’s degree preferred.
• 5+ years of experience as a Data Engineer or in a similar role, with a strong emphasis on cloud-based data solutions.
• Proficiency in Google Cloud Platform (GCP) services and tools.
• Strong programming skills in Python, Java, or Scala.
• Expertise in SQL and hands-on experience with both relational and non-relational database systems.
• Knowledge of data warehousing concepts and ETL frameworks.
• Familiarity with data visualization tools and techniques is a plus.

Technologies & Tools

This position will utilize a variety of technologies and tools within the Google Cloud Platform ecosystem. Key systems will include BigQuery for data analysis, Cloud Dataflow for streamlining ETL processes, and Cloud Storage for data management. In addition to GCP tools, proficiency in programming languages such as Python and SQL will be essential for scripting and querying data efficiently.

Ideal Candidates

The ideal candidate for this position is someone who is passionate about data engineering and possesses a strong analytical mindset. They should exhibit excellent problem-solving skills and the ability to work independently while managing multiple projects simultaneously. Effective communication skills and a collaborative spirit are crucial, as the role requires frequent interaction with team members across various departments. A proactive approach to learning new technologies and processes will set you apart as a strong candidate for our innovative team.