Remote Opportunity: Sr. Cloud Data Engineer with Big Data Exp

This job was posted over 30 days ago, so it has most likely closed. See newer jobs like it.

Written by AI from the job title and company, not by SPAR Information Systems LLC, so some details may not match this job. The employer's own page has the real description.

Position Overview

SPAR Information Systems LLC is seeking a qualified Senior Cloud Data Engineer with a focus on Big Data technologies. The successful candidate will be responsible for designing, implementing, and maintaining advanced data solutions in a cloud environment. This role involves collaborating with cross-functional teams to enhance data processing capabilities, ensuring high data availability, and optimizing storage solutions. The ideal candidate will possess a strong analytical mindset and extensive experience in cloud data engineering, particularly in handling large-scale data solutions.

Job Responsibilities

• Design and implement robust data pipelines for ingesting, processing, and storing large volumes of data in a cloud environment.
• Collaborate with data scientists and analysts to understand data requirements and provide effective solutions.
• Ensure data integrity and security by creating and managing appropriate access controls and audit trails.
• Optimize data processing workflows to improve performance and reduce costs associated with data storage and retrieval.
• Monitor system performance and troubleshoot issues, implementing fixes as necessary.
• Document data architecture, processes, and workflows to maintain consistent data stewardship and transparency.
• Stay updated on the latest industry trends and technologies to invoke best practices in cloud data engineering.

Qualifications

• Bachelor’s degree in Computer Science, Information Technology, or a related field; Master’s degree preferred.
• Minimum of 5 years of experience in data engineering or a related field, with a significant focus on cloud technologies.
• Proven experience with major cloud platforms (AWS, Azure, or Google Cloud).
• Strong proficiency in Big Data technologies such as Apache Hadoop, Spark, and Kafka.
• Experience with data modeling, ETL processes, and data warehousing solutions.
• Solid programming skills in languages such as Python, Java, or Scala.
• Excellent knowledge of SQL and NoSQL databases.
• Strong analytical and problem-solving skills, with attention to detail.

Technologies & Tools

The Senior Cloud Data Engineer will work with a suite of cutting-edge technologies and tools, including but not limited to Apache Hadoop, Apache Spark, Amazon Web Services (AWS), Google Cloud Platform (GCP), Apache Kafka, SQL and NoSQL databases, and a variety of data visualization tools. Proficiency in DevOps practices and tools such as Docker and Kubernetes may also be utilized to ensure efficient deployment and management of data solutions.

Ideal Candidates

The ideal candidate for the Senior Cloud Data Engineer position will be an innovative thinker with a passion for data and technology. They are expected to exhibit strong communication skills, enabling them to effectively collaborate with diverse teams and stakeholders. Proactive problem-solving abilities and a result-oriented mindset are critical, along with a dedication to following best practices and continuous improvement. A desire to stay abreast of new methodologies and technological advancements in data engineering will also contribute to their success within the role.