Remote Opportunity: Sr. Big Data Engineer with Cloud Exp

This job was posted over 30 days ago, so it has most likely closed. See newer jobs like it.

Written by AI from the job title and company, not by SPAR Information Systems LLC, so some details may not match this job. The employer's own page has the real description.

Job Overview

SPAR Information Systems LLC is seeking a highly skilled and experienced Senior Big Data Engineer with Cloud Experience to join our dynamic team. In this remote role, the successful candidate will be responsible for designing, implementing, and maintaining robust data infrastructure and solutions. The engineer will work closely with cross-functional teams to leverage big data technologies and cloud services, ensuring scalability, reliability, and performance of data pipelines and architectures that align with our analytical needs and business objectives.

Job Responsibilities

• Design and implement scalable big data solutions using cloud infrastructure.
• Develop, maintain, and optimize data pipelines to ingest, process, and analyze large datasets.
• Collaborate with data scientists and analysts to understand data requirements and support analytical initiatives.
• Ensure data quality, governance, and security throughout the data lifecycle.
• Monitor and troubleshoot performance issues related to big data solutions and cloud environments.
• Stay current with evolving technologies and best practices in big data and cloud computing.
• Document architecture, design specifications, and operational procedures.

Qualifications

• Bachelor’s degree in Computer Science, Information Technology, or a related field; Master’s degree preferred.
• Minimum of 5 years of experience as a Big Data Engineer or in a similar technical role.
• Extensive knowledge of big data frameworks such as Hadoop, Spark, or Kafka.
• Experience with cloud platforms (AWS, Azure, GCP) and their big data services.
• Proficient in programming languages such as Java, Python, or Scala.
• Strong understanding of database systems including SQL and NoSQL databases.
• Excellent problem-solving and analytical skills with a strong attention to detail.

Technologies & Tools

The Senior Big Data Engineer will be utilizing a variety of technologies and tools, including but not limited to Apache Hadoop, Apache Spark, Apache Kafka, cloud platforms such as Amazon Web Services (AWS) and Google Cloud Platform (GCP), database technologies including SQL and NoSQL solutions like MongoDB and Cassandra, and data modeling tools. Familiarity with data orchestration tools such as Apache Airflow and containerization technologies like Docker may also be beneficial.

Ideal Candidates

The ideal candidate for this position should exhibit strong analytical skills, a deep understanding of big data technologies and cloud computing, and a passion for leveraging data to drive business outcomes. Candidates must possess excellent communication skills and the ability to work collaboratively in a team environment. A proactive attitude toward learning new techniques and technologies, along with a commitment to delivering high-quality solutions in a fast-paced environment, will be essential for success in this role.