Remote Opportunity: Sr. Big Data Engineer with Cloud

This job was posted over 30 days ago, so it has most likely closed. See newer jobs like it.

Written by AI from the job title and company, not by SPAR Information Systems LLC, so some details may not match this job. The employer's own page has the real description.

Position Overview

The Sr. Big Data Engineer with Cloud at SPAR Information Systems LLC will be responsible for designing, implementing, and maintaining robust data architectures and solutions that support the processing and analysis of large datasets in a cloud environment. This role demands expertise in building scalable data pipelines and frameworks while collaborating with cross-functional teams to push the boundaries of data-driven insights. The successful candidate will utilize their knowledge of big data technologies to ensure high performance and reliability in our data processing efforts.

Job Responsibilities

• Design and develop efficient data pipelines to ingest, process, and store large volumes of data from diverse sources.
• Implement big data architectures leveraging cloud platforms (AWS, Azure, or Google Cloud).
• Utilize data modeling techniques to create schemas that support analytical needs.
• Work alongside data scientists and analysts to understand data requirements and iterate on solutions.
• Monitor and optimize data processing tasks for performance and reliability.
• Develop custom ETL processes and automate data workflows for operational efficiency.
• Analyze and resolve issues within the data platforms and recommend improvements.
• Ensure data governance, security, and compliance within all data operations.

Qualifications

• Bachelor's degree in Computer Science, Information Technology, or a related field; a Master's degree is a plus.
• 5+ years of experience in big data engineering or similar roles.
• Strong expertise with big data technologies such as Apache Hadoop, Apache Spark, and Kafka.
• Proficient in programming languages such as Java, Python, or Scala.
• Extensive experience with cloud platforms, particularly AWS, Azure, or Google Cloud.
• Solid understanding of database systems including SQL and NoSQL databases.
• Familiarity with data warehousing concepts and tools.
• Effective communication and collaboration skills for teamwork and project discussions.

Technologies & Tools

In this position, the Sr. Big Data Engineer will work extensively with a variety of technologies and tools, including but not limited to Apache Hadoop, Apache Spark, Kafka, SQL and NoSQL databases (such as MongoDB and Cassandra), and cloud services from providers like AWS, Azure, or Google Cloud. The role may also involve the use of containerization technologies such as Docker and orchestration tools like Kubernetes for deploying big data applications.

Ideal Candidates

The ideal candidate for the Sr. Big Data Engineer role will possess a strong analytical mindset combined with a problem-solving attitude. They will thrive in a fast-paced remote work environment, demonstrating great attention to detail and the ability to adapt to changing technologies and requirements. A collaborative spirit, eagerness to learn, and a proactive approach to tackling challenges are essential traits that will contribute to their success in this role at SPAR Information Systems LLC.