Remote Opportunity: Sr. Big Data Engineer with Cloud Exp

This job was posted over 30 days ago, so it has most likely closed. See newer jobs like it.

Written by AI from the job title and company, not by SPAR Information Systems LLC, so some details may not match this job. The employer's own page has the real description.

Job Overview

The Senior Big Data Engineer with Cloud Experience at SPAR Information Systems LLC will be responsible for designing, implementing, and maintaining scalable data processing systems that leverage cloud technologies. The successful candidate will work closely with data scientists and business analysts to ensure data solutions align with business objectives. This role involves optimizing the data architecture, improving data quality and accessibility, and providing strategic insights to enhance operational efficiency and drive data-driven decision-making.

Job Responsibilities

• Design and implement robust, scalable, and high-performance big data pipelines.
• Collaborate with cross-functional teams to gather and analyze data requirements and specifications.
• Utilize cloud services for data storage, processing, and analysis, ensuring efficiency and cost-effectiveness.
• Optimize existing data models and ETL processes to improve performance and reliability.
• Monitor and troubleshoot data processing systems to ensure high availability and reliability.
• Conduct code reviews and provide mentorship to junior data engineers.
• Implement best practices for data governance, security, and data privacy.

Qualifications

• Bachelor’s degree in Computer Science, Engineering, or a related field; a master’s degree is a plus.
• 5+ years of experience in big data engineering and cloud technologies.
• Proficient in big data frameworks such as Hadoop, Spark, or Kafka.
• Experience with cloud platforms, including AWS, Azure, or Google Cloud Platform.
• Strong proficiency in programming languages such as Python, Java, or Scala.
• Hands-on experience with data warehousing solutions like Snowflake or Redshift.
• Knowledge of SQL and NoSQL databases for effective data management.
• Familiarity with data visualization tools and techniques is advantageous.

Technologies & Tools

The Senior Big Data Engineer will leverage a variety of technologies and tools to ensure the effective handling and processing of large datasets. Key technologies include Apache Hadoop, Apache Spark, cloud platforms (AWS, Azure, or GCP), SQL and NoSQL databases, and ETL tools. Familiarity with data orchestration tools such as Apache Airflow or similar solutions is also beneficial.

Ideal Candidates

The ideal candidate for this position possesses a strong analytical mindset, excellent problem-solving skills, and effective communication abilities. They should be innovative and adaptable, capable of thriving in a fast-paced, remote work environment. A commitment to continuous improvement and an eagerness to stay abreast of emerging technologies in the data landscape will also set the ideal candidate apart from others.