Devops Big data architect Remote(Spark, Python, Snowflake)/Oaklnad, CA

This job was posted over 30 days ago, so it has most likely closed. See newer jobs like it.

Written by AI from the job title and company, not by Radiansys Inc., so some details may not match this job. The employer's own page has the real description.

Overview

The DevOps Big Data Architect will play a critical role in transforming how Radiansys Inc. leverages big data to enhance its capabilities and offerings. This position requires a blend of strong technical skills in Spark, Python, and Snowflake, along with a deep understanding of DevOps principles and practices. The successful candidate will be responsible for designing and implementing scalable big data architectures, ensuring high performance and availability, and fostering a robust data pipeline that supports business intelligence initiatives. Collaboration with cross-functional teams to drive innovative solutions will be essential to achieving business objectives.

Job Responsibilities

• Design and implement scalable big data architectures using Spark, Python, and Snowflake.
• Lead the deployment of data solutions across on-premises and cloud-based environments.
• Develop and maintain automated CI/CD pipelines for big data applications.
• Collaborate with data scientists and analysts to establish data requirements and specifications.
• Monitor and optimize the performance of big data systems and workflows.
• Provide technical guidance and mentorship to junior team members.
• Ensure data security and compliance with organizational policies and regulations.
• Continuously evaluate emerging technologies to enhance big data solutions.

Qualifications

• Bachelor’s degree in Computer Science, Information Technology, or a related field; Master’s degree preferred.
• Minimum of 5 years of experience in data engineering or architecture, with a focus on big data solutions.
• Proficient in programming languages such as Python, with a strong understanding of Spark.
• Experience with Snowflake and its ecosystem.
• Strong knowledge of DevOps methodologies, CI/CD automation, and container orchestration (e.g., Docker, Kubernetes).
• Familiarity with cloud platforms, such as AWS, Azure, or Google Cloud.
• Excellent problem-solving skills and ability to work in a fast-paced environment.
• Strong verbal and written communication skills.

Technologies & Tools

The DevOps Big Data Architect role involves working with a variety of technologies and tools essential for building and maintaining big data solutions. Key technologies include Apache Spark for large-scale data processing, Python as the primary programming language for data manipulation and analytics, and Snowflake for cloud-based data warehousing. Additionally, familiarity with DevOps toolchains such as Jenkins, Git, and Terraform, along with cloud services like AWS or Azure, will be crucial to success in this position.

Ideal Candidates

Ideal candidates for this position will possess a strong blend of technical expertise and problem-solving ability, complemented by a collaborative mindset. They should demonstrate a passion for data and a commitment to continuous learning, enabling them to stay ahead of industry trends. Candidates with excellent communication skills will excel in this role, as the ability to articulate complex concepts to non-technical stakeholders is essential. An innovative thinker, the perfect fit will have the resilience and adaptability to thrive in a dynamic work environment.