Platform Architect (AWS+Databricks)

This job was posted over 30 days ago, so it has most likely closed. See newer jobs like it.

Written by AI from the job title and company, not by Vantedge Search, so some details may not match this job. The employer's own page has the real description.

Job Overview

The Platform Architect (AWS+Databricks) at Vantedge Search is responsible for designing, implementing, and maintaining scalable and high-performance data architecture solutions tailored for cloud-based environments. This role involves working closely with cross-functional teams to ensure the effective integration and deployment of AWS and Databricks technologies, facilitating data-driven decision-making to support the organization’s objectives. The successful candidate will leverage their deep understanding of cloud infrastructure, data engineering practices, and best architectural practices to drive innovative solutions and improve operational efficiency.

Job Responsibilities

• Design and architect scalable data solutions leveraging AWS and Databricks platforms.
• Collaborate with data engineering and analytics teams to optimize data pipelines and workflows.
• Evaluate and implement new technologies that enhance cloud architecture capabilities.
• Develop and enforce data governance policies and best practices to ensure data quality and security.
• Provide technical guidance and mentorship to junior engineers and architects.
• Monitor system performance and troubleshoot issues to maintain high availability and reliability.
• Work with stakeholders to translate business requirements into technical specifications.

Qualifications

• Bachelor's degree in Computer Science, Information Technology, or a related field; Master's degree preferred.
• Minimum of 5 years of experience in cloud architecture, preferably with AWS.
• Strong expertise in Databricks, Apache Spark, and related data processing technologies.
• Proficiency in cloud-based services such as AWS S3, Lambda, and Redshift.
• Experience in designing and implementing data integration and ETL processes.
• Knowledge of programming languages such as Python, Scala, or Java.
• Familiarity with containerization technologies like Docker and orchestration tools like Kubernetes is a plus.

Technologies & Tools

The Platform Architect will work extensively with Amazon Web Services (AWS), Databricks, Apache Spark, and various data management tools. Familiarity with container orchestration tools like Kubernetes, programming languages such as Python or Scala, and data integration solutions will be essential. Additional exposure to CI/CD pipelines and DevOps practices will further enhance the effectiveness in this role, ensuring seamless integration and delivery of architecture solutions.

Ideal Candidates

The ideal candidates for the Platform Architect position will exhibit strong analytical and problem-solving skills, along with a keen attention to detail. They should be proactive, adaptable, and possess excellent communication abilities, enabling them to work effectively in a collaborative environment. A passion for technology and continuous improvement, combined with the ability to translate complex technical concepts to non-technical stakeholders, will distinguish successful candidates in this role. Strong leadership qualities and a commitment to fostering a positive workplace culture are also essential attributes.