AWS Platform Architect - Data Pipeline - REMOTE

This job was posted over 30 days ago, so it has most likely closed. See newer jobs like it.

Written by AI from the job title and company, not by Perficient, so some details may not match this job. The employer's own page has the real description.

Job Overview

The AWS Platform Architect - Data Pipeline at Perficient will be responsible for designing, implementing, and optimizing data pipeline infrastructures within the AWS ecosystem. This role requires a deep understanding of cloud technologies, big data processing, and data integration techniques to create scalable and efficient solutions. The candidate will collaborate with cross-functional teams to ensure robust data solutions that meet business requirements while maintaining the best practices in security, performance, and cost efficiency.

Job Responsibilities

• Design and architect data pipelines that leverage AWS services to manage data ingestion, transformation, and storage.
• Collaborate with data engineers, data scientists, and stakeholders to define data requirements and ensure data integrity.
• Implement best practices for data processing, including ETL (Extract, Transform, Load) processes and real-time data processing architectures.
• Optimize data flow and storage solutions to enhance performance and minimize cost.
• Develop and maintain documentation for data pipelines, architecture, and workflows.
• Ensure compliance with industry standards and regulatory requirements regarding data handling and privacy.
• Conduct troubleshooting and maintenance of existing data services and pipelines.
• Stay updated on the latest AWS services and industry trends, integrating new technologies as appropriate.

Qualifications

• Bachelor's degree in Computer Science, Information Technology, or a related field; Master's degree preferred.
• Minimum of 5 years of experience in data architecture, cloud infrastructure, or a related role.
• Proficiency in AWS services such as S3, EC2, Lambda, Glue, Redshift, and RDS.
• Experience with big data frameworks and tools like Apache Spark, Kafka, and Kinesis.
• Strong knowledge of data modeling, ETL processes, and data warehousing concepts.
• Ability to write complex SQL queries and work with relational and non-relational databases.
• Excellent communication skills, both verbal and written.
• Certifications in AWS architecture (e.g., AWS Certified Solutions Architect) are a plus.

Technologies & Tools

This position will involve the use of various technologies and tools within the AWS ecosystem. Key tools include Amazon S3 for storage, AWS Lambda for serverless computing, Amazon Kinesis for real-time data processing, and AWS Glue for ETL operations. Familiarity with data visualization tools such as Tableau or Power BI, as well as programming languages like Python or Java, is essential to effectively implement and automate data solutions.

Ideal Candidates

Ideal candidates for this role will possess a strong analytical mindset alongside exceptional problem-solving skills. They should be proactive, detail-oriented, and capable of working in a fast-paced environment while managing multiple projects. Strong interpersonal skills are crucial for effectively collaborating with various teams and stakeholders, along with the ability to adapt to changing technologies and business needs. A genuine passion for data and a commitment to delivering high-quality solutions will set successful candidates apart.