Job Description
This job was posted over 30 days ago, so it has most likely closed. See newer jobs like it.
Written by AI from the job title and company, not by Agility Partners, so some details may not match this job. The employer's own page has the real description.
Job Overview
The Senior Cloud Data Engineer at Agility Partners will play a pivotal role in designing, building, and managing our cloud-based data solutions. This position demands a combination of technical expertise in data engineering principles, proficiency with cloud services, and strong problem-solving skills. The ideal candidate will collaborate with cross-functional teams to enable data-driven decision-making, ensuring the integrity, security, and scalability of our data infrastructure.
Job Responsibilities
- Design, develop, and maintain scalable data pipelines to support data ingestion, transformation, and storage.
- Implement best practices for data governance, security, and quality across the data lifecycle.
- Collaborate with data scientists and analysts to define data requirements and deliver actionable insights.
- Optimize cloud resources to ensure efficient cost management within the data infrastructure.
- Troubleshoot and resolve data-related issues in a timely manner, ensuring minimal disruption to business operations.
- Stay updated on the latest cloud technologies and data engineering trends to continuously improve processes and architectures.
Qualifications
- Bachelor’s or Master’s degree in Computer Science, Data Engineering, or a related field.
- Minimum of 5 years of experience in data engineering or a similar role.
- Proficiency in cloud platforms such as AWS, Azure, or Google Cloud.
- Strong programming skills in languages such as Python, Java, or Scala.
- Experience with data warehousing solutions and ETL/ELT processes.
- Familiarity with big data technologies like Hadoop, Spark, and data lake architecture.
- Knowledge of database systems, both SQL (MySQL, PostgreSQL) and NoSQL (MongoDB, Cassandra).
- Excellent analytical and problem-solving skills, with attention to detail.
Technologies & Tools
The Senior Cloud Data Engineer will work with a diverse stack of technologies and tools, including but not limited to Amazon Web Services (AWS) services such as Redshift, Lambda, and S3; data orchestration tools like Apache Airflow or Spark; and database management systems including PostgreSQL and MongoDB. Familiarity with containerization technologies like Docker and CI/CD pipelines for data deployment is also beneficial.
Ideal Candidates
The ideal candidate for the Senior Cloud Data Engineer position is someone who possesses a strong technical background with a passion for innovation in data management. They are proactive learners who stay abreast of emerging technologies, demonstrating both leadership and teamwork capabilities. A strong communicator, they can articulate complex ideas clearly to both technical and non-technical stakeholders. Their analytical mindset and detail-oriented approach ensures high-quality outcomes in all delivered projects.
What a person out of work can get differs a lot from one country to the next. We compare them, each from its government’s own pages. Compare countries →
View Similar Jobs
Similar jobs which you may be interested in. Typically using your existing skillset.