Job Description
This job was posted over 30 days ago, so it has most likely closed. See newer jobs like it.
Written by AI from the job title and company, not by Progressive Insurance, so some details may not match this job. The employer's own page has the real description.
Job Overview
The Senior Data Engineer - AWS at Progressive Insurance will play a pivotal role in architecting and optimizing data pipelines and infrastructure. This position involves designing, building, and maintaining scalable data solutions that support analytics and operational use cases. The successful candidate will collaborate with cross-functional teams to drive data initiatives, ensuring that data delivery is timely, consistent, and reliable. This role will also focus on implementing AWS services to enhance data processing efficiency and capacity.
Job Responsibilities
- Design, develop, and optimize scalable data pipelines and ETL processes to support data ingestion from various sources.
- Collaborate with data scientists and analysts to understand data requirements and ensure appropriate data availability.
- Implement AWS technologies, including but not limited to S3, Redshift, Glue, and Lambda, to enhance data processing and storage capabilities.
- Ensure data quality, integrity, and security throughout the data lifecycle.
- Monitor and troubleshoot data workflow issues, providing timely resolutions to maintain data availability.
- Document data models, processes, and workflows for knowledge sharing and future reference.
- Mentor junior data engineering staff, sharing best practices and fostering a culture of continuous improvement.
Qualifications
- Bachelor’s degree in Computer Science, Information Technology, or a related field; Master’s degree preferred.
- A minimum of 5 years of experience in data engineering or a related role.
- Strong proficiency in SQL and experience with relational databases, particularly AWS Redshift.
- Hands-on experience with AWS services, including S3, EC2, Lambda, and Glue.
- Proficiency in programming languages such as Python, Java, or Scala.
- Experience with data modeling, ETL processes, and data warehousing concepts.
- Familiarity with big data technologies, such as Hadoop or Spark, is a plus.
- Excellent problem-solving skills and ability to work in a dynamic, collaborative environment.
Technologies & Tools
The Data Engineer - AWS position utilizes a range of cutting-edge technologies and tools, primarily focusing on the AWS ecosystem. Candidates will work extensively with AWS services including S3 for storage, Redshift for data warehousing, and Glue for ETL processes. Familiarity with analytical tools and programming languages, such as Python and SQL, will also be crucial in developing efficient data solutions. Additionally, experience with data orchestration tools and version control systems will enhance the effectiveness in this role.
Ideal Candidates
Ideal candidates for the Senior Data Engineer - AWS position are detail-oriented, analytical thinkers with a strong background in data engineering and AWS technologies. They should possess excellent communication skills, enabling them to articulate complex data concepts to various stakeholders. Candidates should be proactive in problem-solving and demonstrate a passion for continuous learning and improving data systems. A collaborative spirit and the ability to mentor others are also key characteristics that will contribute to success in this role.
Securities, Commodities, and Financial Services Sales Agents: 490,000 people in the US, paid from $48,040 a year (the lowest 10%) to $212,880 (the top 10%), with $78,660 in the middle, in May 2025. See these jobs →
View Similar Jobs
Similar jobs which you may be interested in. Typically using your existing skillset.