Full Time

Senior Data Engineer - Python

Avesta Computer Services
$110,000 - $150,000* / year (about $53–$72 an hour)

Job Description

This job was posted over 30 days ago, so it has most likely closed. See newer jobs like it.

Written by AI from the job title and company, not by Avesta Computer Services, so some details may not match this job. The employer's own page has the real description.

Job Overview

Avesta Computer Services is seeking a Senior Data Engineer specializing in Python to join our innovative team. The ideal candidate will be responsible for architecting, constructing, and maintaining robust data pipelines that integrate disparate data sources, ensuring the reliability, efficiency, and scalability of our data architecture. This role will require collaboration with cross-functional teams to drive data-driven decision-making, enhance data processing capabilities, and support the organization's strategic goals.



Job Responsibilities

  • Design and implement scalable data pipeline architectures using Python and related technologies.
  • Optimize existing data processes to improve data quality and performance.
  • Collaborate closely with data scientists, analysts, and product stakeholders to define data requirements and implement solutions.
  • Ensure the security and privacy of data by establishing robust data governance policies and practices.
  • Monitor data systems and conduct regular maintenance to ensure high availability and reliability.
  • Document data schemas and workflows to facilitate understanding and collaboration across teams.
  • Conduct performance tuning and troubleshooting of ETL processes and data storage systems.


Qualifications

  • Bachelor's degree in Computer Science, Engineering, Mathematics, or a related field.
  • 5+ years of experience in data engineering or related fields with a focus on Python.
  • Strong knowledge of relational databases (e.g., MySQL, PostgreSQL) and NoSQL databases (e.g., MongoDB, Cassandra).
  • Experience with data warehousing solutions and related technologies (e.g., AWS Redshift, Snowflake).
  • Proficient in data modeling and transformation techniques.
  • Familiarity with Apache Hadoop, Spark, or similar big data frameworks is an advantage.
  • Excellent problem-solving skills and the ability to work independently and in a team environment.


Technologies & Tools

The Senior Data Engineer will work with a variety of technologies and tools essential for effective data processing and management, including Python, Apache Kafka, AWS services (such as S3, Lambda, and Redshift), SQL databases, and ETL tools. Familiarity with containerization technologies like Docker and orchestration platforms like Kubernetes is beneficial for facilitating scalable and automated data workflows.



Ideal Candidates

The ideal candidate for this position is someone who possesses a strong analytical mindset and is highly detail-oriented. A passion for working with data, coupled with a proactive approach to problem-solving, will help drive success. The candidate should demonstrate exceptional communication skills, enabling them to translate technical concepts for non-technical stakeholders, and exhibit leadership qualities to mentor junior team members. Being adaptable to evolving technologies and business needs is essential for thriving in this dynamic environment.

Over the last year, unemployment was lowest in legal jobs (1.4%) and highest in farming, fishing and forestry jobs (8.3%). For all workers it was 4.3%. Compare kinds of work →

View Similar Jobs

Matches Jobs

Similar jobs which you may be interested in. Typically using your existing skillset.