Senior Data Engineer
Job Description
We’re partnering with a leading client to find a Senior Data Engineer to join their team. You’ll keep the data pipelines and cloud services behind a production forecasting platform running smoothly, so business customers get accurate forecasts on time. This role blends hands-on data engineering with production support, so you’ll follow a problem from source data all the way to the customer and fix it for good. If you enjoy building pipelines and tracing a failure to its root cause, this one is for you.
What You’ll Own
- You’ll have the opportunity to design, build, and optimize ETL/ELT (extract, transform, load) pipelines that bring telemetry, weather, market, and operational data together from APIs (application programming interfaces), databases, flat files, SFTP (secure file transfer protocol), and cloud storage.
- You’ll create reusable Python and SQL (Structured Query Language) processing frameworks that replace manual and hard-coded workflows.
- You’ll strengthen pipeline monitoring, logging, validation, and failure recovery, and add data-quality and reconciliation checks.
- You’ll partner with data scientists to deliver clean, timely data for model training and daily production forecasts.
- You’ll troubleshoot production issues across data, databases, and AWS (Amazon Web Services) resources like S3, Lambda, ECS, EC2, and CloudWatch, and support deployments, incident response, and root-cause analysis.
- You’ll document dependencies and recovery steps, and cross-train with the team so critical systems always have solid backup coverage.
What You Bring
Must-haves
- You’ll draw on your experience building and supporting enterprise ETL/ELT or data integration pipelines in production, including troubleshooting failed jobs.
- You’ll put your advanced SQL skills (PostgreSQL, Oracle, SQL Server, or similar) and Python proficiency to work on data processing, automation, and integrations.
- You’ll apply your hands-on AWS or comparable cloud experience, along with Git source control and solid logging, monitoring, and root-cause analysis practices.
Nice-to-haves
- You’ll bring extra value if you know AWS Step Functions, PostgreSQL/Aurora, Redshift, Databricks, or Spark/PySpark.
- You’ll stand out if you’ve supported CI/CD (continuous integration and continuous delivery) pipelines or administered SFTP services and SSH (Secure Shell) keys.
- You’ll fit right in if you’ve built forecasting or machine-learning data pipelines, or worked in Agile teams using Jira and Confluence.
What We Offer
- On-site role in the Palm Beach County area.
- Contract position (W2 or 1099)
- 12-month contract with renewals
- Broad ownership across data, cloud, and delivery, so you grow beyond a single tool
- Day-to-day collaboration with data scientists on production forecasting models
About the Team
You’ll join a forecasting team that is growing its data engineering capacity and making its platform more resilient. The team values engineers who document clearly, share knowledge, and learn unfamiliar systems quickly. You’ll own real production systems, not just tickets.
??? people applied to this job
Free tools for your search, no account needed: a LinkedIn headline writer, a resume checker and more. Free tools →
View Similar Jobs
Similar jobs which you may be interested in. Typically using your existing skillset.
$100,000 - $150,000/Mo
2 years ago
Site Reliability Engineer
Team Remotely Inc.San Diego, USA
Site Reliability
Engineer
Infrastructure Maintenance
$100,000 - $150,000/Mo
2 years ago
$60,000 - $90,000/Mo
2 years ago
Junior Site Reliability Engineer
Patterned Learning Career.San Diego, USA
Site Reliability
Engineering
Junior
$60,000 - $90,000/Mo
2 years ago
Site Reliability Engineer
Phoenix Recruitment.San Diego, USA
Site Reliability Engineer
DevOps
System Administrator
$95,000 - $160,000/Mo
2 years ago
$110,000 - $150,000/Mo
2 years ago
Site Reliability Engineer
Stellar Consulting Solutions, LLC.San Diego, USA
Site Reliability
Engineer
IT Operations
$90,000 - $150,000/Mo
2 years ago
$90,000 - $140,000/Mo
2 years ago
DevOps Engineer
Team Remotely Inc.San Diego, USA
1. Cloud Infrastructure 2. Continuous Integration 3. Automation Tools
$90,000 - $150,000/Mo
2 years ago
$90,000 - $140,000/Mo
2 years ago