Site Reliability Engineer
Job Description
Site Reliability Engineer (SRE)
Location: Boston, MA or Dallas, TX
Employment: Contract-to-Hire
Work Arrangement: Hybrid with occasional travel
Position Overview
We are seeking an experienced Site Reliability Engineer (SRE) to support and optimize large-scale GPU infrastructure, AWS and Cloudflare environments, and critical client data pipelines. This role focuses on infrastructure reliability, automation, observability, and incident response across high-performance computing environments.
The ideal candidate brings strong Linux, cloud infrastructure, and distributed systems expertise, with the ability to troubleshoot complex issues across compute, networking, storage, and orchestration platforms.
Key Responsibilities
- Maintain reliability, availability, and performance of GPU clusters, cloud infrastructure, and client data integrations.
- Define and manage SLOs, SLIs, monitoring, alerting, and incident response processes.
- Build observability across GPU compute, InfiniBand networking, storage, Kubernetes, and Slurm.
- Automate infrastructure provisioning, monitoring, troubleshooting, and remediation using Python or Go.
- Lead root-cause analysis and resolve complex production infrastructure issues.
- Optimize infrastructure performance, scalability, capacity, and operational efficiency.
- Collaborate with engineering teams to improve system reliability and reduce manual intervention.
- Develop runbooks, dashboards, and operational documentation.
- Participate in an on-call rotation for critical infrastructure incidents.
Required Qualifications
- 5+ years of experience in Site Reliability Engineering, Platform Engineering, DevOps, or infrastructure operations.
- Strong Linux administration, scripting (Python or Go), and automation experience.
- Hands-on experience with AWS, Kubernetes, distributed systems, and production infrastructure.
- Experience with monitoring, observability, incident management, and troubleshooting.
- Ability to diagnose issues across compute, networking, storage, and application infrastructure.
- Strong communication, documentation, and cross-functional collaboration skills.
Preferred Qualifications
- Experience supporting NVIDIA GPU clusters, HPC, or AI/ML training infrastructure.
- Familiarity with Slurm, InfiniBand, RoCE, and GPU networking.
- Experience with Prometheus, Grafana, OpenTelemetry, ELK, or OpenSearch.
- Knowledge of high-performance storage technologies such as Lustre or DDN EXAScaler.
- Experience supporting enterprise infrastructure under SOC 2, ISO 27001, or HIPAA requirements.
Technology Environment
- Compute: NVIDIA H100, H200, B200/B300, GB200/GB300 NVL72
- Networking: InfiniBand, NVLink, Cloudflare
- Orchestration: Kubernetes, Slurm, bare-metal infrastructure
- Storage: DDN EXAScaler, Lustre
- Cloud & Automation: AWS, Python, Go
- Monitoring: Prometheus, Grafana, OpenTelemetry
Location Requirements: Candidates must be located in or willing to work a hybrid schedule in the Greater Boston or Greater Dallas area. Occasional travel to infrastructure sites may be required.
??? people applied to this job
Stuck turning a job you did into resume lines? Say what you did in your own words, however rough, and get it back as five lines that start with the action. Write bullet points →
View Similar Jobs
Similar jobs which you may be interested in. Typically using your existing skillset.
$100,000 - $150,000/Mo
2 years ago
Site Reliability Engineer
Team Remotely Inc.San Diego, USA
Site Reliability
Engineer
Infrastructure Maintenance
$100,000 - $150,000/Mo
2 years ago
$60,000 - $90,000/Mo
2 years ago
$110,000 - $150,000/Mo
2 years ago
Site Reliability Engineer
Stellar Consulting Solutions, LLC.San Diego, USA
Site Reliability
Engineer
IT Operations
$90,000 - $150,000/Mo
2 years ago
$90,000 - $140,000/Mo
2 years ago
DevOps Engineer
Team Remotely Inc.San Diego, USA
1. Cloud Infrastructure 2. Continuous Integration 3. Automation Tools
$90,000 - $150,000/Mo
2 years ago
$90,000 - $140,000/Mo
2 years ago
$90,000 - $150,000/Mo
2 years ago
$90,000 - $130,000/Mo
2 years ago