Full Time

Senior Infrastructure Operations Engineer (DCOps & DevOps)

Fish Audio
Full-time
Mid-Senior level
Technology, Information and Media
Palo Alto, CA
$150,000 - $220,000* / year (about $72–$106 an hour)

Job Description

Senior Infrastructure Operations Engineer

Fish Audio · Palo Alto, California


Fish Audio is hiring a Senior Infrastructure Operations Engineer to help run the infrastructure behind our voice AI products, from CPU, NVIDIA B300 GPU, and storage clusters to application deployment pipelines and containerized services.

Your day-to-day work will focus on reliable operations, monitoring, troubleshooting, and automation. When we deploy or expand hardware, you will coordinate on-site delivery, validate installations, and work with remote-hands teams and vendors.

You will work closely with our Head of Infrastructure, who leads architecture and key technical decisions. You will own day-to-day execution and operational follow-through across both infrastructure and application operations.

This is a full-time role based in Palo Alto, with on-site work primarily in California and occasional travel to other U.S. data center locations.


What you'll do

  • Operate and troubleshoot Linux servers, CPU and NVIDIA B300 GPU clusters, storage systems, and the services running on them.
  • Maintain monitoring, alerting, dashboards, and runbooks; investigate incidents and coordinate resolution with our infrastructure and application teams.
  • Automate server provisioning, configuration management, health checks, and routine maintenance using scripts and infrastructure tooling.
  • Maintain and improve CI/CD pipelines for business applications and services, including deployment checks and rollback procedures.
  • Deploy and operate containerized applications; troubleshoot service configuration, networking, resource usage, and deployment issues.
  • Execute infrastructure changes and maintenance with clear validation, change records, and recovery plans.
  • Coordinate server deliveries, rack installation, cabling, labeling, power connections, and readiness checks when hardware is deployed or expanded.
  • Oversee remote-hands work and validate InfiniBand cabling and configuration against plans defined with our Head of Infrastructure.
  • Coordinate hardware diagnostics, repairs, component replacements, and vendor RMAs; maintain asset inventories and rack and cabling records.


What we're looking for

  • 5+ years of relevant experience in infrastructure operations, DevOps, Linux systems administration, or related roles, with the judgment to independently manage day-to-day execution.
  • Strong Linux troubleshooting skills and practical scripting ability in Bash or Python.
  • Hands-on experience with CI/CD pipelines, version control, and deploying and operating containerized applications.
  • Experience with monitoring, alerting, incident troubleshooting, and repeatable deployment or configuration workflows.
  • Practical understanding of server hardware, networking, storage, and data center operations; ability to investigate issues across hardware and software.
  • Ability to coordinate remote hands, colocation providers, and hardware vendors, and to follow through on operational issues.
  • Clear technical communication in English.
  • Ability to work on-site in Palo Alto, visit data center sites as needed, and travel occasionally within the U.S.


Nice to have

  • Experience operating production infrastructure at a hyperscale cloud provider, major technology company, or large-scale data center is strongly preferred.
  • Experience operating NVIDIA GPU clusters, especially B300 or other large GPU deployments.
  • Experience with InfiniBand networking, fabric diagnostics, or cluster deployment validation.
  • Experience with Kubernetes, configuration management, or infrastructure-as-code tools.
  • Experience with storage clusters, hardware health monitoring, or deployments across multiple data center locations.


Compensation

The base salary range for this position is US$160,000–$200,000 per year. Final compensation within this range will depend on job-related skills and experience.


How to apply

Apply through LinkedIn with your resume. Please highlight the infrastructure you have operated, the deployment or automation workflows you have built, and any GPU or data center experience.

We welcome qualified applicants of all backgrounds and evaluate candidates based on job-related skills and experience.

In 98 of the 191 countries we compare, we found no unemployment benefit on official sites. Compare countries →

View Similar Jobs

Matches Jobs

Similar jobs which you may be interested in. Typically using your existing skillset.