Senior Developer Tools Engineer | $150/hr Remote
Job Description
Type: Contractor Assignment
Compensation: $150 per hour
Location: Remote
Commitment: Part-time (20-40 hours/week), with at least 4 hours overlap during PST business hours
Role Responsibilities
- Build and maintain pipelines and infrastructure supporting AI data generation, collection, and evaluation workflows.
- Design, refine, and iterate on rubrics and evaluation criteria for preference data.
- Review and label preference data while identifying subtle quality issues.
- Collaborate with researchers and engineers to translate qualitative judgment into scalable evaluation processes.
- Synthesize technical findings into clear, actionable write-ups, updates, and recommendations.
- 5+ years of experience with Python, TypeScript, Golang, or JavaScript, particularly building and maintaining pipelines or infrastructure.
- Hands-on experience with preference data collection and/or rubric creation.
- Experience navigating or contributing to large codebases; experience with codebases such as VSCode is a plus.
- Experience with AI/LLM evaluation or related engineering workflows is preferred.
- A LinkedIn profile is mandatory for review.
- Candidates should not currently be working with Microsoft.
- Profile screening and shortlisting
- Completion of the Interest Check Form (ICF), if shortlisted
- AI Interview
- Coding Challenge
- One 30-minute interview covering technical and cultural fit
- Final evaluation and shortlisting
- Shortlisted candidates will be contacted for onboarding
??? people applied to this job
Unemployment in St. Pierre & Miquelon was 3% in 2024, says IEDOM. See it over the years →
View Similar Jobs
Similar jobs which you may be interested in. Typically using your existing skillset.
$100,000 - $150,000/Mo
2 years ago
Site Reliability Engineer
Team Remotely Inc.San Diego, USA
Site Reliability
Engineer
Infrastructure Maintenance
$100,000 - $150,000/Mo
2 years ago
Junior Site Reliability Engineer
Patterned Learning Career.San Diego, USA
Site Reliability
Engineering
Junior
$60,000 - $90,000/Mo
2 years ago
Site Reliability Engineer
Phoenix Recruitment.San Diego, USA
Site Reliability Engineer
DevOps
System Administrator
$95,000 - $160,000/Mo
2 years ago
Staff Site Reliability Engineer
2K.San Diego, USA
Site Reliability Engineering
Staff Engineer
Infrastructure Operations
$90,000 - $130,000/Mo
2 years ago
$90,000 - $150,000/Mo
2 years ago
Sr. Site Reliability Engineer
Veza.San Diego, USA
Site Reliability Engineer
Senior Engineer
Systems Architect
$120,000 - $160,000/Mo
2 years ago
Senior AWS Cloud & Site Reliability Engineer
INFY8.COM.San Diego, USA
AWS Expert
Cloud Infrastructure Specialist
Senior Site Reliability Engineer
$120,000 - $160,000/Mo
2 years ago
$110,000 - $150,000/Mo
2 years ago
Senior Systems Administrator
Ingenta.San Diego, USA
Systems Administration
IT Management
Network Infrastructure
$80,000 - $120,000/Mo
2 years ago