AI Software Engineer – LLM Evaluation & Automation (Remote)
Job Description
About this kind of role
What a AI Software Engineer – LLM Evaluation & Automation (Remote) usually does. The employer's own details are in the listing.
Typically does: This role focuses on evaluating and improving Large Language Models (LLMs). Responsibilities include designing and implementing automated testing frameworks to assess LLM performance across various metrics. Engineers in this position often analyze model outputs, identify areas for improvement, and contribute to the development of strategies for enhancing model accuracy and reliability. They may also work on automating evaluation processes to increase efficiency and scalability.
Tools and skills: Proficiency in Python, experience with machine learning frameworks like TensorFlow or PyTorch, and familiarity with LLM evaluation metrics are commonly required.
Good fit for: Individuals with a strong background in software engineering and a passion for artificial intelligence, particularly those interested in the practical application and refinement of large language models, will likely thrive in this role.
??? people applied to this job
Unemployment fell most in Greece: from 10% in 2024 to 8.5% in 2025, by the International Labour Organization’s estimates. Every country, ranked →
View Similar Jobs
Similar jobs which you may be interested in. Typically using your existing skillset.
$100,000 - $150,000/Mo
2 years ago
Site Reliability Engineer
Team Remotely Inc.San Diego, USA
Site Reliability
Engineer
Infrastructure Maintenance
$100,000 - $150,000/Mo
2 years ago
$60,000 - $90,000/Mo
2 years ago
Junior Site Reliability Engineer
Patterned Learning Career.San Diego, USA
Site Reliability
Engineering
Junior
$60,000 - $90,000/Mo
2 years ago
Site Reliability Engineer
Phoenix Recruitment.San Diego, USA
Site Reliability Engineer
DevOps
System Administrator
$95,000 - $160,000/Mo
2 years ago
$110,000 - $150,000/Mo
2 years ago
Site Reliability Engineer
Stellar Consulting Solutions, LLC.San Diego, USA
Site Reliability
Engineer
IT Operations
$90,000 - $150,000/Mo
2 years ago
$90,000 - $140,000/Mo
2 years ago
DevOps Engineer
Team Remotely Inc.San Diego, USA
1. Cloud Infrastructure 2. Continuous Integration 3. Automation Tools
$90,000 - $150,000/Mo
2 years ago
$90,000 - $140,000/Mo
2 years ago