QA Engineer | Remote | $30-$60/hr Job at Codefeast, United States

  • Codefeast
  • United States

Job Description

QA Engineer – AI Training & Evaluation

Experience: 3–8 Years

Job Type: Contractor

Location: Remote

Compensation: $30–$60/hour

Role Overview

  • Contribute to LLM training and evaluation workflows by testing software, reviewing AI-generated outputs, and validating model behavior.
  • Assess outputs for functional correctness, accuracy, reliability, edge-case handling, and adherence to requirements .
  • Create and review test cases, test scenarios, evaluation criteria, bug reports, and quality benchmarks for AI-driven workflows.
  • Provide detailed feedback to improve LLM performance, software quality, and reliability across complex technical tasks.

Key Requirements

  • 3–8 years of professional experience in QA, Software Testing, Quality Engineering, or related roles .
  • Strong experience with manual and automated testing, test case design, debugging, API testing, and regression testing .
  • Proficiency with Python, JavaScript, Java, or similar languages , along with tools such as Selenium, Playwright, Cypress, or equivalent .
  • Experience with or strong interest in LLM evaluation, AI-assisted testing, prompt engineering, or AI training workflows .

Job Tags

For contractors, Remote work

Similar Jobs

HeartFlow

Senior Data Scientist, Medical Imaging Job at HeartFlow

 ...received international recognition for exceptional strides in healthcare innovation, is supported by medical societies around the...  ...than 750,000 patients worldwide. We are looking for a Senior Data Scientist with a strong foundation in both statistical data analysis and... 

Mercor

American Voice Artist - Fully Remote | Upto $50/hr Job at Mercor

Job Description Job Description About the job Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors include Benchmark , General Catalyst , Peter Thiel , Adam D'Angelo , Larry Summers...

Instacart

Grocery Delivery Shopper Job at Instacart

As an Instacart Shopper, you help Instacart connect millions of customers with local grocery and retail partners across North America. In this flexible, app-based role, youll receive customer orders, shop for groceries and household items in nearby stores, and deliver... 

Arka Infotech

Sr. PeopleSoft 9.2 Upgrade Expert System Admin Job at Arka Infotech

 ...Job Description Sr. PeopleSoft 9.2 Upgrade Expert/System Admin 12 Months + Mclean, VA 10/12/2015 Senior PeopleSoft 9.2 upgrade expert who has extensive experience executing all activities to perform technical upgrades. This upgrade expert will have deep experience... 

Sia Partners

Banking Job at Sia Partners

 ...drastically changed over the last decade, driven by increased regulatory constraints, diverse competition inside and beyond traditional banking organizations, and emerging technologies reshaping long-standing ecosystems. Sias Financial Services Business Unit provides a...