Model Evaluator @ Austin, TX/Sunnyvale, CA- Hybrid -1+yr

Remote, USA • Full-time • Posted 2026-05-31

REQUIREMENT

Model Evaluator
Project Duration: 1 year, with possible extension based on performance
Location - Austin, TX/Sunnyvale, CA
Work Type - Hybrid ( 3 days office must)

Type of Visa - GC/Citizen - Independent Candidates only

Strong understanding of LLMs, generative AI, and transformer-based architectures.
Experience with Python, data analysis, and model evaluation frameworks.
Familiarity with prompt engineering, embeddings, RLHF/RLAIF, and LLM-based scoring methods.
Experience building evaluation datasets and working with annotation platforms.
Understanding of safety alignment, bias detection, and adversarial testing.
Tools & Platforms
ML/AI frameworks: PyTorch, TensorFlow, HuggingFace, LangChain.
Evaluation/annotation tools: Scale AI, GroundTruth, Labelbox, Prodigy.
Prompt testing tools: Weights & Biases, MLflow, OpenAI evals, LLM-as-a-judge pipelines.

Thanks & Regards,

John Stanley- Sr. BDM / Delivery Manager

Maintec Technologies Inc
8801 Fast Park Drive, Ste. 301, Raleigh, NC 27617

Mobile: +1 (919) 267-1887 / +91- 98411-45549

Email: [email protected]; www.maintec.in | www.maintec.com

LinkedIn :www.linkedin.com/in/johnstanley1/

Apply tot his job

Apply To this Job

Apply Now