AI / ML Architect/Developer/Tester ( 3 roles) – GenAI (LLM & RAG)

Remote, USA Full-time Posted 2026-05-04
Apply Now

Dice is the leading career destination for tech experts at every stage of their careers. Our client, ConfigUSA, is seeking the following. Apply via Dice today!

AI / ML Architect – GenAI (LLM & RAG)

Location: Philadelphia, PA (Hybrid – onsite PI meetings once a month / quarter)

Duration: 6+ Months Contract

    AWS SageMaker, Bedrock, S3
  • Python
  • LLMs
  • RAG
  • Vector DB (OpenSearch/DynamoDB)
    Role Focus:
  • Test LLM & RAG pipelines (prompt accuracy, grounding, hallucination checks)
  • Validate ML models (data, features, inference, drift)
  • Test AWS ML workflows (training, endpoints, pipelines)
  • Ensure governance, auditability, and compliance readiness
    Must-Have:
  • 4+ yrs QA/testing (data, ML, or AI systems)
  • Hands-on testing of LLM/GenAI applications
  • Python for test automation & data validation
  • Understanding of model behavior & evaluation metrics
    Nice-to-Have:
  • Regulated domains (Insurance / BFS)

Apply Now

Apply Now

Similar Jobs