Evaluating AI-generated creative writing
Seeking two careful readers to evaluate AI-generated writing
The task is in two phases:
(1) creative-writing pieces
(2) long-form non-fiction writing (academic abstracts, blog posts, marketing copy, lesson plans, etc.).
Total reading is 68 pieces across both phases: Phase A creative-writing pieces are typically 1,500–3,000 words; Phase B non-fiction pieces vary from a few hundred words (short structured tasks) to ~3,000 words (longer reports and guides).
For each piece you'll rate it on a quality rubric (7 dimensions in Phase A, 6 dimensions in Phase B) and write a brief justification for each rating.
Total task time: approximately 12–15 hours, depending on reading pace, completable across multiple sessions over the contract period. Your progress is automatically saved between sessions.
Requirements:
- 18+
- Fluent in English
- Background in reading, editing, or literature
By applying, you confirm that you meet these requirements.
Once you're selected, you'll start with a first milestone: a short practice round to get used to the rubric, then the first 6 stories of the main session, 12 pieces in all (you'll also read a brief task overview and the rubric first). Plan on roughly 1.5-2 hours for this milestone; you'd be paid $40 for this milestone. If your work on it looks careful and consistent, you'll continue with the rest of the study, about 56 more pieces over roughly 10-14 hours with a pay of $260.
Attached are the evaluation rubric you would be rating on and some sample stories to a get a feel for the kind of writing this task involves.
Please send any questions through Upwork messaging.
Apply tot his job
Apply To this Job