LLM Response Evaluator & Content Annotator — Portuguese (Brazil)
Location: Remote, Brazil
Engagement: Part-time with a flexibal time schedule
We are hiring Brazilian Portuguese speakers to support an LLM (Large Language Model) response evaluation and content-improvement project.
In this role, you will review and compare AI-generated answers to user prompts that may involve legal, financial, or medical topics . You will apply clear project guidelines to assess answer quality, select the strongest response, improve it where needed, and identify and correct any errors.
This is an excellent opportunity for early-career professionals and recent graduates with a background in Law, Finance, or Medical/Healthcare fields who are interested in contributing to the development of high-quality AI systems.
What You’ll Do
- Review user prompts and four AI-generated responses in Brazilian Portuguese.
- Evaluate, score, and rank responses based on accuracy, relevance, clarity, safety, and overall quality.
- Select the best-performing response as the “golden response.”
- Edit and improve the selected response in line with project guidelines.
- Identify factual, logical, professional, linguistic, or localization errors in model-generated content.
- Clearly document issues found and provide corrected or improved content.
- Ensure responses are natural, accurate, and appropriate for Brazilian Portuguese-speaking users.
- Maintain consistent quality standards while working independently in a remote environment.
What We’re Looking For
- High level Brazilian Portuguese fluency, with excellent writing and editing skills.
- Fluent English reading and communication skills; project instructions and materials may be provided in English.
- Educational background or professional experience in at least one of the following areas:
- Law / Legal Studies
- Finance / Accounting / Economics / Banking / Investment
- Medicine / Healthcare / Pharmacy / Nursing / Public Health / Biomedical Sciences
- Ideally 1–3 years of relevant professional experience; strong recent graduates are also welcome to apply.
- Strong critical thinking, research, fact-checking, and attention-to-detail skills.
- Ability to recognize inaccurate, incomplete, misleading, or potentially unsafe content.
- Comfortable following detailed instructions and applying consistent evaluation standards.
- Self-motivated and able to manage priorities in a flexible, fully remote setting.
Nice to Have
- Experience with content review, editing, localization, translation, research, quality assurance, or data annotation.
- Familiarity with generative AI, LLMs, or AI evaluation projects.
- Experience working with sensitive, regulated, or high-accuracy content in legal, financial, or healthcare contexts.
Why Join Us?
- Work fully remotely from anywhere in Brazil.
- Flexible working hours.
- Contribute directly to the development and improvement of next-generation AI systems.
- Gain practical experience in AI evaluation, content quality, and domain-specific review.
If you are a detail-oriented Brazilian Portuguese professional with domain knowledge in Law, Finance, or Healthcare and an interest in AI, we would love to hear from you.
Sign in
To continue your applicationor continue with email
By continuing you agree to our Terms & Privacy Policy.
![[Job- 30624] Senior Software Engineer & AI Consultant, Brazil](https://pcdns.recruit.net/2.0/jobsapi/logos/3198_128x128.png)