Remote Python Senior Software Engineer, AI Training
G2i · Engineering · Senior · 12d ago
$208k – $416k
per year
Anyone, anywhere in the world can apply.
Applies on the original listing · via Himalayas
Who can apply
Read straight from the listing, so you know before you spend time on it.
Anyone, anywhere in the world can apply.
“Contract | Remote, worldwide | $100-$200/hour depending on experience and location | 10-20 hrs/week”
- Async-first
- Evaluations are conducted independently with flexible hours, requiring written feedback and recorded Loom videos with no live interview.
- Contractor / B2B
- Engagements are flexible part-time contracts running from two weeks to several months.
- Global stipend
- No home office or equipment budget mentioned.
- Annual retreat
- No company-paid get-togethers mentioned.
Read from the listing automatically. Always confirm the details with the company before you accept an offer.
About the role
In this contract AI evaluation role, you will assess how modern AI coding agents behave in real-world engineering scenarios. Rather than writing production code, you will evaluate whether model outputs reflect strong engineering taste and sound judgment, whether preambles and explanations are actually helpful, and provide detailed written and video feedback on model interactions.
What you'll do
- Evaluate AI-generated coding interactions end-to-end for utility, accuracy, and engineering judgment
- Assess the quality of reasoning and explanations provided by models, not just syntax
- Distinguish between quality tiers of responses and provide rigorous, opinionated written feedback
- Help establish quality benchmarks when working with modern tools like Cursor, Codex, and Claude Code
- Record short video walkthroughs explaining your reasoning and evaluation scores
What you bring
- Senior, Staff, or Principal-level engineering background (or equivalent experience)
- Strong background in TypeScript/JavaScript or Python
- Hands-on experience with tools like OpenAI Codex, Claude Code, or Cursor
- Ability to evaluate code conceptually without needing to execute every line
- Strong written and spoken English proficiency (B2 or above)
About G2i
G2i is a hiring platform and talent network that matches vetted software engineers with leading tech companies and cutting-edge contract projects worldwide.
View G2i profile & open roles →