Open Source Applied Engineer Talent Network

Contract / Remote

Role Details & Requirements

Key Responsibilities:
Design and oversee the creation of evaluations for a wide range of coding tasks across multiple languages, including JavaScript, TypeScript, Python, Java, and C.
Develop test cases to accurately assess system performance in diverse engineering scenarios.
Analyze system behavior on real-world user use cases to uncover strengths and improvement areas.
Communicate evaluation results effectively to the research team to support continued development and optimization.