Function-based Code Annotator

About the Role

Design and develop high-quality, function-level algorithm problems covering a wide range of algorithms and data structures, from basic to advanced.

What You'll Do

• Write clear and accurate problem descriptions in both Chinese and English, defining precise input/output formats and constraints.
• Design comprehensive and robust test datasets, including edge cases and extreme scenarios, to ensure accurate evaluation and prevent cheating.
• Write reference solutions and automatic validation logic, and perform difficulty grading and quality assessment.
• Participate in team cross-reviews to ensure the scientific validity, fairness, and innovation of the benchmark.

Who We're Looking For

Required Skills:

• Experience participating in or creating problems for programming competitions like ACM/ICPC, Codeforces, etc.
• Expertise in algorithms and data structures, with a specialization in at least one area such as graph theory, dynamic programming, or string algorithms.
• Proficient in Python or C/C++ for writing efficient algorithm implementations and validators.
• Excellent problem abstraction skills to transform vague ideas into unambiguous algorithmic problems.

Professional Background:

• Background in Computer Science, Software Engineering, Mathematics, or Artificial Intelligence; or experience as an Algorithm Engineer or Software R&D Engineer (Algorithm-focused).
• Experience in evaluating code generation models is a plus.

Bonus Points:

• Understanding of the capability boundaries and common pitfalls of major Code LLMs.
• Experience writing algorithm blogs or teaching courses.
• Experience in benchmark design or contributions to open-source Online Judge (OJ) systems.
• Skilled in designing complex problems that test the logical reasoning abilities of AI models.

Compensation

USD $120-150/Day, based on skills and experience.