Clarity and completeness
Identify unclear instructions, missing assumptions, inconsistent constraints and information gaps that prevent fair scoring.
TASK-QUALITY AUDITS
Commission a focused review of existing reasoning tasks, answers and scoring. New task construction is a separate option, not a prerequisite.
THE COMPANY ENGAGEMENT
Identify unclear instructions, missing assumptions, inconsistent constraints and information gaps that prevent fair scoring.
Inspect whether accepted outcomes follow from the task and whether the rubric measures the intended requirement. Flag alternative valid answers.
Where an executable checker is included, scope tests for false acceptance, false rejection, malformed responses and edge cases.
WHAT ARRIVES
Item identifiers, finding categories, severity, supporting rationale and recommended action. Task content stays inside the private delivery.
Agree whether ALA proposes edits, implements them or returns findings for your team to resolve. Track each change against the reviewed version.
Where remediation is commissioned, record the tests rerun, remaining issues and the version accepted.
Compare against named available sources or buyer-provided collections. Report the scope and matches. This is not a guarantee of absence from model training.
Reasoning and task-design review can complement the buyer’s domain experts. Legal, clinical, financial or other specialist correctness requires appropriate domain review.
BRIEF THE OFFICE
Tell us the task type, approximate set size, grading approach and the issue you want investigated. Do not upload proprietary tasks through the public form. The office will arrange the scope and private exchange.
A PRIVATE COMPANY ENGAGEMENT
The office responds with a proposed scope, deliverables and price. Work begins only after agreement.
Advanced Learning Academy LLC
Private delivery. No public task samples.