Original reasoning for the companies building and buying AI.Advanced Learning Academy LLC · Carmel, Indiana
ALAREASONING LABS

EVIDENCE CENTER

Measured results.
Private tasks.

A technical buyer can examine the task counts, run conditions, scoring decisions and limitations without receiving the prompts or answers.

Evidence date: 20 November 2026Source records retained privatelyNo public task samples
1,296,779deduplicated clue-to-answer pairsInventory scan, 18 November 2026
18tasks in the structured proof setReference answers checked by program
50items in the constrained wordplay audit37 remained fair after review
60items in the riddle wordplay run46 recorded as correct

RECORDED RESULTS

What the completed runs support.

Every row carries its denominator and material limitation. A result describes the recorded run. It does not become a universal claim about every system or every reasoning task.

CapabilityConditionsRecorded resultLimit

Structured reasoning

18 private tasks. Single attempt. Answers checked by reference programs.

17 of 18
on each of two recorded runs

One network timeout in each run remained in the denominator.

Hard structured variants

18 harder variants. Single attempt. Reference-program scoring.

16 of 18

Both misses were network timeouts. Run-to-run variation was not measured.

Riddle wordplay

60-item sample. Blind, single attempt.

46 of 60

The exact system identity was not recorded in the source file, so this remains contextual evidence.

WHY TASK AUDITS MATTER

A score can be exact
and still be wrong.

A naive exact-match score made the wordplay run look like 7 correct answers out of 50.

Human review changed the meaning of that number. Thirteen responses were defensible same-length answers. Thirteen source items could not be reached fairly without crossing letters. The final fair-item denominator was 37, with 17 genuine misses.

This is the commercial value of a task-quality audit. It separates model failure from ambiguous construction, incomplete information and an acceptance rule that is too narrow.

Request an audit scope

MEASURED INVENTORY

Large enough to license.
Defined enough to inspect.

The inventory counts describe identified historical material. They are separate from a fresh held-out evaluation and are not presented as proof that every historical item is absent from training data.

97,314

Pun and wordplay pairs

A measured subset of the clue-to-answer total.

107,030

Distinct answers

Unique answer strings after normalization.

112,647

Puzzle records

Constructed records in the measured master library.

1,510

Complete crosswords

Family Time puzzles with a grid, clues and a riddle.

LIMITATIONS

What these figures do not claim.

  • The structured results are single-attempt runs. They do not establish run-to-run stability.
  • Network timeouts remain visible and are not silently removed from the denominator.
  • The historical library is licensable inventory. It is not described as entirely unseen by models.
  • Legacy wordplay records without an exact system identifier are contextual evidence, not headline benchmark claims.
  • The prompts, answers, checkers and model responses remain private.

A BUYER-REVIEWABLE ENGAGEMENT

Test the quality of a set.
Or commission a fresh one.

The office responds with a written scope, deliverables and price. A private technical dossier accompanies the agreed work.

Discuss an evaluation

Advanced Learning Academy LLC
Private delivery. No public task samples.