EXTERNAL CFD / CHALLENGE 01
FAILBlind Validation Challenge 01
NASA TM-4074 Table XIII: 18 angles × 3 grids. Frozen criteria and input-only execution code preceded the production runs. 54 / 54 attempts finished in the published snapshot. Reference-withheld execution; supervisory setup was not fully blinded.
LOCAL-MODEL / OPERATOR HANDOFF
MIXEDModel-to-CFD workflow trials
Seven iterative airfoil attempts and the internal-flow model trials are retained, including rejected proposals. A local 7B model completed a solver run with operator help but failed strict observation; two bounded 14B workflows passed.
This tests proposal and evidence-reading behavior, not agreement with independent CFD measurements.
THERMAL + STRUCTURAL / SOURCE-DERIVED
SYNTHETIC PREBENCHMARKSamarmad-derived PCHE gate pack
A separate six-point synthetic shakedown of prediction freeze, criteria hashing, curved-interface transfer, generic OpenFOAM CHT, and generic CalculiX gates.
Synthetic pipeline proof only; not the publication-specific run.
THERMAL-HYDRAULIC / PUBLICATION-TARGETED
NUMERICAL FAIL · EXPERIMENT UNSCOREDSamarmad PCHE v1 — independent reconstruction
Three OpenFOAM CHT grids ran on the reconstructed Model 6 cell. Every grid misses the residual target, and medium-to-fine pressure drop shifts by more than 22%. The article was reviewed after freeze, but no exact matching experimental point could be established; v1 is not tuned.
The paper has no structural test. Exploratory CalculiX mapping failed its 100% coverage gate. The prediction hash is verified; external timestamp confirmation remains pending.