Promptfoo

CER OCR evals: smoke

  • Exported 2026-11-03T22:52:24.687Z
  • Evaluated 2026-11-03T22:52:21.876Z

Total Results

1

Pass Rate

0.0%

Passed

0

Failed

1

Errors

0

Prompts

1

Evaluation results

1 of 1 rows shown
Promptfoo evaluation results table
caseId [gemini:gemini-3.5-flash-lite] {{caseId}}
09
FAIL Score 0.50 outcome 1.00 rule_codes 0.00
{"caseId":"09","model":"gemini:gemini-3.5-flash-lite","outcome":"REJECTED","ruleCodes":["TYPED_SIGNATURE_VOID"],"rejectionReason":"Your California Resale Certificate (Form CDTFA-230) could not be approved due to statutory compliance requirements:\n• Computer-generated cursive script font detected. Decorative script fonts without cryptographic verification fail state audit standards. (Action: Sign the form with a handwritten pen stroke or an authenticated digital signature (e.g. DocuSign/Adobe Sign).)\n\nUnder California law (Cal. Rev. & Tax. Code §§ 6091-6093), sellers are required to verify a complete and signed Form CDTFA-230 before issuing tax exemption.\nYou can download the official blank CDTFA-230 form here: https://www.cdtfa.ca.gov/formspubs/cdtfa230.pdf\nPlease upload a corrected copy to immediately clear sales tax on your order.","extracted":{"isRecognizedForm":true,"detectedDocumentType":"California Resale Certificate CDTFA-230","sellerPermitNumber":"506-789012","purchaserLegalName":"Sample Kite & Toy Co.","certificateScope":"BLANKET","signatureDetected":true,"signatureType":"TYPED_FONT_INVALID","documentConfidence":0.98,"dateSigned":"11/02/2026","propertyDescription":"Toys and games for resale","purchaseOrderNumber":null,"purchaserAddress":{"city":"Santa Rosa","state":"CA","street":"77 Example Drive","zip":"95401"},"purchaserDba":null,"rawExtractionNotes":"Document is a standard CDTFA-230 form. Signature is rendered in a uniform typed cursive font without natural handwriting variance.","signerName":"Jorge Example","signerTitle":"Owner"},"schemaValid":true,"error":null,"inputTokens":1307,"outputTokens":266,"costUsd":0.0010570999999999998,"latencyMs":2598}

expected [MISSING_SIGNATURE], got [TYPED_SIGNATURE_VOID]

No rows match the current search and status filters.