Spectralgraph
Frequently asked questions

Straight answers, on the record.

Everything prospects ask us most, answered the way we answer email: plainly, in writing, with the limits stated as clearly as the strengths.

FIXED PRICE · FIVE BUSINESS DAYS · NO MEETINGS, EVERYTHING IN WRITING · NO CUSTOMER DATA
Straight answers

The questions, answered

What exactly does Spectralgraph measure?
Fabrication, the confidently wrong answers language models produce. What it does is measure the model itself, reading the model's own internal signals rather than grading its response output, and it maps where a model fabricates, how often, and on which topics, using your real question types on a model you host. Flagged answers are individually verifiable by your own team.
What access does the test need?
A sample of your real question types and a model endpoint you designate. It never touches customer, member, policyholder, or patient data, and nothing is installed in your environment. Everything you share is held confidential under a written agreement before any work begins.
Which models are in scope?
Models your organization hosts or controls: self-hosted open-weight models, private Azure OpenAI or AWS Bedrock deployments, and your own fine-tunes. Vendor-hosted SaaS AI that the vendor attests to is out of scope, and we will tell you so rather than sell you something with nothing to measure.
Is this an audit or a certification?
No. The deliverable is a screening measurement: a signed, dated report of measured model behavior. We are not an audit firm or a certification body, and we do not issue opinions or attestations. That distinction is deliberate and we keep it everywhere.
How accurate is the instrument?
In testing so far it catches fabricated answers at about 0.85 AUC on models it had never seen before, under leave-one-model-out validation. That figure is provisional until the work is published. A public demonstration of the method, the AI Reliability Index, covers 18 open-weight models across 15 regulated domains.
Why no meetings?
The lab is written-first and async on purpose: every question answered in writing, on the record. Compliance buyers tend to prefer having the answers in the file over having had a phone call about them.
What does it cost?
Fixed fees, never success-based: LLM Validation Report $9,500; Continuous Assurance $6,500 per quarter for one model, $8,000 for a second model or a heavy change cadence; Model Selection Study $4,500 for two candidates, plus $1,500 per additional candidate, to a maximum of four for $7,500. A founding client program for the first three clients is described on the home page.
How fast is delivery?
Five business days from materials-complete: your question types received and your endpoint reachable. Replies to email come the same day.
What arrives at the end?
A signed, dated validation report plus the complete findings file: fabrication frequency by topic, the specific flagged answers, and the measured baseline your governance file keeps. Ask for the sample report by email and judge the deliverable before spending a dime.
Who we serve

Segment-specific answers live on their own pages.

Banks and credit unions: independent AI model testing for the model-risk file. Insurers: evidence for your AIS program under OID Bulletin 2024-11. Health systems: validation evidence for Joint Commission AI certification. Law firms: confidential testing built for Opinion 512 duties. Standards programs: model-level evidence for ISO/IEC 42001.

A question we didn't answer?

Email it. Replies come the same day, in writing, and the answer goes in your file, not just your memory.

Email the lab
REPLIES SAME DAY · EVERYTHING ANSWERED IN WRITING, ON THE RECORD