Model Assurance

Know which model you are running, and where it came from.

Model Assurance verifies that the model in your environment is the one you evaluated and approved. It uses black-box behavioral fingerprints and continuous stability monitoring, with no SDK and no access to customer traffic.

What it verifies

  • Model provenance

    Verify where a model came from, including fine-tunes and distillations, before you adopt it.

  • Supply chain integrity

    Verify that the model running is the one you approved, and catch swaps, tampering, and unauthorized updates.

  • Governance and compliance

    Keep a timestamped record of which model ran, when, and where it came from.

A detailed provenance inspection, using validated, published methods.

The full assessment runs once, when a model is offered. It examines the model at two levels: weight analysis reads lineage directly from the trained parameters, and behavioral fingerprinting characterizes what the model does. Each detects cases the other misses. Both methods are validated in published research. The evidence report is the basis for approval.

Fig. 1 — Source selection assessment
RUNS INSIDE YOUR ENVIRONMENT — ON-PREMISES OR AIR-GAPPED INPUT Candidate model open-weight model under evaluation Source selection assessment FINGERPRINTS GENERATED 1 Behavioral fingerprint how the model maps fixed inputs to outputs 2 Weight-derived signals five signals computed from the trained weights 3 Tokenizer comparison tokenizer structure and vocabulary overlap 4 Architecture metadata layer layout, dimensions, configuration each compared against a reference catalog of known models OUTPUT Evidence report one artifact — structured, storable, exportable Behavioral neighbors Weight-lineage matches Tokenizer and architecture matches Combined reading BEHAVIORAL FINGERPRINT RETAINED AS BASELINE FOR STAGES 02–03 NO WEIGHTS CROSS THE BOUNDARY · NO CALL-HOME
Run once, at source selection. VAIL produces the behavioral fingerprint. Cisco Model Provenance Kit produces weight, tokenizer, and architecture signals. All four are compared against a reference catalog of known models and combined into one evidence report, usable for provenance records and AI bill of materials (AIBOM) documentation. The behavioral fingerprint in the report becomes the baseline for stages 02 and 03.

Lineage classification

Weight analysis · Cisco Model Provenance Kit

Classifies the model as a direct descendant, fine-tune, quantization, or merger of a known base — or as independently trained. Reads the weights directly, so renaming and metadata removal do not affect the result. Requires access to the weights.

Behavioral identity

Behavioral fingerprint · VAIL

A compact vector derived from the model's output distributions on a fixed probe set. Detects divergence from a parent that weight analysis misses, such as a fine-tune that changes refusal behavior. Works on a served model without weight access.

Three inspection points. One baseline.

Example: a drone supplied by an external vendor, with a model on board.

Fig. 2 — Inspection points across the acquisition life cycle Example: vendor-supplied drone
01 · SOURCE SELECTION 02 · INSTALLATION AUDIT 03 · CONTINUOUS MONITORING baseline carried forward baseline carried forward ON-PREMISES OR AIR-GAPPED Evaluate the offered model vendor submits the model full assessment (Fig. 1) approved or rejected METHOD · BEHAVIORAL WEIGHT ANALYSIS OUTPUT · EVIDENCE REPORT AND BASELINE AT DELIVERY Verify the installed model drone delivered with model on board behavioral fingerprint taken matched to the stage 01 report METHOD · BEHAVIORAL ONLY OUTPUT · MATCH OR MISMATCH ON THE DEVICE, OFFLINE Monitor in operation service enabled on the drone behavioral fingerprint, ongoing drift or change flagged locally METHOD · BEHAVIORAL ONLY OUTPUT · STABILITY STATUS
Weight analysis runs only at stage 01. Stages 02 and 03 use the behavioral fingerprint alone, matched against the fingerprint in the stage 01 evidence report. Stage 02 is a one-time check; stage 03 is an ongoing service that keeps checking until turned off. Every stage runs on customer or device hardware; reference catalog updates are small vector files that can be moved across an air gap.

Fingerprints in use. Three places to see them today.

VAIL Model Similarity Explorer

app.projectvail.com

Pick any of the nearly 1,900 models VAIL tracks and see the rest arranged by behavioral fingerprint similarity. Shown: Qwen3.5-35B-A3B at the center.

Open the explorer
Radial similarity graph with Qwen3.5-35B-A3B at the center and hundreds of models placed around it by fingerprint similarity

Interconnects Artifacts Hub

artifactshub.ai

Each open model page carries its VAIL fingerprint and links to the models that behave most like it. Shown: Gemma 4 26B A4B IT.

View on Artifacts Hub
Artifacts Hub page for Gemma 4 26B A4B IT, with a VAIL fingerprint panel under Similarity

Cisco AI Supply Chain Provenance Explorer

provenance.aidefense.cisco.com

Cisco traces each model’s declared ancestry, and VAIL measures the behavioral similarity at each step. Shown: Foundation-Sec-8B-Q8_0-GGUF, 88.40% behaviorally similar to its Llama 3.1 8B base.

View on Cisco’s explorer
Cisco provenance explorer showing Foundation-Sec-8B-Q8_0-GGUF derived from Llama 3.1 8B, with 88.40% behavioral similarity powered by VAIL

Screenshots captured October 2026. The live pages update as models are added.

Published research.

Cisco

Models don't have passports: AI lineage crosses organizational and geographic borders

Joint study · Cisco and VAIL · August 2026

Amy Chang, Ankit Garg (Cisco) · Manish Shah, Jonah Leshin (VAIL)

Applies both methods to NVIDIA Nemotron models, some of which are documented as post-trained from Alibaba Qwen base weights. Independently, each method places Qwen models disproportionately among those models' nearest neighbors and recovers the documented lineage ordering: Qwen-base, then NVIDIA-native, then Llama-base. Results are detection evidence consistent with documented lineage, not proof of derivation.

Read the paper (PDF) →
Weight analysisBehavioral
Qwen-neighbor enrichment, Qwen-base Nemotron models1.74×1.89×
Lineage ordering recovered (permutation test)p = 0.00001p = 0.00002
Reference catalog184 models1,159 models

Behavioral Fingerprints for LLM Endpoint Stability and Identity

VAIL · ACM CAIS 2026 · System demonstrations

Jonah Leshin, Manish Shah, Ian Timmis, Daniel Kang

Describes the behavioral fingerprinting method and a monitor that fingerprints a model periodically from a fixed prompt set and compares output distributions over time. In real-world monitoring of the same model hosted by multiple providers, it finds substantial stability differences between and within providers. This is the method used for installation audit and continuous monitoring.

Read the paper (arXiv:2603.19022) →
Change to the modelDetected
Model familyYes
Model versionYes
Inference stackYes
QuantizationYes
Behavioral parametersYes

Hardware-Rooted Trust Anchors for Sovereign AI Processing: Cryptographic Verification of Location, Identity, and Confidentiality in Cloud Environments

Joint study · Lucid Computing, Lunal, and VAIL · ICDS 2025

Milos Borenovic, Connor Dunlop, José Dunia (Lucid Computing) · Amean Asad (Lunal) · Manish Shah, Jonah Leshin (VAIL)

Verifies an AI workload running on untrusted infrastructure by combining hardware trusted execution, network-based location attestation, and VAIL's input–output fingerprint for runtime model integrity. The fingerprint check applies to stages 02 and 03: confirming the identity of a model that is already running. It is stable across machines and quantization and separates independently trained models.

Read the paper (PDF) →
Model Similarity
Base model vs. its instruction-tuned version (4 pairs)0.96–0.98
Qwen3-32B vs. quantized versions> 0.91
Qwen3-32B vs. unrelated models of similar size0.63–0.84
Derivation threshold0.85

Built for

Teams
AI platform engineers, security teams, procurement, and compliance.
Deployment
No SDK, no code changes, and no access to customer traffic. Managed, in your cloud, or air-gapped.

Request an assessment.

Tell us which model you need verified. We reply within one business day with a scope and a start date.

Or write to contact@projectvail.com

Reply within one business day