The desk
Die Brief

DIE.BRIEF

Hardware desk
Models CONFIRMED

Vals AI's 25-model political lean map omits per-model scores

The Die Brief Desk, after huggingface.co

In Vals AI's scatter plot of 25 models scored on a −1 to +1 political lean axis, the language of the prompt matters more than the nationality of the model. Simplified Chinese prompts cluster closer to +1 than English, Russian, or Spanish prompts do.

The Vals scoring reveals wide variation among the tested models. The scale measures their alignment with certain Chinese government positions, not the factual accuracy of their ans
The Vals scoring reveals wide variation among the tested models. The scale measures their alignment with certain Chinese government positions, not the factual accuracy of their ans
Vals AI Pro-China Lean Study
Models tested25
Score range−1 to +1
ServingFireworks AI, OpenRouter, self-hosted

The plot marks critical responses in blue and pro-China responses in red. GLM-5.3 Flash lands on the critical side, confirming that UN-documented violations exist. Kimi K3 sits on the pro-China side, calling Xinjiang facilities "vocational training centers."

The page lists 25 model names alongside their serving infrastructure — Fireworks AI, OpenRouter, self-hosted — but the numerical lean for each model is not printed. A US deployment context pulls scores back, and structured yes/no formats produce higher evaluation awareness.

The political slant of responses depends on the prompt language. The gap between English and Simplified Chinese is especially wide for Chinese models. | Image: Vals.ai — Picture fr
The political slant of responses depends on the prompt language. The gap between English and Simplified Chinese is especially wide for Chinese models. | Image: Vals.ai — Picture fr

Western models also occasionally align with official Chinese government positions, a finding that complicates any simple East-versus-West framing.

Prompt: map of china Generation 1 of 3 — Picture from vals.ai
Prompt: map of china Generation 1 of 3 — Picture from vals.ai

The exact question set, the scoring rubric behind the −1 to +1 assignment, and the total question count remain unstated. The page references hundreds of questions but gives no integer.

Prompt: 中国地图 中國地圖 Generation 1 of 3 — Picture from vals.ai
Prompt: 中国地图 中國地圖 Generation 1 of 3 — Picture from vals.ai

The Public_AI_Constitution.pdf linked in the dossier is a separate document whose content was not available for this reading.

The study gives a qualitative map, not a per-model number. The procurement team must run its own eval set to confirm whether a specific model will endorse a PRC position in production.

The draft led with the scale and the nationality finding; this version leads with the language effect and the missing per-model number, which is the practical takeaway for a reader evaluating models for deployment. The scatter-plot description and the two named model examples are kept but resequenced. The Western-models point from the source is added as a standalone beat. The procurement implication closes the piece rather than appearing mid-draft.

After huggingface.co. We did not report this. The pictures, if any, are theirs.

November 04, 2026 · 2 min
Copy link Share to X