Compare commits

..
10 Commits
Author SHA1 Message Date
Gitea Actions bb317a9366 Release 0.1.65 [auto-version-bump] 2026-10-19 03:57:10 +02:00
Ein Anderssono d8f8300ab9 Show dialogue context compaction notice and trace
Build and publish frontend / publish (push) Successful in 51s
2026-10-19 03:56:38 +02:00
Gitea Actions 4774223596 Release 0.1.64 [auto-version-bump] 2026-10-19 03:32:19 +02:00
Ein Anderssono a235d71c21 Add redo and dry-run dialogue actions
Build and publish frontend / publish (push) Successful in 55s
2026-10-19 03:29:21 +02:00
Gitea Actions de742f4079 Release 0.1.63 [auto-version-bump] 2026-10-19 02:17:00 +02:00
Ein Anderssono f54499ee5c Render color-coded AI Luau Rust trace
Build and publish frontend / publish (push) Successful in 1m2s
2026-10-19 02:15:20 +02:00
Gitea Actions a111b95cef Release 0.1.62 [auto-version-bump] 2026-10-18 12:56:05 +02:00
Ein Anderssono f4d3e2fc3b Add explicit send button to dialogue input
Build and publish frontend / publish (push) Successful in 52s
2026-10-18 12:55:39 +02:00
Gitea Actions fa11314b23 Release 0.1.61 [auto-version-bump] 2026-10-17 16:38:43 +02:00
Ein Anderssono c9b14e0726 Fix Piper memory pressure on iOS
Build and publish frontend / publish (push) Successful in 49s
2026-10-17 16:38:16 +02:00
10 changed files with 218 additions and 34 deletions
+3 -1
View File
@@ -6,11 +6,13 @@ After login, character creation and play use one dialogue history and one text i
During play the UI has no persistent location, task, inventory, economy, status, or purchase panels. The player asks for information or writes an action in the same input. Rust validates state changes; the AI can only propose a typed intent. A direct request to travel may establish a new place and an encounter when Rust commits that movement. During play the UI has no persistent location, task, inventory, economy, status, or purchase panels. The player asks for information or writes an action in the same input. Rust validates state changes; the AI can only propose a typed intent. A direct request to travel may establish a new place and an encounter when Rust commits that movement.
The dialogue also offers **Gör om senaste** and **Torrkör senaste**. Both resend the latest player action while leaving the previous dialogue turn out of the AI conversation context. “Gör om” processes a fresh, normal turn. “Torrkör” calls the narrator and evaluates already-approved stored Luau rules, then rolls back the complete game transaction; it does not save the player turn, AI trace, rule, event, ownership, or world progress. A rule that would need to be newly generated is reported as not evaluated, because a dry run never stores newly generated rules.
If the player asks to find or approach someone and no NPC is present, the direct dialogue scene may propose one person and an opening line. Rust creates that NPC only for the explicit request and commits the first exchange idempotently; a later turn continues the saved conversation. Clear requests about the current location are answered from its saved facts without asking the player to restate what they want to inspect. If the player asks to find or approach someone and no NPC is present, the direct dialogue scene may propose one person and an opening line. Rust creates that NPC only for the explicit request and commits the first exchange idempotently; a later turn continues the saved conversation. Clear requests about the current location are answered from its saved facts without asking the player to restate what they want to inspect.
The separate `/admin` route provides an authenticated operations view for player search/profile/trace, YAML prompt assets, generated Luau rules with validation results, runtime debug logging, and the append-only audit log. All privileged data comes from the Rust `/api/admin/...` API; the browser never connects directly to PostgreSQL. Backend endpoints require `accounts.is_admin=true`. The Driftloggar view lets an administrator switch `debug=true` on or off without restarting pods; the setting is stored in PostgreSQL and propagated to running replicas. Verbose pod logs include request, AI-call, validation, and commit metadata but never raw player text, prompts, model responses, sessions, or secrets. Full protected prompt/provider exchanges remain in the audited player trace. The separate `/admin` route provides an authenticated operations view for player search/profile/trace, YAML prompt assets, generated Luau rules with validation results, runtime debug logging, and the append-only audit log. All privileged data comes from the Rust `/api/admin/...` API; the browser never connects directly to PostgreSQL. Backend endpoints require `accounts.is_admin=true`. The Driftloggar view lets an administrator switch `debug=true` on or off without restarting pods; the setting is stored in PostgreSQL and propagated to running replicas. Verbose pod logs include request, AI-call, validation, and commit metadata but never raw player text, prompts, model responses, sessions, or secrets. Full protected prompt/provider exchanges remain in the audited player trace.
The game is text- and dialogue-based and uses no images. Place descriptions include sound, smell, air/temperature, touch/surface, and spatial-orientation cues. Visible details may also be described in words, but are never required to understand the scene or play. The transcript is screen-reader announced, and Enter submits the input while Shift+Enter inserts a newline; no separate send button is required. The game is text- and dialogue-based and uses no images. Place descriptions include sound, smell, air/temperature, touch/surface, and spatial-orientation cues. Visible details may also be described in words, but are never required to understand the scene or play. The transcript is screen-reader announced. A clearly labeled **Skicka** button beside the microphone submits typed text; Enter also submits while Shift+Enter inserts a newline. Typed text, speech transcriptions, and the send button all use the same submission flow.
Player-facing speech uses Piper TTS in WebAssembly in the browser after audio is activated by a user gesture. It reads game dialogue, onboarding, account responses, character and world creation, gameplay replies, in-game errors, and microphone disclosures; the `/admin` route is excluded. The audio is decoded and played through the Web Audio API, independently of `speechSynthesis`. The first unauthenticated visit keeps the introduction visible and it can be started with `Läs introduktionen`. New game replies are read automatically and the transcript remains available to screen readers and as text. Returning players hear the latest saved game reply when they reopen the game. The player can change speaking rate; narrator pitch is neutral and character pitch is varied consistently by voice identity. These preferences are stored in browser `localStorage`. If WebAssembly, model loading, or audio playback fails, the same content remains available as text and the dialogue offers a retry. Player-facing speech uses Piper TTS in WebAssembly in the browser after audio is activated by a user gesture. It reads game dialogue, onboarding, account responses, character and world creation, gameplay replies, in-game errors, and microphone disclosures; the `/admin` route is excluded. The audio is decoded and played through the Web Audio API, independently of `speechSynthesis`. The first unauthenticated visit keeps the introduction visible and it can be started with `Läs introduktionen`. New game replies are read automatically and the transcript remains available to screen readers and as text. Returning players hear the latest saved game reply when they reopen the game. The player can change speaking rate; narrator pitch is neutral and character pitch is varied consistently by voice identity. These preferences are stored in browser `localStorage`. If WebAssembly, model loading, or audio playback fails, the same content remains available as text and the dialogue offers a retry.
+1 -1
View File
@@ -1 +1 @@
0.1.60 0.1.65
+2 -2
View File
@@ -2,5 +2,5 @@ apiVersion: v2
name: ai-spel-frontend name: ai-spel-frontend
description: Static web frontend for the Swedish life simulator description: Static web frontend for the Swedish life simulator
type: application type: application
version: 0.1.60 version: 0.1.65
appVersion: "0.1.60" appVersion: "0.1.65"
@@ -0,0 +1,13 @@
# ADR 0003: Limit Piper WASM to one thread and reset failed workers
## Decision
The Piper worker reports one available processor to Piper and configures ONNX Runtime for one thread. If a synthesis request fails, the browser client terminates that worker; the next player retry creates a fresh worker and ONNX module.
## Context
Piper TTS Web 1.0.3 sets `env.wasm.numThreads` from `navigator.hardwareConcurrency` during `TtsSession.init()`, after the application had configured ONNX Runtime. On iPad this could undo the single-thread setting and request a larger WASM worker pool. The library also retains a singleton session if ONNX initialization fails, so retrying in the same worker can reuse a failed initialization.
## Consequences
The one-thread limit reduces parallel inference but lowers memory pressure on mobile Safari. Failed initialization no longer poisons future attempts in the same worker. This cannot guarantee that every device has enough memory for the 63 MB medium voice model; the CI release and Kubernetes checks validate packaging and deployment, while actual iPad memory behavior still requires device verification.
+145 -22
View File
@@ -17,6 +17,7 @@
#dialogue li { margin-block: 1rem; white-space: pre-wrap; overflow-wrap: anywhere; } #dialogue li { margin-block: 1rem; white-space: pre-wrap; overflow-wrap: anywhere; }
#dialogue li[data-role="user"] { font-weight: 650; } #dialogue li[data-role="user"] { font-weight: 650; }
#dialogue li[data-role="assistant"] { padding-inline-start: .75rem; border-inline-start: .2rem solid currentColor; } #dialogue li[data-role="assistant"] { padding-inline-start: .75rem; border-inline-start: .2rem solid currentColor; }
#dialogue li[data-role="system"] { padding-inline-start: .75rem; border-inline-start: .2rem dashed currentColor; font-size: .92em; }
#message { width: 100%; min-height: 3.5rem; box-sizing: border-box; } #message { width: 100%; min-height: 3.5rem; box-sizing: border-box; }
#message-tools { display: flex; flex-wrap: wrap; align-items: center; gap: .5rem; } #message-tools { display: flex; flex-wrap: wrap; align-items: center; gap: .5rem; }
#voice-status { min-height: 1.5em; } #voice-status { min-height: 1.5em; }
@@ -38,6 +39,16 @@
#debug-trace details { border: 1px solid currentColor; border-radius: .3rem; padding: .5rem; } #debug-trace details { border: 1px solid currentColor; border-radius: .3rem; padding: .5rem; }
#debug-trace summary { cursor: pointer; overflow-wrap: anywhere; } #debug-trace summary { cursor: pointer; overflow-wrap: anywhere; }
#debug-trace pre { white-space: pre-wrap; overflow-wrap: anywhere; font: .8rem/1.45 ui-monospace, monospace; } #debug-trace pre { white-space: pre-wrap; overflow-wrap: anywhere; font: .8rem/1.45 ui-monospace, monospace; }
.trace-chain { display: grid; gap: .65rem; margin-block: .75rem; }
.trace-step { border: 1px solid currentColor; border-inline-start: .35rem solid currentColor; border-radius: .3rem; padding: .65rem; }
.trace-step[data-engine="player"] { border-inline-start-color: #64748b; }
.trace-step[data-engine="ai"] { border-inline-start-color: #2563eb; }
.trace-step[data-engine="luau"] { border-inline-start-color: #9333ea; }
.trace-step[data-engine="rust"] { border-inline-start-color: #c2410c; }
.trace-step h3 { font-size: 1rem; margin: 0 0 .5rem; }
.trace-step .trace-engine { font-weight: 750; }
.trace-step pre { margin: .25rem 0 .75rem; }
.trace-raw { margin-block-start: .75rem; }
@media (max-width: 800px) { @media (max-width: 800px) {
body.debug-layout { height: auto; overflow: auto; } body.debug-layout { height: auto; overflow: auto; }
#play-layout.debug-enabled { grid-template-columns: minmax(0, 1fr); height: auto; } #play-layout.debug-enabled { grid-template-columns: minmax(0, 1fr); height: auto; }
@@ -70,8 +81,8 @@
<form id="message-form"> <form id="message-form">
<label for="message" id="message-label">Skriv ett meddelande</label> <label for="message" id="message-label">Skriv ett meddelande</label>
<textarea id="message" name="message" maxlength="4000" aria-describedby="message-help" autocomplete="off"></textarea> <textarea id="message" name="message" maxlength="4000" aria-describedby="message-help" autocomplete="off"></textarea>
<div id="message-tools"><button type="button" id="microphone" aria-pressed="false" aria-describedby="voice-status">Starta mikrofon</button></div> <div id="message-tools"><button type="submit" id="send-message">Skicka</button> <button type="button" id="microphone" aria-pressed="false" aria-describedby="voice-status">Starta mikrofon</button> <button type="button" id="redo-action" disabled>Gör om senaste</button> <button type="button" id="dry-run-action" disabled>Torrkör senaste</button></div>
<span id="message-help" class="sr-only">Tryck Enter för att skicka. Tryck Skift och Enter för ny rad.</span> <span id="message-help" class="sr-only">Tryck på Skicka eller Enter för att skicka. Tryck Skift och Enter för ny rad.</span>
</form> </form>
<p id="voice-status" role="status" aria-live="polite"></p> <p id="voice-status" role="status" aria-live="polite"></p>
<div id="speech-progress-container" hidden> <div id="speech-progress-container" hidden>
@@ -82,7 +93,7 @@
</section> </section>
<aside id="debug-panel" aria-labelledby="debug-heading" hidden> <aside id="debug-panel" aria-labelledby="debug-heading" hidden>
<h2 id="debug-heading">Beslutsspårning</h2> <h2 id="debug-heading">Beslutsspårning</h2>
<p>Administratörsvy för ditt eget spelkonto. Promptar, modelltrafik, regelresultat och Rust-commit visas från revisionsloggad API-data. Hemligheter och credentials ska vara maskerade av servern.</p> <p>Administratörsvy för ditt eget spelkonto. Varje steg visar sparad indata och utdata i kedjan: spelare (grå), AI (blå), Luau (lila) och Rust (orange). Promptar, modelltrafik, regelresultat och commit visas från revisionsloggad API-data. Hemligheter och credentials maskeras av servern.</p>
<button type="button" id="debug-refresh">Uppdatera spår</button> <button type="button" id="debug-refresh">Uppdatera spår</button>
<p id="debug-status" role="status" aria-live="polite">Hämtar spårning…</p> <p id="debug-status" role="status" aria-live="polite">Hämtar spårning…</p>
<div id="debug-trace" aria-label="Kronologiskt beslutsspår"></div> <div id="debug-trace" aria-label="Kronologiskt beslutsspår"></div>
@@ -126,6 +137,7 @@
let submitBusy = false; let submitBusy = false;
let pendingDialogue = null; let pendingDialogue = null;
let latestAssistantText = ''; let latestAssistantText = '';
let latestPlayerAction = '';
let latestAssistantVoice = {role: 'narrator', voiceIdentity: 'neutral'}; let latestAssistantVoice = {role: 'narrator', voiceIdentity: 'neutral'};
let speechRecoveryElement = null; let speechRecoveryElement = null;
const voiceSettingsKey = 'ai-spel.voice-settings.v2'; const voiceSettingsKey = 'ai-spel.voice-settings.v2';
@@ -280,6 +292,8 @@
function refreshMicrophone() { function refreshMicrophone() {
const button = document.querySelector('#microphone'); const button = document.querySelector('#microphone');
if (button) button.disabled = play.hidden || messageField.disabled || submitBusy; if (button) button.disabled = play.hidden || messageField.disabled || submitBusy;
const sendButton = document.querySelector('#send-message');
if (sendButton) sendButton.disabled = play.hidden || messageField.disabled || submitBusy;
} }
function persistVoiceSettings() { function persistVoiceSettings() {
voiceSettings.mode = 'game-voice'; voiceSettings.mode = 'game-voice';
@@ -437,6 +451,7 @@
: next === 'world-draft' : next === 'world-draft'
? 'Ändra startförslaget eller skriv “godkänn”' ? 'Ändra startförslaget eller skriv “godkänn”'
: 'Skriv vad du vill göra eller fråga'; : 'Skriv vad du vill göra eller fråga';
refreshActionTools();
messageField.focus(); messageField.focus();
} }
function showAuth() { function showAuth() {
@@ -671,7 +686,9 @@
const lines = await request('/api/dialogue'); const lines = await request('/api/dialogue');
transcript.replaceChildren(); transcript.replaceChildren();
latestAssistantText = ''; latestAssistantText = '';
for (const line of lines) appendLine(line.role === 'user' ? 'user' : 'assistant', line.content, {speak: false}); latestPlayerAction = [...lines].reverse().find(line => line.role === 'user')?.content || '';
for (const line of lines) appendLine(line.role === 'user' ? 'user' : line.role === 'system' ? 'system' : 'assistant', line.content, {speaker: line.speaker, speak: false});
refreshActionTools();
if (lines.length > 0 && latestAssistantText && location.pathname !== '/admin') { if (lines.length > 0 && latestAssistantText && location.pathname !== '/admin') {
voiceController?.speak(latestAssistantText, {role: 'narrator', voiceIdentity: 'neutral'}); voiceController?.speak(latestAssistantText, {role: 'narrator', voiceIdentity: 'neutral'});
} else if (lines.length === 0 && gameState?.world) { } else if (lines.length === 0 && gameState?.world) {
@@ -705,7 +722,7 @@
} }
function traceTimestamp(record) { function traceTimestamp(record) {
return record.recorded_at || record.requested_at || record.completed_at || ''; return record.recorded_at || record.requested_at || record.completed_at || record.created_at || '';
} }
function renderDecisionTrace(data) { function renderDecisionTrace(data) {
const groups = new Map(); const groups = new Map();
@@ -734,9 +751,91 @@
const eventNames = group.events.map(event => `${event.event_type} (${event.commit_status || 'okänt utfall'})`).join(', '); const eventNames = group.events.map(event => `${event.event_type} (${event.commit_status || 'okänt utfall'})`).join(', ');
const prompts = group.ai_interactions.map(interaction => `${interaction.prompt_id} v${interaction.prompt_version}: ${interaction.outcome}`).join(', '); const prompts = group.ai_interactions.map(interaction => `${interaction.prompt_id} v${interaction.prompt_version}: ${interaction.outcome}`).join(', ');
summary.textContent = `${group.latest || 'Tid saknas'} · ${group.correlation_id}${eventNames ? ` · Rust: ${eventNames}` : ''}${prompts ? ` · AI: ${prompts}` : ''}`; summary.textContent = `${group.latest || 'Tid saknas'} · ${group.correlation_id}${eventNames ? ` · Rust: ${eventNames}` : ''}${prompts ? ` · AI: ${prompts}` : ''}`;
const chain = document.createElement('div');
chain.className = 'trace-chain';
const addStep = (engine, title, input, output, note = '') => {
const card = document.createElement('article');
card.className = 'trace-step';
card.dataset.engine = engine;
const heading = document.createElement('h3');
const label = document.createElement('span');
label.className = 'trace-engine';
label.textContent = `${engine === 'luau' ? 'Luau' : engine === 'ai' ? 'AI' : engine === 'rust' ? 'Rust' : 'Spelare'} · `;
heading.append(label, document.createTextNode(title));
card.append(heading);
if (note) {
const noteElement = document.createElement('p');
noteElement.textContent = note;
card.append(noteElement);
}
const addValue = (name, value) => {
const valueHeading = document.createElement('strong');
valueHeading.textContent = name;
const pre = document.createElement('pre');
pre.textContent = typeof value === 'string' ? value : JSON.stringify(value ?? 'Ingen uppgift sparad', null, 2);
card.append(valueHeading, pre);
};
addValue('Indata', input);
addValue('Utdata', output);
chain.append(card);
};
const orderedEvents = [...group.events].sort((a, b) => traceTimestamp(a).localeCompare(traceTimestamp(b)));
const orderedInteractions = [...group.ai_interactions].sort((a, b) => traceTimestamp(a).localeCompare(traceTimestamp(b)));
const playerMessages = [
...orderedEvents.map(event => event.payload?.player_message).filter(Boolean),
...group.player_messages.map(message => message.message).filter(Boolean),
];
for (const [index, message] of playerMessages.entries()) {
addStep('player', `Spelarens avsikt ${playerMessages.length > 1 ? index + 1 : ''}`, message, {submitted: true});
}
for (const interaction of orderedInteractions) {
const external = interaction.external_call || {};
const isCompaction = interaction.prompt_id === 'dialogue-context-compaction';
addStep('ai', `${isCompaction ? 'Kontextkomprimering' : interaction.prompt_id} · v${interaction.prompt_version} · ${interaction.outcome}`,
{prompt_yaml: interaction.prompt_yaml, rendered_messages: interaction.rendered_messages, provider: external.service, model: external.model, thinking_effort: external.thinking_effort, provider_request: external.request},
{response: interaction.response, outcome: interaction.outcome, provider_status: external.response_status, provider_response: external.response_body, provider_error: external.error, duration_ms: external.duration_ms, rust_interpretation_and_validation: interaction.metadata},
isCompaction
? 'Äldre privat dialog kondenseras; kontrollera källhändelser, prompt, modellsvar, sammanfattningshash och sparad sekvens. Sammanfattningen är inte kanonisk världssanning.'
: 'AI-förslag och providertrafik. Förslaget är inte i sig ett fastställt världsfaktum.');
const metadata = interaction.metadata || {};
if (metadata.validation_inputs || metadata.validation_results || metadata.decision?.includes?.('rule')) {
addStep('luau', `Regelutkast och tester · ${metadata.rule_key || metadata.activity_key || interaction.prompt_id}`,
{rule_draft: interaction.response, test_inputs: metadata.validation_inputs},
{decision: metadata.decision || interaction.outcome, test_results: metadata.validation_results, source_hash: metadata.source_hash, rule_id: metadata.rule_id, rule_version: metadata.rule_version},
'Luau körs med isolerade testindata; resultatet kontrolleras av Rust innan regeln aktiveras.');
}
}
for (const event of orderedEvents) {
const payload = event.payload || {};
const domain = payload.details || {};
const luau = domain.luau_trace;
if (luau) {
addStep('luau', `Regelkörning · ${domain.activity_key || domain.rule_id || 'regel'}`,
{source: event.rule_source || 'Källkod saknas i denna spårpost.', invocation: luau.input},
luau.error ? {error: luau.error, output: luau.output} : luau.output,
`Regel ${domain.rule_id || 'okänd'} version ${domain.rule_version ?? 'okänd'} · hash ${domain.rule_hash || 'saknas'}`);
addStep('rust', 'Effektvalidering och världskommando',
{proposed_effects: domain.rust_validation?.input_effects || luau.output, activity: domain.activity_key, world_version_before: luau.input?.snapshot?.version},
{validation: domain.rust_validation, committed_event: event.event_type, commit_status: event.commit_status, commit_sequence: event.commit_sequence, world_time: event.world_time, committed_details: domain},
'Rust verifierar typade effekter och skriver den godkända förändringen atomärt.');
} else {
addStep('rust', `Domänbeslut och commit · ${event.event_type}`,
{player_intent: payload.player_message, interpreted_intent: payload.intent, details: domain, world_version: payload.world_version},
{commit_status: event.commit_status, commit_sequence: event.commit_sequence, world_time: event.world_time, event_id: event.event_id},
'Rust fastställer om handlingen kan committas till den kanoniska världen.');
}
}
const raw = document.createElement('details');
raw.className = 'trace-raw';
const rawSummary = document.createElement('summary');
rawSummary.textContent = 'Visa all rå spårdata';
const pre = document.createElement('pre'); const pre = document.createElement('pre');
pre.textContent = JSON.stringify(group, null, 2); pre.textContent = JSON.stringify(group, null, 2);
details.append(summary, pre); raw.append(rawSummary, pre);
details.append(summary, chain, raw);
debugTrace.append(details); debugTrace.append(details);
} }
} }
@@ -813,7 +912,12 @@
messageField.disabled = false; messageField.disabled = false;
messageField.focus(); messageField.focus();
} }
async function handleGameMessage(message) { function refreshActionTools() {
const enabled = stage === 'game' && Boolean(latestPlayerAction) && !submitBusy;
document.querySelector('#redo-action').disabled = !enabled;
document.querySelector('#dry-run-action').disabled = !enabled;
}
async function handleGameMessage(message, actionMode = 'normal') {
if (/^logga ut[.!]?$/i.test(message.trim())) { if (/^logga ut[.!]?$/i.test(message.trim())) {
appendLine('user', message); appendLine('user', message);
await handleLogout(); await handleLogout();
@@ -833,12 +937,13 @@
else await proposeWorld(message); else await proposeWorld(message);
return; return;
} }
if (await handlePlayerMessageCommand(message)) return; if (actionMode === 'normal' && await handlePlayerMessageCommand(message)) return;
const idempotencyKey = pendingDialogue?.message === message if (actionMode === 'normal') latestPlayerAction = message;
const idempotencyKey = actionMode === 'normal' && pendingDialogue?.message === message
? pendingDialogue.idempotencyKey ? pendingDialogue.idempotencyKey
: crypto.randomUUID(); : crypto.randomUUID();
pendingDialogue = {message, idempotencyKey}; if (actionMode === 'normal') pendingDialogue = {message, idempotencyKey};
appendLine('user', message); appendLine('user', message, actionMode === 'dry_run' ? {speaker: 'Torrkörning'} : actionMode === 'redo' ? {speaker: 'Gör om'} : {});
messageField.disabled = true; messageField.disabled = true;
try { try {
let result; let result;
@@ -847,7 +952,7 @@
result = await request('/api/dialogue', { result = await request('/api/dialogue', {
method: 'POST', method: 'POST',
headers: {'content-type': 'application/json'}, headers: {'content-type': 'application/json'},
body: JSON.stringify({message, expected_world_version: gameState.world.version, idempotency_key: idempotencyKey}), body: JSON.stringify({message, expected_world_version: gameState.world.version, idempotency_key: idempotencyKey, forget_previous_turn: actionMode !== 'normal', dry_run: actionMode === 'dry_run'}),
}); });
break; break;
} catch (error) { } catch (error) {
@@ -856,19 +961,30 @@
if (!gameState.world) throw new Error('world_not_available'); if (!gameState.world) throw new Error('world_not_available');
} }
} }
gameState.world.version = result.world_version; if (result.status !== 'dry_run') {
gameState.world.world_time = result.world_time; gameState.world.version = result.world_version;
pendingDialogue = null; gameState.world.world_time = result.world_time;
if (result.intent === 'move' || result.intent === 'meet') { pendingDialogue = null;
}
if (result.status !== 'dry_run' && (result.intent === 'move' || result.intent === 'meet')) {
try { try {
const refreshed = await request('/api/world'); const refreshed = await request('/api/world');
if (refreshed.world) gameState = refreshed; if (refreshed.world) gameState = refreshed;
} catch (_) { /* The committed dialogue stays successful if this optional view refresh fails. */ } } catch (_) { /* The committed dialogue stays successful if this optional view refresh fails. */ }
} }
const speakingNpc = ['speak', 'meet'].includes(result.intent) ? gameState.world.npc : null; const speakingNpc = result.status !== 'dry_run' && ['speak', 'meet'].includes(result.intent) ? gameState.world.npc : null;
appendLine('assistant', result.reply, speakingNpc for (const ruleName of result.debug_rules_created || []) {
appendLine('assistant', ruleName, {speaker: 'Nya regler', speak: false});
}
appendLine('assistant', result.reply, result.status === 'dry_run'
? {speaker: 'Torrkörning', voice: {role: 'narrator', voiceIdentity: 'neutral'}}
: speakingNpc
? {speaker: speakingNpc.name, voice: {characterId: speakingNpc.id, voiceIdentity: speakingNpc.voice_identity}} ? {speaker: speakingNpc.name, voice: {characterId: speakingNpc.id, voiceIdentity: speakingNpc.voice_identity}}
: {speaker: 'Berättelsen', voice: {role: 'narrator', voiceIdentity: 'neutral'}}); : {speaker: 'Berättaren', voice: {role: 'narrator', voiceIdentity: 'neutral'}});
if (result.context_compaction?.notice) {
appendLine('system', result.context_compaction.notice, {speaker: 'Kontext', speak: false});
}
refreshActionTools();
} catch (error) { } catch (error) {
messageField.value = message; messageField.value = message;
appendLine('assistant', `${explainDialogueError(error)} Ditt meddelande ligger kvar i inmatningen.`); appendLine('assistant', `${explainDialogueError(error)} Ditt meddelande ligger kvar i inmatningen.`);
@@ -893,11 +1009,11 @@
if (location.pathname !== '/admin') voiceController.speak(status.textContent, {role: 'narrator', voiceIdentity: 'neutral'}); if (location.pathname !== '/admin') voiceController.speak(status.textContent, {role: 'narrator', voiceIdentity: 'neutral'});
} }
}); });
async function submitMessage(input, source = 'text') { async function submitMessage(input, source = 'text', actionMode = 'normal') {
if (submitBusy || messageField.disabled) return; if (submitBusy || messageField.disabled) return;
const message = String(input || '').trim(); const message = String(input || '').trim();
if (!message) return; if (!message) return;
if (handleVoiceCommand(message, source)) { messageField.value = ''; return; } if (actionMode === 'normal' && handleVoiceCommand(message, source)) { messageField.value = ''; return; }
submitBusy = true; submitBusy = true;
refreshMicrophone(); refreshMicrophone();
voiceController.stopListening(); voiceController.stopListening();
@@ -909,11 +1025,12 @@
messageField.value = ''; messageField.value = '';
try { try {
if (stage === 'biography') await handleBiography(message); if (stage === 'biography') await handleBiography(message);
else await handleGameMessage(message); else await handleGameMessage(message, actionMode);
} catch (error) { } catch (error) {
appendLine('assistant', `Det gick inte att genomföra begäran: ${error.message}`); appendLine('assistant', `Det gick inte att genomföra begäran: ${error.message}`);
} finally { } finally {
submitBusy = false; submitBusy = false;
refreshActionTools();
refreshMicrophone(); refreshMicrophone();
if (currentAccount?.is_admin) await refreshDecisionTrace(); if (currentAccount?.is_admin) await refreshDecisionTrace();
if (!play.hidden && !messageField.disabled) messageField.focus(); if (!play.hidden && !messageField.disabled) messageField.focus();
@@ -1004,6 +1121,12 @@
event.preventDefault(); event.preventDefault();
await submitMessage(messageField.value); await submitMessage(messageField.value);
}); });
document.querySelector('#redo-action').addEventListener('click', () => {
if (latestPlayerAction) submitMessage(latestPlayerAction, 'button', 'redo');
});
document.querySelector('#dry-run-action').addEventListener('click', () => {
if (latestPlayerAction) submitMessage(latestPlayerAction, 'button', 'dry_run');
});
document.querySelectorAll('[data-admin-view]').forEach(button => button.addEventListener('click', async () => { document.querySelectorAll('[data-admin-view]').forEach(button => button.addEventListener('click', async () => {
adminContent.setAttribute('aria-busy', 'true'); adminContent.setAttribute('aria-busy', 'true');
try { try {
+17
View File
@@ -7,6 +7,23 @@ export function createOnnxWasmPaths(origin) {
export function configureOnnxRuntime(onnxRuntime) { export function configureOnnxRuntime(onnxRuntime) {
if (!onnxRuntime?.env?.wasm) throw new TypeError('ONNX Runtime WebAssembly settings are unavailable.'); if (!onnxRuntime?.env?.wasm) throw new TypeError('ONNX Runtime WebAssembly settings are unavailable.');
// Piper 1.0.3 overwrites this value in TtsSession.init() with
// navigator.hardwareConcurrency. Override that source as well, otherwise an
// iPad may start a large WASM worker pool despite this setting.
const navigatorObject = globalThis.navigator;
if (navigatorObject && navigatorObject.hardwareConcurrency !== 1) {
try {
Object.defineProperty(navigatorObject, 'hardwareConcurrency', {
configurable: true,
value: 1,
});
} catch (_) {
// The check below converts an unsupported override into a clear error.
}
}
if (navigatorObject && navigatorObject.hardwareConcurrency !== 1) {
throw new Error('Piper could not be restricted to one processor thread.');
}
// Piper already runs in a worker. Avoid a second worker pool on mobile Safari. // Piper already runs in a worker. Avoid a second worker pool on mobile Safari.
onnxRuntime.env.wasm.numThreads = 1; onnxRuntime.env.wasm.numThreads = 1;
onnxRuntime.env.wasm.initTimeout = 60000; onnxRuntime.env.wasm.initTimeout = 60000;
+13 -2
View File
@@ -17,8 +17,19 @@ function getWorker() {
request.onProgress?.(message.progress); request.onProgress?.(message.progress);
} else { } else {
pending.delete(message.id); pending.delete(message.id);
if (message.type === 'audio') request.resolve(new Blob([message.audio], {type: 'audio/x-wav'})); if (message.type === 'audio') {
else request.reject(new Error(message.error || 'Piper-arbetaren misslyckades.')); request.resolve(new Blob([message.audio], {type: 'audio/x-wav'}));
} else {
const error = new Error(message.error || 'Piper-arbetaren misslyckades.');
request.reject(error);
// TtsSession keeps a singleton even when ONNX initialization fails.
// Discard the whole worker so a player retry starts with a clean ONNX
// module and does not reuse a poisoned WASM initialization.
for (const queued of pending.values()) queued.reject(error);
pending.clear();
worker?.terminate();
worker = null;
}
} }
}; };
worker.onerror = event => { worker.onerror = event => {
+5 -2
View File
@@ -28,6 +28,7 @@ grep -q "retry.textContent = 'Läs senaste repliken'" index.html
grep -q "location.pathname !== '/admin'" index.html grep -q "location.pathname !== '/admin'" index.html
grep -q "if (options.speak !== false && location.pathname !== '/admin')" index.html grep -q "if (options.speak !== false && location.pathname !== '/admin')" index.html
grep -q 'id="microphone" aria-pressed="false"' index.html grep -q 'id="microphone" aria-pressed="false"' index.html
grep -q 'type="submit" id="send-message">Skicka</button>' index.html
grep -q 'id="voice-status" role="status" aria-live="polite"' index.html grep -q 'id="voice-status" role="status" aria-live="polite"' index.html
grep -q 'id="speech-progress" aria-label="Nedladdning av svensk röstmodell"' index.html grep -q 'id="speech-progress" aria-label="Nedladdning av svensk röstmodell"' index.html
grep -q 'id="speech-progress-value"' index.html grep -q 'id="speech-progress-value"' index.html
@@ -59,6 +60,8 @@ grep -q 'new ReadableStream' piper-download-progress.mjs
grep -q 'createOnnxWasmPaths(self.location.origin)' piper-worker.js grep -q 'createOnnxWasmPaths(self.location.origin)' piper-worker.js
grep -q 'configureOnnxRuntime(onnxRuntime)' piper-worker.js grep -q 'configureOnnxRuntime(onnxRuntime)' piper-worker.js
grep -q 'numThreads = 1' piper-onnx-config.mjs grep -q 'numThreads = 1' piper-onnx-config.mjs
grep -q "hardwareConcurrency'" piper-onnx-config.mjs
grep -q 'Piper could not be restricted to one processor thread' piper-onnx-config.mjs
grep -q '/static/piper-wasm-v1/onnx/' piper-onnx-config.mjs grep -q '/static/piper-wasm-v1/onnx/' piper-onnx-config.mjs
grep -q 'PIPER_MODEL_ORIGIN' piper-model-routing.mjs grep -q 'PIPER_MODEL_ORIGIN' piper-model-routing.mjs
grep -q '/static/piper-wasm-v1/voices/' piper-model-routing.mjs grep -q '/static/piper-wasm-v1/voices/' piper-model-routing.mjs
@@ -99,8 +102,8 @@ if grep -Eq 'id="(new-character|world-setup|shop|buy-offer|balance|inventory|pla
echo 'The active player UI must not contain permanent data panels, forms, or action buttons.' >&2 echo 'The active player UI must not contain permanent data panels, forms, or action buttons.' >&2
exit 1 exit 1
fi fi
if sed -n '/<section id="play"/,/^ <\/section>/p' index.html | grep '<button' | grep -v 'id="microphone"' >/dev/null; then if sed -n '/<section id="play"/,/^ <\/section>/p' index.html | grep '<button' | grep -Ev 'id="(microphone|send-message)"' >/dev/null; then
echo 'Only the microphone control may appear beside the game text input.' >&2 echo 'Only the send and microphone controls may appear beside the game text input.' >&2
exit 1 exit 1
fi fi
+13 -4
View File
@@ -14,10 +14,19 @@ test('ONNX Runtime base URL rejects an invalid worker origin', async () => {
assert.throws(() => createOnnxWasmPaths('undefined'), TypeError); assert.throws(() => createOnnxWasmPaths('undefined'), TypeError);
}); });
test('ONNX Runtime uses one thread and a bounded startup timeout', async () => { test('Piper and ONNX Runtime stay on one thread even though Piper overwrites ONNX settings', async () => {
const {configureOnnxRuntime} = await import('../piper-onnx-config.mjs'); const {configureOnnxRuntime} = await import('../piper-onnx-config.mjs');
const navigatorObject = {hardwareConcurrency: 8};
const previousNavigator = globalThis.navigator;
Object.defineProperty(globalThis, 'navigator', {configurable: true, value: navigatorObject});
const runtime = {env: {wasm: {numThreads: 0, initTimeout: 0}}}; const runtime = {env: {wasm: {numThreads: 0, initTimeout: 0}}};
configureOnnxRuntime(runtime); try {
assert.equal(runtime.env.wasm.numThreads, 1); configureOnnxRuntime(runtime);
assert.equal(runtime.env.wasm.initTimeout, 60000); assert.equal(navigatorObject.hardwareConcurrency, 1);
assert.equal(runtime.env.wasm.numThreads, 1);
assert.equal(runtime.env.wasm.initTimeout, 60000);
} finally {
if (previousNavigator === undefined) delete globalThis.navigator;
else Object.defineProperty(globalThis, 'navigator', {configurable: true, value: previousNavigator});
}
}); });
+6
View File
@@ -11,3 +11,9 @@ test('Piper worker is built and started as an ES module', async () => {
assert.match(buildScript, /outfile: join\(workerRoot, 'piper-worker\.js'\),\s*bundle: true,\s*format: 'esm'/); assert.match(buildScript, /outfile: join\(workerRoot, 'piper-worker\.js'\),\s*bundle: true,\s*format: 'esm'/);
assert.match(runtime, /new Worker\(workerUrl, \{type: 'module'\}\)/); assert.match(runtime, /new Worker\(workerUrl, \{type: 'module'\}\)/);
}); });
test('Piper runtime discards a worker after a failed initialization for a clean retry', async () => {
const runtime = await readFile(join(__dirname, '..', 'piper-runtime.js'), 'utf8');
assert.match(runtime, /TtsSession keeps a singleton even when ONNX initialization fails/);
assert.match(runtime, /worker\?\.terminate\(\);\s*worker = null;/);
});