2716d822c4
Two plans in wave 1 (parallel): - 39-01: Sentence-buffered TTS streaming + multi-language synthesis (VPIPE-07, VPIPE-08) - 39-02: Onboarding voice hardware capability probe (ONBRD-01, ONBRD-02) Co-Authored-By: Claude Opus 4.6 (1M context) <noreply@anthropic.com>
12 KiB
12 KiB
| phase | plan | type | wave | depends_on | files_modified | autonomous | requirements | must_haves | ||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| 39-voice-polish | 02 | execute | 1 |
|
true |
|
|
Purpose: New installs detect whether the machine can run STT/TTS before offering voice features, preventing users from enabling voice on incapable hardware. Output: Extended hardware probe with voice capability, updated VoiceStep with hardware-aware UI.
<execution_context> @$HOME/.claude/get-shit-done/workflows/execute-plan.md @$HOME/.claude/get-shit-done/templates/summary.md </execution_context>
@.planning/ROADMAP.md @.planning/REQUIREMENTS.md @.planning/phases/39-voice-polish/39-CONTEXT.md@server/src/services/hardware.ts @server/src/routes/hardware.ts @ui/src/components/onboarding/VoiceStep.tsx @ui/src/components/NexusOnboardingWizard.tsx @ui/src/hooks/useHardwareInfo.ts
From server/src/services/hardware.ts: ```typescript export type HardwareTier = "gpu" | "apple_silicon" | "cpu_only";export interface HardwareInfo { totalGb: number; freeGb: number; usableGb: number; platform: NodeJS.Platform; gpuName: string | null; gpuVramGb: number | null; unifiedMemory: boolean; hardwareTier: HardwareTier; cpuModel: string | null; }
export function hardwareService(): { detect(): Promise }
From ui/src/components/onboarding/VoiceStep.tsx:
```typescript
interface VoiceStepProps {
onEnable: () => void;
onSkip: () => void;
}
// Currently only checks for microphone via navigator.mediaDevices
// Does NOT check if Whisper/Piper binaries are available on server
From ui/src/hooks/useHardwareInfo.ts:
// Hook that fetches GET /system/providers and returns HardwareInfo
// Used by NexusOnboardingWizard.tsx
2. Extend HardwareInfo interface with `voiceCapability: VoiceCapability`.
3. Add `async detectVoiceCapability(): Promise<VoiceCapability>` to hardwareService:
- Probe whisper-cpp: try `execFile("whisper-cpp", ["--help"])` with 2s timeout. If resolves → whisperAvailable=true. If ENOENT → try `execFile("whisper", ["--help"])` as fallback. Both fail → false.
- Probe piper: try `execFile("piper", ["--help"])` with 2s timeout. If resolves → piperAvailable=true. Catch → false.
- voiceTierSufficient: true if hardwareTier is "apple_silicon" or "gpu", OR if "cpu_only" with freeGb >= 4
- Use execFile from node:child_process with promisify pattern (or the existing execFileAsync if extracted)
4. Call detectVoiceCapability() inside detect() AFTER the existing hardware detection, add result to HardwareInfo. Use a separate 3s timeout to avoid slowing down hardware detection if voice probes hang.
5. In hardware.ts route: no changes needed — it already returns the full HardwareInfo object from detect(), so voiceCapability will be included automatically.
6. Write tests in 39-voice-hardware-probe.test.ts:
- Mock execFile (child_process) to test whisper/piper detection
- Test voiceTierSufficient logic for each hardware tier
- Test that detectVoiceCapability timeout does not exceed 3s
2. Update VoiceStep props to accept voice capability:
```typescript
interface VoiceStepProps {
onEnable: () => void;
onSkip: () => void;
voiceCapability?: {
whisperAvailable: boolean;
piperAvailable: boolean;
voiceTierSufficient: boolean;
};
}
```
3. Update VoiceStep rendering logic:
- If voiceCapability is undefined (loading/missing): show current behavior (mic check only)
- If voiceCapability.voiceTierSufficient === false: show capability note ("Your hardware may not support voice features. Voice requires at least 4GB free RAM."), show Skip button only (no Enable), do NOT auto-skip — let user read the note
- If voiceCapability.whisperAvailable && voiceCapability.piperAvailable: show green checkmark next to STT and TTS labels ("Whisper detected", "Piper detected"), show Enable + Skip buttons
- If whisperAvailable but NOT piperAvailable: show checkmark for STT, warning for TTS ("Piper not found — install piper for voice output"), still allow Enable (voice input will work, output won't)
- If neither available but tier is sufficient: show note "Install whisper-cpp and piper for voice features", show Skip button, dim the Enable button but keep it clickable (user may install later)
4. In NexusOnboardingWizard.tsx, pass voiceCapability to VoiceStep:
- hardwareInfo already comes from useHardwareInfo hook
- Pass `voiceCapability={hardwareInfo?.voiceCapability}` to VoiceStep in step 4
5. Keep existing microphone detection in VoiceStep — it checks client-side mic availability which is complementary to server-side binary detection.
<success_criteria>
- ONBRD-01: Onboarding hardware probe reports Whisper STT and Piper TTS capability (whisperAvailable, piperAvailable, voiceTierSufficient in HardwareInfo)
- ONBRD-02: VoiceStep activates enable/skip when hardware is capable, shows capability note when below threshold
- Backward compatible: existing hardware endpoint still works, VoiceStep degrades gracefully if voiceCapability is undefined </success_criteria>