---
title: "Hardpoint: speech to text"
description: "The stt hardpoint slot 1.0: the built-ins (parakeet-silero, native-parakeet-silero, in-process-parakeet), what a user speech recognizer does (the STT worker wire, a WebSocket on loopback, declared audio_in), its probe (the wire opens within 5 s) and its fallback; the ANE authority lane never replaces a user recognizer."
type: "living"
source: "docs/contracts/hardpoint.stt.v1.md"
verified: "2026-11-14"
group: "Contracts"
---

> **Living doc**, checked against the code 2026-11-14

hardpoint.stt.v1 — the `stt` slot: what a speech-recognition implementation must do to hear a session

- Status: **1.0, built**. The slot's interface contract under [hardpoint.v1](/docs/contracts/hardpoint.v1) and
  ADR 0059 §2. A minor version only adds.
- Owner: the gateway, at session bind. Budget leg: `speech_end_to_commit` in [turn-budget.v1](/docs/contracts/turn-budget.v1)
  (p50 1000 ms, p90 1200 ms). A text-only frontend binds no `stt` slot.

## Built-ins

| id | what it is |
|---|---|
| `parakeet-silero` | the default: the Parakeet relay worker over the STT worker wire |
| `native-parakeet-silero` | the native Parakeet worker, with its deployment admission |
| `in-process-parakeet` | Parakeet in the gateway's own process |

`[shadow_stt] mode = "authority"` puts the CoreML lane (ADR 0027) in front of a built-in. It does not replace a user
implementation.

## What an implementation does

A `stt` implementation receives the session's PCM: mono, 16-bit, 24 kHz. It answers VAD, partial and final transcript
frames on the STT worker wire, the WebSocket protocol `parakeet-silero` speaks (`crates/voice_gateway/src/stt.rs`).
The gateway reads it through the same adapter as a built-in. A transition or a fault rebuilds it at the same endpoint.

## Transports this build drives

| transport | wire | endpoint |
|---|---|---|
| `http_loopback` | the STT worker wire, a WebSocket | `ws://<loopback ip>:<port>/<path>` |

A server that speaks OpenAI's Realtime transcription session (speech.cpp, LocalAI, paddock, mlx-audio) binds through
the Realtime shim, `crates/realtime_stt_shim`. Its Catalog entry is
`catalog/hardpoints/speech-cpp-realtime/hardpoint.toml`. mynah-asr's streaming WebSocket (Nemotron 3.5, 16 kHz only)
binds through the mynah shim, `crates/mynah_stt_shim`, which resamples 24 to 16 kHz as it streams. Its Catalog entry
is `catalog/hardpoints/mynah-nemotron/hardpoint.toml`. Each shim is a separate process on this wire, and both share
`crates/stt_shim_wire`. Wyoming ASR waits for its own minor.

The manifest must declare `audio_in`. The endpoint must be a loopback address: an implementation that receives raw
audio stays local.

## Qualification probe

The probe opens the worker wire within 5 s and closes it. Its ms is the connect time. A failed probe binds the
manifest's `fallback`, reported `degraded {reason: qualification_failed}`.

