> ## Documentation Index
> Fetch the complete documentation index at: https://polargrid.mintlify.site/llms.txt
> Use this file to discover all available pages before exploring further.

# Models

> Available models, capabilities, and specifications

# Models

PolarGrid serves open-weight models on GPU-accelerated edge infrastructure. All models are available via our [OpenAI-compatible API](/api-reference/overview).

<Note>
  PolarGrid runs open-source models optimized for low-latency edge inference. These models are selected for speed and efficiency in real-time applications like voice AI. For workloads that require large cloud-hosted reasoning models (e.g., GPT-4, Gemini, Claude), use those providers directly — PolarGrid does not proxy requests to third-party APIs.
</Note>

## LLM Models

### Qwen 3.8 27B

| | |
| - | - |
| **Parameters** | 27B |
| **Quantization** | FP8 (native) |
| **Max context** | 262,144 tokens (256K) |
| **License** | Apache 2.0 |
| **Pricing** | $0.20 / 1M input tokens, $0.75 / 1M output tokens |

General-purpose large language model with strong performance across reasoning, coding, and multilingual tasks. Our largest deployed LLM, suitable for complex workloads where reply quality is the priority. Available fleet-wide on every edge node.

**Endpoint:** `POST /v1/chat/completions` with `"model": "qwen-3.8-27b"`

***

## Speech-to-Text Models

### Whisper Large V3 Turbo

| | |
| - | - |
| **Parameters** | 809M |
| **License** | Apache 2.0 |
| **Pricing** | \$0.004 / min |

OpenAI's Whisper model optimized for speed. Supports multilingual transcription with high accuracy.

**Endpoint:** `POST /v1/audio/transcriptions` with `"model": "whisper-large-v3-turbo"`

[Full model card →](/models/whisper-large-v3-turbo)

***

### Cohere Transcribe

| | |
| - | - |
| **Parameters** | 2B |
| **License** | [Apache 2.0](https://huggingface.co/CohereLabs/cohere-transcribe-03-2026) |
| **Supported languages** | English, French, German, Italian, Spanish, Portuguese, Greek, Dutch, Polish, Chinese, Japanese, Korean, Vietnamese, Arabic |
| **Pricing** | \$0.004 / min |

High-accuracy multilingual transcription with support for 14 languages. Supports punctuation toggling. Available on `yvr-02` (Blackwell production).

**Endpoint:** `POST /v1/audio/transcriptions?sync=true` with `"model": "cohere-transcribe-03-2026"` (use the full model ID; the short alias `cohere-transcribe` is not routable)

**Latency** (yvr-02 Blackwell, external bench from a Vancouver-area laptop, 100 sync runs, 2026-05-27): server inference p50 **238 ms** / p95 **305 ms**, server-only RTF p50 **0.041** (24× faster than real time). End-to-end TTFB p50 **1068 ms** is upload-dominated — each request ships a \~300 KB WAV body before inference can start; the network leg is the upload time, not POP-to-client RTT. See the [Cohere Transcribe model page](/models/cohere-transcribe-03-2026) for the full breakdown.

***

## Text-to-Speech Models

### Hume AI TADA

| | |
| - | - |
| **Parameters** | \~4B (Llama 3.2 3B text base + audio components) |
| **License** | [Llama 3.2 Community License](https://huggingface.co/HumeAI/tada-3b-ml) |
| **Output** | 24 kHz mono — caller picks the container via `response_format` (`pcm`, `wav`, or `mp3`) |
| **Supported languages** | English, French, German, Spanish, Italian, Portuguese, Polish, Japanese, Arabic, Chinese |
| **Capabilities** | Cross-lingual voice cloning, speed control (batch only) |
| **Streaming** | ✓ chunked HTTP, `pcm` + `opus` (per-token via decoupled Triton handler; `speed` not honored in streaming mode) |
| **Pricing** | \$0.009 / min |

Expressive text-to-speech with cross-lingual voice cloning. Generates natural-sounding speech across 10 languages from a short reference clip.

**Endpoint:** `POST /v1/audio/speech` with `"model": "tada-3b-ml"`

***

### Kokoro 82M

| | |
| - | - |
| **Parameters** | 82M |
| **License** | Apache 2.0 |
| **Streaming** | ✓ chunked HTTP, `pcm` + `opus` |
| **Pricing** | \$0.006 / min |

Lightweight, fast text-to-speech model. Ideal for low-latency voice applications where speed is critical.

**Endpoint:** `POST /v1/audio/speech` with `"model": "kokoro-82m"`

[Full model card →](/models/kokoro-82m)

***

## Voice Pipeline

### PersonaPlex

| | |
| - | - |
| **Parameters** | 7B |
| **Pipeline** | STT + LLM + TTS (end-to-end) |
| **Pricing** | \$0.070 / min |

Integrated voice-to-voice pipeline that combines speech recognition, language model reasoning, and speech synthesis into a single low-latency stream. Billed by wall-clock duration.

See the [PersonaPlex guide](/guides/personaplex) for setup details.

***

## Performance

Latency benchmarks per model and region are actively being measured. Performance depends on:

* **Client proximity** to the nearest [edge region](/guides/regions)
* **Model size** — smaller models have lower TTFT and higher throughput
* **Request complexity** — token count, audio length, streaming vs. batch

The [autorouter](https://autorouter.polargrid.ai) optimizes for the lowest-latency region automatically. For detailed performance data, [contact us](mailto:hello@polargrid.ai).

## Custom Models

Enterprise customers can deploy custom fine-tuned models on PolarGrid infrastructure. PolarGrid handles provisioning and loading — contact us to discuss your model requirements.

For custom model deployments, contact [hello@polargrid.ai](mailto:hello@polargrid.ai).

<CardGroup cols={2}>
  <Card title="Pricing" icon="dollar-sign" href="/pricing">
    See full pricing details and volume discounts
  </Card>

  <Card title="API Reference" icon="code" href="/api-reference/overview">
    Full endpoint documentation
  </Card>
</CardGroup>


This documentation is built and hosted on [Mintlify](https://mintlify.com), a developer documentation platform.