Network overview

Operations

Last 60 minutes · 1 minute resolution

Output throughput

—tokens / second

Requests

—selected window

Active now

—in flight

Avg latency

—milliseconds

Success rate

—— errors

Routable nodes

—— registered

GPUs online

—available devices

Warm models

—routable replicas

Throughput

Generated tokens / second

Output tokens

Waiting for traffic data

Traffic

Requests

Waiting for request data

Infrastructure

Routable Disconnected Offline