Nova Reliability Ops

Network Fabric Command

Track the backbone powering Nova Exchange. Inspect global service health, streaming latencies, and job queue saturation in real time. Data is fictional and crafted for interface exploration.

Global uptime 99.982%
Active regions 4
Open incidents 3

Realtime Edge Snapshot

  • Ingress rate 1.7M req/min
  • Average saturation 68.20%
  • Median error rate 0.22%
  • Weighted latency (P95) 129 ms

Edge Throughput

+2.40%

12.60 Gbps

Ingress Requests

+5.50%

1.7M req/min

P95 Latency

-3.70%

142 ms

Error Rate

-0.05%

0.18%

Capacity Utilisation

+1.20%

68.20%

Service Performance

Latency, error rates, and saturation across critical pipelines.

ServiceStatusRequests/minP95 latencyError rateSaturationTrajectory
Realtime Stream Gatewayoperational128K98 ms0.08%
63.00%
Portfolio Risk Enginewatch20K214 ms0.22%
72.00%
Notification Pipelineoperational85K143 ms0.11%
54.00%
Settlement APIdegraded7.4K286 ms0.46%
81.00%

Cluster Health

Regional compute footprints with resource utilisation and throughput.

us-east-1

218/260 nodes active

CPU 68%
Memory 71%
IOPS 148K

us-west-2

176/220 nodes active

CPU 74%
Memory 69%
IOPS 123K

eu-central-1

162/200 nodes active

CPU 63%
Memory 66%
IOPS 116K

ap-southeast-1

191/240 nodes active

CPU 71%
Memory 75%
IOPS 154K

Incident Timeline

Keep the loop tight with evolving events across the stack.

  • major
    Partial settlement delay

    Settlement API cold path exceeding 280ms. Canary nodes isolated; rerouting traffic.

    #INC-1842
  • minor
    Realtime stream jitter

    Transient latency spike on Sydney POP. Auto mitigation reduced impact to <2% of traffic.

    #INC-1841
  • critical
    Risk engine throttle

    Risk job queue approaching saturation. Scaling batch processors and precomputing exposures.

    #INC-1840

Job Queues

Real-time progress across the highest priority asynchronous workloads.

Risk recomputation

risk-recalc
In flight 48
Pending 132
ETA 06m
61.0% complete

Comms pipeline

notif-burst
In flight 11
Pending 28
ETA 02m
82.0% complete

Ledger jobs

ledger-rollup
In flight 22
Pending 64
ETA 04m
47.0% complete