§ 03 · Technical Specifications

The numbers, exactly.

Implementation-grade specifications covering formats, quantization, hardware envelopes, compatibility, and failure semantics. Engineers can build against this page alone.

3.1

Supported model formats

FormatTarget runtimeUse caseSigned
GGUFllama.cpp (desktop, mobile)Quantized LLMs 1B–7BEd25519
ONNXONNX Runtime Web, mobileEncoder models, classifiers, embeddingsEd25519
MLC / WebLLMWebGPU browsersPrimary browser LLM pathEd25519
CoreML (mlpackage)iOS 17+Apple Neural Engine pathApple + MeshInfer.AI
LiteRT (TFLite)Android NNAPIFallback on older AndroidEd25519
3.2

Quantization matrix

LevelBits/weightQuality lossSpeed vs FP16Recommended for
Q4_K_M~4.5−2.1% MMLU3.2×Default — browser & mobile
Q5_K_M~5.5−0.9% MMLU2.4×Desktop with ≥16GB RAM
Q8_0~8.5−0.2% MMLU1.3×High-accuracy desktop
FP1616baseline1.0×Only via cloud fallback
Quantization is selected per-device at model download time based on the capability probe. Nodes can hold multiple quants and the Router picks at dispatch.
3.3

Browser compatibility matrix

BrowserMin versionWebGPUWASM SIMDVerdict
Chrome / Edge121+✓✓Full — primary target
Safari17.4+✓ (macOS/iOS)✓Full
Firefox127+⚠ flag✓WASM path (degrade to Q4)
Samsung Internet24+✓✓Full
WebViewsvariesvaries✓WASM path guaranteed
3.4

Hardware envelopes

Desktop (native client)

Minimum4-core x64/arm64 · 8GB RAM · integrated GPU · 10GB free disk
Recommended8-core · 16GB RAM · 6GB VRAM discrete GPU or Apple M1+
Premium16-core · 32GB RAM · 12GB+ VRAM · runs 7B Q5 @ 45 tok/s

Mobile

iOS minimumiPhone 13 / iPad M1 · iOS 17 · 4GB RAM
iOS recommendediPhone 15 Pro+ · A17 Pro / M-series · 8GB+ RAM
Android minimumSD 8 Gen 2 or equivalent · 8GB RAM · Android 14
Android recommendedSD 8 Gen 3, Dimensity 9300+ · 12GB RAM · Android 15
3.5

Security model

TransportTLS 1.3 only. HSTS preload. ECDHE + ChaCha20-Poly1305 preferred.
Task envelopesAES-256-GCM, keys per-session, derived via HKDF from TLS exporter
Model integrityEvery model bundle signed Ed25519. Refused on signature mismatch.
Sandbox (browser)Workers run in isolated realms. No DOM access. No network beyond signed Coordinator URLs.
Sandbox (desktop)Rust worker in seccomp/App Sandbox. No FS outside cache dir.
Prompt exposureLocal routes: prompt never leaves device. Mesh routes: encrypted end-to-end to peer; peer runs in isolated worker; result encrypted back.
Peer anonymityRequesting node never learns peer identity; Coordinator acts as blinded relay.
Data retentionCoordinator retains metadata only (no bodies) for 30 days. Configurable to 0.
ComplianceSOC 2 Type II (target Q3), GDPR DPA, HIPAA BAA (Enterprise), ISO 27001 (target 2027)
3.6

Task verification

Peer-dispatched tasks are verifiable without leaking plaintext:

Peer-dispatched tasks are verifiable without leaking plaintext. A configurable sample of tasks is duplicated to independent verifier nodes. Outputs are compared under deterministic decoding conditions to detect discrepancies. A hash mismatch escalates both outputs to a third verifier; the minority output is flagged suspicious and the node's reputation is penalized. Repeated suspicious results within a rolling window trigger node quarantine.

3.7

Failure recovery & retries

Failure classDetectionAction
Local OOMruntime error or RAM probeInstant re-route to mesh, then cloud
WebGPU lostGPUDevice.lost eventFall back to WASM path for this session
Peer timeout>2× SLOCancel, re-dispatch, decrement peer reputation
Cloud 5xxstatus ≥500Retry on next-best provider, max 1
Signature failEd25519 verifyDiscard bundle, blacklist source, alert
Network dropfetch/ws closeExponential backoff 250ms–8s, max 6 attempts
3.8

Rate limiting & throttling

Per API key600 req/min sliding window · 100k tokens/min
Per end-user60 req/min · customer-scoped (enforced in SDK + coordinator)
Per node (mesh work)120 tasks/min · prevents peer exploitation
Burst allowance2× limit for 10s, token-bucket refill
429 responseincludes Retry-After header + X-MeshInfer.AI-Reset-At epoch ms