Edge Command Workbench — デプロイガイド

プリセット

RK3576 Kev RKLLM

This preset deploys the tested Kev RKLLM path on RK3576 test platform. The engine export capacity is 8192 tokens, while the deployment guard and metadata limit requests to 2048 tokens because the 8K configuration caused global OOM on that device. The package records the runtime, engine, head, tokenizer, and metadata as separate pinned artifacts.

The 500-token reproducibility report for both RKLLM devices is archived at assets/evidence/context500-20261011/. It records 120 original and 120 reverse fixture cases per device; the fixture uses generated context and is not a general long-request accuracy claim.

1

Deploy the Kev Workbench

The container selects DECISION_BACKEND=rkllm and MODEL_ID=kev. Supply a complete model directory containing model.rkllm, kev_head.npz, tokenizer/tokenizer.json, and the pinned runtime at runtime/librkllmrt.so. The image contains the C helper only when built with the pinned RKLLM 1.3.1 headers.

リモート

Enter SSH credentials. Keep at least 3GB free for the RKLLM bootstrap; the measured fresh artifact peak is about 1.94GB with a 1GB reserve. The optional MODEL_SERVICES_JSON maps another model family to an already running HTTP service; the local Kev model remains the only model loaded by this container. VOICE_SERVICE_URL connects an existing compatible voice service and does not install ASR.

入力が必要な項目(SenseCraft Solution アプリで入力)
  • Device IP or hostname*
  • SSH username*
  • SSH password*
  • Remote model profiles JSON (optional)

    Map another model id to an existing HTTP model service; leave blank to use local Kev. RK3576 deployment context is limited to 2048 tokens.

  • Existing local voice service URL (optional)
トラブルシューティング
SymptomFix
The model is not readyCheck that model.rkllm, kev_head.npz, tokenizer/tokenizer.json, and runtime/librkllmrt.so are present in the supplied model directory, then deploy again.
The health response has another backend or model IDCheck the deployment fields and confirm this preset uses DECISION_BACKEND=rkllm and MODEL_ID=kev.
デプロイ後

Open http://<device-ip>:18768. Verification requires /api/health to report model_ready: true, backend: "rkllm", and model_id: "kev".

2

Open the Kev Workbench

Submit a request with candidate commands after the health check reports a ready Kev model.

RK3576 second validation

The second RK3576 test platform validation used the same pinned image and verified five HTTP 200 golden cases with 5/5 expected selections. The 2069-word boundary request encoded to 2088 tokens and was rejected with HTTP 422 before NPU execution. This run used the image-built helper and had no external helper, RKNN runtime, or GOMP mount. Raw evidence is assets/evidence/rk3576-release-0.3.1-20261011/second-validation/.

トラブルシューティング
SymptomFix
The workbench page does not openConfirm the health endpoint is ready at port 18768 before opening the page.
A request is rejected with HTTP 422Check the request size against the preset limit; the documented boundary case is rejected before NPU execution.