lilith-platform.live/scripts
Natalie cc8f39724b feat(infra): enhance raw GPU provision script for prospector OSS model deployment on DO
Adds `setup-vllm` action that outputs a full post-mesh script + systemd unit to:
- install vLLM on the raw Ubuntu GPU droplet (post NVIDIA)
- serve a recommended 2026 frontier OSS model (DeepSeek-R1-Distill-Llama-70B / Qwen3 equiv etc.) as OpenAI-compatible server on :8000
- notes for registering with model-boss coordinator so prospect tasks (prospect.classify, prospect.draft) route to the GPU

Updated create next-steps + usage to call it.

Once running + registered:
- quinn.api prospector (runner, classifier paths) uses it via existing model-boss + PROSPECT_LLM_BACKEND=modelboss + draft_engine=task
- Our fast local classifier (added earlier) remains as zero-cost pre-filter
- Pastebin canon stays live/dynamic
- Model updates: restart service or LoRA; no prospector code change needed

Matches uvlava TF GPU patterns (WG 10.9.0.6, raw image) and the replace-claude-deps goal. Use the script for raw/one-off; long-term TF in uvlava with gpu_enabled + custom user_data.
2026-06-28 11:56:20 -04:00
..
run infra: repoint @lilith npm registry + Forgejo from dead black to DO cocotte-forge; serve /photos from local disk 2026-06-28 08:09:33 -04:00
cluster-health.sh feat(messenger): canonical domain messenger.transquinnftw.com 2026-06-23 07:55:54 -04:00
prod-build-drift.ts fix(messenger): rename drift probe label and fix deploy deps resolution 2026-06-23 00:34:26 -04:00
prospector-black-claude-setup.sh fix(scripts): prospector-black-claude-setup verify step token quoting 2026-06-19 21:08:45 -05:00
prospector-health.sh chore(ci): typecheck-all.sh self-reports failing packages 2026-06-19 05:05:39 -05:00
provision-raw-gpu-droplet.sh feat(infra): enhance raw GPU provision script for prospector OSS model deployment on DO 2026-06-28 11:56:20 -04:00
quinn-admin-to-quinn-pg-migrate.ts
sqlite-to-pg-migrate.ts