#inference #latency #ml #openscience #serving #throughput #vllm

About this template

OpenScience ML Inference Lab

Fork → BYOK → pick a model + serve shape (online OpenAI-compatible API vs batch).

What you get

ml agent default for inference work
Skills: ml-inference-serve + ml-inference-bench
Layout: serve/, bench/, clients/, runbooks/ under ~/ml-inference-lab/

BYOK

export ANTHROPIC_API_KEY=sk-ant-…
export HF_TOKEN=hf_…  # optional

Demo

Ask the ml agent to design an OpenAI-compatible serve + p50/p99 bench scaffold.

Click Open OpenScience on your VM for the browser workspace.

Inside this fork

Forking copies this template into a brand-new, fully isolated microVM on your own subdomain. Here's exactly what lands in it.

OpenScience agent
The upstream harness, pre-installed — same version the creator ran.
Pro VM
2 vCPU · 6 GiB RAM · 50 GiB disk.
Creator's /persist data
The captured persist volume is copied byte-for-byte into your fork.
BYOK — your keys, your VM
Add your model API keys after forking; they live only inside your microVM.

What this agent can do

2 skills

ml-inference-bench
Latency/throughput benches
ml-inference-serve
Design inference serving stacks

What you'll configure after forking

Secrets are scrubbed from shared templates — these are the names you supply in your agent's terminal once it boots.

Environment variables

ANTHROPIC_API_KEY
GEMINI_API_KEY
HF_TOKEN
OPENAI_API_KEY
OPENROUTER_API_KEY

Related templates

Your own ML Inference Lab for OpenScience, live in about 3 minutes.

Forking copies this OpenScienceagent into a brand-new, fully isolated microVM on your own subdomain — the creator's /persist state and all. Add your own keys after it boots; they never leave the box. Don't love it? Your first jurniti purchase comes with 30 days to get every cent back.

New paid VM · BYOK · 30-day money-back on your first purchase · ~3 min to provision

What's inside