Datadog Alert Noise Digest

Ranks Datadog monitors by action rate, not volume — then proposes specific thresholds with the percentile behind them. Never mutes a monitor.

NewNew8.9 KB snapshotStarter VM
Claude Code logo

What's inside

Harness

Claude Code

Plan

Starter

vCPU

1

Memory

2 GiB

Snapshot

8.9 KB

How it works · ~3 minutes

  1. 01 · Fork

    New isolated microVM on your subdomain — creator state included.

  2. 02 · Your keys

    Log into Claude Code with your own model credentials (BYOK).

  3. 03 · Ask it to work

    Open the terminal and give it a real job. You keep what ships.

30-day money-back on your first purchase · no free trial · keys never leave the VM

About this template

400 alerts a month. You act on thirty.

Everyone knows which monitors are noise. Nobody wants to be the person who muted the one that mattered — so the noise stays, and the real pages get skimmed.

Fixing that needs a number, not an opinion.

Noise is action rate, not volume

action_rate = triggers a human acknowledged ÷ total triggers

A monitor that fires 200 times and gets acted on 200 times is the best monitor you have. Volume alone says nothing, and the rules file says so explicitly.

When acknowledgement data isn't available it falls back to auto-resolve rate — the share of alerts that fixed themselves untouched — and tells you which metric it used. An alert that always self-resolves is telling you its threshold is wrong.

Four verdicts

  • RETUNE — high volume, low action rate, fast self-resolve. Gets a specific proposed threshold.
  • NEEDS OWNER — fires regularly, nobody acks. That's a routing problem, not a threshold one, so it proposes a team — never a mute.
  • FLAPPING — resolves and re-triggers inside the evaluation window. Gets a recovery threshold or a longer window.
  • HEALTHY — named explicitly. A report that flags everything is as useless as one that flags nothing.

Proposals are specific or they don't ship

"Raise the threshold" isn't a proposal.

"p95 over the last 30 days is 340ms; this fires at 200ms; propose 400ms" is — and every RETUNE comes with the percentile that justifies it.

The monitors it won't touch

Anything tagged or named as paging, SLO, security, data-loss, or billing is out of scope for retuning regardless of its numbers. They're listed in an Out of scope section so nobody assumes they were missed — they were excluded deliberately.

The reason is cost asymmetry: a missed page costs more than a noisy one.

What you supply

DD_API_KEY, DD_APP_KEY (both read-only) and DD_SITE, plus your own Claude Code login. Export them in your shell — nothing is stored in the template.

No Events API access? Drop a CSV export into ~/ddnoise/exports/ instead and it says which input it used.

The guard is a file, not a promise

~/ddnoise/policy/NOISE-RULES.md carries NEVER_MUTE, the actionability formula and the never-touch list. The skill reads it before every run. Muting the wrong monitor is how outages get missed, so that decision is never the agent's.

Where this stops

It reads monitors and drafts proposals. It does not mute, disable, delete, or edit a monitor, and it does not resolve incidents.

It won't call an alert a false positive — it can't know that from monitor state — and it won't give root cause, because it's reading alert metadata, not traces.

Verified on build: the skill, the working tree, the NEVER_MUTE guard, the action-rate rule and the never-touch list are present on a fresh fork, and no Datadog key shape exists in the snapshot. Running it on your own org is yours.

Inside this fork

Forking copies this template into a brand-new, fully isolated microVM on your own subdomain. Here's exactly what lands in it.

  • Claude Code agent

    The upstream harness, pre-installed — same version the creator ran.

  • Starter VM

    1 vCPU · 2 GiB RAM · 10 GiB disk.

  • Creator's /persist data

    The captured persist volume is copied byte-for-byte into your fork.

  • BYOK — your keys, your VM

    Add your model API keys after forking; they live only inside your microVM.

What this agent can do

1 skill

  • datadog-noise-digest

    Rank Datadog monitors by actionability, find the alerts nobody acts on, and draft retune / routing proposals. Use for alert fatigue or an…

What you'll configure after forking

Secrets are scrubbed from shared templates — these are the names you supply in your agent's terminal once it boots.

Environment variables

  • ANTHROPIC_API_KEY

Your turn

Your own Datadog Alert Noise Digest, live in about 3 minutes.

Forking copies this Claude Codeagent into a brand-new, fully isolated microVM on your own subdomain — the creator's /persist state and all. Add your own keys after it boots; they never leave the box. Don't love it? Your first jurniti purchase comes with 30 days to get every cent back.

New paid VM · BYOK · 30-day money-back on your first purchase · ~3 min to provision

Starter · fork

$25/ mo

Needs 1 of your own API key