Part of Santh · blog · @SanthProject
keyhog scans source trees, git history, Docker images, S3 buckets, and
running systems for leaked credentials. 891 service-specific detectors,
decode-through (base64/hex/url/protobuf), confidence scoring, SARIF output,
zero runtime configuration. Default keyhog scan . works out of the box.
# .github/workflows/keyhog.yml
name: keyhog
on: [push, pull_request]
permissions: { contents: read, security-events: write }
jobs:
scan:
runs-on: ubuntu-latest
steps:
- uses: actions/checkout@v4
- uses: santhsecurity/keyhog/.github/actions/keyhog@v0.5.37
with: { path: ., severity: high, format: sarif }Cost to your CI: ~20 MB binary download (cacheable), ~400 ms cold-start
on hosted runners (GPU auto-disabled, SIMD path), ~10 s wall-clock for
a 5,000-file repo. Single libhyperscan5 apt package, no Python, no
JVM, no Docker daemon. Findings auto-upload to GitHub code-scanning as
SARIF; adopt without breaking an existing tree by committing a baseline
(keyhog scan --create-baseline .keyhog-baseline.json) so the action
fails only on NEW secrets.
For ultra-lean CI installs there's now cargo install keyhog --no-default-features --features ci: 13 MB binary (vs 22 MB full),
~140 ms cold-start, no Hyperscan dependency, no wgpu/Vulkan probe,
no libstdc++ link. Same 891 detectors, same ML/entropy/decode/multiline
data paths. Use this profile in self-built CI images where binary size
or container cold-start matters; the prebuilt installer above stays the
default for a turnkey single-binary download.
GitLab CI, CircleCI, Drone, BuildKite, Jenkins, Bazel, pre-commit, Husky,
lefthook recipes: docs/DROP_IN_USAGE.md.
keyhog compiles its 891 detectors into a single Hyperscan NFA database, decodes nested encodings before matching, calibrates confidence per detector via Bayesian Beta(α,β) feedback, and routes every scan to the fastest hardware backend present:
| Layer / Backend | When | How |
|---|---|---|
simdsieve prefilter |
AVX-512 / AVX2 / NEON | Layer 1: skims every file for the 8 highest-value secret prefixes (AWS AKIA/ASIA, GitHub ghp_, OpenAI sk-proj-, Slack xoxb-/xoxp-, SendGrid SG., Square sq0csp-) at up to 50 GB/s, before the regex backend runs |
gpu-zero-copy |
discrete GPU + ≥256 MiB scan | vyre AC automaton on GPU via WGPU (cross-platform) or optional CUDA backend |
simd-regex |
AVX-512 / AVX2 / NEON + Hyperscan | parallel multi-pattern NFA at ~500 MB/s |
cpu-fallback |
no SIMD, no GPU | Aho-Corasick prefix + Rust regex extraction |
The simdsieve prefilter is a performance layer, not a separate detector: a
hit surfaces under its canonical detector id (aws-access-key,
github-classic-pat, slack-bot-token, …) - identical on every platform and
build, whether the fast path or the full regex engine made the find.
Backend selection is automatic. On startup:
keyhog v0.5.37 | 16 cores | SIMD: AVX-512 | Hyperscan | 891 detectors
Full documentation: santhsecurity.github.io/keyhog - install, first scan, output formats, detection internals, suppressions, verification, pre-commit + CI integration, CLI reference, exit codes, env vars, contributing. Source under docs/.
# Linux / macOS
curl -fsSL https://raw.githubusercontent.com/santhsecurity/keyhog/main/install.sh | sh
# Windows (PowerShell)
iwr https://raw.githubusercontent.com/santhsecurity/keyhog/main/install.ps1 -useb | iex
# From source (any platform)
git clone https://github.com/santhsecurity/keyhog.git
cd keyhog && cargo build --release -p keyhog
# From crates.io
cargo install keyhog --no-default-features --features portable
install.sh(signed prebuilt) remains the recommended path because a freshcargo install keyhogsource-builds Hyperscan + the GPU stack (~3 minutes on a hosted runner) versus a ~20 MB signed-binary download in ~1 s.cargo install keyhogis the right path for developers who want a source build with their toolchain.
Works on Linux, macOS (Intel + Apple Silicon), Windows. Zero
configuration. keyhog scan . works out of the box.
The installer auto-detects host state and picks a sensible default:
WGPU + SIMD everywhere, including on Linux NVIDIA hosts - WGPU runs
the same vyre AC / RulePipeline dispatch on the GPU via the vulkan
backend, with a smaller binary and no libcuda.so runtime dependency.
The dedicated keyhog-linux-x86_64-cuda variant is only auto-picked
when the full CUDA toolkit is present (nvcc on PATH, $CUDA_HOME set,
or /usr/local/cuda exists) - the signal that you actively run a CUDA
development setup, not just an NVIDIA driver. Apple Silicon hosts get
an explicit "Metal GPU acceleration coming soon" note. Each download
is SHA256-verified against the release-side checksum file before
install.
Override the variant with KEYHOG_VARIANT=cuda (force the native CUDA
build, requires libcuda.so at runtime) or KEYHOG_VARIANT=cpu (force
the default WGPU + SIMD build, skip GPU detection entirely). Pin a
version with KEYHOG_VERSION=v0.5.37. Change the install dir with
KEYHOG_INSTALL=/usr/local/bin.
Three diagnostic modes ship with the same script:
sh install.sh --diagnose # print host + binary state, change nothing
sh install.sh --repair # re-download the right variant for this host
sh install.sh --uninstall # remove the binary (leaves PATH entries alone)For an interactive install (variant prompts + post-install wizard for PATH, shell completions, Claude Code / Cursor hook, git pre-commit hook), download the script first instead of piping into sh:
curl -fsSL https://raw.githubusercontent.com/santhsecurity/keyhog/main/install.sh \
-o keyhog-install.sh
sh keyhog-install.shDaemon mode (sub-100 ms pre-commit scans) is Unix only. Everything else works identically on Windows.
Once installed, keyhog maintains itself - the install script is only needed for the first install:
keyhog doctor # health check: host probe + end-to-end scan self-test
keyhog update # self-update to the latest release (verified download + atomic swap)
keyhog update --check # is a newer release available? (exits 10 if yes, 0 if current)
keyhog update --variant cuda # update to the CUDA build instead of the portable one
keyhog repair # reinstall a known-good binary if the self-test fails (--force to force)
keyhog uninstall # remove the binary (dry run; pass --yes to actually delete)keyhog doctor reuses the scanner's own hardware probe and runs a real
end-to-end self-test - it plants a synthetic secret and confirms the
binary detects it - so it is the authoritative "will keyhog work here?"
check (the installer runs it automatically after install). update and
repair download the release binary over HTTPS, verify its minisign
signature against keyhog's embedded public key, and atomically swap the
running binary in place; a tampered or unsigned-mismatched binary is
refused. On a healthy host keyhog update is the one-command upgrade
path.
keyhog scan . # scan a directory
keyhog scan --git-staged # pre-commit: only staged blobs
keyhog scan --git-diff main # files changed since base ref
keyhog scan --git-history . # every commit, every branch
keyhog scan --docker-image registry/app:v1 # Docker image layers
keyhog scan --s3-bucket logs-prod --s3-prefix / # S3 objects (--s3-endpoint for non-AWS)
keyhog scan --github-org acme --github-token "$GH_PAT" # every repo in a GitHub org (PAT required)
keyhog scan-system --space 50G # walk every drive, every git historyInteractive dashboard:
keyhog tui demo # live finding feed + GPU panel + stats
keyhog tui . --throttle-ms 200 # paced scan, useful for recordings/demosFilter, format, gate:
keyhog scan . --severity high # info | low | medium | high | critical
keyhog scan . --min-confidence 0.5 # raise the ML floor
keyhog scan . --format sarif -o keyhog.sarif # GitHub code scanning
keyhog scan . --verify # live-verify against vendor APIs
keyhog scan . --baseline .keyhog-baseline.json # only NEW findings vs snapshot
keyhog scan . --fast # pre-commit speed (skip ML + decode)
keyhog scan . --deep # max detection depth
keyhog scan . --incremental # BLAKE3 Merkle skip → 10–100× CI loopExit codes: 0 clean, 1 findings above the severity floor, 2 error
(bad path, unreadable file, unsupported flag), 3 detectors --audit
flagged a quality issue, 4 backend --self-test failed, 10 live
credentials found (requires --verify), 11 scanner thread panicked
mid-scan (state is unreliable, re-run before trusting). Matches
keyhog --help.
891 service-specific detectors with checksum / companion validation:
- Cloud providers . AWS (access key + secret + STS verification), Azure (subscription key, storage account key, SAS), GCP (service account, API key), Cloudflare, Heroku, Vercel, Supabase.
- Payment processors . Stripe, Braintree, Razorpay, Paddle, Plaid, Square, PayPal . all with companion-required validation (a Braintree private key without its public counterpart never fires).
- Source forges . GitHub PATs (with CRC32 checksum), GitLab tokens, Bitbucket app passwords, npm tokens (with checksum), Gitea / Forgejo / Codeberg.
- Auth / SSO . Okta, Auth0, Clerk, JumpCloud, Kinde.
- Comms . Slack, Discord, Twilio, SendGrid, Postmark, Mailgun, Resend, Loops.
- AI / ML . OpenAI (sk-/sk-proj-), Anthropic, Google AI Studio, Cohere, Mistral, HuggingFace, Replicate.
- Databases . Postgres connection strings, MongoDB Atlas, Supabase service-role, PlanetScale, Neon, Turso, MySQL, Redis URLs.
- Generic + entropy fallback .
API_KEY=<high-entropy-blob>catches credentials with no named detector, gated by per-context entropy thresholds + ML scoring. - Cryptographic material . RSA / EC / SSH private keys, PGP private blocks, JWT signing secrets.
Each detector ships as a TOML file (data, not code): service metadata, regex patterns, keywords, companion fields, verification handler. Adding a new detector is 5–10 lines of TOML; the contributor guide walks through it.
Browse the full catalog at /site/detectors.html -
loads all 891 with severity + service + keyword filter.
- Decode-through scanning. Kubernetes
Secretmanifests, JWT payloads, base64-wrapped envs, helm values, docker-configauth:blobs . the structured preprocessor decodes them in place and feeds every downstream detector the plaintext, so detectors don't each need to re-implement decoding. - Multiline reassembly.
"sk-proj-" + \continuation in JavaScript, YAML multi-line strings, Makefile backslash-continuation, Helm / Jinja templated outputs . all reassembled before regex matching. - Companion-required validation. AWS access key without its 40-char
secret? Skipped. Twilio API key without its auth token? Skipped.
Two-out-of-two signals are required for the high-noise detectors,
cutting the canonical
git log -G ghp_false-positive cluster. - Confidence scoring. Every finding carries a
[0.0, 1.0]score derived from Shannon entropy, surrounding context, companion match, checksum (GitHub CRC32, npm, Slack), and a small ML classifier (~30k params). Default threshold0.3filters low-quality matches without hiding real secrets. - Bayesian per-detector calibration.
keyhog calibrate --fp generic-api-keyfeeds a Beta(α,β) posterior that damps detectors that fire wrongly in your codebase, sharpening over time without manual rule tuning.
Measured head-to-head against the major scanners on the same corpora:
| KeyHog | Gitleaks | BetterLeaks | TruffleHog | Titus | |
|---|---|---|---|---|---|
| Recall (25-secret synthetic benchmark) | 96 % | 72 % | 72 % | 28 % | 32 % |
| Recall (15k SecretBench-mirror, v0.5.37) | 82.0 % | 41 % | 87.3 % * | 22 % | 25 % |
| Precision (SecretBench-mirror, v0.5.37) | 97.2 % | 87 % | 91.3 % * | 73 % | 19 % |
| F1 (SecretBench-mirror, v0.5.37) | 0.890 | 0.55 | 0.892 * | 0.34 | 0.22 |
| False positives (Django, 0 real secrets) | 1 | 0 | 0 | 0 | 17 481 |
| Speed (Django 86 MB) | 0.5 s | 0.3 s | 0.2 s | 1.4 s | 2.3 s |
| Speed (Kubernetes 397 MB) | 1.1 s | . | . | . | 3.5 s |
| Speed (large monorepo, 4.2 GB) | 2.5 s | . | . | . | 252 s |
* BetterLeaks' P/R/F1 figures cited from their own "Rare Not Random" post (token-efficiency + CEL stack). Same SecretBench-mirror corpus shape. v0.5.37 lands within 0.003 F1 of their headline while running 5.9 percentage points higher precision (fewer false positives per true catch).
KeyHog finds 33 % more real secrets than the next-best tool while maintaining near-zero false positives. The two recall numbers are both real: 96 % on a tight synthetic test set, 69 % on a 15k-fixture adversarial corpus that wraps secrets in realistic env-var distributions. Real codebases land between the two depending on how much CI / k8s / structured config they contain.
Reproduce: cargo bench --bench scan_throughput or run
./tools/secretbench/scoring/leaderboard.py --corpus <path> against
your own fixtures.
- uses: santhsecurity/keyhog/.github/actions/keyhog@v0.5.37
with:
path: .
severity: high # info | low | medium | high | critical
format: sarif # SARIF auto-uploads to GitHub code scanning
baseline: .keyhog-baseline.json # block only NEW findingsAuto-downloads a prebuilt binary; falls back to cargo build when no
release asset matches the host triple. SARIF carries CWE-798 + OWASP
A07:2021 taxa on every finding.
keyhog runs pure CPU/SIMD in CI - no GPU, no drivers, no CUDA toolkit.
keyhog auto-detects hosted CI runners (CI=true plus a dozen
provider-specific markers) and skips every GPU init path, routing all
work through the SIMD/CPU engine. There is nothing to configure: the
GPU is for interactive desktop scans on machines that have one, never a
requirement. Detection results are identical on CPU and GPU - the GPU
only changes throughput, never which secrets are found.
Self-hosted runner with a real GPU and want to use it? Set
KEYHOG_NO_GPU=0 to opt back in.
Building keyhog from source in CI (rather than the prebuilt binary)?
Use the portable feature - every detection feature, no system-library
build deps (skips the Hyperscan/Ghidra build step):
- run: cargo install keyhog --no-default-features --features portable
- run: keyhog scan . --format sarif --severity high > keyhog.sarifOther CIs (GitLab, CircleCI, Drone, BuildKite, Jenkins), pre-commit
recipes, Husky / lefthook, and the full SARIF schema:
site/ci.html and docs/DROP_IN_USAGE.md.
keyhog hook install # writes .git/hooks/pre-commit
keyhog hook uninstall # removes the keyhog-generated hookThe installed hook calls keyhog scan --fast --git-staged on every
commit. If keyhog daemon start is running, the in-process scan reuses
the daemon's compiled scanner for sub-50 ms latency; otherwise the
hook pays the ~3 s compile cost on each commit.
Or via the pre-commit framework:
repos:
- repo: https://github.com/santhsecurity/keyhog
rev: v0.5.37
hooks:
- id: keyhogEvery keyhog invocation pays a ~2 s cold start in the default desktop build (Hyperscan compile + GPU adapter probe). The lean ci profile above drops that to ~140 ms by skipping both. For pre-commit and IDE save handlers where even 140 ms is too much, run keyhog as a daemon: the cost is paid once per host, every subsequent scan is ~7 ms:
keyhog daemon start # Unix socket on $XDG_RUNTIME_DIR
keyhog scan --stdin --daemon < .env # 7 ms instead of 740 ms
keyhog daemon status
keyhog daemon stopUse it in pre-commit hooks, IDE save handlers, or any per-commit CI
loop. systemd / launchd unit examples in
site/daemon.html.
Watch-mode for IDEs:
keyhog watch ./src # inotify/FSEvents/RDCW; sub-100 ms per savesudo keyhog scan-system --space 50G # default 50 GiB ceiling
sudo keyhog scan-system --space 1T --include-network # also scan NFS / SMB
sudo keyhog scan-system --space 10G --no-git-history # skip historical blobsEnumerates every mounted drive (skipping pseudo-FS like /proc,
/sys, tmpfs, nsfs, fuse.snapfuse), auto-discovers every .git
(worktrees + bare repos + submodules), and runs the full scan +
git-history pipeline. Honors a hard --space <bytes> ceiling and
exits 1 on findings. Built for incident-response triage, M&A
inheritance audits, and quarterly developer-laptop sweeps.
For deployments where keyhog runs on the same machine that holds the secrets (e.g. paired with EnvSeal) and there is no trusted boundary between the scanner and the credentials it inspects:
keyhog scan . --lockdownEnforces:
mlockall(MCL_CURRENT|MCL_FUTURE)on Linux . credentials never page to swap.PR_SET_DUMPABLE = 0(always on, even outside lockdown) . disables core dumps, ptrace,/proc/<pid>/memreads. macOS getsPT_DENY_ATTACH.setrlimit(RLIMIT_CORE, 0)on Linux . kernel refuses to write any core file regardless of the systemcoredump_filter, so anonymous pages can never reach disk via the dump path.- Refuses to run if
~/.cache/keyhog/*exists, refuses--incrementalwrites, refuses--verify, refuses--show-secrets, refuses--fast/--no-decode/--no-entropy/--no-ml/--no-unicode-norm/--no-default-excludes(each trades off detection completeness for speed; lockdown is for the highest-stakes runs where you want every gate engaged).
The always-on hardening (everything except mlock + cache refusal) is
applied to every keyhog invocation . even without --lockdown a
keyhog binary can't be coredumped or ptraced.
use keyhog_core::{Chunk, ChunkMetadata, DetectorFile};
use keyhog_scanner::CompiledScanner;
// build.rs embeds every detectors/*.toml as a (name, toml-body) pair.
let detectors: Vec<_> = keyhog_core::embedded_detector_tomls()
.iter()
.filter_map(|(_name, body)| toml::from_str::<DetectorFile>(body).ok())
.map(|file| file.detector)
.collect();
let scanner = CompiledScanner::compile(detectors)?;
let findings = scanner.scan(&Chunk {
data: "TOKEN=sk_live_EXAMPLE…".into(),
metadata: ChunkMetadata::default(),
});Mix shipped + custom detectors by concatenating before compile. The
scanner is Send + Sync; share one across rayon workers. Streaming
source helpers in keyhog-sources (file-system, git, stdin, Docker,
S3, GitHub org). Live verification in keyhog-verifier.
Full API surface + stability policy: site/api.html.
Per-repo defaults via .keyhog.toml:
[scan]
severity = "high"
min_confidence = 0.5
exclude = ["**/test/fixtures/**", "vendor/"]
[detector.generic-api-key]
enabled = false # noisy detector? turn it off (hot-* fast-path
# ids like `hot-aws_key` are disabled the same way)
[lockdown]
require = true # refuse to run unless --lockdown is passedPrecedence (later overrides earlier): compiled defaults → system →
user → repo → env → CLI flags. Full reference:
site/config.html.
Suppress specific findings (not whole detectors) with a .keyhogignore
file by hash, path glob, or detector id - see
suppressions.
Allowlist a known leak with a hash, path glob, or detector id . plus
optional reason / expires / approved_by governance metadata:
# .keyhogignore . gitignore-style shorthand
*.log
node_modules/
9d6060e21ef8d5daec9cfe4a44b1b1bc9792246bfad28210edaaa1782a8a676a
# Explicit form with governance
hash:9f86d081… ; reason="rotated 2026-04-25" ; expires=2026-07-01 ; approved_by="security@acme"
detector:demo-token
path:**/fixtures/*.env
Entries past expires are silently dropped on load with a WARN.
crates/
core/ Detector loading, finding types, reporting (text/JSON/SARIF), allowlists
scanner/ Hardware routing, Hyperscan, GPU, decode-through, entropy, ML, multiline
sources/ File system, git (staged/diff/history), stdin, Docker, S3, GitHub org, web
verifier/ Live credential verification (341 detectors carry an active `[detector.verify]` endpoint)
cli/ CLI binary, daemon, watch, baselines, calibrate, hook installer
detectors/ 891 TOML files (data, not code)
site/ Documentation site (17 pages, GitHub-Pages-ready)
tools/ SecretBench mirror + scoring + leaderboard harness
Two-phase coalesced scan:
- Phase 1 . Hyperscan NFA on raw bytes, parallel across all files via rayon. 95 %+ of files have no hits and pay zero cost.
- Phase 2 . full extraction on hits only: regex capture groups, companion matching, checksum validation, entropy gating, ML confidence + Bayesian damping.
Result: a multi-GB monorepo scans in seconds. Determinism is part of the contract . same input → same output, byte-exact, every time.
Full architecture writeup, hardware routing matrix, profiling tips:
site/architecture.html and
site/performance.html.
keyhog detectors --search aws --verbose # list / inspect detectors
keyhog explain aws-access-key # spec, regex, severity, rotation guide
keyhog diff before.json after.json # NEW / RESOLVED / UNCHANGED for CI gates
keyhog calibrate --tp aws-access-key # record a true positive
keyhog calibrate --fp generic-api-key # record a false positive
keyhog calibrate --show # posterior-mean bar chart per detector
keyhog backend # detected hardware + routing matrix
keyhog completion zsh # shell completions (bash/zsh/fish/powershell/elvish)- New detector? Drop a TOML in
detectors/, open a PR. The contributor guide (CONTRIBUTING.md) has the schema and a worked example. - Bug / missed secret / false positive? File an issue with the
redacted credential shape and detector id; each report becomes a
permanent test fixture under
tests/contracts/. - Security issue in keyhog itself? Don't open a public issue -
email
security@santh.dev(PGP key on the org page).
keyhog stands on prior secret-scanning work. Ideas borrowed from:
- trufflehog . detector breadth + verification semantics
- betterleaks . entropy/keyword fusion and false-positive suppression
- titus . scanning ergonomics and severity calibration
Thanks to these projects and their contributors.
MIT. Use commercially, embed, fork, sell a hosted version. The detector TOMLs are also MIT . adding one is a 5-line PR with zero legal friction.
If keyhog has saved you from leaking a credential, a star is the cheapest way to tell the next person it exists.