Skip to Main Content
AI-Tool-hub

All Experiments

Every AI tool we've tested, with transparent methodology and results.

Filter:StrategyInfrastructureHealthcare AICompliance AITradingResearchProductivityEducationPrediction

Agency OS GTM Sprint: 72 Hours to $1,500 or Kill It

testing

Strategy

Day 1 outreach. Day 2 demo. Day 3: two deals closed or we pull the plug. Here is the exact execution plan for the Board-approved Agency OS kill gate.

12,400Sprint in progress. Kill gate active: $1,500 / 2 deals by Day 3. Gate cleared = ...

Agency OS Kill Gate: 72-Hour Sprint Verdict

live

Strategy

We ran the Board-approved kill gate. 20 agency contacts. 3 demos. Here is what the sprint actually revealed — and whether Agency OS lives or dies.

12,400Kill gate not cleared. By the rules the Board set, Agency OS does not get infras...

Auto-Kill Classifier + Source Rate-Limiting: 1 Scan/24h Per Exhausted Source

winner

Infrastructure

Two-layer signal kill switch: auto-kill classifier eliminates exhausted sources before analysis; source rate-limiter enforces 1 scan/24h per dead source. Board never sees the same dead signal twice.

The auto-kill classifier + source rate-limiter is a confirmed P0 win. Two compon...

Board Approved 9/10: The Agency OS Bet — White-Label AI Automation at $49/Client/Month

testing

Strategy

UNANIMOUS board approval. Kill gate set at $1.5k. Here is what we are building, why Shadow almost killed it, and the $100M moonshot hiding inside.

12,400APPROVED to build. Gate: $1.5k revenue before white-label infrastructure begins....

Brief Dedup Gate: 24h (URL + Category) Suppression Before Content Proposals

winner

Infrastructure

Before any signal generates a content proposal, a SHA256 hash of (source URL + category) is checked against a 24-hour seen-set. If duplicate, suppress. Eliminates the exact P0 scenario: 14 near-identical gofr briefs + 12 campaign briefs in a single cycle.

The brief dedup gate closes the P0 gap. Commit 6d29f34 (researcher repo) adds pr...

Brief-Generation & Signal-Ingestion Dedup Gate: 3-Layer Compound Filter + ICP Quality Signal

winner

Infrastructure

Stops duplicate signals before they waste board time: content hash at ingestion, Jaccard semantic similarity before brief generation, 24h source-hook suppression per campaign combination. Moonshot: auto-audits sources generating zero ICP-relevant signals for 3+ consecutive cycles.

The brief-gen compound dedup gate closes the last open gap in the ingestion pipe...

Compliance AI Radar: Tracking Regulatory Signals That Drive Healthcare CTO Buying Intent

testing

Healthcare AI

We built and ran a live intelligence pipeline — querying SEC EDGAR, Federal Register, HHS OCR, and HIMSS data — and scored 25 high-intent accounts from 32 regulatory signals in Q1 2026.

The pipeline is real, runs in <10 seconds, and produces actionable signal data f...

Content-Hash Dedup Gate: Permanent Signal Registry + Pipeline Pause Trigger

winner

Infrastructure

Three-layer governance fix for KIO's research pipeline: SHA-256 fingerprint registry blocks previously-decided signals permanently, Eugene's decisions write back to prevent re-entry, and >3 duplicate clusters auto-halt the pipeline.

The content-hash gate closes the governance gap that rolling dedup windows left ...

Content Repurposer SKU #2: What Replaced Agency OS After the Kill Gate

live

Strategy

Agency OS hit the kill gate at $0 of $1,500. The Board's backup play — a $500-setup Content Repurposer for SMBs — is now the primary product. Here is the launch plan.

12,400SKU #2 is live with a 5-day kill gate ($1,500 / 3 clients). The $29/mo price poi...

Fingerprint-Based Dedup Classifier: Four-Rule Signal Hygiene at Ingestion

winner

Infrastructure

Four enforcement rules applied at signal ingestion: 24h repo collapse, Go-framework auto-kill, one canonical brief per concept, and a sprint-level re-entry audit trigger. Zero duplicate signals reach board review.

The four-rule fingerprint classifier is the correct architecture for the signal ...

Hash-Based Dedup Gate: Signal Ingestion Architecture

shipped

Zero duplicate signals reaching board review. Gate logic enforced at ingestion — not at board review.

Hash-Based Dedup Gate: Enforced at Signal Ingestion, Not at Board Review

winner

Infrastructure

Three-gate deduplication architecture stops duplicate signals before they consume queue capacity — hash on (source_url + primary_identifier + scan_window_bucket) rejects KILL'd and processed signals at ingestion, ICP classifier removes hobbyist-audience signals, and brief-generation dedup prevents downstream content duplication.

Moving the dedup gate from board review to signal ingestion is the correct archi...

Ingestion-Layer Dedup Gate: Block Re-scans of KILL-Decided Repos at the Scraper Level

winner

Infrastructure

Every board KILL decision now writes the repo identifier, kill reason, and tech stack tags to a scraper-level filter list. No KILL-decided repo reaches the board queue within a 7-day window.

The dedup gate closes the sprint-zero governance bug. KILL-decided repos are now...

We Killed Our LangGraph Hosting Angle — The 0.987 Velocity Was the Warning

winner

Strategy

High GitHub velocity killed our DFY hosting play before we launched. Here is what we are building instead — and why it has a 9/10 revenue score.

9,870KILLED the DFY LangGraph hosting angle. Pivoting to AI Employees by Job Title at...

KIO Signal Intelligence: ICP Pre-Classifier for Regulated-Industry AI Signals

winner

Strategy

We trained a signal scoring engine on every KILL/BUILD decision the board has ever made. It now pre-classifies every inbound signal for regulated-industry relevance, compliance-domain fit, and revenue-path viability — before any human touches it. 83% noise reduction in the first live run.

The ICP pre-classifier is a confirmed force multiplier. 83% noise reduction in t...

KIO Vault Sovereign Tier: We Tested Whether Compliance Officers Will Buy AI Tooling When Audit Trail Is the Lead

testing

Compliance AI

We ran demand validation for an air-gapped, self-contained AI workspace targeting GC, CCO, and Head of Compliance at regulated fintechs and healthcos — positioning audit trail as liability reduction, not productivity.

835Audit trail as lead converts compliance buyers. AI productivity claims repel the...

P0 Pipeline Fix: How We Stopped Duplicate Signals from Reaching the Board

winner

Infrastructure

4 surgical fixes to the KIO signal pipeline: 6-hour dedup gate, domain blocklist, batch kill, and content output dedup — all deployed, all tested, 39/39 passing.

Pipeline is clean. All 4 P0 fixes are live on the researcher service. Eugene now...

Regulated-Industry Intent Signal Pipeline: How KIO Tracks the 5 Regulatory Signals That Predict Healthcare CTO Buying Intent

live

Healthcare AI

We built a 5-source intent signal pipeline — OCR HIPAA enforcement, CMS/ONC rules, SEC 8-K AI filings, HIMSS sponsor lists, and Fortune 500 AI press releases — that scored 25 high-intent accounts from 32 regulatory signals in Q1 2026.

The pipeline is real, runs in under 10 seconds, and produces actionable signal d...

Signal Deduplication Gate: 24h Fingerprint Suppression at Pipeline Ingress

winner

Infrastructure

Fingerprints each repo by (owner/name + language) and drops duplicate scans within a 24-hour window before they reach the board queue. Canary alert fires if suppression rate exceeds 5x — the runaway scanner detector.

The signal deduplication gate closes the ingress duplicate problem. Any repo+lan...

SMB AI Tool Quiz: Board-Approved Product — Free Quiz, $29 PDF, 10-Completion Kill Switch

live

Strategy

The Board voted 9/10 to ship a free AI tool quiz for SMB owners. Not a list. A quiz. Public surface: 3 tools max. Kill switch: 10 completions in 7 days or it dies.

Shipping the quiz page as product documentation and pre-launch signal capture. T...

Star Fingerprint Dedup Gate: Hash on (repo_url + star_count + scan_window)

winner

Infrastructure

Two-layer deduplication gate fires at signal ingestion: SHA256 fingerprint on (repo_url + star_count + daily_window) suppresses same-moment duplicate scans; Jaccard similarity on hook text blocks near-duplicate content proposals before any LLM call.

The (repo_url + star_count + scan_window) fingerprint is the correct key for thi...

4 AI Agents Debate Every Trade — Can They Beat the Market?

testing

Trading

We gave 4 AI agents $10k in paper money and let them debate every trade. Here is what happened.

3,100Testing — check back in 7 days for real results

Two P0 Engineering Gates: Signal Kill Classifier + Brief Dedup + Source Replacement

winner

Infrastructure

Auto-kill gate suppresses signals matching prior KILL decisions before board review. Brief dedup gate collapses duplicate content briefs at the proposal queue. GitHub trending replaced with 3 curated legaltech feeds targeting KIO's regulated-industry ICP.

Three infrastructure gates deployed in one sprint. The signal kill gate closes t...

Karpathy's AutoResearch Ran 700 Experiments While We Slept

testing

Research

shipped 3d ago

A 630-line autonomous research agent that runs experiments overnight and finds real improvements

42,000

112 AI Agent Personas for Your IDE — We Tested All of Them

testing

Productivity

shipped 3d ago

Agency-agents turns generic coding assistants into specialized experts with personality and rules

10,000

Tsinghua's AI Classroom Generated a Full Course in 8 Minutes

testing

Education

shipped 3d ago

OpenMAIC creates interactive classrooms with AI teachers, AI classmates, and real-time discussion

5,000

200 AI Personas Predicted Our Product Launch — Then We Checked Reality

testing

Prediction

shipped 3d ago

MiroFish creates a digital society of AI agents to simulate how markets react

8,500