I built a private LLM API in one morning that logs nothing — here's exactly how

I was frustrated. Every LLM API provider logs your prompts. OpenAI. Anthropic. Google. All of them. For teams building on sensitive data — healthcare, fintech, legal — this is a blocker. So this mo...

By · · 1 min read
I built a private LLM API in one morning that logs nothing — here's exactly how

Source: DEV Community

I was frustrated. Every LLM API provider logs your prompts. OpenAI. Anthropic. Google. All of them. For teams building on sensitive data — healthcare, fintech, legal — this is a blocker. So this morning I built NullLog. A private LLM inference API with zero data retention. Not a policy. Architecture. Nothing is ever written to storage. Here's exactly how I built it in a few hours. The stack Cloudflare Workers — edge routing, auth, key management Cloudflare Workers AI — inference (free tier covers a lot) Cloudflare KV — API key storage only (no prompts, no responses) Stripe — payments, instant API key delivery Resend — transactional email Total infra cost to run: near zero. How it works Customer pays Stripe → Webhook fires to Cloudflare Worker → Worker generates API key → Key stored in KV (email + tier only, no usage logs) → Customer gets key by email in 60 seconds → They hit /v1/chat/completions → Worker routes to inference → Response returned → Nothing written anywhere The worker (sim

Related Posts

Trending on ShareHub

  1. Understanding Modern JavaScript Frameworks in 2026
    by Alex Chen · Feb 12, 2026 · 0 likes
  2. The System Design Primer
    by Sarah Kim · Feb 12, 2026 · 0 likes
  3. Just shipped my first open-source project!
    by Alex Chen · Feb 12, 2026 · 0 likes
  4. OpenAI Blog
    by Sarah Kim · Feb 12, 2026 · 0 likes
  5. Building Accessible Web Applications: A Practical Guide
    by Alex Chen · Feb 12, 2026 · 0 likes
  6. Rapper Lil Poppa dead at 25, days after releasing new music
    Rapper Lil Poppa dead at 25, days after releasing new music
    by Anonymous User · Feb 19, 2026 · 0 likes
  7. write-for-us
    by Volt Raven · Mar 7, 2026 · 0 likes
  8. Before the Coffee Gets Cold: Heartfelt Story of Time Travel and Second Chances
    Before the Coffee Gets Cold: Heartfelt Story of Time Travel and Second Chances
    by Anonymous User · Feb 12, 2026 · 0 likes
    #coffee gets cold #the #time travel
  9. Best DoorDash Promo Code Reddit Finds for Top Discounts
    Best DoorDash Promo Code Reddit Finds for Top Discounts
    by Anonymous User · Feb 12, 2026 · 0 likes
    #doordash #promo #reddit
  10. Premium SEO Services That Boost Rankings & Revenue | VirtualSEO.Expert
    by Anonymous User · Feb 12, 2026 · 0 likes
  11. NBC under fire for commentary about Team USA women's hockey team
    NBC under fire for commentary about Team USA women's hockey team
    by Anonymous User · Feb 18, 2026 · 0 likes
  12. Where to Watch The Nanny: Streaming and Online Viewing Options
    Where to Watch The Nanny: Streaming and Online Viewing Options
    by Anonymous User · Feb 12, 2026 · 0 likes
    #streaming #the nanny #where
  13. How Much Is Kindle Unlimited? Subscription Cost and Plan Details
    How Much Is Kindle Unlimited? Subscription Cost and Plan Details
    by Anonymous User · Feb 12, 2026 · 0 likes
    #kindle unlimited #subscription #unlimited
  14. Russian skater facing backlash for comment about Amber Glenn
    Russian skater facing backlash for comment about Amber Glenn
    by Anonymous User · Feb 18, 2026 · 0 likes
  15. Google News
    Google News
    by Anonymous User · Feb 18, 2026 · 0 likes

Latest on ShareHub

Browse Topics

#ai (2726)#news (1886)#webdev (1253)#programming (876)#business (867)#/business (707)#opensource (634)#productivity (619)#sa transcripts (605)#investing (577)

Around the Network