Bull.inf

Docs · How it works

How Bull.inf works

A two-sided marketplace for LLM inference. Sellers list capacity. Buyers call one OpenAI-compatible API. Settlement is in $ANSEM on Solana.

01 The idea in one minute

Sellers connect an OpenAI-compatible upstream (OpenRouter, Venice, Groq, a self-hosted box, etc.), pick a model, set a discount, and list an offer. They earn $ANSEM when buyers route through them.

Buyers get an inf_… key, fund a ledger balance, and call /v1/chat/completions like OpenAI. Bull.inf picks the cheapest matching offer and pays the seller.

You do not need your own OpenAI / Anthropic key to buy marketplace inference. Bring-your-own-key (BYOK) is an optional side path — not how you get Claude or GPT from the market.

02 Buy inference — step by step

  1. Open the market desk Go to /market and sign in with a Solana wallet (Privy).
  2. Get an API key Buy panel → deposit $ANSEM (Approve + Load), then Get key. Calls debit your loaded balance. Settlement is only in $ANSEM — no card, no USD.
  3. Fund → Approve → Load Hold $ANSEM in your wallet, Approve the treasury as spend delegate, then Load into your ledger. Chat spends from ledger credit.
  4. Check the board Live offers on the desk. If a model has no sellers yet, requests fail until someone lists — see Empty markets.
  5. Call the API Use your inf_… key against the OpenAI-compatible base URL.
curl https://YOUR_API_HOST/v1/chat/completions \
  -H "Authorization: Bearer inf_your_key" \
  -H "Content-Type: application/json" \
  -d '{
    "model": "claude-opus-4-8",
    "messages": [{"role": "user", "content": "Hello"}]
  }'

Default routing uses trusted seller upstreams only. Opt into unverified sellers under Get key → Routing preferences (or PATCH /api/buyer/routing).

03 Sell capacity — step by step

  1. Sign in on /market Same wallet login as buyers. Open List offer.
  2. Pick a trusted provider (recommended) Allowlisted hosts (e.g. OpenRouter, Venice, Groq). These offers show up for default buyers.
  3. Or use a custom URL (advanced) Any OpenAI-compatible base URL. Listing is unverified — buyers must opt in. Acknowledge the notice before listing.
  4. Choose model + discount Catalog model id and price vs list. Platform take-rate comes from the seller side.
  5. Get paid Earnings accrue on the ledger. Ops settles batches as SPL $ANSEM to your Solana wallet.
Closed lab hosts (OpenAI, Anthropic, Google direct) cannot be listed as sell upstreams. Offer those models via an aggregator, or let buyers use BYOK.

04 Trusted vs unverified sellers

Trusted

Allowlisted provider hosts. Default buyer routing includes these. No extra opt-in.

Unverified

Custom / unknown hosts. Show an Unverified badge. Buyers must opt in before traffic can reach them.

The market can list anything OpenAI-compatible; buyers choose whether to trust unknown endpoints with their prompts.

05 BYOK — optional, not the main path

Bring-your-own-key lets you register a private upstream. Chat tries it before marketplace sellers. On success you pay a thin relay fee (default ~2% of the marketplace quote); the seller gets $0. Your lab/provider bills you separately for the tokens.

Use BYOK when you already have a lab key, or need a model no seller lists.

Skip BYOK when you just want market inference — fund, get a key, call /v1.

06 If markets look empty

An empty board means no one has listed an offer yet — not that buyers must use BYOK. Until at least one seller lists a trusted offer for a model, chat for that model has nowhere to route.

Fix: list a trusted offer (OpenRouter / Venice / Groq), or wait for someone else to. Then buyers can buy without attaching their own provider keys.