GPT-4 with Jev
GPT-4 is a model from OpenAI, released 2023-05-28. It costs $30 per million input tokens and $60 per million output tokens, reads up to 8K tokens of context, and writes up to 4,096 tokens in one reply. Through llm11, set model to openai/gpt-4.
- Input price
- $30 / 1M
- Output price
- $60 / 1M
- Context window
- 8K tokens
- Max output
- 4K tokens
- Released
- 2023-05-28
- Accepts
- text
Read from the live catalogue and refreshed daily. At blended list price, 2% of the 332 priced models we can call cost more.
Using GPT-4 with Jev
Jev is TypeSafe AI's System One model. It reads each request first and decides which model in your pool answers, with a calibrated confidence on that call. GPT-4 does the answering when Jev sends it work, or when you name it yourself. At list price GPT-4 falls in the llm11-smart band, but no pack routes to it because its context window is under 32K tokens, the floor for pack members. You can still pin it: pass openai/gpt-4 as model and routing steps aside while verification still runs.
Jev is new, so we have not published results for GPT-4 with and without it, and this page does not invent any. Every response comes with a receipt that names the model that answered and what it cost against your most expensive model, so you can measure the pairing on your own traffic.
What a request costs
List price arithmetic, the same sum a receipt does. llm11 adds nothing per request; the only fee is on buying credits.
| Request | Tokens in / out | One | A thousand |
|---|---|---|---|
| Short chat turn | 500 / 200 | $0.027 | $27.00 |
| Question over retrieved documents | 4,000 / 500 | $0.150 | $150.00 |
| Long document summary | 30,000 / 1,000 | $0.960 | $960.00 |
Cheaper models to try
The catalogue has no benchmark score for GPT-4, so this is a price ordering. It does not claim these answer as well.
| Model | Input / 1M | Output / 1M | Context | Released |
|---|---|---|---|---|
| OpenAI o3 Pro | $20 | $80 | 200K | |
| OpenAI o1 | $15 | $60 | 200K | |
| OpenAI GPT-6 Astra | $10 | $50 | 1.05M | |
| OpenAI GPT-6 Astra Pro | $10 | $50 | 1.05M |
Call it
Same OpenAI request shape. Naming the model pins it, so nothing is routed, and the answer is still checked.
python
from openai import OpenAI
client = OpenAI(base_url="https://www.llm11.com/v1", api_key="llm11_live_...")
res = client.chat.completions.create(
model="openai/gpt-4",
messages=[{"role": "user", "content": "Hello"}],
)More from OpenAI
| Model | Input / 1M | Output / 1M | Context | Released |
|---|---|---|---|---|
| GPT-6 Luna | $0.100 | $0.500 | 1.05M | |
| GPT-6 Luna Pro | $0.100 | $0.500 | 1.05M | |
| GPT-6 Sol | $2.00 | $10 | 1.05M | |
| GPT-6 Sol Pro | $2.00 | $10 | 1.05M | |
| GPT-6 Astra | $10 | $50 | 1.05M | |
| GPT-6 Astra Pro | $10 | $50 | 1.05M |
Questions
- What is GPT-4 with Jev?
- Jev is TypeSafe AI's System One model. It reads each request first and decides which model in your pool answers, with a calibrated confidence on that call. GPT-4 does the answering when Jev sends it work, or when you name it yourself. At list price GPT-4 falls in the llm11-smart band, but no pack routes to it because its context window is under 32K tokens, the floor for pack members. You can still pin it: pass openai/gpt-4 as model and routing steps aside while verification still runs. Routing decisions are made by Jev, TypeSafe AI's System One model.
- Is GPT-4 a System One model?
- No. GPT-4 answers requests. The System One model is Jev, which decides which model answers each one, so the two do different jobs and llm11 uses both.
- How much does GPT-4 cost?
- $30 per million input tokens and $60 per million output tokens. A 4,000 token prompt with a 500 token answer costs about $0.150, so a thousand of them is about $150.00. llm11 passes provider list price through and charges 5% when you buy credits.
- What is the GPT-4 context window?
- 8,191 tokens, with up to 4,096 tokens in a single reply.
- Does GPT-4 support tool calling and structured output?
- The catalogue lists tool calling and structured output, but it does not list reasoning controls.
- Can I use GPT-4 through llm11?
- Yes. Set model to openai/gpt-4 on the OpenAI-compatible endpoint and the request goes to it directly, with verification still running.
- Does Jev route to GPT-4?
- Routing decisions are made by Jev, TypeSafe AI's System One model. At list price GPT-4 falls in the llm11-smart band, but no pack routes to it because its context window is under 32K tokens, the floor for pack members. You can still pin it: pass openai/gpt-4 as model and routing steps aside while verification still runs.
- What is a cheaper alternative to GPT-4?
- Nearest in price and below it: OpenAI o3 Pro at $20 in and $80 out, OpenAI o1 at $15 in and $60 out and OpenAI GPT-6 Astra at $10 in and $50 out. The catalogue has no benchmark score for GPT-4, so this is a price ordering. It does not claim these answer as well.