Skip to content
OpenKey

Llama 3.1 8B Instruct

Meta AIReleased Jul 23, 2024

Meta's latest class of model (Llama 3.1) launched with a variety of sizes & flavors. This 8B instruct-tuned version is fast and efficient. It has demonstrated strong performance compared to...

Try in playground
Context window
131K tokens
Max output
16K tokens
Input
text
Output
text
Tokenizer
Llama3
Knowledge cutoff
Dec 31, 2023
Released
Jul 23, 2024

Pricing

Per 1M tokens. The provider price and our flat 3% fee are separate columns — what you pay is their sum.

Per 1M tokensProvider+ 3% feeYou pay
Input$0.020$0.0006$0.021
Output$0.030$0.0009$0.031

Benchmarks

Artificial Analysis

Intelligence index
7.6
Coding index
5.4
Agentic index
0.5

Supported parameters

  • frequency_penalty
  • logit_bias
  • logprobs
  • max_tokens
  • min_p
  • presence_penalty
  • repetition_penalty
  • response_format
  • seed
  • stop
  • structured_outputs
  • temperature
  • tool_choice
  • tools
  • top_k
  • top_logprobs
  • top_p

Call it

OpenAI-compatible: point your SDK at api.openkey.ai/v1 and use model meta-llama/llama-3.1-8b-instruct.

Code sample language
curl https://api.openkey.ai/v1/chat/completions \
  -H "Authorization: Bearer $OPENKEY_API_KEY" \
  -H "Content-Type: application/json" \
  -d '{
    "model": "meta-llama/llama-3.1-8b-instruct",
    "messages": [{"role": "user", "content": "Hello"}]
  }'
import os
from openai import OpenAI

client = OpenAI(
    base_url="https://api.openkey.ai/v1",
    api_key=os.environ["OPENKEY_API_KEY"],
)

completion = client.chat.completions.create(
    model="meta-llama/llama-3.1-8b-instruct",
    messages=[{"role": "user", "content": "Hello"}],
)
print(completion.choices[0].message.content)
import OpenAI from "openai";

const client = new OpenAI({
  baseURL: "https://api.openkey.ai/v1",
  apiKey: process.env.OPENKEY_API_KEY,
});

const completion = await client.chat.completions.create({
  model: "meta-llama/llama-3.1-8b-instruct",
  messages: [{ role: "user", content: "Hello" }],
});
console.log(completion.choices[0].message.content);

Questions

How much does Llama 3.1 8B Instruct cost via API?
Through OpenKey, Llama 3.1 8B Instruct costs $0.021 per 1M input tokens and $0.031 per 1M output tokens. That is the provider price ($0.020 / $0.030) plus a flat 3% fee — nothing else.
What is Llama 3.1 8B Instruct's context window?
Llama 3.1 8B Instruct accepts up to 131K tokens of context and returns up to 16K tokens per request.
Is Llama 3.1 8B Instruct OpenAI-compatible?
Yes. Send requests to OpenKey's /v1/chat/completions endpoint with model "meta-llama/llama-3.1-8b-instruct" using any OpenAI SDK — only the base URL and API key change.
What inputs does Llama 3.1 8B Instruct support?
Llama 3.1 8B Instruct accepts text input and produces text output. Its knowledge cutoff is Dec 31, 2023.

More from Meta AI

All Meta AI models →