Llama 3.3 70B Instruct
Llama logo

Llama 3.3 70B Instruct

llama-3.3-70b-instructllms.txt
Llama

Pricing

  • Input Tokens: $0.6 /M tokens
  • Output Tokens: $1.2 /M tokens
  • Cache Read: $0 /M tokens

Input Modalities

  • Text

Output Modalities

  • Text

Capabilities

  • Long context

Providers

SambaNova sambanova-llama-3-3-70b-instruct
Pricing$0.6$1.2
Cache$0
Context131K
Max output0
Latency-
Throughput-
Uptime
0.00% uptime 2 days ago
0.00% uptime yesterday
100.00% uptime today

Performance for llama-3.3-70b-instruct

Uptime is the percentage of requests that succeeded over the past 72 hours. AIHubMix continuously monitors every provider and automatically retries with the next-best provider when one returns an error or responds too slowly; Latency is total round-trip time (lower is better); Throughput is how fast the model writes (tokens per second, higher is better).

Uptime
Loading...
Latency
Loading...
Throughput
Loading...

Try this model

Python
import os
from openai import OpenAI

client = OpenAI(
    api_key=os.environ["AIHUBMIX_API_KEY"],
    base_url="https://aihubmix.com/v1",
)

response = client.chat.completions.create(
    model="llama-3.3-70b-instruct",
    messages=[
      {
        "role": "user",
        "content": "Hello, how are you?"
      }
    ],
    max_tokens=1024,
    stream=False,
)

print(response.choices[0].message.content)

Frequently asked questions

What is the context length of Llama 3.3 70B Instruct?

Llama 3.3 70B Instruct has a 131,072 token context window.