Llama 3.1 70B
Llama logo

Llama 3.1 70B

llama-3.1-70b
Llama

Pricing

  • Input Tokens: $0.440 /M tokens
  • Output Tokens: $0.440 /M tokens

Input Modalities

    Providers

    Deepinfra deepinfra-llama-3.1-70b
    Pricing$0.440$0.440
    Context128K
    Max output128K
    Latency-
    Throughput-
    Uptime
    100.00% uptime 2 days ago
    0.00% uptime yesterday
    0.00% uptime today

    Performance for llama-3.1-70b

    Uptime is the percentage of requests that succeeded over the past 72 hours. AIHubMix continuously monitors every provider and automatically retries with the next-best provider when one returns an error or responds too slowly; Latency is total round-trip time (lower is better); Throughput is how fast the model writes (tokens per second, higher is better).

    Uptime
    Loading...
    Latency
    Loading...
    Throughput
    Loading...

    Try this model

    Python
    import os
    from openai import OpenAI
    
    client = OpenAI(
        api_key=os.environ["AIHUBMIX_API_KEY"],
        base_url="https://aihubmix.com/v1",
    )
    
    response = client.chat.completions.create(
        model="llama-3.1-70b",
        messages=[
          {
            "role": "user",
            "content": "Hello, how are you?"
          }
        ],
        max_tokens=1024,
        stream=False,
    )
    
    print(response.choices[0].message.content)

    Frequently asked questions

    How much does Llama 3.1 70B cost?

    On AIHubMix, Llama 3.1 70B costs $0.44 per million input tokens and $0.44 per million output tokens.