Llama2 70B 40960
Llama logo

Llama2 70B 40960

llama2-70b-40960llms.txt
Llama

Pricing

  • Input Tokens: $0.500 /M tokens
  • Output Tokens: $0.500 /M tokens

Input Modalities

    Output Modalities

    • Text

    Try this model

    Python
    import os
    from openai import OpenAI
    
    client = OpenAI(
        api_key=os.environ["AIHUBMIX_API_KEY"],
        base_url="https://aihubmix.com/v1",
    )
    
    response = client.chat.completions.create(
        model="llama2-70b-40960",
        messages=[
          {
            "role": "user",
            "content": "Hello, how are you?"
          }
        ],
        max_tokens=1024,
        stream=False,
    )
    
    print(response.choices[0].message.content)

    Frequently asked questions

    How much does Llama2 70B 40960 cost?

    On AIHubMix, Llama2 70B 40960 costs $0.5 per million input tokens and $0.5 per million output tokens.