Provider Benchmark

Provider Benchmark posts from the AIHubMix team.

AllTutorialOpinionNewsProvider BenchmarkAnnouncementChangelog
  • DeepSeek V4.1 Flash on Fireworks: empty stop replies, 3/9 cache hits

    DeepSeek V4.1 Flash on Fireworks: empty stop replies, 3/9 cache hits

    On 2026-11-03/04, DeepSeek V4.1 Flash 1017 was run through the APB Full suite on five providers, all reached through AIHubMix with the same questions, parameters and request scripts. This APB Profile covers Fireworks only. The model is listed as DeepSeek V4.1 Flash 1017. Scores are Q 41.42, F 71.78, P 79.51, K 60.68 and R 100; the overall index is 64.10. This post reports scores only, with no ranking or provider recommendation. Q, F, P, K and R come first; the overall index is a summary number

    8 min readProvider Benchmark
  • DeepSeek V4.1 Flash on the official channel: 94.00 F, 15 invalid probes

    DeepSeek V4.1 Flash on the official channel: 94.00 F, 15 invalid probes

    On 2026-11-03/04, the APB Full suite ran against DeepSeek V4.1 Flash 1017 on five providers through AIHubMix. The same questions, parameters and request scripts were used for every provider; the five provider entries are on the models page. This APB Profile covers the DeepSeek official channel only. It is reached through AIHubMix's DeepSeek official supplier route, not a direct connection to DeepSeek's API. This post reports scores only, without ranking providers or recommending one: Q 42.45,

    10 min readProvider Benchmark
  • DeepSeek V4.1 Flash on Alibaba Cloud: 1.34s first token, 99.37 cache

    DeepSeek V4.1 Flash on Alibaba Cloud: 1.34s first token, 99.37 cache

    On 2026-11-03/04, the APB Full suite ran against DeepSeek V4.1 Flash 1017 on five providers through AIHubMix. The same model, questions, parameters and request scripts were used for every provider; the model is listed on the AIHubMix model page, and the five provider entries are on the models page. This APB Profile covers Alibaba Cloud only: what each section measured and what came back. This post reports scores without ranking providers or recommending one. Q, F, P, K and R come first; K is a

    10 min readProvider Benchmark
  • DeepSeek V4.1 Flash on Baidu: no available channel hits Q and P

    DeepSeek V4.1 Flash on Baidu: no available channel hits Q and P

    On 2026-11-03/04, DeepSeek V4.1 Flash 1017 was tested on five providers through AIHubMix with the APB Full suite: the same questions, parameters and request scripts each time. This APB Profile covers the Baidu run only, section by section. The numbers below are scores only, not a ranking or a provider recommendation. Q 38.00, F 88.39, P 37.77, K 68.85 and R 100 come first; the overall, 56.48, is a summary index with no confidence interval. The scoring rules are those of AIHubMix Provider Bench

    10 min readProvider Benchmark
  • DeepSeek V4.1 Flash on ByteDance: tool calls match, metering doesn't

    DeepSeek V4.1 Flash on ByteDance: tool calls match, metering doesn't

    On 2026-11-03/04, DeepSeek V4.1 Flash 1017 was tested on five providers through AIHubMix with the APB Full suite: the same questions, parameters and request scripts each time. This APB Profile covers the ByteDance run only, section by section. The numbers below are scores, not a ranking or a provider recommendation. Q, F, P, K and R come first; the overall is a summary index, not a certification, and it has no confidence interval. The scoring rules are defined in AIHubMix Provider Benchmark St

    11 min readProvider Benchmark

© 2023 - 2026 AIHubMix, LLC

Product

Developer

Company

Terms & Policies