In their first demo video, to make a 3D render of the photo, the thinking trace gives away the game:<p>> Interesting! It turns out there's already an existing project here [...] The project is fully built [...]<p>I'm always astounded how little effort is put into checking the AI answers displayed in these announcements. Back when I paid more attention, I remember OpenAI's and Google's demos constantly showed their AIs giving wrong answers.
Since people seem interested in this comment of mine, here's another fun line I noticed in the same video, at the very top of the logs, just before the Step 5 agent found the already-completed project:<p>> Error: OpenAI API error (403): {"message":"model water18-new is not available for user i-yuliang [trace_id=bfcfdd6bcdc236ca18d009c65cca52e4 code=40004]", "type":"invalid_request_error", "param":null, "code":null}<p>Here's a still frame for posterity (apologies for the quality, the original video is tiny): <a href="https://boppreh.com/room.jpg" rel="nofollow">https://boppreh.com/room.jpg</a><p>Demos are demos and lots of things are expected to be recreations for a video announcement, but oh boy, somebody should review these things before publishing.
I think it's more likely they recorded the video when the project was already done than cheated
<p><pre><code> > Built on a sparse Mixture-of-Experts architecture, Step 5 Preview has 600B total parameters, with 27B active per token, and supports a 1M-token context window and vision input.
> Step 5 Preview scores 44 on the Artificial Analysis Intelligence Index.
> The model will be released with open weights on October 15.
</code></pre>
I guess being Chinese company they decided to skip version 4, while also giving impression to be on the similar iteration with leading companies (claude opus 5).
I wonder if other Chinese labs like Kimi/Moonshot will follow suit.
600b-a27b doesn’t sound enticing. Also with the higher number of active parameters compared to GLM 5.3 flash and DeepSeek V4/4.1 flash, I don’t see how they want to be more efficient at inference.
Dunno, if US labs would embrace this silly logic, then Anthropic would be compelled to release Fable/Opus 6 instead of a .1 release
I kinda wish everyone just used dates instead...
Another possible reason is that the number 4 is considered unlucky in traditional Chinese culture.
Parent commenter hinted at that. Yet DeepSeek has released their V4 which was hugely successful, and even their new architecture is marked V4.1. Qwen internals mark their Flash-Next model, also very compelling, as "qwen4exp". So both of them are bucking the negative stereotype.
Moonshot has already teased K3.1 so not likely
> Without any Pokémon-specific optimization, Step 5 Preview has so far sustained progress for more than 3,000 turns and 6 million tokens of interaction. By turn 3,082, it had unlocked Cut, earned three Gym Badges, and defeated Lt. Surge. The run is now roughly one-third of the way through the main story.<p>Finally FireRed is being used as a benchmark again! I believe Astra can beat it in 18 hours. Not sure how that compares.
IT's Artificial Analysis Index is the same as Kimi K3, which is about 4.6x bigger, and GLM 5.3, which is about 1.25x bigger. Pricing is $1/$2.70 i/o. Openweights on October 15.
Most of these models, both open and closed, are now so over tuned to agentic and coding tasks that they no longer work well for general purpose. Kimi K3 is an exception to that – maybe you need that larger size todo well on a broader range of tasks.
GLM-5.3 and Kimi K3 are just below where I can use them to completely replace frontier models. Oddly,* SWE-2 is there for me.<p>If this performs similarly in the real world, we're approaching a level of capability where for most devs, it only makes sense to pay for Anthropic or OpenAI subscriptions if they are heavily subsidized and actually cheaper than these alternative options.<p>* Oddly, because I perceived Devin as being kind of a joke before trying SWE-2.
Their posisitoning is nice. Instead of saying they are cheaper and a bit less performant (in terms of intelligence), they say they are <i>best</i> among the cheaper and a bit less performant ones.
For anyone else looking for the pricing: <a href="https://platform.stepfun.ai/docs/en/guides/pricing/details#pricing-for-multimodal-reasoning-models" rel="nofollow">https://platform.stepfun.ai/docs/en/guides/pricing/details#p...</a>
"Pareto frontier" really is the new "web-scale".
Huh wonder why they skipped 4?
How about adding a contested historical facts benchmark?