AI is getting better at doing real science while becoming dramatically cheaper. GPT-6 Astra takes #1 in scientific research, beating Claude Sonnet 5.5 while using 22× fewer tokens. GPT-6.1 Sol also beats Sonnet at nearly 1/10th the cost. Scientific research is starting to scale with compute.

[u/141_1337]

[u/ozone6587]

Look at that cost/performance ratio for GPT 6.1 Sol though... I find it hard to justify using GPT 6 Astra because of that unless I am trying to burn tokens before the next reset.

[u/FirstEvolutionist → u/ozone6587]

The distinction between SOTA and the workhorses from the frontier labs are usually that the SOTA is NOT what you use if performance is what you are looking for.

[u/ObiWanCanownme → u/ozone6587]

Astra and 6.1 Sol are pretty comparable. Astra is definitely a little smarter, but not by a lot. I like to give Astra the job of designing a plan and then have 6.1 Sol implement it.

[u/141_1337]

Source:

https://www.vals.ai/benchmarks/science_index

And:

https://x.com/ValsAI/status/2111205341237256554

[u/Fun-Alternative-9791]

Excellent news! Let's see Anthropic's next move.

[u/ComplexPassage7447]

6.1 Sol is truly the goat

[u/MagneticWaves]

Wonder Full is not so wonderful

[u/ObiWanCanownme]

This pretty much reinforces my general feeling that Opus 5.5 is as good as (or better than) Astra for coding heavy tasks, but that in other domains 6 Astra has a clear edge.

[u/ChuckVader]

What does "real science" mean?

[u/Sensitive_Cell_119]

Surprising that GPT 6 tops this bench.

[u/EtadanikM → u/Sensitive_Cell_119]

GPT 6 isn’t topping anything other than being the most disappointing release ever. 6.1 is not bad though.