返回 2026-09-14 编辑版
原始行动中文优先 · EN 原文开源项目

Show HN:作者重新运行“鹈鹕骑自行车”模型绘图基准

在2025年11月和12月,受到Simon Willison骑海鹦骑自行车基准测试的启发,我让当时的LLMs根据三十个类似的提示创建SVGs,例如“生成一个章鱼操作管风琴的SVG。”Simon在他的博客上提到了这个实验[1]。<p>九个月过去了,更强大的模型已经发布,所以我今天再次尝试了这个实验。链接的网站显示了结果。<p>将十个提示通过六个模型在OpenRouter上运行大约花费了二十美元,所以我目前就停在这里。<p>[1] <a href="https://simonwillison.net/2025/Nov/25/" rel="nofollow">https://simonwillison.net/2025/Nov/25/</a>

查看英文原文

Show HN: Pelican-bicycle alternatives

In November and December 2025, inspired by Simon Willison’s pelican-riding-a-bicycle benchmark, I had some then-current LLMs create SVGs from thirty similar prompts, such as “Generate an SVG of an octopus operating a pipe organ.” Simon mentioned that experiment on his blog [1]. Nine months have passed and much stronger models have been released, so I tried the experiment again today. The linked site shows the results. Running ten of the prompts through six models at OpenRouter cost about twenty dollars, so I stopped there for now. [1] https:&#x2F;&#x2F;simonwillison.net&#x2F;2025&#x2F;Nov&#x2F;25&#x2F;

模型评测、研究资产与平台用量仍是三张不能互换的账

为什么值得看

判断模型机会时,应分别保留研究方法、任务评测和平台使用量:论文结果说明潜在能力,单任务复测揭示局部差异,token 排名只说明该平台当期调用结构。

最强反方

周榜没有环比、客户或收入基线,个人绘图复测不是统一榜单,研究与简报也未在同任务、同预算下交叉复现;三者都不能单独代表市场胜负。

原始出现与传播对照

1 条出现 · 本次 AIHOT 未精确命中

原始行动

Show HN:鹈鹕自行车替代方案(2026年更新)

在2025年11月和12月,受到Simon Willison骑海鹦骑自行车基准测试的启发,我让当时的LLMs根据三十个类似的提示创建SVGs,例如“生成一个章鱼操作管风琴的SVG。”Simon在他的博客上提到了这个实验[1]。<p>九个月过去了,更强大的模型已经发布,所以我今天再次尝试了这个实验。链接的网站显示了结果。<p>将十个提示通过六个模型在OpenRouter上运行大约花费了二十美元,所以我目前就停在这里。

查看英文原文

Show HN: Pelican-bicycle alternatives

In November and December 2025, inspired by Simon Willison’s pelican-riding-a-bicycle benchmark, I had some then-current LLMs create SVGs from thirty similar prompts, such as “Generate an SVG of an octopus operating a pipe organ.” Simon mentioned that experiment on his blog [1]. Nine months have passed and much stronger models have been released, so I tried the experiment again today. The linked site shows the results. Running ten of the prompts through six models at OpenRouter cost about twenty dollars, so I stopped there for now. [1] https:&#x2F;&#x2F;simonwillison.net&#x2F;2025&#x2F;Nov&#x2F;25&#x2F;

直接发布摘要tkgally@tkgally打开该层出处 ↗

In November and December 2025, inspired by Simon Willison’s pelican-riding-a-bicycle benchmark, I had some then-current LLMs create SVGs from thirty similar prompts, such as “Generate an SVG of an octopus operating a pipe organ.” Simon mentioned that experiment on his blog [1].<p>Nine months have passed and much stronger models have been released, so I tried the experiment again today. The linked site shows the results.<p>Running ten of the prompts through six models at OpenRouter cost about twenty dollars, so I stopped there for now.<p>[1] <a href="https:&#x2F;&#x2F;simonwillison.net&#x2F;2025&#x2F;Nov&#x2F;25&#x2F;" rel="nofollow">https:&#x2F;&#x2F;simonwillison.net&#x2F;2025&#x2F;Nov&#x2F;25&#x2F;</a>

来源
Show HN · show-hn
证据角色
project_and_comment_discovery
时间状态
known
用户判决
未判
查看该来源原文raw/show-hn.jsondf69a4ae151a9cec36bf2e173a0ad4ba9e67d008632dcb292795e4839535c9cc
Cluster IDevt_fd5d67ca95d1c4ed17cb9250精确去重依据canonical_url事件状态未判