发现与解读
250 美元的 FPGA 板上可达到 12,000 tok/s。这是一个小模型，并不能连贯地回答任何问题或提示。在 https://trylittlelamb.com/ 上尝试一下，但不要指望能聊得很好。至少它非常快
250 美元的 FPGA 板上可达到 12,000 tok/s。这是一个小模型，并不能连贯地回答任何问题或提示。在 https://trylittlelamb.com/ 上尝试一下，但不要指望能聊得很好。至少它非常快
查看英文原文
12,000 tok/s on a 250$ FPGA board. It's a small model, and doesn't answer coherently to any question or prompt really. try it out on https://trylittlelamb.com/ but don't expect a good chat. at least its VERY fast
12,000 tok/s on a 250$ FPGA board. It's a small model, and doesn't answer coherently to any question or prompt really. try it out on https://trylittlelamb.com/ but don't expect a good chat. at least its VERY fast
12,000 tok/s on a 250$ FPGA board. It's a small model, and doesn't answer coherently to any question or prompt really. try it out on https://trylittlelamb.com/ but don't expect a good chat. at least its VERY fast
- 来源
- X @ycombinator · x-ycombinator
- 证据角色
- x_project_network
- 时间状态
- known
- 用户判决
- 未判