实现同样水平的 Code 效果,开源模型需要生成100次,ChatGPT只需要生成1次。
实现同样水平的 Code 效果,开源模型需要生成100次,ChatGPT只需要生成1次。
Aman Sanger: There are times and places for training your own models... With the release OpenAI's chatGPT API - coding is looking less like one of them.
The human-eval pass@1 rate of ChatGPT is as good as the best Open Source model's pass@100 rate.
And this is still just GPT 3.5...