实现同样水平的 Code 效果，开源模型需要生成100次，ChatGPT只需要生成1次。

实现同样水平的 Code 效果，开源模型需要生成100次，ChatGPT只需要生成1次。 Aman Sanger: There are times and places for training your own models... With the release OpenAI's chatGPT API - coding is looking less like one of them. The human-eval pass@1 rate of ChatGPT is as good as the best Open Source model's pass@100 rate. And this is still just GPT 3.5...