Want to Know How to Run Benchmark

[lcrLeander]

The instruction in https://docs.sotopia.world/examples/benchmark just doesn't work. I have tried many ways but still cannot figure out how to run the benchmark for a model (e.g. gpt-3.5-turbo, having set openAI Key).

[XuhuiZhou]

@ProKil , I believe there's an API update

[ProKil]

@Xiaohongdian119 Sorry for the lack of documentation for our new benchmark tool. You can do sotopia benchmark --help to view the usage for now. We are preparing a new version of doc to cover this.