Benchmarks are as important a measure of progress in AI as they are for the rest of the software industry. But when the benchmark results come from corporations, secrecy very often prevents the community from verifying them. For example, OpenAI granted Microsoft, with which it has a commercial relationship, the exclusive licensing rights to its … Continue reading When big AI labs refuse to open source their models, the community steps in