Testing GPT OSS on a Mac Mini
I’m pretty impressed by the 20 billion parameter gpt-oss model as a code reviewer. The comments generated, which are posted on this pull request, seems to indicate the model inputs allow for a reasonably sensible output.
In terms of performance, a couple of minutes on a 24GB m4 Mac mini seems reasonable given the turn-around speed (i.e. no waiting on other devs for a review), and the relevance of the comments.
It’s not as succinct as another developer would be, but it’s given me confidence that it’s a decent first level thought provoker.