I think the supposed logic is that if you average everyone’s predictions together you’ll be pretty close to accurate.

So the assumption is that, on average, people intuitively know the truth? I think this falls apart the second you look at all the disinformation, common misconceptions, biases and all. There’s a bunch of fallacies named after gambling, because people can’t be trusted to be rational. I’m not sure how crowdsourcing their guesses should correct that.

However, this runs head first into Goodhart’s Law and immediately falls apart

If I got a bonus every time I saw someone running up against Goodhart’s Law, the quality of my customers’ analytics would nosedive.

I love this adage as much as I hate “If you can’t measure it, you can’t manage it”. That sentence is simultaneously half the reason my job exists and the reason for half the bogus requests I deal with.