It should be "statistically representative" wrt to the true causes, and all other factors should be independent. Instead, ML models, and certainly large NNs, allow every bit of data that correlates a tiny bit to contribute.
Since we don't know what the true causes are, nor how to represent them in the data, adding more data might just as well not work.
> statistically representative of wild data
It should be "statistically representative" wrt to the true causes, and all other factors should be independent. Instead, ML models, and certainly large NNs, allow every bit of data that correlates a tiny bit to contribute.
Since we don't know what the true causes are, nor how to represent them in the data, adding more data might just as well not work.