"If you can't do your statistical analysis in 1 to 5 TB of data, your methodology is flawed"
This is probably more about human limitations than math. There's a clear ceiling in how much flexibility we can use. That will also change with easier ways to run new kinds of analysis, but it increases with the logarithm of the amount of things we want to do.
"If you can't do your statistical analysis in 1 to 5 TB of data, your methodology is flawed"
This is probably more about human limitations than math. There's a clear ceiling in how much flexibility we can use. That will also change with easier ways to run new kinds of analysis, but it increases with the logarithm of the amount of things we want to do.