Resolved: Irreducible Error
Hi 365,
Please i have two questions on irreducible errors
First, Can irreducible error be quantified?
Also, are irreducible errors affected by the computational power of the computer used for the statistical learning?
Hey Olisa,
Thank you for reaching out and thank you for the great question!
This is a broad topic associated with a lot of analysis and mathematics behind the scenes. I highly encourage you check the book "An Introduction to Statistical Learning" by Gareth M. James, Daniela Witten, Trevor Hastie, and Robert Tibshirani. The authors are using R as a programming language rather than Python, but the theory and fundamentals are the same regardless. It is a great read which I am sure will answer this and many more questions you might have.
To answer your second question, let me borrow a sentence from the book:
"It is important to keep in mind that the irreducible error will always provide an upper bound on the accuracy of our prediction for Y. This bound is almost always unknown in practice."
Therefore, increased computational power can increase the accuracy only so much. One cannot reduce the error down to 0.
Hope this helps! Enjoy the rest of the course!
Kind regards,
365 Hristina
Thank you very much Hristina.
I will check out the book.