This is one of my favorite Feynman quotes, from The Feynman Lectures on Physics
(Volume 1 page 2-6)
Another most interesting change in the ideas and philosophy of science brought about by quantum mechanics is this: it is not possible to predict exactly what will happen in any circumstance. For example, it is possible to arrange an atom which is ready to emit light, and we can measure when it has emitted light by picking up a photon particle[...]. We cannot, however, predict when it is going to emit the light or, with several atoms, which one is going to. You may say that this is because there are some internal "wheels" [variables] which we have not looked at closely enough. No, there are no internal wheels; nature, as we understand it today, behaves in such a way that it is fundamentally impossible to make a precise prediction of exactly what will happen in a given experiment. This is a horrible thing; in fact, philosophers have said before that one of the fundamental requisites of science is that whenever you set up the same conditions, the same thing must happen. This is simply not true, it is not a fundamental condition of science. The fact is that the same thing does not happen, that we can find only an average, statistically, as to what happens. Nevertheless, science has not completely collapsed. Philosophers, incidentally, say a great deal about what is absolutely necessary for science, and it is always, so far as one can see, rather naive, and probably wrong. For example, some philosopher or other said it is fundamental to the scientific effort that if an experiment is performed in, say Stockholm, and then the same experiment is done in, say, Quito, the same results must occur. That is quite false. It is not necessary that science do that; it may be a fact of experience, but it is not necessary. For example, if one of the experiments is to look out at the sky and see the aurora borealis in Stockholm, you do not see it in Quito[...]. "But," you say, "that is something that has to do with the outside; can you close yourself up in a box in Stockholm and pull down the shade and get any difference?" Surely. If we take a pendulum on a universal joint, and pull it out and let go, then the pendulum will swing almost in a plane, but not quite. Slowly the plane keeps changing in Stockholm, but not in Quito. The blinds are down, too. The fact that this happened does not bring on the destruction of science. What is the fundamental hypothesis of science, the fundamental philosophy? [...] the sole test of the validity of any idea is experiment. If it turns out that most experiments work out the same in Quito as they do in Stockholm, then those "most experiments" will be used to formulate some general law, and those experiments which do not come out the same we will say were the result of the environment near Stockholm. We will invent some way to summarize the results of the experiment, and we do not have to be told ahead of time what this way will look like. If we are told that the same experiment will always produce the same result, that is all very well, but if when we try it, it does not, then it does not. We just have to take what we see, and then formulate all the rest of our ideas in terms of our actual experience.