The philosopher Karl Popper nailed it perfectly in his book “The logic of scientific discovery” (“Logik der Forschung”). His central argument: Scientific theories are the result of a creative imagination. The growth of scientific knowledge rests on the doctrine of falsifiability: only those theories that are testable and falsifiable by observation and experiment are properly open to scientific evaluation.
Strictly interpreted, Popper argues that no number of experiments can ever prove a theory, but a single experiment can contradict one. Hence, the more experiments or measurements confirm a theory, the more confident we may become that this theory is valid. Or, with a statistical twist: the more probable it is that this theory holds true, but this probability will never attain 100%. Hence, we should resist the human need for certainty to which scientists are not immune, regrettably.
Science does not know certainty !