Great thread!
My thinking on it is this, and I agree with a lot of what has been said.
Science definitely deals with probabilities. A good scientist rarely, if ever, would say "x happens when y." Or, "Z happens because of q." The proper terminology is "smiles appear to happen because of cake, or are likely to happen when sex."
So, as has been said, science deals with what it likely to be true, but never deals with truth. One would need to actually see the future to be able to tell that the Earth will keep orbiting the Sun, or that the laws of thermodynamics will continue as they have (which, no mathematical proofs exist to explain the laws of thermodynamics, they just seem to work).
Math deals in more absolutes, but is seldom concretely true. Take, for example the value of pi. To derive the value of pie, one needs the diameter or radius of a circle to compare to the circumference. But where do the values for the ratio come from? Pi. So, the incompleteness theorem applies here, and to almost every proof in math. A mathematical proof is still dependent on outside information which is not provable.
Finally, math and science mingle, but never connect. Math is used as a language to describe physical phenomena. The math is not the physical phenomena. Many plants branch at the angle of Phi (about 130-ish degrees, Phi being an irrational number), but Phi is not a part of the plants.
I hope I've contributed something! That's how I understand things, but I need to chew over some more of these posts, for sure.
Be an adult only when necessary.