Sure. My motive is that I hear about theses and theorems etc in maths that have yet to be proven. There was one asking "is there a highest prime, or do they go on and on?" which I heard about a couple of years ago. Wikipedia has a list of unsolved problems in mathematics. Ordinarily I would think "well, if they can't solve the problem, it's down to not having sufficient mathematical genius." But I also thought, maybe some of there problems and theses etc actually have no solution or proof, because of 'incompleteness' of mathematical systems which Godel demonstrated.
Okay, cool. So the issue of whether there is a highest prime was settled two and a half thousand years ago. A classic and definitive proof is included in Euclid's Elements. If you give me any prime number, no matter how large, I can use it to construct a larger prime in a finite number of steps.
There are certain kinds of unsolved problem that have nothing to do with Godel. For instance, a problem that was outstanding for a few thousand years in classical geometry was to construct a square that has the same area as a circle, but using only ruler and compass. It turned out that the feat was impossible, because the ruler and compass are not sufficiently powerful tools.
Another example of an unsolved problem involves axiom independence. Again, this has little to do with Godel. An example is the problem faced in the centuries following Euclid: how do we derive Euclid's complicated parallel postulate from the other four axioms? It was established in the 19th century that the task is impossible, but not for a lack of tools. The problem was nastier than that, and has been described by historians of mathematics as resulting in a foundational crisis. It was thankfully eliminated when mathematicians relaxed their rigid conception of geometry. This permitted the analysis (some would say discovery) of new kinds of geometry, that have now become the mathematical basis for relativity, and therefore, our understanding of reality itself.
More recently, we have things such as the Continuum Problem. This was an outstanding problem that emerged from set theory, and which a number of analysts were working to solve. It was proved in the mid-20th century (partly by Godel but chiefly by Cohen), that the problem is unsolvable. Again, this is not for a lack of tools, but unlike with Euclid's fifth axiom, we have not found a way to eliminate the problem (so far as I know). The situation is still pretty disturbing.
Now what Godel showed was a bit of tidy mathematical logic: given any formalised axiomatic theory, it is always possible to construct a "problem" that cannot be solved by that theory. However, these problems, or Godel sentences, are not like the malign problems I gave above. Firstly, we are always in a position to assess that Godel sentences are
true, even though the axiomatic theories cannot prove them. Secondly, the Godel sentences are not really
problems as mathematicians would understand them. They are better described as
pathologies, potentially just examples of where our intuitive idea of mathematical theory breaks with the formal idea of an axiomatic theory as studied by mathematical logicians.
The broader question: if we're given a mathematical problem, is there always a way to solve it? Maybe not. As yet, there are no guarantees. The mathematical machinery set up by mathematical logicians to formally ask and answer this question came up with a definitive "no" through Godel. But the "no" answer might just mean "no, mathematical logic cannot answer your question." For as I said, Godel sentences are pretty benign, and Godel's Theorem don't predict the real malign examples such as the Continuum Problem or even Euclid's complex fifth axiom. The real question we want to be asking is: given a mathematical problem that we'd actually care about, such as the outstanding problems in our favourite fields, is there always a way to solve them? Maybe. But don't expect mathematicians to come up with any machinery to answer this question (though you might be amused to know that in my own field, we're trying to get close to it!)