One of the requirements for the application is a research plan statement. This involves proposing a research topic and methods required to tackle the problem. How would you write this if you want to do a pure math PhD? And let's say I'm interested in algebraic geometry and algebraic topology.
The issue is that to even understand an open problem, you (usually) need a considerable amount of background knowledge. And there aren't any "experiments" you can talk about.