So I've found this: http://xenforo.com/help/friendly-urls/ and I've tried adding that code over at my host.. And the host didn't allow that in my configuration.
Asked around and they said I'm not allowed to change location ~ \.php$, so I left that part out. Now the configuration could be...