I have now done the wavefront exam.
Here is the scanned document:

You will notice that the truck in the picture has a halo in an upward direction, and indeed I do yet it is far worse than shown, and more of a double image, yet it got it sort of right, I now understand why I can eliminate the double image and halo by placing my finger above the upper part of my eyes, I basically cover the nasty yellow and red area.
I was told that the problem is not only the astigmatism of the cornea but large pupils, the lens, which then somehow plays out wrong on the retina.
He said that it is unlikely the contact lenses reduce the symptoms, which is not entirely true because I do experience a slight improvement.
He was 100% sure however that it is not keratoconus.
The problem I have is a financial one, to correct my vision I need the iZon glasses which cost 280eur per eye.
But atleast now I know the cause of my problems.