GWs with frequencies in the MHz – THz range could be a unique window to the very early Universe. However, constructing experiments in this frequency range which reach the required sensitivity is extremely challenging. I will give a brief overview of the opportunities, the challenges and some proposed detector concepts, focussing primarily on ideas borrowed from axion searches.