I had to click it as well - I always access LJ via IE (although I use Chrome for other things). It doesn't rehide itself either. So I guess the functionality works only if you have a specific set-up (or possibly specific pop-friendly layouts?)