Unstyled "Privacy settings" tab visible to all on admin theme

There is an issue with the eu cookie compliance module where even if you exclude admin paths and theme in the settings the floating tab still appears on admin pages. Opening this reveals an unstyled form. In my opinion this is an unprofessional look and should be removed from admin pages.

The module developers have stated this is 'by design' and won't change the behaviour.