It's the same for me. I use a third party program once or twice a month that removes empty directories.
Remove Empty Directories (Freeware tool) - jonasjohn.de
Ill have a look.
0003037: Empty folders left behind on Recording drive - MediaPortal Bugtracker
/gibman