Well its been forever since I've tried to fix this issue. But still no luck.
So you are saying that even though you have a horde.conf in /etc/apache2/conf.d/ you still add:
AllowOverride Options Fileinfo
allow from all
Is that right?? Seems odd...