Removing product count - Is it possible to keep on filters?

Hi,

I am wanting to remove the category product count from the top navigation menu of my site and from the categories module/list down the left hand menu, but not from the filters in the filter groups!

I am aware there is an option in the admin area, "Category Product Count:" which removes the count from the categories but this also removes it from the filters as well which I don't want.

Is there a way I can remove it from the categories but not the filters??

Many thanks in advance!