The only area where I'd consider using colored dice is weaponless attacks for heroes - or even with an additional set of stats for monsters, too.
My rules as they stand: a weaponless hero attacks with one die, Barbarian hits on

and

, Dwarf on

, Elf on

, Wizard on

.
The Wizard may only attack weaponless if neither a different action is possible nor he may try to move to escape from the fight (regardless of the opposing monster's movement rate).
A weaponless attack only ever can result in the loss of 1 Body point, buffed by spells or skills or not.
There it actually makes sense to use colored dice, if only for the one reason to make the whole weaponless attack shindig more ... interesting. Can't really explain that.
There's something about each Hero having a dice pool of a fitting color of his own, aside from the white common pool. Then again, the colors of those dice are utter horseshit and intuitively mean nothing close to what they try to convey, except for the black and the pink ones.
Still, the reasons for using them is more elegance than anything else, and if I start there, I have to expand to weapons and effects and spells and card texts and special rule texts get more complex and cards have to be printed bigger again and then we go full RPG once again.
I thought complicated three years ago and wanted to make everything about the game "realistic" until I saw the error of my ways.
Oh, and Slev, I read your rules months ago and what I see before my eyes when I think of them is all those nifty little icons in the rulebook, so I mistook that picture for you using all colored dice. Took a gander again, and there we go. You do not exaggerate their usage.