Of course, I see your point very well. Most people who replace their springs etc do it to lower their cars, and that purely for esthetics. They buy the cheapest and lowest set they can lay their hands on. But I'm positive that if you spend enough money on a part, and make sure to do the needed adjustments afterwards, then it can only be a good thing. If you can get the car closer to what you really want, and money is the only barrier, then go ahead and spend money. As we all know, 2nd hand cars are never like we really want them, and spending money on better parts to outweight the disadvantages is just a matter of wallet size and motivation, if you ask me.
Rice, to me, is a term describing exaggerated exterior styling. When considering aftermarket performance parts, I trust the other members in my car club when they say how it works and if it's worth it. That's one of the pros of being in a large car club, where there is always someone else with the same car as you who have done the same modifications you plan to do. I will, for instance, install a Bilstein PSS9 suspension set this spring, after strong recommendations, and a few test runs. The ride was not harsher, in fact it was more comfortable on straights and stiffer in corners. But then it's not a £500 set, it's more a £1500 set. If that makes me a ricer, then I'm a happy ricer. Keeping the advantages I bought the car for, and removing one of the disadvantages; handling like a boat. Also, the Norwegian car authorities makes sure you are heavily fined if you cannot prove that you have made the necessary adjustments to wheel settings etc after installing a new suspension. All changes have to be registrered in the cars spec papers, and for that you need proof that a professional has checked the settings and made correct adjustments.
My conclusion; if you put enough research and money into an upgrade, and you weight the consequences on beforehand, an upgrade is rarely a bad thing. Just don't buy the first and coolest sounding thing the salesman tells you to buy without consulting previous owners and experts. Replacing the car in a better handling one, will remove another one of the advantages I bought the original car for. Give me both, please.