I've seen people put a shitload of props on themselves using PAC (up to 100-200), and it hasn't degraded the performance at all. If your performance degrades from PAC, then something is wrong with your gmod - or your computer.
If anything, just add an option to make PAC stuff not load for players, so if you don't like PAC, you can just disable it.