Not normally. But depends. Stock Regulator and BBK's won't bleed off like that if they are good.
Aeromotive setups tend to do this for what ever reason. I can't really comment on the regulators, but I know their pumps seem to bleed down rather quickly.
If you pinch a soft spot in the return line. Then prime the system, does it still bleed down?