Not sure if the headlight problem is related, but my immediate concern would be the alternator light. The electrical system should be able to carry the load at any engine speed. I would start by checking your charging voltage across the battery terminals while the engine is idling, and go from there. You don't want to end up stranded somewhere with a dead battery!