Sounds like a bad vacuum leak. Take some carb cleaner and spray around the area while it is idling and when the idle stumbles you have found your leak.
yup, sounds like a vacuum leak. usually old hoses with dry rot and whistle. that trick with the carb spray will do the trick I have done it and it works
