Go to the folder:
C:\Documents and Settings\***username***\Favorites
change the username field with yours... in here you will find all the .URL files IE8 uses... just delete the like any other files, you can hold down shift/ctrl, or use your mouse to select multiple.
Hope this helps