download folder

I hate to be such a putz, but I cannot for the life of me figure out how to delete files from my Downloads folder. They can't be dragged to the desktop or trash bin, only opened. Is there a way to delete directly from Downloads?