You can remove deliverables associated to a milestone from the Milestone Deliverables table on the milestone information page by selecting the deliverable you want to remove and clicking the remove deliverable icon .
You can remove deliverables associated to other types of objects by removing the object from the Edit Deliverable window.