Unfortunately, you cannot delete live survey responses. This restriction exists to maintain data integrity and prevent permanent data loss in activities.
However, you can filter your report and exclude unwanted survey responses from view. For more information about how to do this, see "How do I exclude specific survey responses from a standard report?" in the Knowledge Base.