This is a common question that comes up and it’s very simple to do. From your IDE, in your -meta.xml file, change the to Deleted.
<ApexClass xmlns="http://soap.sforce.com/2006/04/metadata">
<apiVersion>41.0</apiVersion>
<status>Deleted</status>
</ApexClass>
Make sure you check the code coverage and take necessary action.