You can delete a record attachment by going to the "Files" tab on the record page, clicking the three vertical dots next to the attachment and clicking "Delete."
​

​