How do I completely delete a file?
This is no LO question, it is an OS issue.
Use your file manager. Once deleted, the name may remain for a while in the list of “Recent files” but it is harmless as long as you don’t try to open the deleted file (in which case you’ll get “File does not exist” error).