Leave file path untouched if not deleting an attachment

When `wp_delete_file()` is used directly, then we can assume that
the `delete_attachment` hook does not fire and the absolute file
path can be returned untouched.