But why? Now the client has strictly less information than it had before.

The client already has the capability to handle 404 for DELETEs.