Yeah, Joel Spolsky is adamant about this with the "Bugs First" approach and he claims most of the delays and garbage that Microsoft released during the early years of his career were centered on that one rule being violated.

The problem is even if you make a note to fix it later, one you never get back to it and two this drives decisions for things around it, until it breaks...