So... what you are saying is that this annoyance is a "feature" to bring the Content Aware feature to light? Also, not in that article you linked to, is the fact that (just tried it) this only happens on a locked background layer. If I create a new document and then duplicate the initial locked layer, delete the locked layer (so I still have only one, unlocked layer) and select and delete, this "feature" doesn't happen.
Yes, it is only on a background layer that it is the new default.
But If you always perform the same procedure, you should create an action, that you could launch in Batch, or even trigger automatically at the opening of a document, thanks to the scripts events manager.
The old behavior was that delete on a background layer would fill with background color. So that wasn't really a delete either, just a different fill.
In either case you have to double-click the background (to turn it into a floating layer) to actually delete.
There's a modifier key you can hold down to make it fill with the background color as before, without prompting. I forget which one it is and I'm not at my Photoshop system right now.
Option(Mac)/Alt(Pc)+Delete= Fill with foreground color
Command(Mac)/CTRL(Pc)+Delete = Fill with background color.
Delete on the background layer = Fill menu
Delete on a layer = remove pixels
Shift+Delete on a layer =Fill menu
Hope this helps.
And if there is no selection, and that the background layer is targeted, hitting delete removes the background layer.