Isn't the network too shallow to be challenging to decode? One can easily produce few layer network to solve specific goal with construction techniques, so not a surprising result in my view.

What do you mean? Is there prior art? Would you call this a LORA?

My first reaction to your question (rhetorical?) was uncharitable... so, I am curious what you meant that it was "easy."