Delaware is expensive and you must have had a very specific reason to build your LLC there, rather than for example in Wyoming - such that to raise capital, build a corporation, etc. Now if you want to shut it down in a couple of years, it's not exactly clear what you had in mind.

If you register your company in WY but will be doing business in e.g. MA, you will have to pay registration fee in both jurisdictions. Doesn't sound like a saving to me.