My opinion on this, is that your true self is manifested, and that by hiding it(putting it away), you feel uncomfortable. When I started to accept myself, and I actually forced myself to be diapered for a week or two, I discovered that I didn't want to stop afterwards and have been wearing almost 24/7 since. I think that you probably didn't expect this to happen because you haven't had the opportunity to do so until now, so why would you really know what to expect?
If you are like me, then the feeling of wanting a diaper all the time probably won't go away, but that doesn't mean for sure. Some people get tired of it after a while, and maybe this is you just binging on the new found freedom, just don't let it turn into a purge afterwards, commit to yourself that you are not going to throw out your new purchases, and that if you start feeling guilty, or tired of it, you will just let yourself take a shameless break. I have had a few times where I take a day without a diaper, usually though those have been days where I just want to feel less restricted because of physical activities. Personal advice though, don't be ashamed of sleeping with a stuffy, I don't think anybody should be ashamed of sleeping with them, even if they have to travel with it.
Anyway, yeah, it might keep happening, likely will, but you can still control and wear diapers when it is convenient. It isn't like a cigarette addiction, you might feel depressed not wearing diapers, but after a while you get over it.
- - - Updated - - -
There are times for being an adult, and times when you get to choose. Be an adult at work, and in your housework responsibilities. Otherwise, you shouldn't feel ashamed in being in whatever mode you want to be. I'd say what you need to do, is reserve a night each week where you force yourself to be diapered and plan out some activities to help you get into your little head space. Make a habit of it until you find that you have stopped feeling ashamed of it. If you have a night on your reserved evening where you find yourself feeling guilty and you think you should be an adult instead, force yourself to be diapered and surrounded by your baby things anyway. After a while it will start to feel normal and you will have a bit less shame.