I'm going to echo some of the sentiments of my fellow posters here, abstaining and repressing these desires can be unhealthy in and of itself. I know many people, ABDL's, people with other fetishes and sexual orientations that tried to repress and conceal that side of themselves only for it to contribute to their personal detriment i.e. low self-esteem, lack of a personal life, suicide attempts etc. I think being ashamed of these desires, not fully understanding them, not learning to accept and live with them is a recipe for unhappiness.
I have known about my baby side for years, my first inclination wasn't to hide from it or to repress it, my first inclination was to explore it, to learn about it more. I have now fully come to terms with being an AB and yes, while it is certainly interesting, something I don't want everyone to know about and something that not everyone will understand, it hasn't impacted my life in any negative way, on the contrary, I find being an AB to be a very positive thing, it has lead to many interesting relationships and friendships, it has been an effective way to relieve stress and it has made me a happier person on the whole, it has even brought a sense of balance into my life.
I try to regress and baby out at least once a week, but I tend to do so when I need a break or if I have the time. In addition to being an AB, I still do adult things, I still socialize within the adult world, I have a life that goes on separate from my AB side, I have friends, hobbies, other interests.
You seem to be speaking from a place of impeded self-acceptance, your concerns seem to parallel the concerns that many novice AB's have; a fear that being an AB can inhibit your adult life, that AB will take time away from other interests, that being an AB will make you less desirable to romantic partners and friends. I can speak from experience when I say, that being an AB will only work to your detriment if you allow it to, I have a plethora of interests that AB hasn't taken time away from, I also have tons of friends, some of whom are knowledgeable about my AB side and accept it, I've even had multiple relationships with girlfriends and friends who have been accepting enough to Mommy me when I regress. Being an AB hasn't derailed my adult interests or my ability to exist within the adult world and I'm sure that is the same for nearly every AB and DL on the site.
Also, if you are stressed about being caught, I'll tell you that as long as you engage in private, chances are you won't be caught at all and you shouldn't let that stress culminate into paranoia, that's a whole other problem that likely won't go away even if you abstain from AB related activities.
My best advice to you, is to do some soul searching, really consider if this is something you can conceal, hide and shy away from? Ask yourself, is being an AB what is getting in the way of other interests and wasting time for you or is it something else? There's no reason why you can't indulge and acknowledge this side of yourself and continue leading a normal adult life with outside interests. Best of luck to you