Well, I don't see what the purpose of completely quitting would be. I'd say, test out new diapers when it is safe to test them out, such as in your bedroom. Wear whatever you need for backup protection if you feel like you need it at other moments of the day, but try to use the bathroom if you are concerned about the diaper you are wearing being a leaky one. After a while you will figure out what diaper or mix of products works well for you to safely and comfortably navigate your day.
Personally, I wear a Certainties diaper which is a cheap walgreens brand, then I put a baby diaper or two as a booster pad on the inside (and use a tool to poke a bunch of holes in the baby diapers so they soak well), then I put on a plastic pant to keep safe in case my certainty can't hold it all, and on top of all of that, I wear an all in one cloth diaper so it is cute, and extra protection. Plus, it has an added benifit, If I need to change out of my diaper, I can toss the certainty with the baby diapers in the trash, and then I take my outer layer all in one cloth diaper and put it on inside with my plastic pants on the outside, and wala, new diaper while in public without the need of a diaper bag.
This works pretty well for me, because i'm really tall and wear baggy pants and a long shirt, which works well with my height. Some other method, or even this one, will work for you, and you will figure it out, but I don't think it is worth getting discouraged over a leaky diaper, just test out new options in a safe space so the leaks happen where nobody is watching.