Labels aid you in approximating who you are in an efficient manner. Of course, if someone asks what you are, and you say "I'm a babyfur!" there aren't many scenarios where they'll say "oh cool, you know, I thought about being a furry myself." It works a lot better when it's more like: "I climb rock walls!" --> "oh cool, I thought about hiking the Appalachian once." In cases where attempting to explain who or what you are will result in an awkard or embarrassing situation, labels are looked down upon, because they call into mind exactly those negative stereotypes that the labelled prefers to avoid (or downplay.)
Point being, only label yourself as a babyfur if you are confident, or really want to know and meet other ABs or DLs or furries or babyfurs, and need to sort out the question of "what am I?" before you begin. Otherwise, it's best to keep your identity confusion to yourself when dealing with the average person.