Every meat eater who has ever had anything negative to say when I tell them that if I had any children, I'd raise them vegan has said the same thing: "You can't force your lifestyle on a child".
I always have the same response: "How is me raising my child with a vegan lifestyle any different from you raising yours with a meat eating lifestyle? You're still forcing your lifestyle on your child, it's just that your lifestyle is considered the "norm"."
You can raise a happy, healthy, veggie baby. I know of a couple of friends I met on this forum doing just that, and they have wonderful, strong, healthy children.