Ok, it says, While James grew up in the same house with Jesus in Nazareth ? this is an assumption, and so is, Though Jesus and James had the same mother, Jesus was the son not of Joseph, as James was, but of God the Father Himself.
No one knows for sure how, where or anything else about Jesus and the family until later on in his life. James did not pop into the story till almost christ's resurrection.
Put the bible down, step back and imagine christ as just a famous named man. You know nothing of the bible stories. What kind of man is he? He seems to me to be a teacher (that's what a rabbi is) a kind man that had his rebel moments. Most people treated him like a low life, just a laborer. Take away all the hocus-pocus stories and you still have a good man helping people learn. This is how I see it. Even in the bible Jesus did not say he was the son of God. He said father but that could have meant as creator. We still do this. Your child is born you say or think Thank God it was born with all 10 fingers and toes? Does this mean God fathered the child? Well that's my logical opinion about it.
Time and counting years? Each region/tribe/civilization throughout the world had their own way of doing this. I go with the one most reasonable. Those forty years in the desert could have easily been 40 days. Just someones human mistake or an exaggeration? No one knows.