While in Regency London in 1814, Bill Potts was surprised at the amount of black people at the Frost fair, as this conflicted with what was often shown in movies she'd seen. The Twelfth Doctor explained to her that "history is a whitewash", citing Jesus Christ as a prominent example of whitewashing. (TV: Thin Ice)
You've no idea how much damage the myth that the Holy Family were white has done to us, to our self-esteem, Doctor. For centuries, brown people - black, I believe they called themselves then - lived in the shadow of a white God. No matter how much they prayed, how penitent or good they were, being white was something they could never be. That kind of patronage does damage.