While I agree it would be ideal to have the same wind speed/direction of the ghost you are playing, where do you draw the line? What if you have it on firm and fast greens, and they have it on soft, and slow? Same deal with the fairways. How do you know what they chose?
My suspicion is that it is too hard to program for every variable to give you the ghost, and every other variable that they chose.
I suppose a fix would be if you load up a ghost, you get every setting that they used as well. I suspect people may not like that as then they may be playing in conditions/swing types that they don't enjoy.
The ghost system is far from perfect...but it is an novel idea to be able to play against people you know who are not online when you are.