Everything on a bicycle works together. You can almost never change just one thing without the change affecting something else. In this case, using larger or smaller bearings will affect your hub's over locknut dimension. I wouldn't bet on that not causing a new problem of some kind.
__________________
My greatest fear is all of my kids standing around my coffin and talking about "how sensible" dad was.