Borrow a different wheelset from the shop or buddy and see if it makes a difference.
Process of elimination, if the problem persists with another wheelset then it is certainly something to do with the frame or geometry (which it points to if you have issues when adjusting seat position).