I just upgraded to a combination of the two groups from an old 7 speed setup. 105 shifters and front derailer & ultegra crank, bottom bracket, rear derailer & cassette. So far its working out great. I was told that 105's rear cassette and derailer were heavier and clunkier compared to ultegra.
Hope that helps.