looking at your pictures again, it looks like the non-drive side outer walls are bent a little. is this the case? is this because you didn't bore out the wood to disperse more of the crimping force?
i'm thinking about going more of this route:
Here's another version:
https://flic.kr/p/cmHqTL