I ended up ordering the Deore LX shifter (Shimano Part # Y66P98020) as it looked the most like my current XT shifters. When I got it, I confirmed that the LX shifter would bolt up flush to my XT brakes, but this was not my preference. Taking them apart was easy, not so much when I put it back together (should of taken better photos). In any case, the plastic piece was exactly the same and the only difference, that would affect the feel of the shift, was that the XT had more options for a precision shift. I included a photo of this. It took about an hour total, ~15min taking both apart, about ~45min to put the XT back together due to lack of photos.

I guess I can still call them XT, even though 1 piece is technically LX. It is likely the same part number in both shifters.