How many miles were on the old cassette/chain.

Likely you need a longer chain (look up how to figure out chain length - it's very easy and only takes a couple seconds.) You may also need a new chain if your old one is significantly worn. I would take off the old chain and put it in a bag with the 11-23 cassette and get a new chain for your new cassette.