Though, I still cannot wrap my head around how the fork affects it at all.

The measurement for stack is between BB and headtube, which will always be a constant irrespective of the fork length.