Layer shift after pause, filament change, filament runout

I am getting a layer shift whenever I do a pause and then resume (without any other action), change filament regardless if its filament runout or planned pause.

Any ideas on this?