This mistress needed to pass a message that no one had ever passed to this guy. He took a lot of things for granted as a result and this mistress did not like that. That is why she had to make sure that things changed for him and she was the one to do it. She chose to slap the crap out of him and that is how he changed.
Lady Victoria had asked this guy to be considerate but he was not. She did not want it to continue and that is why she chose to use her brutal faceslapping to deal with him. He was shocked at how she wore her gloves and then used them to slap the shit out of him. He wished he had never messed with her or pissed her off but it was too late.