The X button has been lying to you about closing your apps.
Sometimes, an app on Windows can just stop responding out of nowhere. That's annoying on its own, but it's even worse if you're not sure how to force it to close. Luckily, that’s easy enough to do.