But it has a handle

I don't think doors that are meant to be pushed should have handles. Handles are meant for pulling, therefore without looking directly at the words that say "push" be default I tend to pull a door with a handle.