Maybe if you're a single dad, rearing your children on your own, Father's day would be a big deal. But otherwise, it's completely second fiddle to Mother's day. It's a double standard.
The difference: Guys don't care.
Women enjoy getting cards and flowers. Guys can take it or leave it.