What is federation?

Federation is a form of decentralization. Instead of a single central node that all people use, there are multiple nodes, that any number of people can use.

Grade of centralization Examples
Centralized Twitter, Facebook, Instagram
Federated E-mail, XMPP
Distributed BitTorrent, IPFS, Scuttlebutt

A Mastodon server can operate alone. Just like a traditional website, people sign up on it, post messages, upload pictures and talk to each other. Unlike a traditional website, Mastodon servers can interoperate, letting their users communicate with each other, just like you can send an e-mail from your GMail address to someone from Outlook.

Left to right: Centralized, Federated, Distributed

In practical terms: Imagine if you could follow an Instagram user from your Twitter account and comment on their photos without leaving your account. If Twitter and Instagram were federated services, that would be possible.

Source