Let’s see. We could line ‘em up in order of size. Ducks are small, swans are big and geese are somewhere in the middle.
Or by plumage. Ducks are colourful, swans are white—or black or black and white—and geese are somewhere in the middle.

There are true geese, which belong to genera Anser and Branta. No one has a problem with those. There are true swans—Cygnus and their close relative Coscoroba of South America. And there are a dozen or so genera of true ducks. But that still leaves a bunch of others floating about without a neat … er … pigeon hole to roost in.

One classification treats the group as belonging with true ducks. Another puts it with the geese and swans. A third leaves it out on its own ...
Whistling-ducks (Dendrocygnus) are another enigmatic group. Although they are colourful birds that look a lot like ducks and walk a bit like ducks they just aren't ducky enough. Nor are they geese. Nor, despite the scientific name, are they tree-dwelling swans. Whistling-ducks are more or less out on their own in a lineage that diverged early on from the rest of the Anseriformes.

In fact, it is closely related to neither. The magpie goose is descended from a lineage even older than that of whistling-ducks. Only one group of Anseriformes has a more ancient history—the South American screamers (Anhima, Chauna). (One classification places these spur-winged, webless water birds as sister group to the magpie goose.)

There's one. The Cape Barren goose (Cereopsis novaehollandiae of southern Australia is goose-ish. It doesn't snuggle up tightly with the true geese but it swans around with the right crowd.
Just don't ask about the pygmy geese ...
_____________
* Which means 'goose-like'. Told you it was confusing.
From top: Chestnut teal (Anas castanea); Wandering whistling-duck (Dendrocygna arcuata); Magpie goose (Anseranas semipalmata); Cape Barren goose (Cereopsis novaehollandiae)
Read more
Donne-Goussé, C., Laudet, V. & Hänni, C. (2002). A molecular phylogeny of Anseriformes based on mitochondrial DNA analysis. Molecular Phylogenetics and Evolution 23: 339–356.