Treaty heavy cruisers were defined by guns and a maximum

Were treaty heavy cruisers defined by displacement or by their guns?

By their guns within a maximum displacement; the treaty set an upper limit, not a minimum.

Gun calibre identifies the category, while displacement imposes an upper limit. There is no corresponding minimum displacement, so a smaller ship can still fall within the same armament category.