What happened to the populations of Canna before?

Canna currently has a school with no pupils but has a headmaster "just in case". It has been a working school in the past but the island, although beautiful, is too remote for most people's taste. It has just a dozen inhabitants and, as such, the population is unlikely to grow because there are no amenities in the sense you and I would understand them.