Iceland would have been on this list as recently as the late 1940s, The Vatnajokull Ice Sheet touched the Atlantic during the Little Ice Age, it has since retreated inland and now feeds at least in part into a glacial lagoon separated from the Atlantic by a narrow moraine.
If anyone wanted to know: the external territories are Heard Island and the McDonald Islands (Australia), Greenland (Denmark), Kerguelen Islands and Crozet Islands (?) (France), Svalbard, Jan Mayen (?) and Bouvet Island (Norway), South Georgia (UK).