As I understand it, they came to be called Panama hats when Teddy Roosevelt wore one when he went to Panama to inspect the construction of the canal. (Trivia for the day: Teddy was the first US president to leave the country during his term of office.)