It was bustling. The commercial success turned a fishing town into the unfortunately named "Pearl of the Orient."