A castaway enjoying paradise with his family, Hollywood friends such as Quincy Jones and Robert De Niro were also invited to the hideaway and holidayed at Tetiaroa Village during the actor's lifetime