Until 1630 Isola Bella was a rock inhabited by fishermen, with two small churches and a few vegetable gardens. The Borromeos, who had already been owners of Isola Madre since 1501, from the first two decades of the 17th century with Giulio Caesar III and Carlo III focused their interest on the island, launching the grandiose project that was to lead to the creation of the palazzo and the garden.

This aim was to be carried forward, extended and defined by Vitaliano VI, who is to all intents and purposes considered the founder of Isola Bella. The work that resulted in the current layout continued without interruption throughout the 18th and 19th centuries, arriving at 1948, when, with Vitaliano IX Borromeo, the Salone Nuovo, the northern façade and the great pier were built.