Certainly would depend very, very much on the prevailing weather at the time.
Not a chance if you happen to get a 'northerly' or even a strong 'easterly' for that matter; also open to 'southerly's' once round the corner by the lighthouse! IF the weather did happen to be bad, or not good (it can happen in August, as fil says), there is a lot of open sea - 100 miles of it in the case of a tramuntana (northerly)!
Safest option for all concerned would certainly be a trip out from P.P.
It's a large bay, certainly more than large enough for experienced sailors - never mind 'non-yachties'. On the other hand it could all go perfectly well on a very nice day!
By far the best option would be to take heed and used experienced people, i.e. the Charter companies (as per The Wob) or take good advice from the Yacht Club at the marina.
One doesn't see a great number of yachts along the north coast of Mallorca because there is 'nowhere to hide' in bad or worsening weather. Soller is the ONLY port between Andratx and Puerto Pollensa, a distance of some seventy miles or so at a rough guess!!!