For me, time would be the main consideration. If you have lots of it, the boat sounds like fun. If you would rather maximize your time in Mallorca, then fly. We flew from Valencia and the small additional cost was worth it for us. But I would like to take the ferry some day.