Jet-driven and jet-less fireballs from compact binary mergers