Scaling Hetero-Epitaxy from Layers to Three-Dimensional Crystals