This paper presents a numerical study of the breakage of loose agglomerates based on the discrete element method. Agglomerates of fine mannitol particles were impacted with a target wall at different velocities and angles. It was observed that the agglomerates on impact experienced large plastic deformation before disintegrating into small fragments. The velocity field of the agglomerates showed a clear shear zone during the impacts. The final breakage pattern was characterised by the damage ratio of agglomerates and the size distribution of fragments. While increasing impact velocity improves agglomerate breakage, a 45-degree impact angle provides the maximum breakage for a given velocity. The analysis of impact energy exerted from the wall indicated that impact energy in both normal and tangential directions should be considered to characterise the effects of impact velocity and angle.