Atomic-resolution transmission electron microscopy has largely benefited from the implementation of aberration correctors in the imaging part of the microscope. Though the dominant geometrical axial aberrations can in principle be corrected or suitably adjusted, the impact of higher-order aberrations, which are mainly due to the implementation of non-round electron optical elements, on the imaging process remains unclear. Based on a semi-empirical criterion, we analyze the impact of residual aperture aberrations on the quality of exit-plane waves that are retrieved from through-focal series recorded using an aberration-corrected and monochromated instrument which was operated at 300 kV and enabled for an information transfer of ∼0.05 nm. We show that the impact of some of the higher-order aberrations in retrieved exit-plane waves can be balanced by a suitable adjustment of symmetry equivalent lower-order aberrations. We find that proper compensation and correction of 1st and 2nd order aberrations is critical, and that the required accuracy is difficult to achieve. This results in an apparent insensitivity towards residual higher-order aberrations. We also investigate the influence of the detector characteristics on the image contrast. We find that correction for the modulation transfer function results in a contrast gain of up to 40%.