We consider strongly stratified forced turbulence in a plane-parallel layer with helicity and corresponding large-scale dynamo action in the lower part and non-helical turbulence in the upper. The magnetic field is found to develop strongly concentrated bipolar structures near the surface. They form elongated bands with a sharp interface between opposite polarities. Unlike earlier experiments with imposed magnetic field, the inclusion of rotation does not strongly suppress the formation of these structures. We perform a systematic numerical study of this phenomenon by varying magnetic Reynolds number, scale-separation ratio, and Coriolis number. We focus on the formation of a current sheet between bipolar regions where reconnection of oppositely oriented field lines occurs. We determine the reconnection rate by measuring either the inflow velocity in the vicinity of the current sheet or by measuring the electric field in the reconnection region. We demonstrate that for large Lundquist numbers, S > 103, the reconnection rate is nearly independent of S in agreement with results of recent numerical simulations performed by other groups in simpler settings.