John Connaughton the Clinical Director of the Midland Regional Hospital in Portlaoise has apologised unreservedly for poor communication with the families whose babies had died.
The HSE has installed a transition team to take control of maternity services at the hospital.
It follows the findings of a damning report into the deaths of four babies at the Co Laois hospital, who died shortly after birth in similar circumstances.
It added the maternity service in Portlaoise cannot be regarded as safe and sustainable within its current governance arrangements.
It has also emerged that the death of a fifth baby is being investigated by the HSE.
It concluded that there were clear failures in the management of risk and patient safety at both local and national level.
The report makes 11 recommendations, including a call for an immediate assessment by HIQA of patient safety culture in the hospital.