Warrington Hospital says it will publish an internal review into why the remains of stillborn and miscarried babies were stored without permission.
An investigation found there had been three cases since 2006, where remains were kept without parents' permission.
The hospital has apologised to a woman from Cheshire whose miscarried baby's body was stored for almost two years.
Dr Hilary Furniss, from the hospital, said procedures had been changed to make sure it never happened again.
"We are awaiting the final presentation of the full report, and until I and others in the trust receive it, I cannot comment on the actual details of what went wrong.
"But certainly systems have been put in place already to minimise the risk of this happening again, so it should never happen again."
The hospital apologised to Leanne McCabe, 25, of Runcorn, whose miscarried baby's body was stored in the hospital's mortuary without her permission.
It said the incident was down to "an administrative error".
Two similar cases are being dealt with by the hospital. THE BBC