Instead of celebrating Christmas, the team had to dedicate their time to investigating the incident. Yesterday, on December 25 at 7:36 UTC, the zkSync team announced on X social network that they had successfully resolved various issues on the network. They assured the community that they were actively addressing the problem.
At 5:50 UTC on December 25, zkSync Era encountered an issue triggered by an automated safety procedure within the network.
Although the issue has been fully resolved, we would like to provide the community with details regarding the incident and outline the steps taken to address it.
TL;DR
There… pic.twitter.com/hO9TKlfBMQ— zkSync Developers (@zkSyncDevs) December 25, 2023
It was determined that the failure was caused by an error in the program code of one of the servers, which triggered an automatic network security protocol. The incident occurred at 5:50 a.m. UTC, but the solution was restored by 11:00 am. The developers made it clear that user funds were not at risk during this downtime.
After identifying and rectifying the error, the zkSync developers promptly distributed a software update to all network nodes to prevent any recurrences. They apologized for the inconvenience caused by the malfunction and promised to enhance their response process during the holiday season.
In a separate incident earlier this year in March, the Avalanche second-tier solution also encountered a major failure.