‘Leap Second’ Bug Fixed

Aviran Mordo | July 1st 2012 | Java

On Saturday, at midnight Greenwich Mean Time, as June turned into July, the Earth’s official time keepers held their clocks back by a single second in order to keep them in sync with the planet’s daily rotation.

This one second adjustment caused us many problems.  Most of our system that run on Linux and Java started to misbehave, ranging from 100% CPU usage, very high load average to total crash.

It took us a while to figure out that the one second adjustment was the root cause, but crossing information from the web we saw that we are not the only ones with the problem.

Eventually we fixed the problem with this easy command :

date; sudo date `date +"%m%d%H%M%C%y.%S"`; date;

That is it,  once you run it you don’t even have to restart your java applications, they will start behaving normally again.


By Aviran Mordo
Head of back-end engineering @Wix
Wix

Leave a Reply

We are always looking for excellent people. Browse Jobs Here   

At Wix Engineering we develop some of the most innovative cloud-based web applications that influence our 80+ million users worldwide.

Have any questions? Email academy@wix.com.

Find out what’s coming up at Wix Engineering:

Subscribe to our newsletter for updates, events and more.