Weekend shifts
This had been a strange weekend.
The release on Friday went without any notable problems and everything worked quite well.
But on Saturday evening my group leader called me and I had no good feelings. But the new release still worked and he called because of another problem at another customer.
It seems that we're loosing data between two components of our product but there is no sign of an error or failure in any of the logs, which is theoretically impossible.
But it is possible to reconstruct the missing data and that's what we did from 10:00 till 16:00 yesterday on Mother's Day.
It's just a huge time-consuming, yet semi-automatic, task.
Dammit, why are 0,0001 percent of the data hiding? Does someone delete them by hand, just to give us trouble?