Google still working to restore Gmail service
Company says e-mails are not lost, but many still without e-mail today
Computerworld - Two days after tens of thousands of Google Gmail users discovered that their e-mail, chat histories and contacts had disappeared from their accounts, the problem still is not fixed.
Google announced Monday night that the Gmail issue, which struck some users on Sunday, was caused by a bug in a storage software update. While Google had said Monday afternoon that the issue would be resolved for all users within 12 hours, the company now says that the problem has not been fixed but will be "soon."
The good news is that Google reported that users' e-mails, contacts, folders and settings have not been lost. They are retrievable and should be back in users' accounts once the problem is resolved.
"Imagine the sinking feeling of logging in to your Gmail account and finding it empty," wrote Ben Treynor, a Google vice president engineering and site reliability czar, in a blog post. "That's what happened to 0.02% of Gmail users yesterday, and we're very sorry. The good news is that email was never lost and we've restored access for many of those affected. Though it may take longer than we originally expected, we're making good progress and things should be back to normal for everyone soon."
Estimates of the number of users affected have varied. At first, the company estimated that 0.08% of its users, or 150,000 people, had been affected. Later on Monday, Google reduced that estimate to 0.02%, or 35,000 people.
On Monday afternoon, a Google spokesman told Computerworld that engineers had restored service to about one-third of those affected.
In his blog Monday night, Treynor addressed the question of how such a problem could occur, given the fact that Google has multiple copies of users' data in multiple data centers.
"Well, in some rare instances software bugs can affect several copies of the data," Treynor wrote. "That's what happened here. Some copies of mail were deleted, and we've been hard at work over the last 30 hours getting it back for the people affected by this issue."
He added that engineers have also archived to tape in order to save the data.
"To protect your information from these unusual bugs, we also back it up to tape," he said. "Since the tapes are offline, they're protected from such software bugs. But restoring data from them also takes longer than transferring your requests to another data center, which is why it's taken us hours to get the email back instead of milliseconds."
Treynor said a detailed incident report will be posted to Google's Apps Status Dashboard.
Sharon Gaudin covers the Internet and Web 2.0, emerging technologies, and desktop and laptop chips for Computerworld. Follow Sharon on Twitter at @sgaudin, or subscribe to Sharon's RSS feed . Her e-mail address is email@example.com.
Read more about Web Apps in Computerworld's Web Apps Topic Center.
- How Network Connections Drive Web Application Performance Users around the globe, on all sorts of devices, expect Web applications to function as seamlessly as desktop applications. This paper discusses the...
- Big Data, Big Mess: Sound Risk Intelligence Through Complete Context This paper examines the insecurity of the small businesses in the supply chain and offers tips to close those backdoors into the enterprise.
- Using Cyber Insurance and Cybercrime Data to Limit Your Business Risk This paper examines the challenges of understanding cyber risks, the importance of having the right cyber risk intelligence, and how to use this...
- 5 Tips to Secure Small Business Backdoors in the Enterprise Supply Chain This paper examines the insecurity of the small businesses in the supply chain and offers tips to close those backdoors into the enterprise.
- NSS Labs & Cisco Present: Evaluating Leading Breach Detection Systems Today's constantly evolving advanced malware and APTs can evade point-in-time defenses to penetrate networks. Security professionals must evolve their strategy in lockstep to...
- Will the Real Endpoint Threat Detection and Response Please Stand Up? This webinar explores new technologies & process for protecting endpoints from advanced attackers as well as the innovations that are pushing the envelope... All Web Apps White Papers | Webcasts