We Americans pay a hefty slice of our monthly budget--$80, on average--for the convenience (and fun) of owning a smartphone. In total, U.S. consumers will spend $4.8 billion on smartphones and wireless services (voice and data messaging) in 2010, according to market research firm In-Stat.
With all that money being spent on mobile technology, you'd expect an abundance of critical research and analysis indicating which products and services work well for the money, and which don't. But little information exists. That's why PCWorld initiated this survey, asking owners of all kinds of smartphones to relate for their real-world experiences with buying, using, and troubleshooting the devices.
Perhaps the central finding of our survey is that smartphone owners have plenty of complaints, yet seem to willing to tolerate many of the shortcomings of their wireless service providers as well as the manufacturers of the phones. The survey asked the opinions of some 3500 smartphone owners during the month of October2009, and the results revealed mediocre or poor reliablity and ease of use in a number of major smartphone brands, and poor problem resolution and network service from some major wireless service providers. Surprisingly, however, smartphone owners registered noticably low levels of dissatisfaction about these deficiencies.
Note: The percentage numbers contained in our survey results carry a margin of error of 3.3 percent unless otherwise indicated.
Who's Hot, and Who's Not
The Apple iPhone, at least for now, is still the hottest and best-loved smartphone in use out. The carrier that sells and connects the device, AT&T, is, well, not so beloved. Verizon and Sprint are the best-liked wireless carriers in the eyes of the smartphone users we surveyed. (Note: Click on the thumbnail graphic to see the full-size image.)
The idea of pairing the best device with the best (compatible) network--Verizon--has been the subject of much speculation and debate over the past year, but Verizon's recent anti-iPhone advertising and the release of its "iPhone killer" Droid make that union less likely.
The good news is that both networks and devices are changing so fast that Apple's lockup with AT&T may not seem so important a year from now. Better devices running on faster networks are likely to enter the market in the coming months and years, especially if new competitors like the cable companies, WiMax providers, and dark horses like Google begin selling smartphones and wireless service.
Tech Support: Many Problems Go Unresolved
Smartphones are complex devices, and becoming more so. This increases users' reliance on service providers (and in some cases, handset manufacturers) to help keep the gadgets--little PCs, really--running and working properly. (Note: Click on the chart image to see our survey results on user satisfaction with technical support. And see "What Technical Support Means" below this section for more information on our measures of satisfaction in this area.)
Service providers are usually the first lines of support, shifting support issues over to the manufacturer of the phone only in severe cases. Service providers end up handling users' problems about 66 percent of the time, while smartphone manufacturers handle the problem only about 21 percent of the time, and electronics retailers do so only 1 percent of the time (the remaining 12 percent said "other" or "don't know").
Technical support must be judged on how well, and how fast, it helps users troubleshoot problems as they arise. The combined support systems (Web, phone, and in-store) of service providers and manufacturers fail to fully resolve smartphone technical breakdowns in a surprisingly high percentage of cases. Of the smartphone owners who reported having had to call tech support, 17 percent say their problem was never resolved, while another 21 percent say their problem was only "somewhat" (partly) resolved.
One carrier performed even worse than that: 19 percent of the Sprint customers who answered our survey said their problem was never resolved, while another 28 percent said their problem was only partly resolved.
Nevertheless, smartphone users report moderate satisfaction with the technical support they've received. On a 7-point scale (with 1 being "extremely dissatisfied" and 7 being "extremely satisfied"), readers ranked the four major service providers--AT&T, Sprint, T-Mobile, and Verizon--in the low 5 region, meaning they were "somewhat satisfied" with service provider tech support services. Specifically, Verizon and T-Mobile each scored 5.4 out of 7; Sprint and AT&T each scored 5.2.
What the Measurements Mean
The following describes the criteria we used in our survey to measure service providers' technical support.
Average phone hold time: Based on the average time smartphone owners waited on hold to speak to a phone support representative.
Phone service rating: Based on a cumulative score derived from smartphone owners' ratings of several aspects of their experience in phoning the company's technical support service. Among the factors considered were whether the information was easy to understand, and whether the support representative spoke clearly and knowledgeably.
Problem was never resolved: Based on the percentage of survey respondents who said the problem remained after they contacted technical support.
In-person service rating: Based on a cumulative score derived from phone owners' ratings of several aspects of technical support received at a service provider's retail location. Among the factors considered were the ease of getting a representative's attention in the store, and the knowledge, fairness, and attitude of the rep.
Overall service rating: Based on a cumulative score derived from smartphone owners' responses to a series of questions that focused on 11 specific aspects of their experience with the company's service department.
Next: Phone and In-Store Support
Satisfied With Phone Support
To access tech support, smartphone owners experiencing problems usually elect to call (as opposed to using Web-based or in-store support). And in general, smartphone users say they're satisfied with the quality of the phone support they get from service providers.
We asked users to rate the support departments on the quality of the information given, on the reps' communication skills and problem-solving abilities, and on other criteria. Smartphone customers from all four major carriers responded uniformly, and rather positively. Sprint customers gave its tech support an overall score of 5.6 out of 7, while AT&T, T-Mobile, and Verizon customers graded those companies' tech support a 5.7 out of 7.
Our study shows that, in 43 percent of cases, smartphone support issues are resolved through phone support alone, and, in almost 50 percent of cases, after contact with just one phone rep.
Still, many of our survey takers expressed frustration. "It took too long to solve the problem," says Sprint Palm Pre user Javier D. Margo Jr. "I spent five hours continuously either chatting online or speaking directly, often to two different reps (one from Sprint, one from Palm) at the same time."
"If they don't know the answer or how to solve the problem, [they should] take the person's number, find the solution to the issue, then call the person back," suggests one AT&T customer who asked that his name not be used. "That way," he continues, "the customer doesn't have to wait through transfers and holds while somebody goes to ask somebody else."
Sprint, Verizon Do Better on Hold Times
First impressions count, and often the first taste of service provider support that smartphone owners receive is the length of time they have to wait on hold to speak to a rep.
We saw some real differences in the hold times reported by customers of the four major wireless service providers. Sprint and Verizon seemed to excel here; their customers reported average hold times of just 4.4 minutes and 4.7 minutes, respectively. Meanwhile, AT&T and T-Mobile customers told us they waited on hold an average of 6.5 minutes and 6.6 minutes, respectively.
Smartphone owners as a whole have mixed opinions about the acceptability of hold times. About 49 percent of our survey takers said hold times were completely acceptable, while 33 percent called them somewhat acceptable, and about 18 percent considered them unacceptable.
In-Store Support: You May Have to Wait
Smartphone users are a bit more satisfied with the tech support they receive in service provider stores, compared with phone or online support. For 15 percent of smartphone problems, a visit to an AT&T, Sprint, T-Mobile, or Verizon store provided a resolution to the issue.
When asked about the attitude, knowledge, problem-solving skills, and timeliness of in-store reps, subscribers graded staffers in AT&T and Verizon stores fairly well at 5.7 and 5.3, respectively, on our 7-point scale.
Our results suggest that Sprint and Verizon may not have enough staff in stores to help customers quickly. Thirty-five percent of Sprint customers felt that they were kept waiting in the store too long before getting attention. About 28 percent of Verizon customers complained of long in-store wait times.
Next: Network Service
Sprint, Verizon Networks Are Best Liked
Without the networks that connect handsets to the Internet, smartphones are little better than paperweights. This network connection is where service providers make most of their profit, and customer perceptions of the performance of those networks is hugely important to service providers. (Click on the chart image to see our survey results on users' satisfaction with providers' network service.)
Big wireless companies make grand claims like "America's fastest" and "the nation's most dependable," based largely on their own research, and that provided by paid third parties. Since commissioned studies can lead to biased results, we turned to real-world wireless customers to learn about the value of the major wireless services. Specifically we asked smartphone owners to grade the speed and reliability of their Internet connection, and the quality of their voice calls.
We found that among the big four carriers, Sprint's customers are happiest overall with the performance of their network. In particular, Sprint customers like the speed and reliability with which the Sprint network connects them to the Internet. More than 70 percent of Sprint's customers said that they were "very satisfied" or "extremely satisfied" with the speed of their smartphone's internet connection. Sprint scored even better on the reliability of its network when connecting: Almost 80 percent of Sprint subscribers in the survey said that they were highly satisfied.
Verizon won the day on pure voice-call quality, with almost 85 percent of its subscribers saying they were highly satisfied with the sound and connection quality of calls. Sprint came in a close second, with almost 85 percent of its subscribers saying they were either very or extremely satisfied with the quality of voice service.
The AT&Tand T-Mobile networks didn't fair too badly in our survey either. Both scored well, between the 70th and 80th percentiles (along with Sprint and Verizon) in terms of overall satisfaction with network service.
AT&T and T-Mobile did stumble in a couple of key areas, however. Only 59 percent of T-Mobile subscribers described themselves as highly satisfied with the speed of their wireless Internet connection. T-Mobile's competitors all scored above the 65th percentile in this area.
AT&T fared poorly on voice-call quality. Though 74 percent of the company's subscribers in our survey said they were completely satisfied with call quality, AT&T's competitors each scored well above the 80th percentile on this measurement.
Some anecdotal evidence suggests that AT&T's voice network performance is highly variable from coverage area to coverage area, and even from time to time, as in the example provided by AT&T subscriber and iPhone user Tammy Zink:
"A year ago, when I first got the phone, I was worried about AT&T's reputation, but AT&T's call service was fabulous--no dropped calls, great reception all the time. However, in past six months, almost every call is dropped, and reception is lousy. I now cringe when the phone rings or I have to make an important call."
Over the past two years, smartphones, and the iPhone in particular, have caused wireless Internet usage to rocket upwards. To better accommodate the demand, AT&T and other providers have been "tuning" their networks. As network resources are shifted to bolster one service, however, another service may suffer--in this case, voice service.
The findings of a new survey by Consumer Reports seem to agree with our results. Consumer Reports asked subscribers of the major wireless providers in 26 cities for their thoughts about their cell phone service, and found that AT&T subscribers were the "least satisfied" of all in 19 of those cities.
AT&T had the same general reaction to Consumer Reports' findings as it did to ours, saying neither study paints a true picture of U.S. wireless users' experience.