Why Samsung Cheats at Benchmarks (Allegedly)

Ron Amadeo, over at Ars Technica: 

The smoking gun here is CPU idle speeds, which can be viewed with a system monitor app while using the phone. The above picture shows how differently the CPU treats a benchmarking app from a normal app. Normally, while the Note 3 is idling, three of the four cores shut off to conserve power; the remaining core drops down to a low-power 300MHz mode. However, if you load up just about any popular CPU benchmarking app, the Note 3 CPU locks into 2.3GHz mode, the fastest speed possible, and none of the cores ever shut off. Stopping the CPU from idling shouldn't in and of itself affect the benchmark scores a whole lot, so this was our first sign that something was wrong. Benchmarks exist to measure the performance of a phone during normal usage, and a device should never treat a benchmark app differently than a normal app.

As mentioned in the article, this isn't the first time that Samsung has been caught with its hand in the benchmark cookie jar. Months ago, it was determined that the Galaxy S4 was guilty of the same sort of shenanigans. To be fair, almost every Android manufacturer does this too. My focus, though, is on Samsung since they were the ones most recently caught 'juicing' their benchmark results. Why does Samsung (allegedly) cheat at benchmarks?

The answer is quite simple: because cheating has very many positive benefits and very few negative effects.

Consider the benefits of hypothetical headlines that proclaim Samsung Releases Most Powerful Phone or Galaxy Note 3 is Fast. Those kind of headlines help Samsung cultivate a particular brand image, specifically that their phones are better than their competitors' phones. Certainly, all the tech enthusiasts would have seen such a headline, and with any luck the story would be picked up by the traditional media outlets. Some tech sites are obsessed with benchmarks, so anything that can be done to boost those benchmarks helps Samsung's cause.

Samsung, by the way, is fully aware of the fact that news story retractions are never as impactful as the original story.  Once a particular impression has been made (e.g. that Samsung makes fast phones), it is difficult for that impression to be changed in consumers' minds.

Look at Ars Technica's headline. Note 3’s benchmarking “adjustments” inflate scores by up to 20%. That certainly doesn't have as much oomph as Galaxy Note 3 is Fast . It simply isn't catchy enough. In fact, the headline loses impact by stating the facts indirectly. They could have written a different headline such as Galaxy Note 3 Cheats at Benchmark Tests  which would have been just as true. If they were worried about potential legal implications, then they could have written a headline such as Galaxy Note 3 Artificially Inflates Benchmark Scores . The positive headlines are much easier to remember and much more likely to be propagated among the general public. The negative headlines are much more likely to stay out of the public consciousness.

Folks, manufacturers shouldn't be rewarded for their deception. Consumers should demand honesty (and reward honesty).

 

Google Made a Huge Number of Awesome Announcements at its I/O Keynote

Google is once again making waves in the technology world. Here are some quick thoughts about the most important and/or interesting things they announced during their keynote at Google I/O.

Google Maps + Google Earth + Street View​The visual design revamp is remarkable, and the location+identity-based search relevance is incredible. It's difficult to conceive of any competitor (e.g. Apple) ever catching up to Google in this arena.

Google Now reminder cards, transit info, music recommendations​: Google Now was already very useful before, and now is even more useful with these new cards. Hopefully we will see these cards added to the iOS Google Search app.

Google+ Hangouts app​: This is something that has been sorely needed to bring sanity to Google's messaging/communications services.

Android Studio​: I'm a huge fan of the IntelliJ IDE, and it looks like Google has worked closely with the folks at JetBrains to make it even easier for developers to create apps for Android.

Google Play game services:​ This is similar in concept to Apple's Game Center, but offers cross-platform compatibility. This helps game developers to keep players engaged across the platform markets.

Google Chrome Voice Search:​ This is technically interesting, and socially somewhat creepy. Also, imagine having fun pranking your co-workers by making their browser search for something inappropriate.

Unlocked Samsung Galaxy S4 with stock Android:​ This one was a shocker. I've written before about Google and Samsung's relationship issues, and this was an unexpected yet welcome surprise. This is arguably the best Android phone on the market, and quite possibly is the best smartphone on the market.

​Folks, that was just the first day of the Google I/O conference announcements, with more to come. By the way, if you don't feel like sitting through all 3.5 hours of the keynote video, the folks at The Verge edited the keynote down to the best 3.5 minutes.

Samsung's Galaxy S4 Commercials are Pretty Good

As I have mentioned before, Samsung makes some good commercials.​ In this case, the commercials focus on Samsung's Galaxy S4 smartphone. The "Easy Mode" commercial is fine for what it is, which is an appeal to older individuals that are concerned about phones being too complicated. My favorite of the new batch is the "Grad Photo" commercial, which shows off a camera feature that lets users remove unwanted items from a picture. Quite frankly, this is a feature that every phone should have and the commercial does a good job of selling this as an essential feature. The commercial shows potential buyers a real world scenario where they might make use of and value such a feature.

Samsung's Galaxy S4 Comes With Less Available Storage Than You Might Think

Chris Welch, in a post over at The Verge:

Some buyers of Samsung's new Galaxy S4 have been disappointed to learn that the 16GB model offers only around 8GB of user-accessible storage. However, in a statement to CNET, Samsung is reminding irked customers that they can easily remedy any concerns with the help of the built-in microSD slot.

If this was an Apple product, you wouldn't be able to turn on your TV without hearing about this story. Since it's not, you won't hear about it (except here, of course).​

It's Difficult for Apple and Samsung to Compete with These Prices in India

Kartikay Mehrotra, in a post for Bloomberg:

Karbonn unveiled the Titanium S5 on March 15, with similar technical specifications to the Canvas HD: Qualcomm Inc. (QCOM)’s Snap Dragon quad-core processor, an 8-megapixel camera and a 5-inch touchscreen for 11,990 rupees. Samsung, the market leader in Indian smartphones, offers the same features on its Galaxy Grand for 21,500 rupees. The iPhone 5 starts at 45,500 rupees in a market where operators do not subsidize handsets.

I've recently had a lot of conversations with a friend, who is from India, about the impact that Karbonn and Micromax have had on the Indian smartphone market.​ These two manufacturers offer phones that have features comparable to what is available from Samsung and Apple but at half the price. In fact, according to my friend, these phones are cheap enough that oftentimes users will simply purchase a new phone every year since it is the easiest (and sometimes only way) for them to get the latest and greatest operating system version.

Samsung is Building Stores Inside of Best Buy

As has been reported, Samsung is building stores inside of Best Buy. This is a very smart move to push the Samsung brand across all of the many products that it manufactures.

Coincidentally, I popped into a local Best Buy and snapped a pic of that store's Samsung store (which is not yet complete).​

​To no one's surprise, this is across the aisle from the Apple store.

​To no one's surprise, this is across the aisle from the Apple store.

Which Mobile Operating Systems Will Survive?

The mobile operating system market for smartphones has changed very much over the past several years. In particular, we have seen the rise of two dominant competitors (Android and iOS) and the demise of an upstart (webOS).​ The past few months have seen new challengers enter the fray or announce plans to do so. The following is an analysis of the strengths and weaknesses of each competitor as well as a rough determination of market viability.

It should be noted that this should not be construed as investment advice.

1) Android

Strengths

Android, the operating system backed by Google, is by far the world leader in market share with almost 70% of the market as measured by shipments. Accounting for some margin of error due to the way various manufacturers report shipments vis-a-vis sales, Android has roughly 60-70% of the global installed user base. Android's open source nature and flexibility has allowed it to dominate overall market share, with particular strength in the mid- to low-end smartphone market. Android can be tweaked by users (e.g. via widgets) or manufacturers (e.g. Samsung's TouchWiz or HTC's Sense). Its connection to various app stores (e.g. Google Play and the Amazon App Store for Android), along with the ability for users to 'side-load' apps from non-app store sources has increased the amount of software available for the operating system. Google Play, in particular, has over 700,000 apps available for users to download.

Weaknesses

A major weakness of Android is the fragmentation due to various OS implementations and device integration. In the case of custom skins (such as the aforementioned TouchWiz and Sense examples), the combination of customization and wireless carrier interference has drastically limited the rate at which newer versions of Android proliferate throughout the installed user base. The two year-old Gingerbread was only recently eclipsed in market share by the combined share of the Ice Cream Sandwich and Jelly Bean releases. This fact, along with device hardware variability, makes it more burdensome for developers to target the Android market. As such, it is often the case that so-called 'premier' apps launch first on iOS and later on will release a version for Android (if at all). It should be noted that Android user web usage hints at the idea that Android users buy Android phones to be, well, 'phones' and not 'mobile computers'. Android is also heavily dependent on the success of a single manufacturer, in the form of Samsung. A danger exists in the form of 'forking' such as what Amazon did to produce its Kindle Fire.

Viability:Excellent

The strengths (and installed user base) of Android make its chances of remaining viable in the foreseeable future excellent. Assuming that non-compatible forked versions do not proliferate, Android's open source nature and large user base will protect its place in the market.

2) iOS

Strengths

iOS, the operating system created by Apple, has roughly 20% of the market (see the aforementioned report in the Android section for details). Despite trailing Android in market share, Apple has been able to use iOS to achieve roughly 70-75% profit share. iOS is known for being popular with users for its tight integration with the apps, video, music, and books available via Apple's App Store and iTunes Store. The App Store, in particular, has roughly the same number of apps (700,000) as Google Play yet has a staggering lead in terms of revenue generation with a much smaller installed user base. iOS tends to receive the lion's share of so-called 'premier' apps that launch first on the platform. Examples of this include Instagram, Angry Birds, and Instapaper. There have also been cases where app makers (such as Facebook) have focused their attention on upgrading the iOS version of the app months before upgrading the Android version of the app. iOS is exclusive to hardware from a single manufacturer (Apple), and as such it benefits greatly by being optimized for a significantly reduced hardware set. In addition, developers can more quickly make use of features available in newer versions of iOS since users are able to upgrade the operating system at a much faster pace than is seen with Android.

Weaknesses

iOS, being completely produced by a single company, suffers somewhat from not being able to quickly iterate on various new design ideas or feature innovations. iOS, as is often noted by more technically inclined users, does not offer powerful widgets that quickly provide information to the user (as is done in Android).​ In fact, in some cases where iOS has relative parity in features such as the Notification Center (which appeared earlier in Android), iOS has much more limited interaction available for the same feature. Likewise, iOS is hampered by a rather limited interapp communication scheme that does not provide the same flexibility offered in competing platforms. This makes it more difficult for developers to integrate with third party apps beyond the ones officially sanctioned by Apple (e.g. Facebook and Twitter). iOS also suffers somewhat in terms of services maturity exemplified by the new Maps app and iCloud Core Data syncing, though this somewhat mitigated by the availability of alternative services. iOS is, by and large, only available in the high-end phone market and is thus not within the reach of users with limited budgets such as those in India and China.

Viability: Good

Apple must overcome its shortcomings in terms of services maturity as well as rapidly innovate in offering developers and users newer (and better) features. If it does so, the profit-driven war chest combined with current large installed base of users willing to pay for a premium product will protect its place in the market.

3) Windows Phone

Strengths

Windows Phone, produced by Microsoft, has roughly 3% market share.​ This number is due, in part, to Windows Phone being released three years 'late to the party'. Windows Phone's strengths are in its integration with the Microsoft ecosystem (e.g. with the Xbox 360 via Smart Glass) and some third party providers (e.g. Facebook and Twitter integration in the People Hub). The 'Metro' design language works well to provide users with more information and less 'chrome', and is stylistically unique when compared to its competitors.

Weaknesses

Windows Phone suffers from a much smaller app store. This is exemplified by the absence of ports of notable applications such as Instagram.​ Major app announcements focus on apps that have been available on other platforms for years.

Viability: Fair

Windows Phone maintains some measure of safety due to the sheer size of Microsoft. However, it'll need to take better advantage of the Microsoft ecosystem (e.g. Office and Xbox) if it is to stand a chance in the long term.​

4) BlackBerry 10

Strengths

BlackBerry 10, created by BlackBerry (formerly Research in Motion), is a renewed entry into the market. Its Android app compatibility has helped to create a larger app store than would be expected at this early stage after launch. BlackBerry 10 offers innovations in the area of communication integration, multi-tasking, and the separation of work versus personal data. BlackBerry 10 also continues BlackBerry's emphasis on security and messaging.

Weaknesses

The larger than expected app store is inflated by the inclusion of Android ports.​ While this helps to get the platform off the ground, it is also could turn out to be a crutch used by developers to avoid having to create a BlackBerry 10 port of an app that would take advantage of features unique to the platform. BlackBerry's market share has dwindled and faces pressure in the government and enterprise spaces from Windows Phone.

Viability: Fair

BlackBerry 10 must not only recapture the BlackBerry faithful (while fending off encroachment ​from Microsoft), but must also find a way to carve out a significant portion of users from Android and iOS.

5) Tizen

Strengths

Tizen, produced by a consortium led by Samsung and Intel, is a new entrant into the market. It is an open source, HTML5-based platform similar in many respects to webOS.​ The HTML5 foundation provides developers with an opportunity to more easily create apps that work across many kinds of devices. It is backed by Samsung, who leads the world in phone sales (all sales, not just smartphones). Samsung's interest in reducing its dependence on Google ensures it will maintain some level of interest in the platform.

Weaknesses

Tizen suffers from many of the same issues that plague platforms not named 'Android' and 'iOS': limited number of apps in general, especially in the area of premier apps. While being based on HTML5 confers some ease of transferring of skills for mobile app developers (especially if they have a web development background), the past failure of webOS, the pace of innovation in the native platform space, and the concern around the look-and-feel issues surrounding HTML5 apps deflate much of the advantages of going the HTML5 route.​

Viability: Poor

Despite being backed by a market leader like Samsung, the issues surrounding HTML5 as a mobile operating system remain outstanding. As well, it is entirely possible that Samsung may decide to 'pull an Amazon' and ​fork Android in order to reduce its dependence on Google. This would relegate Tizen to a second-class citizen in the Samsung ecosystem.

6) Firefox OS

Strengths

Firefox OS, created by the Mozilla Foundation, is an open source, HTML5-based platform.​ It is targeted at devices at the low-end of the market, where it will have less competition from the likes of Apple or the mid- to high-end Android devices manufactured by Samsung. As well, the emphasis on low-end (and thus less expensive) phones allows Firefox OS an opportunity to catch some of the growing market in the developing world.

Weaknesses

Firefox OS shares all of the weaknesses of the aforementioned Tizen operating system. As well, it suffers from not being backed by a market behemoth like Samsung.​

Viability: Poor

Entering a market with two established, entrenched platforms and two clear market manufacturers (one of which has its own hat in the budget OS ring) creates a poor outlook for Firefox OS.

7) Ubuntu (for phones)

Strengths

Ubuntu, backed by Canonical, is a smartphone interface for the Ubuntu operating system. It provides for native apps as well as HTML5-based apps. It has a user interface design that emphasizes the use of gestures. It provides a 'full PC experience' when docked.

Weaknesses

Ubuntu's strengths are arguably weaknesses as well. The extensive use of gestures to drive the UI may equally as innovative as it is daunting to use for new users. Trumpeting the ability to turn the phone into a 'full PC' would make more sense as an advantage for Microsoft (the desktop OS leader) than it does for an OS with a tiny desktop market share.

Viability: Poor

Ubuntu for phones, unfortunately, makes the least amount of sense as a platform compared to its competitors. Outside of some UI innovation, there is very little evidence that it stands a chance of surviving in a very crowded market.​

Summary

The mobile operating system market has grown and matured at a fantastic pace. As the market matures, we will likely see a relative few competitors remaining in the space once the dust settles.​

Apple and Samsung Lock Screen Hacks

It's been a bad day for Apple (Jacqui Cheng, Ars Technica):​

Just a day after Apple released iOS 6.1.3, a new lock screen bug has been discovered that could give an attacker access to private information. The vulnerability is different from the passcode bug(s) addressed by Tuesday's iOS update, but the end result is similar: access to iPhone's contact list and photos.

Also a bad day for Samsung (Chris Davies, SlashGear):​

A new Samsung lockscreen hack has been identified, allowing unofficial access to PIN-secured Galaxy smartphones through a combination of keypresses and commands, though Samsung is apparently working on a software fix. The exploit relies on brief visibility of the phone’s display, unlocked, after a failed emergency call placed from the lockscreen; though ponderous, you could use that access to download a screenlock disabler from the Google Play store.

This isn't the first time that Apple and Samsung have had issues with securing their lock screens. They both desperately need to get their act together.​ Users need their devices to be reasonably secure.

Samsung's Galaxy S4 Looks Very Good

Samsung recently revealed its newest phone in the Galaxy S line, the Samsung Galaxy S4. Despite its odd choice of using a theatrical show format during the announcement, Samsung showed off some interesting stuff.​

As every one expected, the phone comes with a 5-inch screen. More interesting than the actual hardware specs, though, is the software. Samsung showed off its "Air Gestures" and "Smart Stay"​ features, which allow for touch-free use of the phone and eye-based tracking of the user's intent, respectively. Changing music tracks without having to touch the phone (such as while driving) is useful, as is the ability for the phone to automatically pause video when the user looks away. I'm skeptical of the usefulness of the eye tracking that automatically scrolls text content, since it seems like that might register too many false positives or false negatives to avoid being annoying. I'm guessing that the ability to use the phone even when wearing gloves has something to do with the Air Gestures feature, but I could be wrong about this.

​The S4's integration with televisions and with health and fitness devices makes a lot of sense. It also goes a long way towards flexing Samsung's muscle as one of the largest electronics manufacturers in the world.

A new accessory that seems to have slipped in under the radar is the ​wireless game controller that connects to the S4. While the design of the controller seems to have been a bit *ahem* 'inspired' by the Xbox 360 controller, it may portend a greater focus in the future on gaming for Samsung devices. There is some criticism of the controller as having limited utility since it is not a standard component that game developers can count on users having, but with Samsung's burgeoning influence in the industry it is simply a matter of time before there is enough of an installed user base to make this close to ubiquitous. Remember, folks, Samsung sells more Android devices than anyone.

In summary, it looks like Samsung has a real winner of a device in the Galaxy S4. Samsung has put together an excellent phone for consumers that will sell like hotcakes.​

Samsung Isn't Impressed By Windows 8

John Paczkowski, writing for AllThingsD.com:

“The global PC industry is steadily shrinking despite the launch of Windows 8,” Jun said. “I think the Windows 8 system is no better than the previous Windows Vista platform.”

That isn't even the most damning quote in the article. Samsung went further to bash Microsoft's Surface effort and referred to the Windows 8 platform as being "less-competitive".

Considering this news in addition to Samsung's situation with Google over Android, it seems as though Samsung is flexing its (rapidly growing) muscle in the industry.