OnePlus responds to accusations that it manipulated benchmark scores in the OnePlus 5

midian182

Posts: 9,745   +121
Staff member

Chinese smartphone manufacturer OnePlus finally unveiled its flagship OnePlus 5 handset yesterday, and the early reviews were overwhelmingly positive. Publications praised its speed, specs, software, and comparatively low price, but the company has come under fire for claims that it has once again used code in the review units to manipulate benchmark scores.

In January this year, XDA Developers reported that OnePlus and Meizu were artificially boosting the benchmark scores of the OnePlus 3T and Meizu Pro 6 Plus by causing the systems to run at higher than normal CPU speeds when they detected a benchmark tool was running.

OnePlus said it would fix the issue in the next update of OxygenOS (the custom version of Android found in its smartphones). But XDA Developers claim the company is up to its old tricks once again with the OnePlus 5.

“… it [the OnePlus 5] resorts to the kind of obvious, calculated cheating mechanisms we saw in flagships in the early days of Android, an approach that is clearly intended to maximize scores in the most misleading fashion,” the publication notes.

“While there are no governor switches when a user enters a benchmark (at least, we can't seem to see that's the case), the minimum frequency of the little cluster jumps to the maximum frequency as seen under performance governors. All little cores are affected and kept at 1.9GHz, and it is through this cheat that OnePlus achieves some of the highest GeekBench 4 scores of a Snapdragon 835 to date.”

When XDA contacted OnePlus, the company gave the following statement: “People use benchmark apps in order to ascertain the performance of their device, and we want users to see the true performance of the OnePlus 5. Therefore, we have allowed benchmark apps to run in a state similar to daily usage, including the running of resource intensive apps and games. Additionally, when launching apps the OnePlus 5 runs at a similar state in order to increase the speed in which apps open. We are not overclocking the device, rather we are displaying the performance potential of the OnePlus 5.”

Contrary to what OnePlus is stating, the handset’s CPU is boosted only when certain benchmark tools are being run. This doesn’t happen in apps that aren't targetted by the boosts, meaning it's not representative of the kind of performance owners will see during daily usage.

The OnePlus 5 is still a great, well-priced phone, and it could even be the case that the issue won't be present in the consumer units. We’ll just have to wait and see whether the revelations affect sales of the handset, which can now be preordered and will be available starting June 27.

Permalink to story.

 
One of the reviews TechSpot quoted said he opened every app and saw no slowdown. Maybe One Plus is telling the truth?
 
OP can be accused of benchmark manipulation as much as anyone likes but it still won't make a scratch on sales of the device. It's only us geeky consumers who are aware of these allegations. To the other 99% of the consumers? They wouldn't know and wouldn't care and to be honest, if I were interested in buying the OP5 , neither would I. (care, that is).
 
Oppo's OnePlus has been shady from the start!
"Startup", that was a big fib.
"Never Settle"? Yeah right
Missing features, broken devices.
Stereo speakers that turned out to be twin mono speakers, the Display issue they laughed off as they set the color of the screen more "warmer" so it looked more yellow than blue, which turned out to be rushed displays that were not properly cured. Software bugs, very little if any support, other than software.
Yeah, they've improved, but, if it can be proven, it won't help Oppos's beta tester OnePlus.
Oh if you go to their user forums, you'll see the devoted rabid fanboys, who are WORSE than the Apple/Samsung cheerleaders.
 
In the end, manipulated or not, the performance is coming from the hardware which means it exists so who cares?! My OnePlus 3T has been fantastic for all the games I play and I have no complaints. Just use the **** phone and enjoy it.
 
I had the original OPO and adored it for a full year and half, but then the touch screen started to fail and their support team was crap. Unfortunately the experience was so bad I decided to never buy another phone from them again.
 
Yeah, that is awful but it sports the latest snapdragon fashion + 8 gb ram ... and I don't see any alternative atm ... nexus line has died ... probably the only android phone I would recommend currently. Most likely they thought they can control the damage ... just one publication, the xda dudes are serious but is no big deal ... given the specs and the price ... the rest of the reviewers are a joke anyway. I am gonna buy one of oneplus successors probably in one or two years - just milking my current nexus 6p as much as possible. I don't see a decent candidate for an android tablet though ... maybe they should get into tablets as well ..
 
Oppo's OnePlus has been shady from the start!
"Startup", that was a big fib.
"Never Settle"? Yeah right
Missing features, broken devices.
Stereo speakers that turned out to be twin mono speakers, the Display issue they laughed off as they set the color of the screen more "warmer" so it looked more yellow than blue, which turned out to be rushed displays that were not properly cured. Software bugs, very little if any support, other than software.
Yeah, they've improved, but, if it can be proven, it won't help Oppos's beta tester OnePlus.
Oh if you go to their user forums, you'll see the devoted rabid fanboys, who are WORSE than the Apple/Samsung cheerleaders.
No, it's not without it's flaws but when you come to think of it, there is no such as "a perfect fit for everyone" For the specs, price & performance, they can easily be overlooked... unless you're unlucky enough get sold a lemon, and there are lemons in each and every batch of devices manufactured irrespective of the brand. QA is not foolproof.
 
If I understood the article correctly... when a benchmark app is run, they boost processor frequency to 100%. That makes complete sense to me. I wouldn't want a benchmark score on a hobbled processor frequency, they are pushing it to the maximum allowed speed. Good for them. According to the OnePlus website, this phone has a SnapDragon 835, up to 2.45Ghz. In the article above, you say it boosts to 1.9Ghz? That means it's well within the limits and could even be pushed further... or am I missing something? I'm pretty clueless on mobile hardware nowadays.

If I have a 4 core desktop CPU, that the manufacturer rated for 4Ghz, but runs slower and powers down cores for power savings and efficiency... that's fine. But when I run something that puts load on that processor, I expect it to perform at 4Ghz, with all cores. That is what it is rated and designed for.
 
They all do it, seems fair enough.

I'm not very knowledgeable on this topic, however, can't someone else create a new benchmark tool that hasnt been compromised?

the handset’s CPU is boosted only when certain benchmark tools are being run.

Creating a new benchmark tool would possibly bypass this?
 
Back