Hey review sites like geek.com and pcmag.com. I'd like to propose that someone make cell phone reviews better and not just a little bit better, a LOT better! I think the gold standard for review sites is
imaging-resource.com but alas they do not review cell phones/smart phones, just cameras. They have created a very detailed set of comparisons that is in my opinion one of the best in the industry.
What is lacking today from pretty much all phone reviews is a standardized comparison list. Most users don't consider all the features of most phones because nobody pays any attention to the details.
Most of these features are routinely ignored by manufacturers and users alike. Reviewers pay most of their attention to a few glamorous details and don't compare apples to apples even in the same reveiw one phone review might talk about the display and the other phone this topic is missed totally making the review totally useless.
And how about all the real world things that make the phone a joy to use or make it just a peice of junk with a nice name. Things like the Microphone sensitivity are key. But nobody reviews the mic. Also things like camera shutter speed and ability to take a picture in direct sunlight. Also for those of us who have compromised senses like less than 20/20 vision or subpar hearing. These details are key and mostly missed out on by the young youthful generation of testers.
There should be a the "Grandma Test" which is a test done on a selection of computer illiterate folks who give you subjective feedback on usability of these sensory tests. As Albert Einstein said. If you can't explain it to your Grandma you don't understand the subject. So I say in this context that same thing applies. Is the phone well thought out and usable in all these little details for the non techie?
|
Most cell phone reviews are "JUNK"! |
Here's a short list of details to show you what I'm talking about.
Missed out comparisons:
- Water Resistance (Before or after market options)
- Waterproof vs Water resistant.
- Realworld depth tests.
- Rebooting (When actively running a standard set of softwares)
- Hard Boot restart time
- Soft Boot restart time
- Audio Speaker Comparison (using pro audio measurement tools http://www.audiocheck.net/):
- Stereo vs Mono.
- Front facing vs Rear Facing.
- Base reproduction.
- Treble reproduction.
- Max volume without distortion.
- Min volume without distortion.
- Audio reproduction ranges (0 hertz to 20,00 hertz using standard test audio sound files)
- Microphone Sensitivity Comparison (NTi Audio)
- Microphone recording app ease of use
- Load speed
- Save speed
- Ease of use tests
- Max recording sensitivity without distortion.
|
Microphone Test Reference Chart |
- Realworld sensitivity tests: source in front of mic 1", 5", 10" and 50", source beside mike 1", 5", 10" and 50.
- Min recording sensitivity without distortion.
- Realworld sensitivity tests: source in front of mic 1", 5", 10" and 50", source beside mike 1", 5", 10" and 50.
- Audio recording re-reproduction range (0 hertz to 20,00 hertz)
- e.g. if you record a sound at 5000 hertz does it play back at 5000 hertz?
- Wifi Connection Speed (how fast can you connect to a never before connected to hotspot)
- Bluetooth Connection Speed (same as above but for bluetooth)?
- Bundled Software Comparison.
- Create standard list of "must have software"
- Create standard list of "commonly free software"
- Charge time from a completely flat battery
- Actual talk time battery life (standardized talk test e.g. someone talks on phone for 4 hours and two of those hours is on the speaker phone).
- Actual battery life
- Under load of standard set of real world apps.
- Camera Comparison
- Resolution and Distortion Tests
|
Resolution and Distortion Test Comparison Chart |
- Shooting into backlight.
- Ability to focus
- Washout stats
- Macro Tests
- How close can it focus
- Normal Focus Test
- In daylight
- In fluorescent light
- In tungsten light
- At dusk light levels
- Stary night tests.
- Zoom
- Optical vs Digital
- 1x, 2x, 3x, 10x etc
- Wide Angle Test
- Range of view
- 10mm vs 70mm etc
- Load speed from start to focus lock/taking photo (first time after reboot)
- Reload speed from start to focus lock/taking photo (after camera has been run once)
- Colour comparison
- Standard photo colour reproduction tests (see http://www.imaging-resource.com/ for list of standarized tests.
- Storage Comparison
- Built in memory speeds (small data and big data)
- Read
- Write
- External memory speed (small data and big data)
- Read
- Write
In the end it would be nice to see an agreed on list of standardized tests that all review sites could use to do their testing.
I really like how imaging-resource does a summary and a detail review. It is very well done and consistent across time. So you can compare this years reviews to last years reviews etc. They also update all their tests over time if there are mistakes. I like that.
How about it guys? Any takers?