Our Smart Home Testing Methodology
Smart Bulb Testing — 30-Day Reliability Study
Each bulb is installed in an active household as a primary light source. Protocol:
| Test | Method | Frequency |
|---|---|---|
| Connection check | Command sent, response success/fail logged | Twice daily (9am, 9pm) |
| Response time | Slow-motion video from command to light change | 5 tests every Sunday (20 total) |
| False wake rate | Manual classification of all unexpected triggers | Continuous |
Uptime formula: (Successful connections ÷ 60 total checks) × 100
Environment: All WiFi bulbs on Eero Pro 6E, same channel, consistent load. Zigbee bulbs on Hue Bridge. Thread bulbs with HomePod mini.
→ See full 30-day study results
Smart Thermostat Testing — 3-Month Energy Study
| Phase | Duration | Measurement |
|---|---|---|
| Baseline | 3 months pre-install | Utility bills, same calendar period previous year |
| Active test | 3 months post-install | Utility bills, runtime logs, manual adjustments counted |
| Normalisation | Applied post-test | Degree-day methodology for outdoor temperature differences |
Home type: 3-bed semi-detached UK homes with gas combi boilers. Testing conducted Jan–March (heating season).
Smart Lock Testing — 90-Day Reliability
- Auto-lock reliability: Every auto-lock cycle over 90 days logged. Failure = door detected open, auto-lock doesn't engage within 5 minutes
- DoorSense accuracy: 50 manual checks comparing physical door state vs sensor report
- Installation time: Measured from tool pickup to first successful app-controlled lock/unlock
- Battery life: Fresh batteries at test start, logged to first low-battery alert
Security Camera Testing — 6-Week Real-World
- False positive rate: All motion alerts over 6 weeks manually classified. False positive % = irrelevant alerts (cars, shadows, wind) ÷ total alerts
- Notification speed: 20 triggered events, time from trigger to phone notification measured with dual-camera setup
- Battery life: Charged to 100%, monitored to 20% alert, calendar days counted
- Night vision: Test at 5m, 10m distances, graded on face recognisability in still frames
Mesh WiFi Testing — 8-Week Smart Home Focus
- Smart device disconnections: All WiFi smart devices monitored for connection failures over 8 weeks
- Speed tests: 20 speed tests per system at 5m, 10m, 15m from nearest node, averaged
- Setup time: Unboxing to all-devices-connected, stopwatch timed
Smart Sensor Testing — 6-Week Field Test
- Motion sensors: False positive rate over 6 weeks, response time (trigger to Alexa/HomeKit notification) averaged from 20 tests
- Contact sensors: Zero missed detections test (100 manually triggered open/close events)
- Battery life: Fresh battery at test start, logged to first low-battery notification
Purchase Policy
Every product on this site was purchased at retail with personal funds. We have never accepted free review samples. We believe this is the only basis for genuinely unbiased recommendations — manufacturer-supplied samples create obligation, even unconscious, towards positive coverage.
Affiliate Policy
We are an Amazon Associates affiliate. We earn a commission when readers purchase via our links at no extra cost to you. This does not influence product rankings. Products we rank first include ones with lower commission rates than alternatives. Products we actively recommend against (e.g. Govee bulbs) include ones that do have affiliate programmes. See our full affiliate disclosure.
Corrections Policy
If you identify an error in our data or product information, contact us. We correct factual errors within 48 hours and note corrections in the relevant guide with a timestamp.