Platform, OS and browser recommendations for testing

List of latest stable releases

Operating systems

  • Android 11
  • iOS / iPadOS 14 — soon!
  • macOS 11 Big Sur — soon!
  • Microsoft Windows 10

Browsers

  • Google Chrome 86
  • Microsoft Edge Chromium 86
  • Microsoft Internet Explorer (MS-IE) 11
  • Mozilla Firefox (FF) 81
  • Safari 14 — soon!
  • Google Chrome 86
  • Microsoft Edge Chromium 86
  • Microsoft Internet Explorer (MS-IE) 11
  • Mozilla Firefox (FF) 81
  • Safari 14 — soon!

Assumptions

  • The majority of users receive new versions of Chrome, Firefox, Internet Explorer, Edge and Safari automatically.
  • New versions cannibalise the market share of old versions within three to six months.
  • Significant differences in web page display between versions are few and far between.

Recommendations

General

  • Invest in the future, not the past. Focus project time and effort on optimising web sites for the next 6–9 months, while making sure that popular older combinations are still viewable.
  • Use a range of mainstream devices to ensure coverage of most regular users’ everyday experience.
  • Avoid testing with specific minor releases unless there are compelling reasons to do so. Here’s an example of a compelling reason: a third-party augmented reality (AR) component is known to work with Safari 13.0.1 but not with Safari 13.0.2.
  • Do not invest in an operating system/browser combination if support is discontinued by the manufacturer. E.g. Google Chrome on Windows XP.
  • Do not support beta-release operating systems and browsers. Allow new versions time to stabilise, be released and become mainstream first, especially Android.
  • New versions on the horizon currently include macOS 11 Big Sur, iOS / iPadOS 14, and Safari 14, all expected end-2020.
  • We define ‘mainstream’ as above 5% market share.

PC operating system recommendations

  • Test with Windows 8.1.
  • Test with Windows 10.

PC browser recommendations

  • Low priority: Test with MS-IE 11 on Windows 8.1.
  • Test with Microsoft Edge Chromium on Windows 10.
  • Test with Chrome.
  • Test with Firefox (FF).
  • In each case, test with the latest release only.
  • Do not test with Opera. Market penetration is too low.

Mac desktop operating system recommendations

  • Low priority: Test with macOS 10.13 High Sierra.
  • Test with macOS 10.14 Mojave.
  • Test with macOS 10.15 Catalina.
  • Test with macOS 11 Big Sur.

Mac desktop browser recommendations

  • Low priority: Test with Safari 12.
  • Test with Safari 13.
  • Test with Safari 14.
  • Test with Chrome latest release only.
  • Do not test with Firefox. Market penetration is too low.

General mobile and tablet platform recommendations

  • Always test with the native browser.
  • Test in both landscape & portrait modes.

Apple mobile and tablet platform recommendations

  • Low priority: Test with iOS / iPadOS 12 using the Safari browser and Chrome browser (latest release).
  • Test with iOS / iPadOS 13 using the Safari browser and Chrome browser (latest release).
  • Test with iOS / iPadOS 14 using the Safari browser and Chrome browser (latest release).

Android mobile and tablet platform recommendations

  • Do not test with Android version 5.0 or lower. Market penetration is low and falling.
  • Test with Android 5.1 Lollipop using the native browser only.
  • Test with Android 6.0 Marshmallow using the native browser only.
  • Test with Android 7.0 Nougat using the native browser only.
  • Test with Android 7.1 Nougat using the native browser only.
  • Test with Android 8.0 Oreo using the native browser only.
  • Test with Android 8.1 Oreo using the native browser only.
  • Test with Android 9.0 Pie using the native browser only.
  • Test with Android 10 using the native browser only.
  • Test with Android 11 using the native browser only.

Other mobile and tablet platform recommendations

  • Strongly consider testing with Chrome browser (latest release) if not native.
  • Consider testing on all platforms with Yandex Browser if targeting Russia.
  • Do not test with Firefox, Opera or any other non-native third-party mobile browser variants on any mobile or tablet platform. Market penetration is not significant. Exception: Consider testing with UC Browser and Opera Mini/Mobile browsers if targeting Asia.

Sources

--

--

Get the Medium app

A button that says 'Download on the App Store', and if clicked it will lead you to the iOS App store
A button that says 'Get it on, Google Play', and if clicked it will lead you to the Google Play store