Many organizations are now trying to support a combination of streaming media, VoIP and data downloads on their Wi-Fi networks, and they’re considering upgrading to Wi-Fi 6 access points (APs) to improve performance. We’ve seen the marketing language of Wi-Fi 6 promising multi-gigabit throughput, so it seems that any AP with the Wi-Fi 6 designation should easily support various high-load scenarios found in enterprises, schools, hotels, hospitals and other organizations.
To test this theory, we recently validated a set of “stress tests” on five popular enterprise-grade, cloud-managed 4×4:4 Wi-Fi 6 APs from HPE Aruba, Extreme Networks, Juniper Mist, Cisco Meraki and CommScope RUCKUS. Many of these APs we’ve worked with on numerous projects. CommScope RUCKUS assembled and operated the test environment and sponsored Packet6 for the validation of the test.
We were surprised with the findings: Performance varied substantially across AP models. While all of the tested APs share the same Wi-Fi 6 specification, vendor implementation clearly yields significant performance differences under the high-demand traffic which the APs were evaluated.
What We Tested
The test was designed to gauge these APs’ overall performance in a mixed traffic environment that included large and small file transfers, high-definition (HD) video streaming and VoIP. (We also tested to learn how each vendor’s cloud management system reacted to and enabled administrators to respond to network incidents.
We set up 30 Dell Latitude laptops with Wi-Fi 6 capability in one room and had them play a HD (1080p) video. Each laptop played a unicast HD video stream before, during, and after the test. Co-located with the laptops were five Apple iPads running a bi-directional Voice-over-IP (VoIP) test to simulate a VoIP conversation. Five additional iPads conducted data downloads in this room. In an adjacent room, associated to the same access point, were twenty Apple MacBook Pros, each conducting downloads of varying data sizes to simulate traffic such as web browsing, email, and file transfers.
The AP was placed in the back of the first room near the wall separating the two rooms, and a RUCKUS switch provided Power-over-Ethernet (PoE) to the APs, each connected to a multigigabit Ethernet port and auto-negotiated to full speed. To maximize the performance of each AP, we tested for throughput and other performance metrics using an 80 MHz-wide channel. We don’t normally recommend 80 MHz-wide channels in a high-density deployment but to realize full performance potential we used 80 MHz-wide.
We started video streams on the Dell laptops before the test began and played them nonstop during and after the test. During the test, five iPads simulated VoIP traffic while five other iPads ran data downloads. In the adjacent room, twenty MacBook Pros also ran data downloads.
We measured overall network throughput, multimedia performance and MOS (VoIP call quality), among other metrics. (See our video for a quick overview of the test.)
The APs delivered varied network throughput, ranging from 100 Mbps on the Mist AP to 441 Mbps on the RUCKUS AP. In fact, the RUCKUS AP delivered roughly 40 percent better throughput than the APs from Aruba, Extreme, and Meraki.
Video Streaming Results
While four out of the five APs supported trouble-free streaming performance before the test, the RUCKUS AP was the only one that delivered 30 stall-free streams during the test. Other APs caused video streams to stall on one or as many as 25 laptops, and we couldn’t get the Mist AP to support 30 video streams (it managed only 24) before the test began. Multiple laptops running video tests is similar in today’s environments using video conferencing.
The RUCKUS AP outperformed all other APs on the MOS metric, providing significantly higher voice call quality under heavy network load. More specifically, only the RUCKUS AP supported a MOS value that would meet typical enterprise service level agreements (SLAs) requiring “good” voice quality. Many organizations are leveraging VoIP and conferencing applications requiring good call quality.
Our Takeaway: Test Before You Buy
The RUCKUS AP significantly outperformed all of the other access points in every test. It was the only access point capable of meeting real-world success criteria—maintaining a “good” MOS score while simultaneously delivering stall-free HD video streams to 30 clients and maintaining “high” throughput for all data clients.
As they say, your mileage may vary; but this test points out that different Wi-Fi 6 APs perform differently in high-demand environments. We strongly recommend that you stress-test multiple vendor APs in your own environment before deciding on a Wi-Fi 6 upgrade.
If you’d like to learn more about the test see contact us today to learn how we can help you with your Wi-Fi 6 migration.