Like every other website on the planet, SmallNetBuilder uses cookies. Our cookies track login status, but we only allow admins to log in anyway, so those don't apply to you. Any other cookies you pick up during your visit come from advertisers, which we don't control.
If you continue to use the site, you agree to tolerate our use of cookies. Thank you!

Wi-Fi Router Charts

Click for Wi-Fi Router Charts

Mesh System Charts

Click for Wi-Fi Mesh System Charts


NOTE!NOTE:This article describes the wireless test procedure for products tested after May 15, 2016.
For wireless products tested between July 25 2014 and May 15 2016, see this article.

The V9 process has been designed to address some weaknesses of the V8 process. Specifically:

  • High 5 GHz path loss resulting in reduced test range
  • Throughput vs. range results not experienced in most real-world use
  • Lack of standard method for testing 4x4 maximum throughput

Throughput vs. Attenuation Test Configuration

We have chosen a 2x2 AC1200 class device as our new test standard for throughput vs. attenuation testing. This more accurately reflects the majority of devices in use today. Note that AC1200 does not support 256-QAM modulation in 2.4 GHz. Although 256-QAM support in 2.4 GHz has been widely adopted in new router designs, it is not part of the 802.11n standard and implementations can be trouble-prone. So the AC1200 standard STA will not test 256-QAM link rates.

The new standard test STA is an Intel Dual Band Wireless-AC 8260 card hosted in a Lenovo ThinkCentre Tiny M600 running Windows 7 Pro. We modified the Lenovo to disconnect the internal antenna and bring the card's second antenna connection to an SMA connector mounted on the rear panel for fully-cabled connection.

Lenovo ThinkCentre Tiny M600

Lenovo ThinkCentre Tiny M600

We are also using octoScope's new high-gain antennas. The increased gain will let us test a wider 5 GHz operating range by lowering total path loss by approximately 10 dB. The higher gain also works in 2.4 GHz, but this causes signal levels to be too high, potentially overloading some products. We address this by reconfiguring the test bed to use two channels of the octoScope quadAtten as fixed attenuators and two as adjustable.

NOTE!It was brought to our attention in March 2017 that the stacked attenuators described above had attenuator-to-attenuator signal leakage affecting 2.4 GHz throughput test results beyond 45 dB of attenuation. The incorrect test values have been removed from the database, having the effect of truncating 2.4 GHz up and downlink results above 45 dB. Product rankings have been recalculated to reflect the new data set. The leakage did not affect 5 GHz results.

octoScope High Gain Antenna

octoScope High Gain Antenna

The throughput vs. attenuation test configuration is shown below. Note only one octoBox test chamber is used.

V9 configuration - Throughput vs. attenuation

V9 configuration - Throughput vs. attenuation

We continue to use 20 MHz bandwidth in 2.4 GHz for throughput vs. attenuation testing, limiting maximum link rate to 144.4 Mbps. This is what most devices will use, given mandatory 40 MHz coexistence mechanisms and overcrowded 2.4 GHz band.

When testing 5 GHz, 80 MHz bandwidth mode will be used for a possible full maximum link rate of 866.7 Mbps with 11ac routers.

All wireless router performance testing is done on the LAN side of a router under test so that the product's routing performance does not affect wireless performance results, i.e. the Ethernet client is connected to a router LAN port. Access points are tested using their Ethernet port.

The wireless router / AP under test (DUT) is centered on the upper test chamber turntable in both X and Y axes. If the DUT has external antennas, they are centered on the turntable. If the antennas are internal, the router body is centered. Distance from center of turntable to chamber antennas is 18 inches (45.72 cm).

Initial orientation (0°) is with the DUT front facing the chamber antennas. The photo below shows the 0° starting position for a NETGEAR R7800 Nighthawk X4S router.

NETGEAR R7800 in Upper Test Chamber - "0 degree" Position

NETGEAR R7800 in Upper Test Chamber - "0 degree" Position

The router or AP under test is prepared as follows:

  • Check / update latest firmware
  • Reset router to defaults
  • Change router settings:
    • LAN IP:
    • 2.4 GHz: Channel 6, Bandwidth: 20 MHz, Security: WPA2 / AES, Key: 11111111
    • 5 GHz: Channel 40, Bandwidth: Auto or 80 MHz, Security: WPA2 / AES, Key: 11111111

Note we have changed from upper band Channel 153 to lower band Channel 40 for 5 GHz band testing. The FCC now allows the same transmit power in both bands and the lower channel gives us a bit lower path loss from the octoScope MPE. 10 dB of fixed additional attenuation is used for 2.4 GHz band tests. No additional attenuation is used for 5 GHz testing.

Throughput vs. Attenuation Test Process

Note: "Downlink" means data flows from router to client device. "Uplink" means data flows from client device to router.

The general test process is as follows:

  1. Associate client. Record connection link rate.
  2. Run IxChariot manual test to check throughput
  3. Run test script
  4. Power cycle DUT and repeat steps 4-6

Two test runs are made in each band for dual-band devices.

Testing is controlled by a Tcl script supplied by octoScope. The script executes the following test plan:

  1. Move the turntable to starting position. This places the DUT at the "0 degree" starting position previously described.
  2. Program the attenuators to 0 dB
  3. Move the turntable to -180° (counter-clockwise)
  4. Start 90 second IxChariot test (throughput.scr with 5,000,000 Byte test file size) simultaneous up and downlink (0 dB only)
  5. Wait 30 seconds, then start turntable rotation to +180° at 1 RPM.
  6. Wait for test to finish
  7. Discard first 30 seconds of IxChariot data, calculate average of remaining data and save to CSV file. Save entire IxChariot .tst file.
  8. Repeat Steps 3 to 7 for downlink only (DUT to STA)
  9. Repeat Steps 3 to 7 for uplink only (STA to DUT)
  10. Increase attenuators by 3 dB.
  11. Repeat Steps 3 to 9 until attenuation reaches 45 dB for 5 GHz test; 63 dB for 2.4 GHz test.

We continue to use the throughput.scr IxChariot script instead of the High_Performance_Throughput.scr script used by many product vendors.

The main difference is the high performance script uses a 10,000,000 Byte default test file size, Microsoft's Overlapped IO socket and sets the transmit and receive buffer sizes to 64 K bytes. The regular throughput script doesn't use Overlapped IO, leaves the transmit and receive buffers at default and a 100,000 Byte test file size.
We found in testing that using the throughput script and adjusting the file size upward actually produced slightly higher throughput than the high performance script.

The CSV files from the two test runs are merged into a single Excel file and the average of the two runs calculated. The average of the two runs is the value entered into the Charts database.

Support Us!

If you like what we do and want to thank us, just buy something on Amazon. We'll get a small commission on anything you buy. Thanks!

Don't Miss These

  • 1
  • 2