If you have used tools like llama.cpp 's built-in benchmark or text-generation-inference (TGI) benchmarks, you know they are excellent for raw compute. However, they suffer from three major flaws:

: Allows you to customize packet size, test duration, and transfer mode (Send Only, Receive Only, or Bidirectional).

: Test if a new Wi-Fi 6 or 6E router actually delivers the advertised speeds within your home.

LANBench