test TCP CC in VM over 1Gbps LAN


Linux VM receiver

One data sender and one data receiver and both are Virtual Machines (VMs).
Each VM is hosted by Bhyve in a separate physical box (Beelink SER5 AMD Mini PC) that is using FreeBSD 14.1 release OS.
The physical boxes (Beelink SER5 AMD Mini PCs) are connected through a 1Gbps hub, which is connected to a 1Gbps router.

test config

Test TCP congestion control performance of CUBIC & NewReno in VM environment with 1% incoming packet drop rate at the Linux receiver. Then, also test with 2% drop rate.

root@n2linuxvm:~ # iptables -A INPUT -p tcp --dport 5001 -m statistic --mode nth --every 100 --packet 0 -j DROP
root@n2linuxvm:~ # iptables -L
Chain INPUT (policy ACCEPT)
target     prot opt source               destination         
DROP       tcp  --  anywhere             anywhere             tcp dpt:5001 statistic mode nth every 100
...
root@n2linuxvm:~ # iptables -R INPUT 1 -p tcp --dport 5001 -m statistic --mode nth --every 50 --packet 0 -j DROP
root@n2linuxvm:~ # iptables -L
Chain INPUT (policy ACCEPT)
target     prot opt source               destination         
DROP       tcp  --  anywhere             anywhere             tcp dpt:5001 statistic mode nth every 50

sender kernel info

FreeBSD 15.0-CURRENT #136 main-n271101-9207f9d206a4-dirty: Tue Jul 9 08:33:50 EDT 2024

receiver kernel info

Linux n2linuxvm 5.15.0-112-generic #122-Ubuntu SMP Thu May 23 07:48:21 UTC 2024

root@n1fbsd:~ # ifconfig vtnet0
vtnet0: flags=1008843<UP,BROADCAST,RUNNING,SIMPLEX,MULTICAST,LOWER_UP> metric 0 mtu 1500
        options=80028<VLAN_MTU,JUMBO_MTU,LINKSTATE>
        ether 58:9c:fc:0e:8c:fb
        inet 192.168.50.37 netmask 0xffffff00 broadcast 192.168.50.255
        inet6 fe80::5a9c:fcff:fe0e:8cfb%vtnet0 prefixlen 64 scopeid 0x1
        media: Ethernet autoselect (10Gbase-T <full-duplex>)
        status: active
        nd6 options=23<PERFORMNUD,ACCEPT_RTADV,AUTO_LINKLOCAL>
root@n1fbsd:~ # ping -c 5 -S 192.168.50.37 192.168.50.89
PING 192.168.50.89 (192.168.50.89) from 192.168.50.37: 56 data bytes
64 bytes from 192.168.50.89: icmp_seq=0 ttl=64 time=0.485 ms
64 bytes from 192.168.50.89: icmp_seq=1 ttl=64 time=0.649 ms
64 bytes from 192.168.50.89: icmp_seq=2 ttl=64 time=0.778 ms
64 bytes from 192.168.50.89: icmp_seq=3 ttl=64 time=0.711 ms
64 bytes from 192.168.50.89: icmp_seq=4 ttl=64 time=0.799 ms

--- 192.168.50.89 ping statistics ---
5 packets transmitted, 5 packets received, 0.0% packet loss
round-trip min/avg/max/stddev = 0.485/0.685/0.799/0.113 ms

root@n2linuxvm:~ # ip addr show enp0s5
2: enp0s5: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1500 qdisc fq_codel state UP group default qlen 1000
    link/ether 58:9c:fc:0d:d6:4e brd ff:ff:ff:ff:ff:ff
    inet 192.168.50.89/24 metric 100 brd 192.168.50.255 scope global dynamic enp0s5
       valid_lft 84995sec preferred_lft 84995sec
    inet6 fe80::5a9c:fcff:fe0d:d64e/64 scope link 
       valid_lft forever preferred_lft forever

iperf -B 192.168.50.37 -c 192.168.50.89 -l 1M -t 10 -i 1 -e

test result

kern.hz value

TCP congestion control algo

iperf result from 1% data packet drop rate

iperf result from 2% data packet drop rate

100000 (100k)

stock newreno

710 Mbits/sec

532 Mbits/sec

stock CUBIC

719 Mbits/sec

547 Mbits/sec

CUBIC patch D41715

23.0 Mbits/sec

12.0 Mbits/sec

10000 (10k)

stock newreno

912 Mbits/sec

757 Mbits/sec

stock CUBIC

923 Mbits/sec

683 Mbits/sec

CUBIC patch D41715

24.1 Mbits/sec

12.7 Mbits/sec

1000

stock newreno

901 Mbits/sec

787 Mbits/sec

stock CUBIC

915 Mbits/sec

524 Mbits/sec

CUBIC patch D41715

21.9 Mbits/sec

12.6 Mbits/sec

100

stock newreno

919 Mbits/sec

800 Mbits/sec

stock CUBIC

189 Mbits/sec

90.0 Mbits/sec

CUBIC patch D41715

23.1 Mbits/sec

12.7 Mbits/sec

result in detail

hz=100000 stock newreno

1% packet drop rate:
root@n1fbsd:~ # iperf -B 192.168.50.37 -c 192.168.50.89 -l 1M -t 10 -i 1 -e ; netstat -nCRp tcp | egrep "Active|Proto|5001"
------------------------------------------------------------
Client connecting to 192.168.50.89, TCP port 5001 with pid 981 (1 flows)
Write buffer size: 1048576 Byte
TOS set to 0x0 (Nagle on)
TCP window size: 32.0 KByte (default)
------------------------------------------------------------
[  1] local 192.168.50.37%vtnet0 port 37230 connected with 192.168.50.89 port 5001 (sock=3) on 2024-07-11 20:36:46.110 (EDT)
[ ID] Interval        Transfer    Bandwidth       Write/Err
[  1] 0.00-1.00 sec  83.0 MBytes   696 Mbits/sec  83/0
[  1] 1.00-2.00 sec  87.0 MBytes   730 Mbits/sec  87/0
[  1] 2.00-3.00 sec  84.0 MBytes   705 Mbits/sec  84/0
[  1] 3.00-4.00 sec  85.0 MBytes   713 Mbits/sec  85/0
[  1] 4.00-5.00 sec  86.0 MBytes   721 Mbits/sec  86/0
[  1] 5.00-6.00 sec  84.0 MBytes   705 Mbits/sec  84/0
[  1] 6.00-7.00 sec  84.0 MBytes   705 Mbits/sec  84/0
[  1] 7.00-8.00 sec  83.0 MBytes   696 Mbits/sec  83/0
[  1] 8.00-9.00 sec  86.0 MBytes   721 Mbits/sec  86/0
[  1] 9.00-10.00 sec  84.0 MBytes   705 Mbits/sec  84/0
[  1] 0.00-10.01 sec   847 MBytes   710 Mbits/sec  847/0
Active Internet connections
Proto Recv-Q Send-Q Local Address          Foreign Address           flowid ftype CC            cwin   ssthresh   MSS ECN
tcp4       0      0 192.168.50.37.37230    192.168.50.89.5001      00000000    63 newreno      42160      26064  1460 off
root@n1fbsd:~ #

2% packet drop rate:
root@n1fbsd:~ # iperf -B 192.168.50.37 -c 192.168.50.89 -l 1M -t 10 -i 1 -e ; netstat -nCRp tcp | egrep "Active|Proto|5001"
------------------------------------------------------------
Client connecting to 192.168.50.89, TCP port 5001 with pid 974 (1 flows)
Write buffer size: 1048576 Byte
TOS set to 0x0 (Nagle on)
TCP window size: 32.0 KByte (default)
------------------------------------------------------------
[  1] local 192.168.50.37%vtnet0 port 61966 connected with 192.168.50.89 port 5001 (sock=3) on 2024-07-11 20:34:43.511 (EDT)
[ ID] Interval        Transfer    Bandwidth       Write/Err
[  1] 0.00-1.00 sec  63.0 MBytes   528 Mbits/sec  63/0
[  1] 1.00-2.00 sec  64.0 MBytes   537 Mbits/sec  64/0
[  1] 2.00-3.00 sec  65.0 MBytes   545 Mbits/sec  65/0
[  1] 3.00-4.00 sec  64.0 MBytes   537 Mbits/sec  64/0
[  1] 4.00-5.00 sec  64.0 MBytes   537 Mbits/sec  64/0
[  1] 5.00-6.00 sec  64.0 MBytes   537 Mbits/sec  64/0
[  1] 6.00-7.00 sec  62.0 MBytes   520 Mbits/sec  62/0
[  1] 7.00-8.00 sec  62.0 MBytes   520 Mbits/sec  62/0
[  1] 8.00-9.00 sec  64.0 MBytes   537 Mbits/sec  64/0
[  1] 9.00-10.00 sec  63.0 MBytes   528 Mbits/sec  63/0
[  1] 0.00-10.03 sec   636 MBytes   532 Mbits/sec  636/0
Active Internet connections
Proto Recv-Q Send-Q Local Address          Foreign Address           flowid ftype CC            cwin   ssthresh   MSS ECN
tcp4       0      0 192.168.50.37.61966    192.168.50.89.5001      00000000    63 newreno      23276      13032  1460 off

hz=100000 stock cubic

1% packet drop rate:
root@n1fbsd:~ # iperf -B 192.168.50.37 -c 192.168.50.89 -l 1M -t 10 -i 1 -e ; netstat -nCRp tcp | egrep "Active|Proto|5001"
------------------------------------------------------------
Client connecting to 192.168.50.89, TCP port 5001 with pid 985 (1 flows)
Write buffer size: 1048576 Byte
TOS set to 0x0 (Nagle on)
TCP window size: 32.0 KByte (default)
------------------------------------------------------------
[  1] local 192.168.50.37%vtnet0 port 18578 connected with 192.168.50.89 port 5001 (sock=3) on 2024-07-11 20:37:47.656 (EDT)
[ ID] Interval        Transfer    Bandwidth       Write/Err
[  1] 0.00-1.00 sec  87.0 MBytes   730 Mbits/sec  87/0
[  1] 1.00-2.00 sec  86.0 MBytes   721 Mbits/sec  86/0
[  1] 2.00-3.00 sec  87.0 MBytes   730 Mbits/sec  87/0
[  1] 3.00-4.00 sec  86.0 MBytes   721 Mbits/sec  86/0
[  1] 4.00-5.00 sec  83.0 MBytes   696 Mbits/sec  83/0
[  1] 5.00-6.00 sec  86.0 MBytes   721 Mbits/sec  86/0
[  1] 6.00-7.00 sec  88.0 MBytes   738 Mbits/sec  88/0
[  1] 7.00-8.00 sec  85.0 MBytes   713 Mbits/sec  85/0
[  1] 8.00-9.00 sec  86.0 MBytes   721 Mbits/sec  86/0
[  1] 9.00-10.00 sec  84.0 MBytes   705 Mbits/sec  84/0
[  1] 0.00-10.02 sec   859 MBytes   719 Mbits/sec  859/0
Active Internet connections
Proto Recv-Q Send-Q Local Address          Foreign Address           flowid ftype CC            cwin   ssthresh   MSS ECN
tcp4       0      0 192.168.50.37.18578    192.168.50.89.5001      00000000    63 cubic        42541      33387  1460 off
root@n1fbsd:~ #

2% packet drop rate:
root@n1fbsd:~ # iperf -B 192.168.50.37 -c 192.168.50.89 -l 1M -t 10 -i 1 -e ; netstat -nCRp tcp | egrep "Active|Proto|5001"
------------------------------------------------------------
Client connecting to 192.168.50.89, TCP port 5001 with pid 960 (1 flows)
Write buffer size: 1048576 Byte
TOS set to 0x0 (Nagle on)
TCP window size: 32.0 KByte (default)
------------------------------------------------------------
[  1] local 192.168.50.37%vtnet0 port 44860 connected with 192.168.50.89 port 5001 (sock=3) on 2024-07-11 20:32:29.177 (EDT)
[ ID] Interval        Transfer    Bandwidth       Write/Err
[  1] 0.00-1.00 sec  64.0 MBytes   537 Mbits/sec  64/0
[  1] 1.00-2.00 sec  66.0 MBytes   554 Mbits/sec  66/0
[  1] 2.00-3.00 sec  66.0 MBytes   554 Mbits/sec  66/0
[  1] 3.00-4.00 sec  66.0 MBytes   554 Mbits/sec  66/0
[  1] 4.00-5.00 sec  65.0 MBytes   545 Mbits/sec  65/0
[  1] 5.00-6.00 sec  65.0 MBytes   545 Mbits/sec  65/0
[  1] 6.00-7.00 sec  65.0 MBytes   545 Mbits/sec  65/0
[  1] 7.00-8.00 sec  64.0 MBytes   537 Mbits/sec  64/0
[  1] 8.00-9.00 sec  66.0 MBytes   554 Mbits/sec  66/0
[  1] 9.00-10.00 sec  65.0 MBytes   545 Mbits/sec  65/0
[  1] 0.00-10.02 sec   653 MBytes   547 Mbits/sec  653/0
Active Internet connections
Proto Recv-Q Send-Q Local Address          Foreign Address           flowid ftype CC            cwin   ssthresh   MSS ECN
tcp4       0      0 192.168.50.37.44860    192.168.50.89.5001      00000000    63 cubic        21786      19511  1460 off

hz=100000 cubic patch D41715

1% packet drop rate:
root@n1fbsd:~ # iperf -B 192.168.50.37 -c 192.168.50.89 -l 1M -t 10 -i 1 -e ; netstat -nCRp tcp | egrep "Active|Proto|5001"
------------------------------------------------------------
Client connecting to 192.168.50.89, TCP port 5001 with pid 956 (1 flows)
Write buffer size: 1048576 Byte
TOS set to 0x0 (Nagle on)
TCP window size: 32.0 KByte (default)
------------------------------------------------------------
[  1] local 192.168.50.37%vtnet0 port 42467 connected with 192.168.50.89 port 5001 (sock=3) on 2024-07-11 20:41:32.707 (EDT)
[ ID] Interval        Transfer    Bandwidth       Write/Err
[  1] 0.00-1.00 sec  4.00 MBytes  33.6 Mbits/sec  4/0
[  1] 1.00-2.00 sec  3.00 MBytes  25.2 Mbits/sec  3/0
[  1] 2.00-3.00 sec  2.00 MBytes  16.8 Mbits/sec  2/0
[  1] 3.00-4.00 sec  3.00 MBytes  25.2 Mbits/sec  3/0
[  1] 4.00-5.00 sec  2.00 MBytes  16.8 Mbits/sec  2/0
[  1] 5.00-6.00 sec  3.00 MBytes  25.2 Mbits/sec  3/0
[  1] 6.00-7.00 sec  2.00 MBytes  16.8 Mbits/sec  2/0
[  1] 7.00-8.00 sec  3.00 MBytes  25.2 Mbits/sec  3/0
[  1] 8.00-9.00 sec  2.00 MBytes  16.8 Mbits/sec  2/0
[  1] 9.00-10.00 sec  3.00 MBytes  25.2 Mbits/sec  3/0
[  1] 0.00-10.21 sec  28.0 MBytes  23.0 Mbits/sec  28/0
Active Internet connections
Proto Recv-Q Send-Q Local Address          Foreign Address           flowid ftype CC            cwin   ssthresh   MSS ECN
tcp4       0      0 192.168.50.37.42467    192.168.50.89.5001      00000000    63 cubic         2920       2896  1460 off
root@n1fbsd:~ #

2% packet drop rate:
root@n1fbsd:~ # iperf -B 192.168.50.37 -c 192.168.50.89 -l 1M -t 10 -i 1 -e ; netstat -nCRp tcp | egrep "Active|Proto|5001"
------------------------------------------------------------
Client connecting to 192.168.50.89, TCP port 5001 with pid 976 (1 flows)
Write buffer size: 1048576 Byte
TOS set to 0x0 (Nagle on)
TCP window size: 32.0 KByte (default)
------------------------------------------------------------
[  1] local 192.168.50.37%vtnet0 port 46795 connected with 192.168.50.89 port 5001 (sock=3) on 2024-07-11 20:44:17.499 (EDT)
[ ID] Interval        Transfer    Bandwidth       Write/Err
[  1] 0.00-1.00 sec  1.00 MBytes  8.39 Mbits/sec  1/0
[  1] 1.00-2.00 sec  2.00 MBytes  16.8 Mbits/sec  2/0
[  1] 2.00-3.00 sec  1.00 MBytes  8.39 Mbits/sec  1/0
[  1] 3.00-4.00 sec  2.00 MBytes  16.8 Mbits/sec  2/0
[  1] 4.00-5.00 sec  1.00 MBytes  8.39 Mbits/sec  1/0
[  1] 5.00-6.00 sec  1.00 MBytes  8.39 Mbits/sec  1/0
[  1] 6.00-7.00 sec  2.00 MBytes  16.8 Mbits/sec  2/0
[  1] 7.00-8.00 sec  1.00 MBytes  8.39 Mbits/sec  1/0
[  1] 8.00-9.00 sec  1.00 MBytes  8.39 Mbits/sec  1/0
[  1] 9.00-10.00 sec  2.00 MBytes  16.8 Mbits/sec  2/0
[  1] 10.00-10.47 sec  1.00 MBytes  17.9 Mbits/sec  1/0
[  1] 0.00-10.47 sec  15.0 MBytes  12.0 Mbits/sec  15/0
Active Internet connections
Proto Recv-Q Send-Q Local Address          Foreign Address           flowid ftype CC            cwin   ssthresh   MSS ECN
tcp4       0      0 192.168.50.37.46795    192.168.50.89.5001      00000000    63 cubic         2920       2896  1460 off

hz=10000 stock newreno

1% packet drop rate:
root@n1fbsd:~ # iperf -B 192.168.50.37 -c 192.168.50.89 -l 1M -t 10 -i 1 -e ; netstat -nCRp tcp | egrep "Active|Proto|5001"
------------------------------------------------------------
Client connecting to 192.168.50.89, TCP port 5001 with pid 954 (1 flows)
Write buffer size: 1048576 Byte
TOS set to 0x0 (Nagle on)
TCP window size: 32.0 KByte (default)
------------------------------------------------------------
[  1] local 192.168.50.37%vtnet0 port 54836 connected with 192.168.50.89 port 5001 (sock=3) on 2024-07-11 16:09:44.956 (EDT)
[ ID] Interval        Transfer    Bandwidth       Write/Err
[  1] 0.00-1.00 sec   108 MBytes   906 Mbits/sec  108/0
[  1] 1.00-2.00 sec   109 MBytes   914 Mbits/sec  109/0
[  1] 2.00-3.00 sec   109 MBytes   914 Mbits/sec  109/0
[  1] 3.00-4.00 sec   108 MBytes   906 Mbits/sec  108/0
[  1] 4.00-5.00 sec   109 MBytes   914 Mbits/sec  109/0
[  1] 5.00-6.00 sec   109 MBytes   914 Mbits/sec  109/0
[  1] 6.00-7.00 sec   109 MBytes   914 Mbits/sec  109/0
[  1] 7.00-8.00 sec   109 MBytes   914 Mbits/sec  109/0
[  1] 8.00-9.00 sec   109 MBytes   914 Mbits/sec  109/0
[  1] 9.00-10.00 sec   109 MBytes   914 Mbits/sec  109/0
[  1] 0.00-10.01 sec  1.06 GBytes   912 Mbits/sec  1089/0
Active Internet connections
Proto Recv-Q Send-Q Local Address          Foreign Address           flowid ftype CC            cwin   ssthresh   MSS ECN
tcp4       0      0 192.168.50.37.54836    192.168.50.89.5001      00000000    63 newreno      52404      27512  1460 off
root@n1fbsd:~ #

2% packet drop rate:
root@n1fbsd:~ # iperf -B 192.168.50.37 -c 192.168.50.89 -l 1M -t 10 -i 1 -e ; netstat -nCRp tcp | egrep "Active|Proto|5001"
------------------------------------------------------------
Client connecting to 192.168.50.89, TCP port 5001 with pid 998 (1 flows)
Write buffer size: 1048576 Byte
TOS set to 0x0 (Nagle on)
TCP window size: 32.0 KByte (default)
------------------------------------------------------------
[  1] local 192.168.50.37%vtnet0 port 53236 connected with 192.168.50.89 port 5001 (sock=3) on 2024-07-11 16:44:34.243 (EDT)
[ ID] Interval        Transfer    Bandwidth       Write/Err
[  1] 0.00-1.00 sec  88.0 MBytes   738 Mbits/sec  88/0
[  1] 1.00-2.00 sec  88.0 MBytes   738 Mbits/sec  88/0
[  1] 2.00-3.00 sec  91.0 MBytes   763 Mbits/sec  91/0
[  1] 3.00-4.00 sec  91.0 MBytes   763 Mbits/sec  91/0
[  1] 4.00-5.00 sec  91.0 MBytes   763 Mbits/sec  91/0
[  1] 5.00-6.00 sec  91.0 MBytes   763 Mbits/sec  91/0
[  1] 6.00-7.00 sec  90.0 MBytes   755 Mbits/sec  90/0
[  1] 7.00-8.00 sec  90.0 MBytes   755 Mbits/sec  90/0
[  1] 8.00-9.00 sec  91.0 MBytes   763 Mbits/sec  91/0
[  1] 9.00-10.00 sec  91.0 MBytes   763 Mbits/sec  91/0
[  1] 0.00-10.01 sec   903 MBytes   757 Mbits/sec  903/0
Active Internet connections
Proto Recv-Q Send-Q Local Address          Foreign Address           flowid ftype CC            cwin   ssthresh   MSS ECN
tcp4       0      0 192.168.50.37.53236    192.168.50.89.5001      00000000    63 newreno       2920      15928  1460 off

hz=10000 stock cubic

1% packet drop rate:
root@n1fbsd:~ # iperf -B 192.168.50.37 -c 192.168.50.89 -l 1M -t 10 -i 1 -e ; netstat -nCRp tcp | egrep "Active|Proto|5001"
------------------------------------------------------------
Client connecting to 192.168.50.89, TCP port 5001 with pid 970 (1 flows)
Write buffer size: 1048576 Byte
TOS set to 0x0 (Nagle on)
TCP window size: 32.0 KByte (default)
------------------------------------------------------------
[  1] local 192.168.50.37%vtnet0 port 54916 connected with 192.168.50.89 port 5001 (sock=3) on 2024-07-11 16:11:01.432 (EDT)
[ ID] Interval        Transfer    Bandwidth       Write/Err
[  1] 0.00-1.00 sec   109 MBytes   914 Mbits/sec  109/0
[  1] 1.00-2.00 sec   110 MBytes   923 Mbits/sec  110/0
[  1] 2.00-3.00 sec   110 MBytes   923 Mbits/sec  110/0
[  1] 3.00-4.00 sec   111 MBytes   931 Mbits/sec  111/0
[  1] 4.00-5.00 sec   110 MBytes   923 Mbits/sec  110/0
[  1] 5.00-6.00 sec   110 MBytes   923 Mbits/sec  110/0
[  1] 6.00-7.00 sec   110 MBytes   923 Mbits/sec  110/0
[  1] 7.00-8.00 sec   111 MBytes   931 Mbits/sec  111/0
[  1] 8.00-9.00 sec   110 MBytes   923 Mbits/sec  110/0
[  1] 9.00-10.00 sec   110 MBytes   923 Mbits/sec  110/0
[  1] 0.00-10.01 sec  1.08 GBytes   923 Mbits/sec  1102/0
Active Internet connections
Proto Recv-Q Send-Q Local Address          Foreign Address           flowid ftype CC            cwin   ssthresh   MSS ECN
tcp4       0      0 192.168.50.37.54916    192.168.50.89.5001      00000000    63 cubic        34496      32087  1460 off
root@n1fbsd:~ # 

2% packet drop rate:
root@n1fbsd:~ # iperf -B 192.168.50.37 -c 192.168.50.89 -l 1M -t 10 -i 1 -e ; netstat -nCRp tcp | egrep "Active|Proto|5001"
------------------------------------------------------------
Client connecting to 192.168.50.89, TCP port 5001 with pid 1050 (1 flows)
Write buffer size: 1048576 Byte
TOS set to 0x0 (Nagle on)
TCP window size: 32.0 KByte (default)
------------------------------------------------------------
[  1] local 192.168.50.37%vtnet0 port 29940 connected with 192.168.50.89 port 5001 (sock=3) on 2024-07-11 17:16:32.068 (EDT)
[ ID] Interval        Transfer    Bandwidth       Write/Err
[  1] 0.00-1.00 sec  78.0 MBytes   654 Mbits/sec  78/0
[  1] 1.00-2.00 sec  80.0 MBytes   671 Mbits/sec  80/0
[  1] 2.00-3.00 sec  82.0 MBytes   688 Mbits/sec  82/0
[  1] 3.00-4.00 sec  83.0 MBytes   696 Mbits/sec  83/0
[  1] 4.00-5.00 sec  82.0 MBytes   688 Mbits/sec  82/0
[  1] 5.00-6.00 sec  80.0 MBytes   671 Mbits/sec  80/0
[  1] 6.00-7.00 sec  84.0 MBytes   705 Mbits/sec  84/0
[  1] 7.00-8.00 sec  81.0 MBytes   679 Mbits/sec  81/0
[  1] 8.00-9.00 sec  82.0 MBytes   688 Mbits/sec  82/0
[  1] 9.00-10.00 sec  83.0 MBytes   696 Mbits/sec  83/0
[  1] 0.00-10.02 sec   816 MBytes   683 Mbits/sec  816/0
Active Internet connections
Proto Recv-Q Send-Q Local Address          Foreign Address           flowid ftype CC            cwin   ssthresh   MSS ECN
tcp4       0      0 192.168.50.37.29940    192.168.50.89.5001      00000000    63 cubic        21343      15297  1460 off
root@n1fbsd:~ #

hz=10000 cubic patch D41715

1% packet drop rate:
root@n1fbsd:~ # iperf -B 192.168.50.37 -c 192.168.50.89 -l 1M -t 10 -i 1 -e ; netstat -nCRp tcp | egrep "Active|Proto|5001"
------------------------------------------------------------
Client connecting to 192.168.50.89, TCP port 5001 with pid 956 (1 flows)
Write buffer size: 1048576 Byte
TOS set to 0x0 (Nagle on)
TCP window size: 32.0 KByte (default)
------------------------------------------------------------
[  1] local 192.168.50.37%vtnet0 port 16483 connected with 192.168.50.89 port 5001 (sock=3) on 2024-07-11 16:13:47.576 (EDT)
[ ID] Interval        Transfer    Bandwidth       Write/Err
[  1] 0.00-1.00 sec  6.00 MBytes  50.3 Mbits/sec  6/0
[  1] 1.00-2.00 sec  3.00 MBytes  25.2 Mbits/sec  3/0
[  1] 2.00-3.00 sec  2.00 MBytes  16.8 Mbits/sec  2/0
[  1] 3.00-4.00 sec  2.00 MBytes  16.8 Mbits/sec  2/0
[  1] 4.00-5.00 sec  3.00 MBytes  25.2 Mbits/sec  3/0
[  1] 5.00-6.00 sec  2.00 MBytes  16.8 Mbits/sec  2/0
[  1] 6.00-7.00 sec  3.00 MBytes  25.2 Mbits/sec  3/0
[  1] 7.00-8.00 sec  2.00 MBytes  16.8 Mbits/sec  2/0
[  1] 8.00-9.00 sec  3.00 MBytes  25.2 Mbits/sec  3/0
[  1] 9.00-10.00 sec  3.00 MBytes  25.2 Mbits/sec  3/0
[  1] 10.00-10.43 sec  1.00 MBytes  19.5 Mbits/sec  1/0
[  1] 0.00-10.43 sec  30.0 MBytes  24.1 Mbits/sec  30/0
Active Internet connections
Proto Recv-Q Send-Q Local Address          Foreign Address           flowid ftype CC            cwin   ssthresh   MSS ECN
tcp4       0      0 192.168.50.37.16483    192.168.50.89.5001      00000000    63 cubic         2920       2896  1460 off
root@n1fbsd:~ #

2% packet drop rate:
root@n1fbsd:~ # iperf -B 192.168.50.37 -c 192.168.50.89 -l 1M -t 10 -i 1 -e ; netstat -nCRp tcp | egrep "Active|Proto|5001"
------------------------------------------------------------
Client connecting to 192.168.50.89, TCP port 5001 with pid 977 (1 flows)
Write buffer size: 1048576 Byte
TOS set to 0x0 (Nagle on)
TCP window size: 32.0 KByte (default)
------------------------------------------------------------
[  1] local 192.168.50.37%vtnet0 port 12329 connected with 192.168.50.89 port 5001 (sock=3) on 2024-07-11 17:25:17.726 (EDT)
[ ID] Interval        Transfer    Bandwidth       Write/Err
[  1] 0.00-1.00 sec  2.00 MBytes  16.8 Mbits/sec  2/0
[  1] 1.00-2.00 sec  1.00 MBytes  8.39 Mbits/sec  1/0
[  1] 2.00-3.00 sec  2.00 MBytes  16.8 Mbits/sec  2/0
[  1] 3.00-4.00 sec  1.00 MBytes  8.39 Mbits/sec  1/0
[  1] 4.00-5.00 sec  2.00 MBytes  16.8 Mbits/sec  2/0
[  1] 5.00-6.00 sec  1.00 MBytes  8.39 Mbits/sec  1/0
[  1] 6.00-7.00 sec  1.00 MBytes  8.39 Mbits/sec  1/0
[  1] 7.00-8.00 sec  2.00 MBytes  16.8 Mbits/sec  2/0
[  1] 8.00-9.00 sec  1.00 MBytes  8.39 Mbits/sec  1/0
[  1] 9.00-10.00 sec  2.00 MBytes  16.8 Mbits/sec  2/0
[  1] 10.00-10.59 sec  1.00 MBytes  14.3 Mbits/sec  1/0
[  1] 0.00-10.59 sec  16.0 MBytes  12.7 Mbits/sec  16/0
Active Internet connections
Proto Recv-Q Send-Q Local Address          Foreign Address           flowid ftype CC            cwin   ssthresh   MSS ECN
tcp4       0      0 192.168.50.37.12329    192.168.50.89.5001      00000000    63 cubic         2920       2896  1460 off
root@n1fbsd:~ #

hz=1000 newreno

1% packet drop rate:
root@n1fbsd:~ # iperf -B 192.168.50.37 -c 192.168.50.89 -l 1M -t 10 -i 1 -e; netstat -nCRp tcp | egrep "Active|Proto|5001"
------------------------------------------------------------
Client connecting to 192.168.50.89, TCP port 5001 with pid 975 (1 flows)
Write buffer size: 1048576 Byte
TOS set to 0x0 (Nagle on)
TCP window size: 32.0 KByte (default)
------------------------------------------------------------
[  1] local 192.168.50.37%vtnet0 port 61321 connected with 192.168.50.89 port 5001 (sock=3) on 2024-07-10 11:49:20.894 (EDT)
[ ID] Interval        Transfer    Bandwidth       Write/Err
[  1] 0.00-1.00 sec   100 MBytes   839 Mbits/sec  100/0
[  1] 1.00-2.00 sec   109 MBytes   914 Mbits/sec  109/0
[  1] 2.00-3.00 sec   109 MBytes   914 Mbits/sec  109/0
[  1] 3.00-4.00 sec   110 MBytes   923 Mbits/sec  110/0
[  1] 4.00-5.00 sec   109 MBytes   914 Mbits/sec  109/0
[  1] 5.00-6.00 sec   104 MBytes   872 Mbits/sec  104/0
[  1] 6.00-7.00 sec   107 MBytes   898 Mbits/sec  107/0
[  1] 7.00-8.00 sec   109 MBytes   914 Mbits/sec  109/0
[  1] 8.00-9.00 sec   109 MBytes   914 Mbits/sec  109/0
[  1] 9.00-10.00 sec   109 MBytes   914 Mbits/sec  109/0
[  1] 0.00-10.01 sec  1.05 GBytes   901 Mbits/sec  1076/0
Active Internet connections
Proto Recv-Q Send-Q Local Address          Foreign Address           flowid ftype CC            cwin   ssthresh   MSS ECN
tcp4       0      0 192.168.50.37.61321    192.168.50.89.5001      00000000    63 newreno      46516      27512  1460 off
root@n1fbsd:~ # 

2% packet drop rate:
root@n1fbsd:~ # iperf -B 192.168.50.37 -c 192.168.50.89 -l 1M -t 10 -i 1 -e ; netstat -nCRp tcp | egrep "Active|Proto|5001"
------------------------------------------------------------
Client connecting to 192.168.50.89, TCP port 5001 with pid 958 (1 flows)
Write buffer size: 1048576 Byte
TOS set to 0x0 (Nagle on)
TCP window size: 32.0 KByte (default)
------------------------------------------------------------
[  1] local 192.168.50.37%vtnet0 port 37571 connected with 192.168.50.89 port 5001 (sock=3) on 2024-07-11 17:30:53.475 (EDT)
[ ID] Interval        Transfer    Bandwidth       Write/Err
[  1] 0.00-1.00 sec  92.0 MBytes   772 Mbits/sec  92/0
[  1] 1.00-2.00 sec  94.0 MBytes   789 Mbits/sec  94/0
[  1] 2.00-3.00 sec  93.0 MBytes   780 Mbits/sec  93/0
[  1] 3.00-4.00 sec  96.0 MBytes   805 Mbits/sec  96/0
[  1] 4.00-5.00 sec  95.0 MBytes   797 Mbits/sec  95/0
[  1] 5.00-6.00 sec  94.0 MBytes   789 Mbits/sec  94/0
[  1] 6.00-7.00 sec  94.0 MBytes   789 Mbits/sec  94/0
[  1] 7.00-8.00 sec  93.0 MBytes   780 Mbits/sec  93/0
[  1] 8.00-9.00 sec  93.0 MBytes   780 Mbits/sec  93/0
[  1] 9.00-10.00 sec  94.0 MBytes   789 Mbits/sec  94/0
[  1] 0.00-10.01 sec   939 MBytes   787 Mbits/sec  939/0
Active Internet connections
Proto Recv-Q Send-Q Local Address          Foreign Address           flowid ftype CC            cwin   ssthresh   MSS ECN
tcp4       0      0 192.168.50.37.37571    192.168.50.89.5001      00000000    63 newreno      24724      15928  1460 off
root@n1fbsd:~ #

hz=1000 stock cubic

1% packet drop rate:
root@n1fbsd:~ # iperf -B 192.168.50.37 -c 192.168.50.89 -l 1M -t 10 -i 1 -e ; netstat -nCRp tcp | egrep "Active|Proto|5001"
------------------------------------------------------------
Client connecting to 192.168.50.89, TCP port 5001 with pid 987 (1 flows)
Write buffer size: 1048576 Byte
TOS set to 0x0 (Nagle on)
TCP window size: 32.0 KByte (default)
------------------------------------------------------------
[  1] local 192.168.50.37%vtnet0 port 13705 connected with 192.168.50.89 port 5001 (sock=3) on 2024-07-10 11:54:59.816 (EDT)
[ ID] Interval        Transfer    Bandwidth       Write/Err
[  1] 0.00-1.00 sec   108 MBytes   906 Mbits/sec  108/0
[  1] 1.00-2.00 sec   109 MBytes   914 Mbits/sec  109/0
[  1] 2.00-3.00 sec   110 MBytes   923 Mbits/sec  110/0
[  1] 3.00-4.00 sec   109 MBytes   914 Mbits/sec  109/0
[  1] 4.00-5.00 sec   110 MBytes   923 Mbits/sec  110/0
[  1] 5.00-6.00 sec   109 MBytes   914 Mbits/sec  109/0
[  1] 6.00-7.00 sec   110 MBytes   923 Mbits/sec  110/0
[  1] 7.00-8.00 sec   109 MBytes   914 Mbits/sec  109/0
[  1] 8.00-9.00 sec   109 MBytes   914 Mbits/sec  109/0
[  1] 9.00-10.00 sec   110 MBytes   923 Mbits/sec  110/0
[  1] 0.00-10.02 sec  1.07 GBytes   915 Mbits/sec  1094/0
Active Internet connections
Proto Recv-Q Send-Q Local Address          Foreign Address           flowid ftype CC            cwin   ssthresh   MSS ECN
tcp4       0      0 192.168.50.37.13705    192.168.50.89.5001      00000000    63 cubic        38224      26565  1460 off
root@n1fbsd:~ #

2% packet drop rate:
root@n1fbsd:~ # iperf -B 192.168.50.37 -c 192.168.50.89 -l 1M -t 10 -i 1 -e ; netstat -nCRp tcp | egrep "Active|Proto|5001"
------------------------------------------------------------
Client connecting to 192.168.50.89, TCP port 5001 with pid 965 (1 flows)
Write buffer size: 1048576 Byte
TOS set to 0x0 (Nagle on)
TCP window size: 32.0 KByte (default)
------------------------------------------------------------
[  1] local 192.168.50.37%vtnet0 port 15640 connected with 192.168.50.89 port 5001 (sock=3) on 2024-07-11 17:32:53.580 (EDT)
[ ID] Interval        Transfer    Bandwidth       Write/Err
[  1] 0.00-1.00 sec  59.0 MBytes   495 Mbits/sec  59/0
[  1] 1.00-2.00 sec  60.0 MBytes   503 Mbits/sec  60/0
[  1] 2.00-3.00 sec  62.0 MBytes   520 Mbits/sec  62/0
[  1] 3.00-4.00 sec  64.0 MBytes   537 Mbits/sec  64/0
[  1] 4.00-5.00 sec  62.0 MBytes   520 Mbits/sec  62/0
[  1] 5.00-6.00 sec  64.0 MBytes   537 Mbits/sec  64/0
[  1] 6.00-7.00 sec  64.0 MBytes   537 Mbits/sec  64/0
[  1] 7.00-8.00 sec  63.0 MBytes   528 Mbits/sec  63/0
[  1] 8.00-9.00 sec  64.0 MBytes   537 Mbits/sec  64/0
[  1] 9.00-10.00 sec  63.0 MBytes   528 Mbits/sec  63/0
[  1] 0.00-10.02 sec   626 MBytes   524 Mbits/sec  626/0
Active Internet connections
Proto Recv-Q Send-Q Local Address          Foreign Address           flowid ftype CC            cwin   ssthresh   MSS ECN
tcp4       0      0 192.168.50.37.15640    192.168.50.89.5001      00000000    63 cubic        16830      14452  1460 off
root@n1fbsd:~ #

hz=1000 cubic patch D41715

1% packet drop rate:
root@n1fbsd:~ # iperf -B 192.168.50.37 -c 192.168.50.89 -l 1M -t 10 -i 1 -e ; netstat -nCRp tcp | egrep "Active|Proto|5001"
------------------------------------------------------------
Client connecting to 192.168.50.89, TCP port 5001 with pid 954 (1 flows)
Write buffer size: 1048576 Byte
TOS set to 0x0 (Nagle on)
TCP window size: 32.0 KByte (default)
------------------------------------------------------------
[  1] local 192.168.50.37%vtnet0 port 36201 connected with 192.168.50.89 port 5001 (sock=3) on 2024-07-10 16:42:35.332 (EDT)
[ ID] Interval        Transfer    Bandwidth       Write/Err
[  1] 0.00-1.00 sec  3.00 MBytes  25.2 Mbits/sec  3/0
[  1] 1.00-2.00 sec  2.00 MBytes  16.8 Mbits/sec  2/0
[  1] 2.00-3.00 sec  3.00 MBytes  25.2 Mbits/sec  3/0
[  1] 3.00-4.00 sec  2.00 MBytes  16.8 Mbits/sec  2/0
[  1] 4.00-5.00 sec  3.00 MBytes  25.2 Mbits/sec  3/0
[  1] 5.00-6.00 sec  3.00 MBytes  25.2 Mbits/sec  3/0
[  1] 6.00-7.00 sec  2.00 MBytes  16.8 Mbits/sec  2/0
[  1] 7.00-8.00 sec  3.00 MBytes  25.2 Mbits/sec  3/0
[  1] 8.00-9.00 sec  2.00 MBytes  16.8 Mbits/sec  2/0
[  1] 9.00-10.00 sec  3.00 MBytes  25.2 Mbits/sec  3/0
[  1] 10.00-10.34 sec  1.00 MBytes  24.8 Mbits/sec  1/0
[  1] 0.00-10.34 sec  27.0 MBytes  21.9 Mbits/sec  27/0
Active Internet connections
Proto Recv-Q Send-Q Local Address          Foreign Address           flowid ftype CC            cwin   ssthresh   MSS ECN
tcp4       0      0 192.168.50.37.36201    192.168.50.89.5001      00000000    63 cubic         2920       2896  1460 off
root@n1fbsd:~ #

2% packet drop rate:
root@n1fbsd:~ # iperf -B 192.168.50.37 -c 192.168.50.89 -l 1M -t 10 -i 1 -e ; netstat -nCRp tcp | egrep "Active|Proto|5001"
------------------------------------------------------------
Client connecting to 192.168.50.89, TCP port 5001 with pid 957 (1 flows)
Write buffer size: 1048576 Byte
TOS set to 0x0 (Nagle on)
TCP window size: 32.0 KByte (default)
------------------------------------------------------------
[  1] local 192.168.50.37%vtnet0 port 25416 connected with 192.168.50.89 port 5001 (sock=3) on 2024-07-11 17:37:53.323 (EDT)
[ ID] Interval        Transfer    Bandwidth       Write/Err
[  1] 0.00-1.00 sec  2.00 MBytes  16.8 Mbits/sec  2/0
[  1] 1.00-2.00 sec  2.00 MBytes  16.8 Mbits/sec  2/0
[  1] 2.00-3.00 sec  1.00 MBytes  8.39 Mbits/sec  1/0
[  1] 3.00-4.00 sec  1.00 MBytes  8.39 Mbits/sec  1/0
[  1] 4.00-5.00 sec  2.00 MBytes  16.8 Mbits/sec  2/0
[  1] 5.00-6.00 sec  1.00 MBytes  8.39 Mbits/sec  1/0
[  1] 6.00-7.00 sec  2.00 MBytes  16.8 Mbits/sec  2/0
[  1] 7.00-8.00 sec  1.00 MBytes  8.39 Mbits/sec  1/0
[  1] 8.00-9.00 sec  1.00 MBytes  8.39 Mbits/sec  1/0
[  1] 9.00-10.00 sec  2.00 MBytes  16.8 Mbits/sec  2/0
[  1] 10.00-10.62 sec  1.00 MBytes  13.5 Mbits/sec  1/0
[  1] 0.00-10.62 sec  16.0 MBytes  12.6 Mbits/sec  16/0
Active Internet connections
Proto Recv-Q Send-Q Local Address          Foreign Address           flowid ftype CC            cwin   ssthresh   MSS ECN
tcp4       0      0 192.168.50.37.25416    192.168.50.89.5001      00000000    63 cubic         2920       2896  1460 off
root@n1fbsd:~ #

hz=100 newreno

1% packet drop rate:
root@n1fbsd:~ # iperf -B 192.168.50.37 -c 192.168.50.89 -l 1M -t 10 -i 1 -e ; netstat -nCRp tcp | egrep "Active|Proto|5001"
------------------------------------------------------------
Client connecting to 192.168.50.89, TCP port 5001 with pid 960 (1 flows)
Write buffer size: 1048576 Byte
TOS set to 0x0 (Nagle on)
TCP window size: 32.0 KByte (default)
------------------------------------------------------------
[  1] local 192.168.50.37%vtnet0 port 51115 connected with 192.168.50.89 port 5001 (sock=3) on 2024-07-10 11:59:23.371 (EDT)
[ ID] Interval        Transfer    Bandwidth       Write/Err
[  1] 0.00-1.00 sec   109 MBytes   914 Mbits/sec  109/0
[  1] 1.00-2.00 sec   110 MBytes   923 Mbits/sec  110/0
[  1] 2.00-3.00 sec   110 MBytes   923 Mbits/sec  110/0
[  1] 3.00-4.00 sec   109 MBytes   914 Mbits/sec  109/0
[  1] 4.00-5.00 sec   110 MBytes   923 Mbits/sec  110/0
[  1] 5.00-6.00 sec   109 MBytes   914 Mbits/sec  109/0
[  1] 6.00-7.00 sec   110 MBytes   923 Mbits/sec  110/0
[  1] 7.00-8.00 sec   109 MBytes   914 Mbits/sec  109/0
[  1] 8.00-9.00 sec   110 MBytes   923 Mbits/sec  110/0
[  1] 9.00-10.00 sec   110 MBytes   923 Mbits/sec  110/0
[  1] 0.00-10.02 sec  1.07 GBytes   919 Mbits/sec  1097/0
Active Internet connections
Proto Recv-Q Send-Q Local Address          Foreign Address           flowid ftype CC            cwin   ssthresh   MSS ECN
tcp4       0      0 192.168.50.37.51115    192.168.50.89.5001      00000000    63 newreno      39192      27512  1460 off
root@n1fbsd:~ #

2% packet drop rate:
root@n1fbsd:~ # iperf -B 192.168.50.37 -c 192.168.50.89 -l 1M -t 10 -i 1 -e ; netstat -nCRp tcp | egrep "Active|Proto|5001"
------------------------------------------------------------
Client connecting to 192.168.50.89, TCP port 5001 with pid 961 (1 flows)
Write buffer size: 1048576 Byte
TOS set to 0x0 (Nagle on)
TCP window size: 32.0 KByte (default)
------------------------------------------------------------
[  1] local 192.168.50.37%vtnet0 port 46170 connected with 192.168.50.89 port 5001 (sock=3) on 2024-07-11 20:17:30.785 (EDT)
[ ID] Interval        Transfer    Bandwidth       Write/Err
[  1] 0.00-1.00 sec  94.0 MBytes   789 Mbits/sec  94/0
[  1] 1.00-2.00 sec  94.0 MBytes   789 Mbits/sec  94/0
[  1] 2.00-3.00 sec  97.0 MBytes   814 Mbits/sec  97/0
[  1] 3.00-4.00 sec  96.0 MBytes   805 Mbits/sec  96/0
[  1] 4.00-5.00 sec  96.0 MBytes   805 Mbits/sec  96/0
[  1] 5.00-6.00 sec  96.0 MBytes   805 Mbits/sec  96/0
[  1] 6.00-7.00 sec  97.0 MBytes   814 Mbits/sec  97/0
[  1] 7.00-8.00 sec  94.0 MBytes   789 Mbits/sec  94/0
[  1] 8.00-9.00 sec  94.0 MBytes   789 Mbits/sec  94/0
[  1] 9.00-10.00 sec  96.0 MBytes   805 Mbits/sec  96/0
[  1] 0.00-10.01 sec   955 MBytes   800 Mbits/sec  955/0
Active Internet connections
Proto Recv-Q Send-Q Local Address          Foreign Address           flowid ftype CC            cwin   ssthresh   MSS ECN
tcp4       0      0 192.168.50.37.46170    192.168.50.89.5001      00000000    63 newreno      37792      17376  1460 off
root@n1fbsd:~ #

hz=100 stock cubic

1% packet drop rate:
root@n1fbsd:~ # iperf -B 192.168.50.37 -c 192.168.50.89 -l 1M -t 10 -i 1 -e ; netstat -nCRp tcp | egrep "Active|Proto|5001"
------------------------------------------------------------
Client connecting to 192.168.50.89, TCP port 5001 with pid 978 (1 flows)
Write buffer size: 1048576 Byte
TOS set to 0x0 (Nagle on)
TCP window size: 32.0 KByte (default)
------------------------------------------------------------
[  1] local 192.168.50.37%vtnet0 port 54891 connected with 192.168.50.89 port 5001 (sock=3) on 2024-07-10 12:00:45.989 (EDT)
[ ID] Interval        Transfer    Bandwidth       Write/Err
[  1] 0.00-1.00 sec  24.0 MBytes   201 Mbits/sec  24/0
[  1] 1.00-2.00 sec  24.0 MBytes   201 Mbits/sec  24/0
[  1] 2.00-3.00 sec  18.0 MBytes   151 Mbits/sec  18/0
[  1] 3.00-4.00 sec  21.0 MBytes   176 Mbits/sec  21/0
[  1] 4.00-5.00 sec  22.0 MBytes   185 Mbits/sec  22/0
[  1] 5.00-6.00 sec  23.0 MBytes   193 Mbits/sec  23/0
[  1] 6.00-7.00 sec  25.0 MBytes   210 Mbits/sec  25/0
[  1] 7.00-8.00 sec  22.0 MBytes   185 Mbits/sec  22/0
[  1] 8.00-9.00 sec  22.0 MBytes   185 Mbits/sec  22/0
[  1] 9.00-10.00 sec  25.0 MBytes   210 Mbits/sec  25/0
[  1] 0.00-10.07 sec   227 MBytes   189 Mbits/sec  227/0
Active Internet connections
Proto Recv-Q Send-Q Local Address          Foreign Address           flowid ftype CC            cwin   ssthresh   MSS ECN
tcp4       0      0 192.168.50.37.54891    192.168.50.89.5001      00000000    63 cubic        14516      13213  1460 off
root@n1fbsd:~ # 

2% packet drop rate:
root@n1fbsd:~ # iperf -B 192.168.50.37 -c 192.168.50.89 -l 1M -t 10 -i 1 -e ; netstat -nCRp tcp | egrep "Active|Proto|5001"
------------------------------------------------------------
Client connecting to 192.168.50.89, TCP port 5001 with pid 969 (1 flows)
Write buffer size: 1048576 Byte
TOS set to 0x0 (Nagle on)
TCP window size: 32.0 KByte (default)
------------------------------------------------------------
[  1] local 192.168.50.37%vtnet0 port 60012 connected with 192.168.50.89 port 5001 (sock=3) on 2024-07-11 20:21:14.651 (EDT)
[ ID] Interval        Transfer    Bandwidth       Write/Err
[  1] 0.00-1.00 sec  11.0 MBytes  92.3 Mbits/sec  11/0
[  1] 1.00-2.00 sec  12.0 MBytes   101 Mbits/sec  12/0
[  1] 2.00-3.00 sec  12.0 MBytes   101 Mbits/sec  12/0
[  1] 3.00-4.00 sec  12.0 MBytes   101 Mbits/sec  12/0
[  1] 4.00-5.00 sec  12.0 MBytes   101 Mbits/sec  12/0
[  1] 5.00-6.00 sec  8.00 MBytes  67.1 Mbits/sec  8/0
[  1] 6.00-7.00 sec  12.0 MBytes   101 Mbits/sec  12/0
[  1] 7.00-8.00 sec  9.00 MBytes  75.5 Mbits/sec  9/0
[  1] 8.00-9.00 sec  11.0 MBytes  92.3 Mbits/sec  11/0
[  1] 9.00-10.00 sec  8.00 MBytes  67.1 Mbits/sec  8/0
[  1] 0.00-10.06 sec   108 MBytes  90.0 Mbits/sec  108/0
Active Internet connections
Proto Recv-Q Send-Q Local Address          Foreign Address           flowid ftype CC            cwin   ssthresh   MSS ECN
tcp4       0      0 192.168.50.37.60012    192.168.50.89.5001      00000000    63 cubic        20356      17493  1460 off
root@n1fbsd:~ #

hz=100 cubic patch D41715

1% packet drop rate:
root@n1fbsd:~ # iperf -B 192.168.50.37 -c 192.168.50.89 -l 1M -t 10 -i 1 -e ; netstat -nCRp tcp | egrep "Active|Proto|5001"
------------------------------------------------------------
Client connecting to 192.168.50.89, TCP port 5001 with pid 1056 (1 flows)
Write buffer size: 1048576 Byte
TOS set to 0x0 (Nagle on)
TCP window size: 32.0 KByte (default)
------------------------------------------------------------
[  1] local 192.168.50.37%vtnet0 port 55113 connected with 192.168.50.89 port 5001 (sock=3) on 2024-07-10 16:40:44.605 (EDT)
[ ID] Interval        Transfer    Bandwidth       Write/Err
[  1] 0.00-1.00 sec  5.00 MBytes  41.9 Mbits/sec  5/0
[  1] 1.00-2.00 sec  2.00 MBytes  16.8 Mbits/sec  2/0
[  1] 2.00-3.00 sec  3.00 MBytes  25.2 Mbits/sec  3/0
[  1] 3.00-4.00 sec  2.00 MBytes  16.8 Mbits/sec  2/0
[  1] 4.00-5.00 sec  3.00 MBytes  25.2 Mbits/sec  3/0
[  1] 5.00-6.00 sec  2.00 MBytes  16.8 Mbits/sec  2/0
[  1] 6.00-7.00 sec  3.00 MBytes  25.2 Mbits/sec  3/0
[  1] 7.00-8.00 sec  2.00 MBytes  16.8 Mbits/sec  2/0
[  1] 8.00-9.00 sec  3.00 MBytes  25.2 Mbits/sec  3/0
[  1] 9.00-10.00 sec  2.00 MBytes  16.8 Mbits/sec  2/0
[  1] 0.00-10.17 sec  28.0 MBytes  23.1 Mbits/sec  28/0
Active Internet connections
Proto Recv-Q Send-Q Local Address          Foreign Address           flowid ftype CC            cwin   ssthresh   MSS ECN
tcp4       0      0 192.168.50.37.55113    192.168.50.89.5001      00000000    63 cubic         2920       2896  1460 off
root@n1fbsd:~ # 

2% packet drop rate:
root@n1fbsd:~ # iperf -B 192.168.50.37 -c 192.168.50.89 -l 1M -t 10 -i 1 -e ; netstat -nCRp tcp | egrep "Active|Proto|5001"
------------------------------------------------------------
Client connecting to 192.168.50.89, TCP port 5001 with pid 963 (1 flows)
Write buffer size: 1048576 Byte
TOS set to 0x0 (Nagle on)
TCP window size: 32.0 KByte (default)
------------------------------------------------------------
[  1] local 192.168.50.37%vtnet0 port 42832 connected with 192.168.50.89 port 5001 (sock=3) on 2024-07-11 20:28:49.154 (EDT)
[ ID] Interval        Transfer    Bandwidth       Write/Err
[  1] 0.00-1.00 sec  2.00 MBytes  16.8 Mbits/sec  2/0
[  1] 1.00-2.00 sec  2.00 MBytes  16.8 Mbits/sec  2/0
[  1] 2.00-3.00 sec  1.00 MBytes  8.39 Mbits/sec  1/0
[  1] 3.00-4.00 sec  2.00 MBytes  16.8 Mbits/sec  2/0
[  1] 4.00-5.00 sec  1.00 MBytes  8.39 Mbits/sec  1/0
[  1] 5.00-6.00 sec  1.00 MBytes  8.39 Mbits/sec  1/0
[  1] 6.00-7.00 sec  2.00 MBytes  16.8 Mbits/sec  2/0
[  1] 7.00-8.00 sec  1.00 MBytes  8.39 Mbits/sec  1/0
[  1] 8.00-9.00 sec  1.00 MBytes  8.39 Mbits/sec  1/0
[  1] 9.00-10.00 sec  2.00 MBytes  16.8 Mbits/sec  2/0
[  1] 10.00-10.58 sec  1.00 MBytes  14.5 Mbits/sec  1/0
[  1] 0.00-10.58 sec  16.0 MBytes  12.7 Mbits/sec  16/0
Active Internet connections
Proto Recv-Q Send-Q Local Address          Foreign Address           flowid ftype CC            cwin   ssthresh   MSS ECN
tcp4       0      0 192.168.50.37.42832    192.168.50.89.5001      00000000    63 cubic         2920       2896  1460 off
root@n1fbsd:~ #

chengcui/testTCPCCinVM (last edited 2024-07-24T16:15:31+0000 by chengcui)