Test Cluster Reservations

The FreeBSD Test Cluster is used for a variety of FreeBSD kernel development, much oriented towards performance measurement and enhancement. This page can be used to register use of a machine for testing purposes to help prevent toe-treading. When you're done using a system for a purpose, please do put a note in the past users table so that we can keep track of the sorts of work being done. This information comes in really handy when looking for donations to help pay for new hardware to add to the cluster!

You can visit the TestClusterOnePointers page for more information on using the test cluster.

DO NOT EDIT THIS PAGE IN GUI MODE, IT WILL SCREW UP THE TABLE

PREVIEW BEFORE YOU SAVE!

Cluster Management Machine Configurations

Machine

pm25 port

pm25 port speed

PMC port

IP

CPU

Cores

RAM

Notes

pm25

-

-

-

192.168.5.25

-

-

-

Livingston PortMaster PM-25

apc2

2003

19200

-

192.168.5.99

-

-

-

APC power switch

apc4

-

-

-

192.168.5.96

-

-

-

APC power switch - telnet to apc4

apc5

cuau0

-

-

192.168.5.84

-

-

-

SYS power switch - telnet to apc5

zoo

-

-

4-1

192.168.5.1

2.2 GHz AMD 4200 X2

2

1GB

Cluster access and build host

devnull

2019?

-

-

192.169.5.3

-

-

-

NetApp filer NAS - console is cuad1 on sloth

sloth2

2015?

-

-

192.168.5.4

AMD/Xeon?

1

512 MB

Off-site backup host and devnull management

gigax2

?

?

?

192.168.5.10

-

-

-

Arista 10GigE switch, ssh admin@, no pass

gigax3

2020

?

?

192.168.5.155

-

-

-

Second Arista 10GigE switch, ssh admin@, no pass

switch

-

-

-

192.168.5.98

-

-

-

netgear GS724T (port 80)

switch1

-

-

-

192.168.5.5

-

-

-

NetApp <-> Netperf link switch (NetApp end)

switch2

-

-

-

192.168.5.6

-

-

-

NetApp <-> Netperf link switch (Netperf end)

LANTime m600

-

-

-

192.168.5.17

-

-

-

Meinberg PTPv2 Grandmaster GPS Clock 192.168.5.200 is source of packets

Cluster Test Machine Configurations

/!\ apc2 is stupid. Port 1 is command 2, port 2 is command 3, etc. The other APCs are not afflicted.

{OK} Ready to vacate

Machine

Reserved By

pm25 port

pm25 port speed

PMC port

IP

CPU

Cores

RAM

IPMI

10G Port (Arista or Cisco or X-over)

Notes

cavium1

-

192.168.5.167

48 core CN8890 ThunderX

1P x 48C

128GB

192.168.5.166

cavium3

-

192.168.5.169

48 core CN8890 ThunderX

1P x 48C

128GB

192.168.5.168

cavium4

andrew

192.168.5.159

2S ThunderX

2P x 48C

128GB

192.168.5.170

fox1

-

???

115.2

ipmi

192.168.5.148

Xeon E5-2643 3.3Ghz

2x4x2

32 GB

fox2

jhb

???

115.2

ipmi

192.168.5.149

Xeon E5-2643 3.3Ghz

2x4x2

32 GB

lama1

-

cuau3

38400

-

192.168.5.32

RMI XLR MIPS

32

4 GB

-

lion1

oshogbo

2021

9600

2-4

192.168.5.81

3.00 GHz Xeon

8

8 GB

ix0:10(A), ix1:11(A)

1 disk

lion2

-

2022

9600

5-6

192.168.5.82

3.00 GHz Xeon

4

4 GB

1x 10GE (Intel), 1 disk (ahd errors?)

lion3

emaste

2023

9600

5-4

192.168.6.83

3.00 GHz Xeon

4

8 GB

ix0:3(A), ix1:4(A)

1 ATA scratch disk

lynx1

-

-

-

192.168.5.151

2.80 GHz Xeon

2P x 10C x 2HTT

32 GB

192.168.7.151

cxl

Network Testing

lynx2

-

-

-

192.168.5.152

2.80 GHz Xeon

2P x 10C x 2HTT

32 GB

192.168.7.156

sfxge

fails to POST

lynx3

pjd

-

-

192.168.5.153

2.80 GHz Xeon

2P x 10C x 2HTT

128 GB

192.168.7.153

cxl

ZFS testing

lynx4

mjg

-

-

192.168.5.154

2.80 GHz Xeon

2P x 10C x 2HTT

128 GB

192.168.7.154

sfxge

mercat1

pho

-

-

-

192.168.5.171

3.50 GHz Xeon E5-1650-v3

1P x 6C x 2HTT

32 GB

192.168.7.171

mlx5

Mellanox 100G

mercat2

andrew

-

-

-

192.168.5.172

3.50 GHz Xeon E5-1650-v3

1P x 6C x 2HTT

32 GB

192.168.7.172

mlx5

Mellanox 100G

mercat3

andrew

-

-

-

192.168.5.173

3.50 GHz Xeon E5-1650-v3

1P x 6C x 2HTT

32 GB

192.168.7.173

bxe

QLogic 8442

mercat4

costin

-

-

-

192.168.5.174

3.50 GHz Xeon E5-1650-v3

1P x 6C x 2HTT

32 GB

192.168.7.174

Exablaze, Intel P3700 NVMe

mercat5

bz

-

-

-

192.168.5.175

3.50 GHz Xeon E5-1650-v3

1P x 6C x 2HTT

32 GB

192.168.7.175

cxl

Chelsio T62100-LP-CR 2x100G, Chelsio T6225-CR 2x25G, b-t-b w/ mercat 6

mercat6

bz

-

-

-

192.168.5.176

3.50 GHz Xeon E5-1650-v3

1P x 6C x 2HTT

32 GB

192.168.7.176

cxl

Chelsio T62100-LP-CR 2x100G, Chelsio T6225-CR 2x25G, b-t-b w/ mercat 5

mercat7

-

-

-

-

192.168.5.177

3.50 GHz Xeon E5-1650-v3

1P x 6C x 2HTT

32 GB

192.168.7.177

bxe

Exalbaze , QLogic 8442

mercat8

-

-

-

-

192.168.5.178

3.50 GHz Xeon E5-1650-v3

1P x 6C x 2HTT

32 GB

192.168.7.178

cxl

SolarFlare 7122, Chelsio T-580

rabbit1

-

-

-

192.168.5.161

3.50 GHz Xeon E5-2637

1P x 4C x 2HTT

32 GB

192.168.7.161

lio

Cavium Liquid IO w/rabbit2

rabbit2

-

-

-

192.168.5.162

3.50 GHz Xeon E5-2637

1P x 4C x 2HTT

32 GB

192.168.7.162

lio

Cavium Liquid IO w/rabbit1

rabbit3

-

-

-

192.168.5.163

3.50 GHz Xeon E5-2637

1P x 4C x 2HTT

32 GB

192.168.7.163

cxl

Chelsio T520-LL-CR back to back with rabbit 4/Arista-SW

rabbit4

-

-

-

192.168.5.164

3.50 GHz Xeon E5-2637

1P x 4C x 2HTT

32 GB

192.168.7.164

cxl

Chelsio T520-CR back to back with rabbit 3/Arista-SW

gibbon1

-

2009

115200

-

-

ARM64 Seattle

1P x 8C

16 GB

millipede1

cuau3

38400

2-8

192.168.5.16

RMI XLS MIPS

16

2 GB

12(A)

-

pig1

mjg

-

-

192.168.5.160

4P x 10C x 2HTT

1TB

192.168.7.160

sloth

simon

2015

9600

2-3

192.168.5.202

500 MHz Geode LX

1

512 MB

Soekris 5501

worm2

-

2013

9600

-

-

2.2 GHz AMD

16

16 GB

22(A)

Exar/Neterion, IPMI on 192.168.5.152, user+pass: ADMIN

giant-ape1

attilio

192.168.5.126

Intel 80 Core Xeon

4

32 GB

IPMI on 192.168.7.135 user+pass: ADMIN

/!\ - Under maintenance or being replaced/upgraded in the immediate future, so may be offline or go offline without notice.

lion4 /!\

-

-

-

-

-

-

4

4 GB

requires PCI-E bridge (en route)

lion5 /!\

-

-

-

-

-

-

4

4 GB

requires PCI-E bridge (en route)

lion6 /!\

-

-

-

-

-

-

4

4 GB

requires PCI-E bridge (en route)

lion7 /!\

-

-

-

-

-

4

4 GB

Being shipped

lion8 /!\

-

-

-

-

-

4

4 GB

Being shipped

lion9 /!\

-

-

-

-

-

4

4 GB

Being shipped

lion10 /!\

-

-

-

-

-

4

4 GB

Being shipped

worm1 /!\

-

-

-

-

-

-

-

shipped back to iX

orangutan /!\

2014

9600

2-4

192.168.5.105

2.2 GHz Xeon

2

2 GB

Dell 2650

sloth-2 /!\

-

9600

4-4

192.168.5.116

267 MHz Geode SC1100

1

128 MB

Soekris 4801, hifn

beaver1

-

2024

9600

2-1

192.168.5.112

VIA 800MHz

1

512MB

padlock(4), ubsec(4)

cheetah

-

2012

9600

4-5

192.168.5.106

2.00 GHz Opteron HE

2

4 GB

NetFPGA card

interlope

-

2018

-

-

192.168.5.115

AMD 3800

1

1 GB

Solaris 200805, hifn

leopard1

-

2001

9600

5-2

192.168.5.107

2.13 GHz Xeon 3050

2

2 GB

3/3(C)

Chelsio

leopard2

-

2005

9600

5-3

192.168.5.108

2.13 GHz Xeon 3050

2

2 GB

2/2(C)

Myricom

leopard3

-

2008

9600

5-1

192.168.5.109

2.13 GHz Xeon 3050

2

2 GB

17(A)

Myricom

octeon

-

cuau4

115200

4-7

192.168.5.19

Cavium Octeon CN5230-SCP

4

2 GB

Lanner MR-730

elephant

-

2016

9600

5-4?? 4-8??

192.168.5.104

800 MHz Pentium III

2

256 MB

SGI

Machines in italics are proposed for decommissioning.

Stash

Bears and IPMI Control

The IPMI cards are on the the 192.168.7.0/24 network, where the last octet matches the IP on 192.168.5.0/24. so bear3 is 192.168.5.124, the IPMI management NIC is 192.168.7.124

userid and passwd are the default ADMIN ADMIN (case SENSITIVE)

For serial redirection to work, in the BIOS you need to redirect to com port B and in /boot/device.hints you need hint.uart.1.flags="0x10" and enable getty on cuau1

Then you can do ipmitool -U ADMIN -P ADMIN -I lanplus -H 192.168.7.124 sol activate and you will be able to see everything from bios screen boot up to serial console interaction.

If you are not using a box long term, powering it off would be great, as it saves us on the power bill :)

ipmitool -U ADMIN -P ADMIN -I lanplus -H 192.168.7.124 "power" "off"

eg

# ipmitool -U ADMIN -P ADMIN -I lanplus -H 192.168.7.124 "power" "status" Chassis Power is on

# ipmitool -U ADMIN -P ADMIN -I lanplus -H 192.168.7.124 "power" "off" Chassis Power Control: Down/Off

# ipmitool -U ADMIN -P ADMIN -I lanplus -H 192.168.7.124 "power" "status" Chassis Power is off

Past Uses

Some past past test cluster users, sorted roughly by inverse start date order. Entries are by-project rather than by-developer.

Dates

User

Notes

Early 2020

kp

if_bridge performance improvements

End 2018

kp

pfsync performance improvements

Feb 2016

AllanJude

NVMe testing for "FreeBSD Mastery: Advanced ZFS"

May/June 2014

kib

PostgreSQL performance measurements and optimizations

Summer 2013

kib

DMAR driver

2012/2013

bz

TCP-MD5, IPv6, PMC, benchmarking

March 2012

flo

vmcontention testing

March 2012

gnn

FUSE testing

February 2012

brooks

LTO and external toolchain support testing.

2011

bz

IPSec NAT-T, pf, ipfw fwd IPv6, IPv6, carp, vnet, ...

March 2010

kib

FPU/XMM in-kernel use KPI development

January 2010

bz

build_option_survey run

November-December 2009

bz

IPsec bugfixing, hifn testing and netisr regression testing

September-November 2009

bz

Networking and security testing

August-November 2009

pjd

ZFS

July 2009

lstewart

SMP panic debugging

May- 2009

bz

VImage

May, 2009 - June 2011

rwatson

netisr2 (parallel netisr) performance and stability testing, network stack profiling, TCP locking optimisation, TCP refactoring, connection groups, parallel network stack work distribution, RSS support

November, December 2008

bz

VImage

September 2008

bz

performace testing

August, September 2008

bz

vimage testing

November 2007 - September 2008

bz

TCP, IPv6, IPsec bughunting and patch testing, also for secteam

December, 2007

simon

OpenSSL hardware acceleration testing.

November, 2007 - December, 2007

rwatson

procstat development

September, 2007 - November, 2007

rwatson

performance measurement of scheduler changes for IP forwarding.

August, September 2007

silby

FreeBSD 7.0 TCP testing.

July 2007 - April 2009

pho

long-term SMP stability and load-testing for FreeBSD 7.x and 8.x

April,June, July 2007

bz

Testing and debugging IPv6 for fast_ipsec patches.

2006-2011

pjd

ZFS porting, GJournal development/testing, various GEOM classes development/testing, opencrypto development/testing.

November, 2006

piso

Interrupt filter stability and performance testing.

April, 2006 - November 2006

jb

dtrace

2005-present

rwatson

MPSAFE network stack development and performance/stability testing.

2005-2008

rwatson

TrustedBSD audit, MAC, privilege development.

December, 2005

jasone

jemalloc load testing.

February, 2005

davidxu

libthr+MySQL performance testing and optimization.

January, 2005 - May, 2006

jkoshy

HWPMC testing on a range of hardware.

bmilekic

A variety of testing and optimization for the network stack locking work, including mbuma.

gnn

Network testing of various protocols.

May, 2007

zec

Virtual Network Stack.

TestClusterOneReservations (last edited 2023-04-30T21:19:26+0000 by PawelJakubDawidek)