Introduction

This page notes what things are currently completed/in-progress for testing in FreeBSD.

Eventually this page will also note coverage in source code as a meaningful rubric for progress.

ATF import status

Build infrastructure status

Test Infrastructure Status

ATF

RUMP

Rump is an extension to the NetBSD kernel that runs kernel code as a standalone user process for development and testing purposes. It is a great technology for isolating code and testing it using a whitebox method of testing, as opposed to having to use fuzzing techniques, failpoints, blackbox/graybox testing, etc, which ultimately allows developers and testers to write more code that isolates API calls and helps ensure that KPI contracts are sane without panicing a system or corrupting system state.

Testcase Status

ATF Testcases

Directory

Repository

Owner

Status

Notes

bin/cat

1

gcooper

complete

Ported from NetBSD.

bin/date

1

gcooper

complete

Ported from tools/regression. Research adding coverage from NetBSD.

bin/dd

1

gcooper

complete

Ported from NetBSD. Needs greater coverage/porting. Throws false positives.

bin/expr

1

gcooper

complete

Ported from NetBSD.

bin/sh

1

gcooper

complete

Ported from tools/regression. Need to get jilles@ to stop committing files to tools/regression :P.

bin/sleep

1

gcooper

complete

Ported from NetBSD.

gnu/usr.bin/diff

1

gcooper

complete

Ported from NetBSD.

lib/libc

1

gcooper

in-progress

Ported from NetBSD. Needs greater coverage/porting. Throws false positives.

lib/libcrypt

1

gcooper

complete?

lib/librt

1

gcooper

in-progress

Ported from NetBSD. Needs greater coverage/porting. Throws false positives.

lib/libthr

1

gcooper

in-progress

Ported from NetBSD. Needs greater coverage/porting. Throws false positives.

lib/msun

1

gcooper

in-progress

Ported from NetBSD. Needs greater coverage/porting. Throws false positives.

sbin/ifconfig

1

gcooper

complete

Ported from NetBSD. Needs greater coverage/porting. Throws false positives.

usr.bin/apply

1

gcooper

complete

Ported from tools/regression. Research adding coverage from NetBSD.

usr.bin/basename

1

gcooper

complete

Ported from NetBSD.

usr.bin/calendar

1

gcooper

complete

Ported from tools/regression.

usr.bin/comm

1

gcooper

complete

Ported from tools/regression.

usr.bin/cut

1

gcooper

complete

Ported from tools/regression.

usr.bin/dirname

1

gcooper

complete

Ported from NetBSD.

usr.bin/file2c

1

gcooper

complete

Ported from tools/regression.

usr.bin/grep

1

gcooper

complete

Ported from NetBSD.

usr.bin/gzip

1

gcooper

complete

Ported from NetBSD.

usr.bin/join

1

gcooper

complete

Ported from tools/regression.

usr.bin/jot

1

gcooper

complete

Ported from tools/regression.

usr.bin/m4

1

gcooper

complete

Ported from tools/regression.

usr.bin/ncal

1

gcooper

complete

Ported from tools/regression.

usr.bin/printf

1

gcooper

complete

Ported from tools/regression.

usr.bin/sed

1

gcooper

complete

Ported from tools/regression.

usr.bin/tr

1

gcooper

complete

Ported from tools/regression.

usr.bin/uudecode

1

gcooper

complete

Ported from tools/regression.

usr.bin/uuencode

1

gcooper

complete

Ported from tools/regression.

usr.bin/xargs

1

gcooper

complete

Ported from tools/regression.

usr.bin/yacc

1

gcooper

complete

Ported from tools/regression.

usr.sbin/nmtree

1

gcooper

complete

Ported from NetBSD. Adjusted slightly to match sha256sum string.

usr.sbin/tcpdump

1

gcooper

complete

Ported from NetBSD. Needs greater coverage/porting. Throws false positives.

tests/contrib/atf

1

gcooper

complete

Ported from NetBSD. All test issues have been pushed back via GoogleCode page for the contrib/atf issues; the build issues and adjustments are all remaining local to FreeBSD for now..

Test::Harness Testcases

Directory

Repository

Owner

Status

Notes

bin/mv

1

gcooper

in-progress

From tools/regression. Convert to ATF.

bin/pax

1

gcooper

in-progress

From tools/regression. Convert to ATF.

bin/pkill

1

gcooper

in-progress

From tools/regression. Convert to ATF.

bin/test

1

gcooper

in-progress

From tools/regression. Convert to ATF.

sbin/geom

1

gcooper

in-progress

From tools/regression. Global tests, mirror, and raid3 testcases have been ported over. Convert to ATF.

tests/sys/pjdfstest

1

gcooper

in-progress

From tools/regression. Need to shim in support for ATF.

usr.bin/lastcomm

1

gcooper

in-progress

From tools/regression. Convert to ATF.

usr.sbin/newsyslog

1

gcooper

in-progress

From tools/regression. Convert to ATF. Need to investigate failures.

usr.sbin/sa

1

gcooper

in-progress

From tools/regression. Convert to ATF. Need to investigate failures.

Repositories

  1. yaneurabeya/.../atf-tools-regression-convert

TestingFreeBSDStatus (last edited 2013-09-11 20:40:24 by GarrettCooper)