• SummerOfCodeIdeas

FreeBSD Google Summer of Code Ideas

How to use this idea list

For students

• The list of projects here should be regarded as inspiration, not as the exclusive list of all projects that will be considered. We are happy to try to find mentors for projects that will benefit the FreeBSD project. If you're unsure if your idea fits this description, try asking in #freebsd-soc or #bsddev on EFNet.
• You should propose the design of your idea first, and only start coding once your project is accepted. Producing a decent design will save you lots of effort.
• Most mentors are working professionals. Please use their time effectively, with up-front study of issues and problems, and try to provide as much data as possible.

• We have a page at SummerOfCodeDevEnvironments where we detail some possible ideas for how to set up your developer environment.

• We also have several pieces of advice on applying at SummerOfCodeStudentChecklist

Skill levels

GSOC projects this year run for 10 weeks, with 18-20 hours of work per week. Note that this is a departure from previous years, where projects ran for 12 weeks at 30 hours per week. Choose a project you feel you can realistically do within the timeline. If you feel unsure, please contact the listed mentor(s) to get their opinion on how much effort and experience a given project may require.

• C: For C-related ideas, at least some experience coding in C is necessary. Generally, it is easier to program/debug userland software than it is when working on the kernel. Kernel programming/debugging is harder, and can involve skills ranging from understanding internals of operating systems construction to understanding the computer architecture itself.

• Kernel: The FreeBSD kernel is written in C, so at least a basic proficiency in C is required to choose a kernel project. Various levels of other skills may be necessary, but you can certainly assume that knowing how to do "Hello world" in the kernel and knowing how to recompile the kernel should be an essential starting point.

• Network: Understanding of TCP/IP will be required for these projects. It'd be good if you understood socket API for any programming language, and know stuff like "sockets".

• Security: For these tasks you must have general understanding of security issues, UNIX permission model, basics of cryptography and its applications.

• Scripting: For scripting, unless otherwise stated we won't enforce which language you choose, however there are certain factors for this choice: if you're willing to work with /bin/sh (+awk/sed/etc), there is a higher chance that whatever you produce could be committed to the base system. If you pick something like Lua for which we don't currently have base system support, it may still be possible to create a convincing case for the tool to get into the tree, with some level of commitment and convincing. For other things in languages too large for the base system and not present there (e.g.: perl, python, ruby), these can still be offered as useful tools to others, but (e.g.) these would be bad language choices for things that need to be usable with just the base system (e.g. the installer). Tools are equally important as every part of the OS. If you create a tool for debugging, analyzing and visualizing complex data, it might help dozens of FreeBSD hackers around the world to be 10x more productive.

Ideas list

---

Kernel Projects

Add support for building Linux-only network drivers

Description

Currently we have a Linux KPI for FreeBSD which mostly helps drm-next graphical stack to work.

The big-picture idea is to have network functionalities implemented in that way too, so that we can build "Linux-only" network drivers for FreeBSD too.

For this purpose the first thing we need to do is to implement the API (KPI) most of Linux drivers rely on. Netlink is one of those and among the important ones.

The steps (the first or at max 2nd one are for current/2019 GSoC)

• Implement netlink
  • Implement base functionalities (ioctl behavior)
  • Implement Netlink protocols (NETLINK_ROUTE, FIREWALL, etc)
• Build a sample driver using new API

Further info is available here.

---

VGA emulation improvements for bhyve

Description

bhyve ships with a VGA/VESA device emulation, though it is little-used compared to the UEFI frame buffer. However, this is useful for booting older guest o/s's.

There are some functional and performance limitations with this code. For example, text-mode rendering uses most of one CPU even when a guest is idle.

Although a linear frame buffer is available through VESA, this hasn't been significantly tested, and should be verified by running a number of different guest operating systems.

This project will examine the VGA emulation in detail. The student should have an interest in computer graphics as well as virtualization.

---

bhyve debug server enhancements

Description

With r333140 bhyve implements a debug server, allowing debuggers that speak the GDB protocol to inspect guest state. r355724 extended the debug server to support the setting of breakpoints. Some more features that would be useful:

* The breakpoint implementation uses an Intel-specific feature, the Monitor Trap Flag, to perform single-stepping, but this does not work on AMD systems. It should be possible to make use of the RFLAGS.TF flag to perform single-stepping if the monitor trap flag is not implemented. Note that this could be implemented and tested on Intel systems by disabling the use of monitor traps in the debug server.

* Implement support for hardware watchpoints. In particular, modify the debug server to set debug registers in the guest and handle VM exits due to debugging exceptions. Some care would be needed to avoid clobbering guest state if the guest OS is making use of hardware debug registers.

Note: these projects require familiarity with at least the basics of how debuggers and hardware-assisted hypervisors work.

---

Convert all FDT drivers attachments to be table driven and mark with PNP_INFO

Description

The devmatch infrastructure gives us a way to match up hardware with kernel modules that implement drivers that claim the hardware. One problem, however, is that these drivers need some modification before devmatch can use them. Specifically, they need to have their compatibility scans done via a table, and that table needs to be decorated with a PNP_INFO tag so the compiler and kld_xref extract the metadata that devmatch needs to do its job. In addition, the armv7 GENERIC kernel needs to be trimmed of the drivers that can be loaded like this. 3 different boards from different SoC families have to successfully boot with their drivers that can be loaded automatically.

---

Finishing MPLS implementation

Description

There are old works about adding MPLS stack into FreeBSD, but none are complete:

• melifaro's old-work-in-progress

• Previous GSoC (2008)

This project should refresh/cleanup one of these Work-in-progress. The OpenBSD'MPLS stack or the NetBSD'MPLS stack can be used as inspiration too.

---

Linuxulator on powerpc64

Description

FreeBSD's Linux compatibility layer, Linuxulator, currently supports ARM and x86. This project is to add support for powerpc64, at least preliminary support. At a minimum simple static binaries should work from this project.

---

eBPF XDP Hooks

Description

The eBPF eXpress Data Path (XDP) allows eBPF programs to be run to filter received packets as early as possible, avoiding unnecessary processing overhead before the filter is run. The goal of this project is to extend an existing FreeBSD network driver (a virtual NIC like a VirtIO if_vtnet would be fine) to be able to call into an eBPF program when processing a newly received packet. As in XDP, the driver must PASS (accept and process normally), DROP, TX or REDIRECT the packet as specified by the program. eBPF helper functions and maps for aiding in packet filtering will also need to be implemented.

---

eBPF Tracing Hooks

Description

The FreeBSD kernel has Statically Defined Tracing (SDT) probe points which are used as entry points for tracing the kernel via DTrace. The goal of this project is to allow these tracing points to also be able to call into eBPF programs. The first stage of this project is to extend the existing SDT infrastructure to allow eBPF programs to be attached to probes. The second stage is to implement eBPF helper functions and maps necessary for tracing kernel execution. This could include eBPF stacktrace and histogram maps, as well as helper functions to get the current time, current thread, current CPU, etc.

---

eBPF JIT for arm64

Description

A just-in-time compiler for eBPF targetting amd64 (x64-64) instructions is in progress. The goal of this project is to extend the JIT to also compile to arm64 instructions.

---

Implement Netlink (RFC 3549) kernel support

Description

Netlink is widely used in linux for many network-related kernel<>userspace communications. Many apps require kernel netlink support to work, making them hard to port to FreeBSD. The goal of this project is to add Netlink support to FreeBSD kernel for route and notification protocol families.

---

Unified kernel tracing interface

Description

The FreeBSD kernel contains several subsystems which add hooks to core pieces of the kernel. For example, the context switch code in the scheduler contains this snippet:

        if (td != newtd) {                                                                                                                                                                                                                                                                                                    
#ifdef  HWPMC_HOOKS                                                                                                                                                                                                                                                                                                           
                if (PMC_PROC_IS_USING_PMCS(td->td_proc))                                                                                                                                                                                                                                                                      
                        PMC_SWITCH_CONTEXT(td, PMC_FN_CSW_OUT);                                                                                                                                                                                                                                                               
#endif                                                                                                                                                                                                                                                                                                                        
                SDT_PROBE2(sched, , , off__cpu, newtd, newtd->td_proc);                                                                                                                                                                                                                                                       
                                                                                                                                                                                                                                                                                                                              
#ifdef KDTRACE_HOOKS                                                                                                                                                                                                                                                                                                          
                /*                                                                                                                                                                                                                                                                                                            
                 * If DTrace has set the active vtime enum to anything                                                                                                                                                                                                                                                        
                 * other than INACTIVE (0), then it should have set the                                                                                                                                                                                                                                                       
                 * function to call.                                                                                                                                                                                                                                                                                          
                 */                                                                                                                                                                                                                                                                                                           
                if (dtrace_vtime_active)                                                                                                                                                                                                                                                                                      
                        (*dtrace_vtime_switch_func)(newtd);                                                                                                                                                                                                                                                                   
#endif                                                                                                                                                                                                                                                                                                                        
                td->td_oncpu = NOCPU;                                                                                                                                                                                                                                                                                         
                cpu_switch(td, newtd, mtx);                                                                                                                                                                                                                                                                                   
                cpuid = td->td_oncpu = PCPU_GET(cpuid);                                                                                                                                                                                                                                                                       
                                                                                                                                                                                                                                                                                                                              
                SDT_PROBE0(sched, , , on__cpu);                                                                                                                                                                                                                                                                               
#ifdef  HWPMC_HOOKS                                                                                                                                                                                                                                                                                                           
                if (PMC_PROC_IS_USING_PMCS(td->td_proc))                                                                                                                                                                                                                                                                      
                        PMC_SWITCH_CONTEXT(td, PMC_FN_CSW_IN);                                                                                                                                                                                                                                                                
#endif

There are three hooks that may be called before switching into the new thread, and two hooks that may be called after the switch. They are used by DTrace and HWPMC to collect information about context switch events. These hooks are disabled most of the time, but each hook introduces overhead even when disabled since we must check whether it is enabled each time the code is executed.

The goal of the project is to identify useful kernel tracepoints, and design and implement a unified interface that can be used by different consumers to collect information about the event corresponding to a particular tracepoint. This would make it easier for new subsystems to collect information from existing tracepoints, rather than modifying the core kernel to add more hooks. An additional aim would be to ensure that such tracepoints have minimal overhead, probably by using hot-patching to enable and disable a particular tracepoint. FreeBSD-CURRENT now uses clang 10.0, which implements the "asm goto" construct that could be useful here.

---

Add audit(4) support to NFS

Description

Security Event Audit is a facility to provide fine-grained, configurable logging of security-relevant events, and is intended to meet the requirements of the Common Criteria (CC) Common Access Protection Profile (CAPP) evaluation. It can record an audit record for various events, such as process creation, network activity, or file system activity. However, it mostly works at the syscall level. Since the NFS server is implemented within the kernel, that means NFS RPCs don't generate any audit records. audit(4) can still be used within NFS networks, but auditd must be run on every NFS client. It would be a great addition if each NFS RPC could be audited. That would allow auditd(8) to run just on the NFS server, and still audit all NFS activity within the network.

---

Port squashfuse to the FreeBSD kernel

Description

squashfs is a read-only filesystem targeted for small embedded environments, where memory and disk space is constrained. squashfuse is a BSD-licensed FUSE implementation of squashfs. The project would be to port this implementation to the FreeBSD kernel, with the aim of being able to boot FreeBSD from an in-memory squashfs filesystem.

---

OpenBSD pf port (to ports)

OpenBSD's pf version has evolved significantly away from the version in FreeBSD. While a full merge is a project far beyond the scope of GSoC there is some value to a straight port.

This would involve taking the OpenBSD pf code and making it build (and work) against FreeBSD's kernel. This port is intended to live in the ports collection, not in the src tree. This means coping with the differences in kernel API between OpenBSD and FreeBSD. Ideally the required changes should be documented extensively, to easy any future porting work.

It does not need to address VNET (although that's a good stretch goal), locking improvements (a single PF mutex is acceptable) or migration tooling from the FreeBSD pf.conf syntax to the new syntax.

---

Command Line Editing, history and escape completion in Boot Loader

The current boot loader lacks any kind of command history and editing at all. This is because it was designed to be small. Now that UEFI has greatly expanded the limits, it makes sense to bring in functionality like this.

This effort would involve creating a number of primitives for expansion, storing the history, etc. It would likely also require some lua integration to work.

This project is one that has a lot of sub-parts, some of which may be omitted (eg command history w/o filename completion) and still result in good project.

---

Userland projects

IPv6 support and cleanup of address family dependency in userland utilities

Description

• rwhod(8) is not IPv6 clean.
• Various yp(8) daemons are not IPv6 clean.
• rpc.rquotad(8) is not IPv6 clean.

This project could also include a broader survey of other network services in /usr/bin and /usr/sbin to make sure they're all IPv6 clean. This project could be further developed. Some more of this includes:

• remove/rework the about 200 gethostby*() calls all in the base system and contrib to use getaddrinfo().
• make more code to conditionally compile in INET or INET6 support.

---

Port SGI's XFS Filesystem to fusefs

Description

SGI open-sourced their production Journaled File System, used in IRIX, and ported it to the linux kernel. The design was quite revolutionary for its time and had many interesting features. At a time, there was great interest for a FreeBSD native port and up to FreeBSD 9 there was even an initial port with read-only support, but eventually the complexity and restrictive licensing killed the port altogether. SGI has disappeared now but in linux the filesystem is still widely used and developed by Redhat. While there are some options (https://www.freshports.org/sysutils/fusefs-lkl/lkl, https://sourceforge.net/projects/fusexfs/fuse-xfs) to access XFS, a clean FreeBSD userland implementation that could perhaps use the advantages of the existing code would be useful to compensate for the absence of a kernel version.

Any proposal must include a coding plan showing understanding of the APIs involved and a test plan.

---

UFS4fuse: support FreeBSD's UFS2 with fusefs

Description

FreeBSD's UFS is arguably the longest standing UNIX file system still under active development. It is well documented and has many interesting features. While UFS has been ported to Linux and Mac OSX, the ports are not very good or have been deprecated. Using fusefs as a userland option would let the filesystem be used on many other systems. Existing FreeBSD headers and code can be reused but a fresh design using modern C++ constructs would be interesting.

This project is challenging: any proposal must include a coding plan and should include credible evidence of userland filesystem development.

---

ELFToolChain improvements

Description

The elftoolchain project provides FreeBSD with several commands for handling ELF executables, including "ar", "addr2line", "elfdump", "nm", "strings", amongst others. These replaced the equivalent tools from GNU binutils. One useful project, needed to support LLVM's Link-Time-Optimization, would be to extend ar, ranlib and nm to support archive files containing LLVM bitcode files. These files have their own container format; the project would involve adding a small parser that is sufficient to extract information required by these tools (e.g., the symbol table).

Another potential project would be to investigate the GNU binutils test suites for these tools and attempt to run them using the ELFToolChain equivalents, with the aim of finding and fixing bugs and incompatibilities.

---

Move to GENERIC armv7 distribution scripting

Description

FreeBSD has grown a large number of boards over the past few years. Far too many to release images for all the boards for. This project would convert the release tools to generate only a generic image that can have any supported u-boot port overlaid. the u-boot ports would need to be updated with meta-data that would describe how each SoCs or board's u-boot and other pieces are places into an image. A simple user-land script needs to be created to take a u-boot package for board X and the generic bootable distribution and make an image that's bootable on board X.

---

Move to GENERIC armv7 distribution web interface

Description

FreeBSD has grown a large number of boards over the past few years. Far too many to release images for all the boards for. We need a way to securely distribute boot images for dozens or even hundreds of boards. The web app would collect user input, run a script to generate the image, sign the image with a secure signing key, then download the results to the user.

---

Capsicumization of the base system

Description

Capsicum is a sandboxing technology used in FreeBSD. It is complemented by Casper, a framework for defining application-specific capabilities. A large number of utilities in the FreeBSD base system have been converted to run under Capsicum and Casper, but many programs have yet to be converted. The project would consist of identifying several high-profile daemons and utilities in the base system or ports, and modifying them to run in capability mode. One good candidate is syslogd, the system logging daemon.

As part of this work it may be necessary or useful to add additional Casper services to the base system. For example, we do not yet have a Casper service which allows an application to make outbound network connections.

Note: Converting applications to run under Capsicum/Casper can take a lot of effort, especially when they are large or when they are not designed with privilege separation in mind. Some applications, like a shell, can't really be run in capability mode at all. Before attempting to sandbox a given application, take care to study the ways in which it interacts with the system. For example, does the application need to open any files? If so, are the file names statically defined or are they derived from user input? This will provide insight into the difficulties that will arise when sandboxing the application.

---

Network Configuration Libraries

Deliverables

A simple tool to configure the network on a laptop to allow a bhyve VM to access the internet.

Use Cases:

• A bhyve VM running on a laptop NAT'd out the laptop's wifi connection
• A bhyve VM bridged to the hosts Ethernet network

Stretch goal: Extend the tool to support configuring network access for standard and VIMAGE jails

Description

Build a libipfw to enable programmatic configuration of the firewall, implement basic functionality to add rules and configure NAT instances.

Optional: relocate most functionality available in the command line interface into the library and replace the replace the command line interface with a thin wrapper around the new library.

Build a libbsdnat that can be used by bhyve VM managers and Jail management tools to configure NAT on the host to allow the guest access to the internet via the host's network. This library will then be extended to handle creating 'port forwarding' rules to expose services in the guest to the public network via the host. Network mappings will be ephemeral and will need to be recreated by the management tools when the VM or jail is restarted.

Possible design for final tool:

• libifconfig - used to create and manage bridge interface for bhyve, epairs for jails
• libbsdnat - Configure NAT for outbound, and port forward rules for inbound.
• libipfw - Used to insert rules routing traffic via above NAT instances.

---

syzkaller improvements

syzkaller is a suite of tools that performs coverage-guided system call fuzzing. Originally targeting Linux, it can now fuzz many different operating system kernels and has been extremely effective at finding bugs, many with security implications. It creates, monitors and fuzzes a set of virtual machines running the target kernel. More information can be found in its documentation, and in these slides. Google kindly runs a public syzkaller instance targeting FreeBSD.

For a while it has been possible to run syzkaller on FreeBSD; that is, fuzz FreeBSD on FreeBSD. syzkaller makes use of ZFS and bhyve (or QEMU) to do so. This makes development and testing of FreeBSD-specific syzkaller features much easier.

Though syzkaller has found quite a few bugs in FreeBSD, it does not cover as much as it does on Linux, so it is virtually guaranteed that there are plenty of bugs waiting to be found. This project consists of several subtasks that would improve FreeBSD's coverage:

• Extend syzkaller's FreeBSD system call descriptions. For each system call, syzkaller requires a set of annotations that describe the system call's arguments. It is missing many of FreeBSD's system calls. syzkaller similarly needs to be taught about device-specific ioctls.
• Support fuzzing of FreeBSD's Linux system call compatibility layer. Since syzkaller can of course fuzz Linux natively, it should be straightforward to run a Linux fuzzer on FreeBSD.
• Support external injection of USB traffic.
• Support running the fuzzer in a jail, optionally with various resource limits in place.
• Test syzkaller with a ZFS root filesystem instead of UFS. Work with the syzkaller developers to get a FreeBSD+ZFS target running in syzbot.

• Port support for automated patch testing and crash bisection to FreeBSD. Some details are listed here.

• Work with the project mentor to triage and possibly fix any kernel bugs found in the process.

Note: contributing to syzkaller requires signing the Google CLA. Please make sure that this is acceptable before attempting this project. Note also that working with syzkaller is probably easiest on a dedicated hardware system with a reasonably large amount of disk space (several hundred GB should be sufficient), ideally running FreeBSD on ZFS. syzkaller can instantiate VMs on Google Compute Engine and fuzz them, so this may be an option as well. Please contact the project mentors for details.

---

Testing

Add more FreeBSD testing to Xen osstest

Description

The current Xen Project test system only has minimal support for FreeBSD: it's able to test a FreeBSD guest, but it's not able to setup a FreeBSD host or perform a Xen compilation on FreeBSD. This project aims to solve this by providing better integration of FreeBSD into the Xen test system (osstest).

First tasks will involve writing the necessary code so that osstest can setup a FreeBSD host and be able to build new FreeBSD host install media, so that we can start tracking FreeBSD upstream. Next steps will involve compiling Xen on FreeBSD and also generating FreeBSD guest install media, so that guests are also tracking upstream FreeBSD.

An initial attempt at this can be found on https://lists.xenproject.org/archives/html/xen-devel/2015-02/msg00280.html. The student can use part of this as a baseline if desired.

---

Audit Base for Read-Only and NFS Mount Compatibility

Description

FreeBSD has supported read-only and "root on NFS" for decades but has not experienced consistent testing for compatibility under these circumstances. Issues can include the failure of utilities to create temporary files and locking failures with "databases" such as /etc/pwd.db, /var/db/pkg/local.sqlite and /var/db/xenstore/dbf. Temporary workarounds include tmpfs(5) mounts for directories such as /var/db/<utility>, MD/MFS mounts, iSCSI/FC/ggate devices, or network-based authentication. Long-term solutions can follow the model of pkg(8)'s NFS_WITH_PROPER_LOCKING=yes option.

Search terms to help understand the problem: "NFS flock", "sqlite on NFS". Motivation: "Cloud" and "Container" environments often achieve statelessness via simple mechanisms like read-only and network file system mounts.

---

Firewall testing

Description

FreeBSD some tests for the pf firewall, based around VIMAGE jails. These tests can be extended to build a test suite for firewall functionality testing usable on all three (pf, ipfw, ipf) firewalls. Ideally the tests should be able to abstract the differences in the firewall configuration systems so that the same tests can be used on all three. Of course each firewall has unique features, so it should still be possible to write per-firewall tests (e.g. for pfsync).

---

Build infrastructure

Integrate MFSBSD into the release building tools

Description

MFSBSD is a version of FreeBSD designed to run from memory. It is often used as a rescue system, or the basis for automated installers.

It is currently maintained by a FreeBSD developer, Martin Matuška

The issue is that only images for the release versions are usually produced, and MFSBSD tends to get out of sync with the tools in base. There is a desire to have MFSBSD images of the weekly snapshots of -current and -stable that are created by the release engineering time. This requires that the process be automated as an additional target in the makefile in src/release. It would be similar to the process used now to generate VM images. Adding flexibility to the MFSBSD build system to control additional features would be a bonus

---

---

CategoryGsoc