bhyve (and jails) manageability workstream


Documents

bhyve

There is a collection of desired features for bhyve.

As of 2024/06, priorities are

  1. create course work / tutorial for EuroBSDCon helping showcase bhyve and its capabilities
  2. Understanding and identifying community needs that could be grouped into a minimum viable product (MVP)
  3. figuring out a path forward for state supervision and process handling (UCL, vmstated, bmd, etc.)
  4. redesign of snapshot and restore functionality as precursor to live migration capability; Vitaly G previously planned to look into options for redesign. Needs update.

There is also some additional tooling to help construct better overall bhyve management tooling

Documentation Improvements

We managed to land several updates to the Handbook on the topic of bhyve - big thanks to jrm@ for helping!

There are multiple potential areas for improvements. Some non exhaustive collection:

Snapshot Redesign

There is a mail thread about redesigning the snapshot file format and there have been numerous approaches to implementing live migration; the current consensus as of 2023/11 appears to be that a redesign of the snapshot file format is required first before moving into migration.

Unless file level issues are not fixed, adding migration functionality would only complicate the matter overall. As of 13.2, snapshot functionality is not enabled by default but requires activating an option in kernel configs, adding src.conf options and then recompiling world and kernel.

My tests as of 2024/02 show, that snapshot features do not yet work on and AMD CPU with 13.2-RELEASE. The attempt crashes when vmm tries to dump VHPET data.

There are also multiple limitations

ID

Title

Status

Created

Last Update

Reviewers

D26387

bhyve - Snapshot Save and Restore multiple devices

Needs Review, landed in different revision

Sep 10 2020, 10:21 AM

Jun 21 2023, 6:15 AM

jhb

D28270

Warm Migration feature for bhyve

Needs Review

Jan 21 2021, 2:19 PM

Jun 30 2021, 9:30 AM

jhb

D29262

Bhyve - Using JSON format for saving and restoring the state

Needs Review

Mar 14 2021, 5:37 PM

Jun 21 2023, 6:15 AM

jhb

D29538

bhyve: Move the gdb_active check to gdb_cpu_suspend().

Closed/Accepted

Apr 1 2021, 4:47 PM

Apr 4 2021, 8:53 AM

-

D30471

Bhyve - Capsicum integration

Needs Review, landed in different revision

May 26 2021, 3:48 PM

Jun 21 2023, 6:15 AM

jhb

D30954

Live Migration feature for bhyve

Needs Review

Jun 30 2021, 10:31 AM

Jul 26 2021, 5:45 PM

jhb

D33431

bhyve snapshot fix for AMD CPUs

Closed/Denied

Dec 14 2021, 9:22 AM

Jun 30 2022, 11:15 PM

-

D34547

bhyve - snapshot capsicum integration[Part 1]

Needs Review

Mar 14 2022, 1:41 PM

Jun 21 2023, 6:15 AM

rew

D34717

Warm Migration feature for bhyve [Part 1]

Closed/Accepted

Mar 31 2022, 6:36 AM.

Jun 19 2023, 6:55 AM

rew, imp, corvink

D34718

Warm Migration feature for bhyve [Part 2]

Needs Revision

Mar 31 2022, 6:47 AM

Tue, Nov 7, 7:59 PM

(no:)afedorov, markj, jhb, rew

D34719

Warm Migration feature for bhyve [Part 3]

Needs Review, Changes Requested

Mar 31 2022, 6:50 AM

Jun 20 2023, 11:42 AM

afedorov, (no:)gusev dot vitaliy at gmail.com

D34720

Warm Migration feature for bhyve [Part 4]

Needs Review

Mar 31 2022, 6:53 AM

Jun 23 2023, 5:34 AM

corvink

D34721

Warm Migration feature for bhyve [Part 5]

Needs Review

Mar 31 2022, 6:56 AM

Jun 14 2023, 3:29 PM

corvink

D34722

Live Migration feature for bhyve [Part 1]

Needs Review

Mar 31 2022, 6:57 AM

Jun 14 2023, 3:30 PM

corvink

D34811

Live Migration feature for bhyve [Part 2]

Needs Review

Apr 6 2022, 11:52 PM

Jun 14 2023, 3:30 PM

corvink

D34813

Live Migration feature for bhyve [Part 3]

Abandoned

Apr 6 2022, 11:53 PM

May 18 2023, 10:08 PM

None

ChrisMoerz/bhyve_management (last edited 2024-06-18T05:46:57+0000 by ChrisMoerz)