This article is part of a series of articles that takes a closer look at Btrfs, the default filesystem for Fedora Workstation and Fedora Silverblue since Fedora Linux 33.<\/p>\n
In case you missed it, here’s the previous article from the series: https:\/\/fedoramagazine.org\/working-with-btrfs-general-concepts\/<\/a><\/p>\n <\/span> <\/p>\n Subvolumes allow for the partitioning of a Btrfs filesystem into separate sub-filesystems. This means that you can mount subvolumes from a Btrfs filesystem as if they were independent filesystems. In addition, you can, for example, define the maximum space a subvolume may take up via qgroups (We’ll talk about this in another article in this series), or use subvolumes to specifically include or exclude files from snapshots (We’ll talk about this, too, in another article in this series). Every default Fedora Workstation and Fedora Silverblue installation since Fedora Linux 33 makes use of subvolumes. In this article we will explore how it works.<\/p>\n Below you will find a lot of examples related to subvolumes. If you want to follow along, you must have access to some Btrfs filesystem and root access. You can verify whether your \/home\/<\/em> directory is Btrfs via the following command:<\/p>\n This command will output the name of the filesystem of your \/home\/<\/em> directory. If it says btrfs<\/em>, you’re all set. Let’s create a new directory to perform some experiments in:<\/p>\n In the text below, you will find lots of command outputs in boxes such as shown above. Please keep in mind while reading\/comparing command outputs that the box contents are wrapped at the end of the line<\/strong>. This makes it difficult to recognize long lines that are broken across multiple lines for readability. When in doubt, try to resize your browser window and see how the text behaves!<\/p>\n<\/p>\n We can create a Btrfs subvolume with the following command:<\/p>\n When we inspect the current directory we will see that it now has a new folder named first<\/em>. Note the first character d<\/em> in the output below:<\/p>\n We can handle this like any regular folder: We can rename it, move it, create new files and folders inside, etc. Note that the folder belongs to root, so we must be root to do these things.<\/p>\n If it acts like a folder and looks like a folder, how do we know whether it’s a Btrfs subvolume? We can use the btrfs<\/em> tools to list all subvolumes:<\/p>\n If you’re on a recent and unmodified Fedora Linux installation you will likely see the same output as above. We will inspect home<\/em> and root<\/em> as well as the meaning of all the numbers later. For now, we see that there is a subvolume at the path we specified. We can limit the output to the subvolumes below our current location:<\/p>\n Let’s rename the subvolume:<\/p>\n We can also nest subvolumes:<\/p>\n And we can also remove subvolumes, either like we remove folders:<\/p>\n or via special Btrfs commands:<\/p>\n The introduction mentioned that Btrfs subvolumes act like separate filesystems. This means that we can mount subvolumes and pass some mount options to them. First we will create a small folder structure to get a better understanding of what happens:<\/p>\n Here’s what the structure looks like:<\/p>\n Verify that there is now a new Btrfs subvolume:<\/p>\n To mount the subvolume we must know the path of the block device where the Btrfs filesystem subvolume resides. The following command tells us:<\/p>\n Now we can mount the subvolume. Make sure you replace the arguments with the values for your PC:<\/p>\n Observe that we use the -o<\/em> flag to give additional options to the mount program. In this case we tell it to mount the subvolume with name home\/hartan\/btrfs-subvolume-test\/a\/2<\/em> from the btrfs filesystem on device \/dev\/vda3<\/em>. This is a Btrfs-specific option and isn’t available in other filesystems.<\/p>\n We see that the directory structure has changed:<\/p>\n Note that the file e<\/em> exists twice now and d<\/em> is gone. We are now able to access the same Btrfs subvolume by two different paths. All changes we perform in either of the paths are immediately reflected in all other locations:<\/p>\n Let’s play some more with the mount options. For example we can mount the subvolume as read-only under a\/1\/b<\/em> like this (Insert arguments for your PC!):<\/p>\n We use the same command as above, except that we add ro<\/em> at the end. Now we can no longer create files via this mount:<\/p>\n but accessing the subvolume directly still works like before:<\/p>\n Don’t forget to clean up before we move on:<\/p>\n Oh no, what happened? Well, since we mounted the subvolume read-only<\/em> above, we cannot delete it. A deletion from a filesystems’ perspective is a write operation: To delete a\/1\/b\/e<\/em>,<\/strong> we remove the directory entry for e<\/strong><\/em> from the directory contents of its parent directory, a\/1\/b<\/strong><\/em> in this case. In other words, we must write<\/em> to a\/1\/b<\/em> <\/strong>to tell it that e<\/strong><\/em> doesn’t exist any longer. So first we unmount the subvolume again, and then we remove the folder:<\/p>\n Remember the first output of the subvolume list<\/em> subcommand? That contained a lot of numbers, so let’s see what that is all about. I copied the output here to take another look:<\/p>\n We see there are three columns of numbers, each prefixed with a few letters to describe what they do. The first column of numbers is a subvolumes ID. Subvolume IDs are unique in a Btrfs filesystem and as such uniquely identify subvolumes. This means that the subvolume named home<\/em> can also be referred to by its ID 256<\/strong>. In the mount command above we wrote:<\/p>\n Another perfectly legal option is to use subvolume IDs:<\/p>\n Subvolume IDs start at 256<\/strong> and increase by 1 for every created subvolume. There is however one exception to this: The filesystem root always has the subvolume name \/<\/em> and the subvolume ID 5. That is right, even the root of a Btrfs filesystem is technically a subvolume. This is just implicitly known, hence it doesn’t show up in the output of btrfs subvolume list<\/em>. If you mount a Btrfs filesystem without the subvol<\/em> or subvolid<\/em> argument, the root subvolume with subvolid=5<\/em> is assumed as default. Below we’ll see an example of when one may want to explicitly mount the filesystem root.<\/p>\n The second column of numbers is the generation counter and incremented on every Btrfs transaction. This is mostly an internal counter and won’t be discussed further here.<\/p>\n Finally, the third column of numbers is the subvolume ID of the subvolumes parent<\/em>. In the output above we see that both subvolume home<\/em> and root<\/em> have 5 as their parent subvolume ID. Remember that ID 5 has a special meaning: It is the filesystem root. So we know that home<\/em> and root<\/em> are children to the root subvolume. hartan\/btrfs-subvolume-test\/first <\/em>on the other hand is a child of the subvolume with ID 256, which in our case is home<\/em>.<\/p>\n In the next section we have a look at where the subvolumes root<\/em> and home<\/em> come from.<\/p>\n<\/p>\n When you create a new Btrfs filesystem from scratch, there will be no subvolumes in it (Except of course for the root subvolume). So where do the home<\/em> and root<\/em> subvolumes in Fedora Linux come from?<\/p>\n These are created by the installer at install time. Traditional installations would often include a separate filesystem partition for the \/<\/em> and \/home<\/em> directories. During boot, these are then appropriately mounted to assemble one full filesystem. But there is an issue with this approach: Unless you use technologies such as lvm<\/em>, it is very hard to change a partitions size at some point in the future. As a consequence you may end up in a situation where either your \/<\/em> or \/home<\/em> runs out of space, while the respective other partition has lots of unused, free space left.<\/p>\n Since Btrfs subvolumes are all part of the same filesystem, they will share the space that the underlying filesystem offers. Remember when we created the subvolumes above? We never told Btrfs how big they are: A subvolume can take up all the space the filesystem has, by default nothing keeps it from doing so. However, we could<\/em> dynamically impose size limits via Btrfs qgroups, which can also be modified during runtime (And we’ll see how in a later article in this series).<\/p>\n Another advantage of separating \/<\/em> and \/home<\/em> is that we can take snapshots<\/em> separately. A subvolume is a boundary for snapshots, and snapshots will never contain the contents of other subvolumes below the subvolume that the snapshot is taken of. More details on snapshots follow in the next article in this series.<\/p>\n Enough of the theory! Let’s see what this is all about. First ensure that your root filesystem is in fact of type Btrfs:<\/p>\n And then get the partition it resides on:<\/p>\n Remember we can mount the filesystem root by its special subvolume ID 5 (Adapt the filesystem partition!):<\/p>\n And there are the subvolumes of our Fedora Linux installation! But how does Fedora Linux know that the subvolume root<\/em> belongs to \/<\/em>, and home<\/em> belongs to \/home<\/em>?<\/p>\n The file \/etc\/fstab<\/em> contains so-called static information about the filesystem. In simple terms, during booting your system reads this file, line by line, and mounts all the filesystems listed there. On my system, the file looks like this:<\/p>\n (Note that the “UUID” lines above have been wrapped into two lines)<\/p>\n The UUID<\/em> at the beginning of each line is simply a means to identify disks and filesystem partitions in your system (roughly equivalent to \/dev\/vda3<\/em> as I used above). The second column is the path in the filesystem tree where this filesystem should be mounted. The third column is the filesystem type. We see that the entries for \/<\/em> and \/home<\/em> are of type btrfs<\/em>, just what we expect! Finally, in the fourth column we see the magic: These are the mount options, and there it says to mount \/<\/em> with the option subvol=root<\/em>. That is exactly the subvolume we saw in the output of btrfs subvolume list \/<\/em> all the time!<\/p>\n With this information, we can reconstruct the call to mount<\/em> that creates this filesystem entry:<\/p>\n And that is how Fedora Linux uses Btrfs subvolumes! If you’re curious as to why Fedora Linux decided to use Btrfs as the default filesystem, refer to the change proposal linked below [1]<\/a>.<\/p>\n<\/p>\n The Btrfs wiki has additional information on subvolumes and most importantly on the mount options that can be applied to Btrfs subvolumes. Some options, like compress<\/em> can only be applied on a filesystem-wide level and thus affect all subvolumes of a Btrfs filesystem. You can find the entry linked below [2]<\/a>.<\/p>\n If you find it confusing to tell which directories are plain directories and which are subvolumes, you can feel free to adopt a special naming convention for your subvolumes. For example, you could prefix your subvolume names with an “@” to make them easily distinguishable.<\/p>\n Now that you know that subvolumes behave like filesystems, one may ask how best to place a subvolume in a certain location. Say you want a Btrfs subvolume under ~\/games<\/em>, where your home directory (~<\/em>) is itself a subvolume, how can you achieve that? Given the example above, you may use a command like sudo btrfs subvolume create ~\/games<\/em>. This way, you create so-called nested<\/em> subvolumes: Inside your subvolume ~<\/em>, there is now a subvolume games<\/em>. That is a perfectly fine way to approach this situation.<\/p>\n Another valid solution is to do what Fedora does by default: Create all subvolumes under the root subvolume (i.e. such that their parent subvolume ID is 5), and mount them into the appropriate locations. The Btrfs wiki has an overview of these approaches along with a short discussion about their respective implications on filesystem management [5]<\/a>.<\/p>\n<\/p>\n In this article we discovered Btrfs subvolumes, which act like separate Btrfs filesystems inside a Btrfs filesystem. We learned how to create, mount and delete subvolumes. Finally, we explored how Fedora Linux makes use of subvolumes – without us noticing at all.<\/p>\n The next articles in this series will deal with:<\/p>\n If there are other topics related to Btrfs that you want to know more about, have a look at the Btrfs Wiki [3]<\/a> and Docs [4]<\/a>. Don’t forget to check out the first article of this series, if you haven’t already! If you feel that there is something missing from this article series, let us know in the comments below. See you in the next article!<\/p>\n<\/p>\n [1]: https:\/\/fedoraproject.org\/wiki\/Changes\/BtrfsByDefault#Benefit_to_Fedora<\/a> This article is part of a series of articles that takes a closer look at Btrfs, the default filesystem for Fedora Workstation and Fedora Silverblue since Fedora Linux 33. In case you missed it, here’s the previous article from the series: https:\/\/fedoramagazine.org\/working-with-btrfs-general-concepts\/ Introduction Subvolumes allow for the partitioning of a Btrfs filesystem into separate sub-filesystems. […]<\/p>\n","protected":false},"author":2,"featured_media":0,"comment_status":"open","ping_status":"closed","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[48],"tags":[45,61,46,47],"class_list":["post-130213","post","type-post","status-publish","format-standard","hentry","category-fedora-os","tag-fedora","tag-fedora-project-community","tag-magazine","tag-news"],"_links":{"self":[{"href":"https:\/\/sickgaming.net\/blog\/wp-json\/wp\/v2\/posts\/130213","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/sickgaming.net\/blog\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/sickgaming.net\/blog\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/sickgaming.net\/blog\/wp-json\/wp\/v2\/users\/2"}],"replies":[{"embeddable":true,"href":"https:\/\/sickgaming.net\/blog\/wp-json\/wp\/v2\/comments?post=130213"}],"version-history":[{"count":0,"href":"https:\/\/sickgaming.net\/blog\/wp-json\/wp\/v2\/posts\/130213\/revisions"}],"wp:attachment":[{"href":"https:\/\/sickgaming.net\/blog\/wp-json\/wp\/v2\/media?parent=130213"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/sickgaming.net\/blog\/wp-json\/wp\/v2\/categories?post=130213"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/sickgaming.net\/blog\/wp-json\/wp\/v2\/tags?post=130213"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}Introduction<\/h2>\n
$ findmnt -no FSTYPE \/home\nbtrfs<\/pre>\n
$ mkdir ~\/btrfs-subvolume-test\n$ cd ~\/btrfs-subvolume-test<\/pre>\n
Creating and playing with subvolumes<\/h2>\n
$ sudo btrfs subvolume create first\nCreate subvolume '.\/first'<\/pre>\n
$ ls -l\ntotal 0\ndrwxr-xr-x. 1 root root 0 Oct 15 18:09 first<\/pre>\n
$ sudo btrfs subvolume list .\nID 256 gen 30 top level 5 path home\nID 257 gen 30 top level 5 path root\nID 258 gen 25 top level 257 path root\/var\/lib\/machines\nID 259 gen 29 top level 256 path hartan\/btrfs-subvolume-test\/first<\/pre>\n
$ sudo btrfs subvolume list -o .\nID 259 gen 29 top level 256 path home\/hartan\/btrfs-subvolume-test\/first<\/pre>\n
$ sudo mv first second\n$ sudo btrfs subvolume list -o .\nID 259 gen 29 top level 256 path home\/hartan\/btrfs-subvolume-test\/second<\/pre>\n
$ sudo btrfs subvolume create second\/third\nCreate subvolume 'second\/third'\n$ sudo btrfs subvolume list .\nID 256 gen 34 top level 5 path home\nID 257 gen 37 top level 5 path root\nID 258 gen 25 top level 257 path root\/var\/lib\/machines\nID 259 gen 37 top level 256 path hartan\/btrfs-subvolume-test\/second\nID 260 gen 37 top level 259 path hartan\/btrfs-subvolume-test\/second\/third<\/pre>\n
$ sudo rm -r second\/third<\/pre>\n
$ sudo btrfs subvolume delete second\nDelete subvolume (no-commit): '\/home\/hartan\/btrfs-subvolume-test\/second'<\/pre>\n<\/p>\n
Handling Btrfs subvolumes like separate filesystems<\/h2>\n
$ mkdir -p a a\/1 a\/1\/b\n$ sudo btrfs subvolume create a\/2\nCreate subvolume 'a\/2'\n$ sudo touch a\/1\/c a\/1\/b\/d a\/2\/e<\/pre>\n
$ tree\n.\n\u2514\u2500\u2500 a \u251c\u2500\u2500 1 \u2502 \u251c\u2500\u2500 b \u2502 \u2502 \u2514\u2500\u2500 d \u2502 \u2514\u2500\u2500 c \u2514\u2500\u2500 2 \u2514\u2500\u2500 e 4 directories, 3 files<\/pre>\n
$ sudo btrfs subvolume list -o .\nID 261 gen 41 top level 256 path home\/hartan\/btrfs-subvolume-test\/a\/2<\/pre>\n
$ findmnt -vno SOURCE \/home\/\n\/dev\/vda3<\/pre>\n
$ sudo mount -o subvol=home\/hartan\/btrfs-subvolume-test\/a\/2 \/dev\/vda3 a\/1\/b<\/pre>\n
$ tree\n.\n\u2514\u2500\u2500 a \u251c\u2500\u2500 1 \u2502 \u251c\u2500\u2500 b \u2502 \u2502 \u2514\u2500\u2500 e \u2502 \u2514\u2500\u2500 c \u2514\u2500\u2500 2 \u2514\u2500\u2500 e 4 directories, 3 files<\/pre>\n
$ sudo touch a\/1\/b\/x\n$ ls -lA a\/2\ntotal 0\n-rw-r--r--. 1 root root 0 Oct 15 18:14 e\n-rw-r--r--. 1 root root 0 Oct 15 18:16 x<\/pre>\n
$ sudo umount a\/1\/b\n$ sudo mount -o subvol=home\/hartan\/btrfs-subvolume-test\/a\/2,ro \/dev\/vda3 a\/1\/b<\/pre>\n
$ sudo touch a\/1\/b\/y\ntouch: cannot touch 'a\/1\/b\/y': Read-only file system<\/pre>\n
$ sudo touch a\/2\/y\n$ tree\n.\n\u2514\u2500\u2500 a \u251c\u2500\u2500 1 \u2502 \u251c\u2500\u2500 b \u2502 \u2502 \u251c\u2500\u2500 e \u2502 \u2502 \u251c\u2500\u2500 x \u2502 \u2502 \u2514\u2500\u2500 y \u2502 \u2514\u2500\u2500 c \u2514\u2500\u2500 2 \u251c\u2500\u2500 e \u251c\u2500\u2500 x \u2514\u2500\u2500 y 4 directories, 7 files<\/pre>\n
$ sudo rm -rf a\nrm: cannot remove 'a\/1\/b\/e': Read-only file system\nrm: cannot remove 'a\/1\/b\/x': Read-only file system\nrm: cannot remove 'a\/1\/b\/y': Read-only file system<\/pre>\n
$ sudo umount a\/1\/b\n$ sudo rm -rf a\n$ tree\n. 0 directories, 0 files<\/pre>\n<\/p>\n
Subvolume IDs<\/h2>\n
ID 256 gen 30 top level 5 path home\nID 257 gen 30 top level 5 path root\nID 258 gen 25 top level 257 path root\/var\/lib\/machines\nID 259 gen 29 top level 256 path hartan\/btrfs-subvolume-test\/first<\/pre>\n
$ sudo mount -o subvol=hartan\/...<\/pre>\n
$ sudo mount -o subvolid=...<\/pre>\n
Inspecting default subvolumes in Fedora Linux<\/h2>\n
$ findmnt -no FSTYPE \/\nbtrfs<\/pre>\n
$ findmnt -vno SOURCE \/\n\/dev\/vda3<\/pre>\n
$ mkdir fedora-rootsubvol\n$ sudo mount -o subvolid=5 \/dev\/vda3 .\/fedora-rootsubvol\n$ ls fedora-rootsubvol\/\nhome root<\/pre>\n
$ cat \/etc\/fstab\n# [ ... ]\n# \/etc\/fstab\n# Created by anaconda on Sat Oct 15 12:01:57 2022\n# [ ... ]\n#\nUUID=5e4e42bb-4f2f-4f0e-895f-d1a46ea47807 \/ btrfs subvol=root,compress=zstd:1 0 0\nUUID=e3a798a8-b8f2-40ca-9da7-5e292a6412aa \/boot ext4 defaults 1 2\nUUID=5e4e42bb-4f2f-4f0e-895f-d1a46ea47807 \/home btrfs subvol=home,compress=zstd:1 0 0<\/pre>\n
$ sudo mount -o subvol=root,compress=zstd:1 UUID=5e4e42bb-4f2f-4f0e-895f-d1a46ea47807 \/<\/pre>\n
(again, the line above has been wrapped into two)<\/pre>\n
More on Btrfs subvolumes<\/h2>\n
Conclusion<\/h2>\n
\n
Sources<\/h2>\n
[2]: https:\/\/btrfs.readthedocs.io\/en\/latest\/Subvolumes.html<\/a>
[3]: https:\/\/btrfs.wiki.kernel.org\/index.php\/Main_Page<\/a>
[4]: https:\/\/btrfs.readthedocs.io\/en\/latest\/Introduction.html<\/a>
[5]: https:\/\/btrfs.wiki.kernel.org\/index.php\/SysadminGuide#Layout<\/a><\/p>\n","protected":false},"excerpt":{"rendered":"