Systemd Services: Monitoring Files and Directories

Systemd Services: Monitoring Files and Directories - Printable Version

+- Sick Gaming (https://www.sickgaming.net)
+-- Forum: Computers (https://www.sickgaming.net/forum-86.html)
+--- Forum: Linux, FreeBSD, and Unix types (https://www.sickgaming.net/forum-88.html)
+--- Thread: Systemd Services: Monitoring Files and Directories (/thread-85278.html)

Systemd Services: Monitoring Files and Directories - xSicKxBot - 06-19-2018

Systemd Services: Monitoring Files and Directories

<div style="margin: 5px 5% 10px 5%;"><img src="http://www.sickgaming.net/blog/wp-content/uploads/2018/06/systemd-services-monitoring-files-and-directories.png" width="1500" height="877" title="" alt="" /></div><div><div><img src="http://www.sickgaming.net/blog/wp-content/uploads/2018/06/systemd-services-monitoring-files-and-directories.png" class="ff-og-image-inserted" /></div>
So far in this systemd multi-part tutorial, we’ve covered <a href="https://www.linux.com/blog/learn/intro-to-linux/2018/5/writing-systemd-services-fun-and-profit">how to start and stop a service by hand</a>, <a href="https://www.linux.com/blog/learn/2018/5/systemd-services-beyond-starting-and-stopping">how to start a service when booting your OS and have it stop on power down</a>, and <a href="https://www.linux.com/blog/intro-to-linux/2018/6/systemd-services-reacting-change">how to boot a service when a certain device is detected</a>. This installment does something different yet again and covers how to create a unit that starts a service when something changes in the filesystem. For the practical example, you’ll see how you can use one of these units to extend the <a href="https://www.linux.com/blog/learn/intro-to-linux/2018/6/systemd-services-monitoring-files-and-directories">surveillance system we talked about last time</a>.
<h3>Where we left off</h3>
<a href="https://www.linux.com/blog/intro-to-linux/2018/6/systemd-services-reacting-change">Last time we saw how the surveillance system took pictures, but it did nothing with them</a>. In fact, it even overwrote the last picture it took when it detected movement so as not to fill the storage of the device.
Does that mean the system is useless? Not by a long shot. Because, you see, systemd offers yet another type of units, paths, that can help you out. Path units allow you to trigger a service when an event happens in the filesystem, say, when a file gets deleted or a directory accessed. And, overwriting an image is exactly the kind of event we are talking about here.
<h3>Anatomy of a Path Unit</h3>
A systemd path unit takes the extension .path, and it monitors a file or directory. A .path unit calls another unit (usually a .service unit with the same name) when something happens to the monitored file or directory. For example, if you have a picchanged.path unit to monitor the snapshot from your webcam, you will also have a picchanged.service that will execute a script when the snapshot is overwritten.
Path units contain a new section, <code>[Path]</code>, with few more directives. First, you have the what-to-watch-for directives:
<ul>
<li><code>PathExists=</code> monitors whether the file or directory exists. If it does, the associated unit gets triggered. <code>PathExistsGlob=</code> works in a similar fashion, but lets you use globbing, like when you use <code>ls *.jpg</code> to search for all the JPEG images in a directory. This lets you check, for example, whether a file with a certain extension exists.</li>
<li><code>PathChanged=</code> watches a file or directory and activates the configured unit whenever it changes. It is not activated on every write to the watched file but only when a monitored file open for for writing is changed and then closed. The associated unit is executed when the file is closed.</li>
<li><code>PathModified=</code>, on the other hand, does activate the unit when anything is changed in the file you are monitoring, even before you close the file.</li>
<li><code>DirectoryNotEmpty=</code> does what it says on the box, that is, it activates the associated unit if the monitored directory contains files or subdirectories.</li>
</ul>
Then, we have <code>Unit=</code> that tells the .path which .service unit to activate, in case you want to give it a different name to that of your .path unit; <code>MakeDirectory=</code> can be <code>true</code> or <code>false</code> (or <code>0</code> or <code>1</code>, or <code>yes</code> or <code>no</code>) and creates the directory you want to monitor before monitoring starts. Obviously, using <code>MakeDirectory=</code> in combination with <code>PathExists=</code> does not make sense. However, <code>MakeDirectory=</code> can be used in combination with <code>DirectoryMode=</code>, which you use to set the the mode (permissions) of the new directory. If you don’t use <code>DirectoryMode=</code>, the default permissions for the new directory are <code>0755</code>.
<h3>Building picchanged.path</h3>
All these directives are very useful, but you will be just looking for changes made to one single file, so your .path unit is very simple:
<pre>
#picchanged.path
[Unit] Wants= webcam.service [Path] PathChanged= /home/[user name]/monitor/monitor.jpg </pre>
In the <code>Unit=</code> section the line that says
<pre>
Wants= webcam.service </pre>
The <code>Wants=</code> directive is the preferred way of starting up a unit the current unit needs to work properly. <a href="https://www.linux.com/blog/intro-to-linux/2018/6/systemd-services-reacting-change"><code>webcam.service</code> is the name you gave the surveillance service that you saw in the previous article</a> and is the service that actually controls the webcam and makes it take a snap every half second. This means it’s picchanged.path that is going to start up webcam.service now, and not the <a href="https://www.linux.com/blog/intro-to-linux/2018/6/systemd-services-reacting-change">Udev rule you saw in the prior article</a>. You will use the Udev rule to start picchanged.path instead.
To summarize: the Udev rule pulls in your new picchanged.path unit, which, in turn pulls in the webcam.service as a requirement for everything to work perfectly.
The “thing” that picchanged.path monitors is the monitor.jpg file in the monitor/ directory in your home directory. As you saw last time, webcam.service called a script, checkimage.sh, took a picture at the beginning of its execution and stored it in monitor/temp.jpg. checkimage.sh then took another pic, temp.jpg, and compared it with monitor.jpg. If it found significant differences (like when somebody walks into frame) the script overwrote monitor.jpg with the temp.jpg. That is when picchanged.path fires.
As you haven’t included a <code>Unit=</code> directive in your .path, the unit systemd expects a matching picchanged.service unit which it will trigger when /home/[user name]/monitor/monitor.jpg gets modified:
<pre>
#picchanged.service
[Service] Type= simple ExecStart= /home/[user name]/bin/picmonitor.sh
</pre>
For the time being, let’s make picmonitor.sh save a time-stamped copy of monitor.jpg every time changes get detected:
<pre>
#!/bin/bash
# This is the pcmonitor.sh script cp /home/[user name]/monitor/monitor.jpg /home/[user name]/monitor/"`date`.jpg"
</pre>
<h3>Udev Changes</h3>
You have to change the custom Udev rule you wrote in <a href="https://www.linux.com/blog/intro-to-linux/2018/6/systemd-services-reacting-change">the previous installment</a> so everything works. Edit /etc/udev/rules.d/01-webcam.rules so instead of looking like this:
<pre>
ACTION=="add", SUBSYSTEM=="video4linux", ATTRS{idVendor}=="03f0", ATTRS{idProduct}=="e207", SYMLINK+="mywebcam", TAG+="systemd", MODE="0666", ENV{SYSTEMD_WANTS}="webcam.service"
</pre>
It looks like this:
<pre>
ACTION=="add", SUBSYSTEM=="video4linux", ATTRS{idVendor}=="03f0", ATTRS{idProduct}=="e207", SYMLINK+="mywebcam", TAG+="systemd", MODE="0666", ENV{SYSTEMD_WANTS}="picchanged.path"
</pre>
The new rule, instead of calling webcam.service, now calls picchanged.path when your webcam gets detected. (Note that you will have to change the <code>idVendor</code> and <code>IdProduct</code> to those of your own webcam — you saw how to find these out previously).
For the record, I also changed checkimage.sh from using PNG to JPEG images. I did this because I found some dependency problems with PNG images when working with mplayer on some versions of Debian. checkimage.sh now looks like this:
<pre>
#!/bin/bash mplayer -vo jpeg -frames 1 tv:// -tv driver=v4l2:width=640:height=480:device=
/dev/mywebcam &>/dev/null mv 00000001.jpg /home/paul/monitor/monitor.jpg while true do mplayer -vo jpeg -frames 1 tv:// -tv driver=v4l2:width=640:height=480:device=
/dev/mywebcam &>/dev/null mv 00000001.jpg /home/paul/monitor/temp.jpg imagediff=`compare -metric mae /home/paul/monitor/monitor.jpg /home/paul/monitor/temp.jpg /home/paul/monitor/diff.png 2>&1 > /dev/null | cut -f 1 -d " "` if [ `echo "$imagediff > 700.0" | bc` -eq 1 ] then mv /home/paul/monitor/temp.jpg /home/paul/monitor/monitor.jpg fi sleep 0.5 done
</pre>
<h3>Firing up</h3>
This is a multi-unit service that, when all its bits and pieces are in place, you don’t have to worry much about: you plug in the designated webcam (or boot the machine with the webcam already connected), picchanged.path gets started thanks to the Udev rule and takes over, bringing up the webcam.service and starting to check on the snaps. There is nothing else you need to do.
<h3>Conclusion</h3>
Having the process split into two doesn’t only help explain how path units work, but it’s also very useful for debugging. One service does not “touch” the other in any way, which means that you could, for example, improve the “motion detection” part, and it would be very easy to roll back if things didn’t work as expected.
Admittedly, the example is a bit goofy, as there are definitely <a href="https://www.linux.com/learn/how-operate-linux-spycams-motion">better ways of monitoring movement using a webcam</a>. But remember: the main aim of these articles is to help you learn how systemd units work within a context.
Next time, we’ll finish up with systemd units by looking at some of the other types of units available and show how to improve your home-monitoring system further by setting up service that sends images to another machine.
Learn more about Linux through the free <a href="https://training.linuxfoundation.org/linux-courses/system-administration-training/introduction-to-linux">“Introduction to Linux” </a>course from The Linux Foundation and edX.
</div>