<span style=" font-size:12pt;font-family:Calibri">Hello Heiner,</span><br><br><span style=" font-size:12pt;font-family:Calibri">just a heads up for
you and the other storage admins, regularly cleaning up /tmp, regarding
one aspect to keep in mind:</span><br><br><span style=" font-size:12pt;font-family:Calibri">- If you are using
Spectrum Scale software call home (mmcallhome), it would be using the directory<b>${dataStructureDump}/callhome</b> to save the copies of the uploaded data.</span><br><span style=" font-size:12pt;font-family:Calibri">
This would be<b> /tmp/mmfs/callhome</b>/ in your case, which
you would be automatically regularly removing.</span><br><span style=" font-size:12pt;font-family:Calibri">- <b>These copies
are used</b> by one of the features of call home: "mmcallhome status
diff"</span><br><span style=" font-size:12pt;font-family:Calibri">
- This feature allows to see an overview of the Spectrum
Scale configuration changes, that occurred between 2 different points in
time.</span><br><span style=" font-size:12pt;font-family:Calibri">
- This effectively allows to quickly find out if any config
changes occurred prior to an outage, thereby helping to find the root cause
of self-caused problems in the Scale cluster.</span><br><span style=" font-size:12pt;font-family:Calibri">
- It was added in Scale 5.0.5.0</span><br><span style=" font-size:12pt;font-family:Calibri">
See IBM KC for more details: </span><a href="https://www.ibm.com/docs/en/spectrum-scale/5.1.0?topic=cch-use-cases-detecting-system-changes-by-using-mmcallhome-command"><span style=" font-size:12pt;color:blue;font-family:Calibri">https://www.ibm.com/docs/en/spectrum-scale/5.1.0?topic=cch-use-cases-detecting-system-changes-by-using-mmcallhome-command</span></a><br><br><span style=" font-size:12pt;font-family:Calibri">
- As a source of the "config snapshots", mmcallhome
status diff is using the DC packages inside of <b>${dataStructureDump}/callhome</b>,
which you would be regularly deleting, thereby hugely reducing the usability
of this particular feature.</span><span style=" font-size:12pt;font-family:sans-serif"><br></span><span style=" font-size:12pt;font-family:Calibri">- Of course, software
call home automatically makes sure, it will not use too much space in <b>dataStructureDump</b>and it automatically removes the oldest entries, keeping at most 2GB or
300 files inside (default values, configurable).</span><br><br><span style=" font-size:9pt;font-family:Arial">Mit freundlichen Grüßen
/ Kind regards</span><br><br><span style=" font-size:11pt;font-family:Arial"><b>Pavel Safre</b></span><br><br><span style=" font-size:8pt;color:#0060a0;font-family:Arial">Software
Engineer</span><br><span style=" font-size:8pt;color:#0060a0;font-family:Arial">IBM Systems
Group, IBM Spectrum Scale Development</span><br><span style=" font-size:8pt;color:#0060a0;font-family:Arial">Dept.
M925</span><table width=800 style="border-collapse:collapse;"><tr height=8><td width=800 colspan=4 style="border-style:none none none none;border-color:#000000;border-width:0px 0px 0px 0px;padding:0px 0px;"><hr><tr height=8><td width=800 colspan=4 style="border-style:none none none none;border-color:#000000;border-width:0px 0px 0px 0px;padding:0px 0px;"><tr height=8><td width=75 style="border-style:none none none none;border-color:#000000;border-width:0px 0px 0px 0px;padding:0px 0px;"><span style=" font-size:8pt;color:#0060a0;font-family:Arial">Phone:</span><td width=274 style="border-style:none none none none;border-color:#000000;border-width:0px 0px 0px 0px;padding:0px 0px;"><td width=329 style="border-style:none none none none;border-color:#000000;border-width:0px 0px 0px 0px;padding:0px 0px;"><span style=" font-size:8pt;color:#0060a0;font-family:Arial"> IBM
Deutschland Research & Development GmbH</span><td width=119 rowspan=3 style="border-style:none none none none;border-color:#000000;border-width:0px 0px 0px 0px;padding:0px 0px;"><div align=right><img align=bottom src=https://dimzapp05.ais.mainz.de.ibm.com/i_dir/ibmmcigen.nsf/mci/ibm.gif src=cid:_1_0D6BCFA00D6BCA14004BE93AC1258792 width=87 height=30 style="border:0px solid;"></div><tr height=8><td width=75 style="border-style:none none none none;border-color:#000000;border-width:0px 0px 0px 0px;padding:0px 0px;"><span style=" font-size:8pt;color:#0060a0;font-family:Arial">Email:</span><td width=274 style="border-style:none none none none;border-color:#000000;border-width:0px 0px 0px 0px;padding:0px 0px;"><span style=" font-size:8pt;color:#0060a0;font-family:Arial">psafre@de.ibm.com</span><td width=329 style="border-style:none none none none;border-color:#000000;border-width:0px 0px 0px 0px;padding:0px 0px;"><span style=" font-size:8pt;color:#0060a0;font-family:Arial"> Wilhelm-Fay-Straße
32</span><tr height=8><td width=75 style="border-style:none none none none;border-color:#000000;border-width:0px 0px 0px 0px;padding:0px 0px;"><td width=274 style="border-style:none none none none;border-color:#000000;border-width:0px 0px 0px 0px;padding:0px 0px;"><td width=329 style="border-style:none none none none;border-color:#000000;border-width:0px 0px 0px 0px;padding:0px 0px;"><span style=" font-size:8pt;color:#0060a0;font-family:Arial"> 65936
Frankfurt am Main</span><tr height=8><td width=800 colspan=4 style="border-style:none none none none;border-color:#000000;border-width:0px 0px 0px 0px;padding:0px 0px;"><hr><tr height=8><td width=800 colspan=4 style="border-style:none none none none;border-color:#000000;border-width:0px 0px 0px 0px;padding:0px 0px;"><a href="https://www.ibm.com/privacy/us/en/"><span style=" font-size:8pt;color:blue;font-family:Arial"><u>IBM
Data Privacy Statement</u></span></a><span style=" font-size:8pt;color:#a2a2a2;font-family:Arial"></span><tr height=8><td width=800 colspan=4 style="border-style:none none none none;border-color:#000000;border-width:0px 0px 0px 0px;padding:0px 0px;"><span style=" font-size:8pt;color:#a2a2a2;font-family:Arial">IBM
Deutschland Research & Development GmbH / Vorsitzender des Aufsichtsrats:
Gregor Pillen<br>Geschäftsführung: Dirk Wittkopp<br>Sitz der Gesellschaft: Böblingen / Registergericht: Amtsgericht Stuttgart,
HRB 243294 </span></table><p style="margin-top:0px;margin-Bottom:0px"></p><br><br><br><br><span style=" font-size:9pt;color:#5f5f5f;font-family:sans-serif">From:
</span><span style=" font-size:9pt;font-family:sans-serif">"Billich
Heinrich Rainer (ID SD)" <heinrich.billich@id.ethz.ch></span><br><span style=" font-size:9pt;color:#5f5f5f;font-family:sans-serif">To:
</span><span style=" font-size:9pt;font-family:sans-serif">"gpfsug
main discussion list" <gpfsug-discuss@spectrumscale.org></span><br><span style=" font-size:9pt;color:#5f5f5f;font-family:sans-serif">Date:
</span><span style=" font-size:9pt;font-family:sans-serif">16.11.2021
17:44</span><br><span style=" font-size:9pt;color:#5f5f5f;font-family:sans-serif">Subject:
</span><span style=" font-size:9pt;font-family:sans-serif">[EXTERNAL]
Re: [gpfsug-discuss] /tmp/mmfs vanishes randomly?</span><br><span style=" font-size:9pt;color:#5f5f5f;font-family:sans-serif">Sent
by: </span><span style=" font-size:9pt;font-family:sans-serif">gpfsug-discuss-bounces@spectrumscale.org</span><br><hr noshade><br><br><p style="margin-top:0px;margin-Bottom:0px"><span style=" font-size:12pt;font-family:Calibri">Hello
Olaf,</span></p><p style="margin-top:0px;margin-Bottom:0px"><span style=" font-size:12pt;font-family:Calibri"> </span></p><p style="margin-top:0px;margin-Bottom:0px"><span style=" font-size:12pt;font-family:Calibri">Thank
you, you are right. I was ignorant about the systemd-tmpfiles* services
and timers. The cleanup in /tmp wasn’t present in RHEL7, at least not
on our nodes. I consider to modify the configuration a bit to keep the
directory /tmp/mmfs - or even create it – but to clean it’s
content .</span></p><p style="margin-top:0px;margin-Bottom:0px"><span style=" font-size:12pt;font-family:Calibri"> </span></p><p style="margin-top:0px;margin-Bottom:0px"><span style=" font-size:12pt;font-family:Calibri">Best
regards,</span></p><p style="margin-top:0px;margin-Bottom:0px"><span style=" font-size:12pt;font-family:Calibri"> </span></p><p style="margin-top:0px;margin-Bottom:0px"><span style=" font-size:12pt;font-family:Calibri">Heiner</span></p><p style="margin-top:0px;margin-Bottom:0px"><span style=" font-size:12pt;font-family:Calibri"> </span></p><p style="margin-top:0px;margin-Bottom:0px"><span style=" font-size:12pt;font-family:Calibri"><b>From:
</b><gpfsug-discuss-bounces@spectrumscale.org> on behalf of Olaf
Weiser <olaf.weiser@de.ibm.com><b><br>Reply to: </b>gpfsug main discussion list <gpfsug-discuss@spectrumscale.org><b><br>Date: </b>Monday, 8 November 2021 at 10:53<b><br>To: </b>"gpfsug-discuss@spectrumscale.org" <gpfsug-discuss@spectrumscale.org><b><br>Cc: </b>"gpfsug-discuss@spectrumscale.org" <gpfsug-discuss@spectrumscale.org><b><br>Subject: </b>Re: [gpfsug-discuss] /tmp/mmfs vanishes randomly?</span></p><p style="margin-top:0px;margin-Bottom:0px"><span style=" font-size:12pt;font-family:Calibri"> </span></p><p style="margin-top:0px;margin-Bottom:0px"><span style=" font-size:12pt;font-family:Arial">Hallo
Heiner,</span></p><p style="margin-top:0px;margin-Bottom:0px"><span style=" font-size:12pt;font-family:Arial"> </span></p><p style="margin-top:0px;margin-Bottom:0px"><span style=" font-size:12pt;font-family:Arial">multiple
levels of answers..</span></p><p style="margin-top:0px;margin-Bottom:0px"><span style=" font-size:12pt;font-family:Arial"> </span></p><p style="margin-top:0px;margin-Bottom:0px"><span style=" font-size:12pt;font-family:Arial">(1st)
... it the directory is not there, the gpfs trace would create it automatically
- just like this:</span></p><p style="margin-top:0px;margin-Bottom:0px"><span style=" font-size:12pt;font-family:Courier New">[root@ess5-ems1
~]# ls -l /tmp/mmfs <br>ls: cannot access '/tmp/mmfs': No such file or directory<br>[root@ess5-ems1 ~]# mmtracectl --start -N ems5k.mmfsd.net<br>mmchconfig: Command successfully completed<br>mmchconfig: Propagating the cluster configuration data to all<br> affected nodes. This is an asynchronous process.<br>[root@ess5-ems1 ~]# <br>[root@ess5-ems1 ~]# <br>[root@ess5-ems1 ~]# ls -l /tmp/mmfs
<br>total 0<br>-rw-r--r-- 1 root root 0 Nov 8 10:47 lxtrace.trcerr.ems5k<br>[root@ess5-ems1 ~]# </span><span style=" font-size:12pt;font-family:Arial"><br><br> </span></p><p style="margin-top:0px;margin-Bottom:0px"><span style=" font-size:12pt;font-family:Arial">(2nd)
I think - the cleaning of /tmp is something done by the OS -</span></p><p style="margin-top:0px;margin-Bottom:0px"><span style=" font-size:12pt;font-family:Courier New">please
check - </span></p><p style="margin-top:0px;margin-Bottom:0px"><span style=" font-size:12pt;font-family:Courier New">systemctl
status systemd-tmpfiles-setup.service</span></p><p style="margin-top:0px;margin-Bottom:0px"><span style=" font-size:12pt;font-family:Arial">or
look at this config file</span></p><p style="margin-top:0px;margin-Bottom:0px"><span style=" font-size:12pt;font-family:Courier New">[root@ess5-ems1
~]# cat /usr/lib/tmpfiles.d/tmp.conf <br># This file is part of systemd.<br>#<br># systemd is free software; you can redistribute it and/or modify
it<br># under the terms of the GNU Lesser General Public License as published
by<br># the Free Software Foundation; either version 2.1 of the License,
or<br># (at your option) any later version.<br><br># See tmpfiles.d(5) for details<br><br># Clear tmp directories separately, to make them easier to override<br>q /tmp 1777 root root 10d<br>q /var/tmp 1777 root root 30d<br><br># Exclude namespace mountpoints created with PrivateTmp=yes<br>x /tmp/systemd-private-%b-*<br>X /tmp/systemd-private-%b-*/tmp<br>x /var/tmp/systemd-private-%b-*<br>X /var/tmp/systemd-private-%b-*/tmp<br><br># Remove top-level private temporary directories on each boot<br>R! /tmp/systemd-private-*<br>R! /var/tmp/systemd-private-*<br>[root@ess5-ems1 ~]# </span><span style=" font-size:12pt;font-family:Arial"><br> </span></p><p style="margin-top:0px;margin-Bottom:0px"><span style=" font-size:12pt;font-family:Arial"> </span></p><p style="margin-top:0px;margin-Bottom:0px"><span style=" font-size:12pt;font-family:Arial">hope
this helps -</span></p><p style="margin-top:0px;margin-Bottom:0px"><span style=" font-size:12pt;font-family:Arial">cheers</span></p><p style="margin-top:0px;margin-Bottom:0px"><span style=" font-size:12pt;font-family:Arial"> </span></p><p style="margin-top:0px;margin-Bottom:0px"><span style=" font-size:12pt;font-family:Arial"> </span></p><p style="margin-top:0px;margin-Bottom:0px"><span style=" font-size:12pt;font-family:Arial"> </span></p><p style="margin-top:0px;margin-Bottom:0px"><span style=" font-size:12pt;font-family:Arial">Mit
freundlichen Grüßen / Kind regards</span></p><p style="margin-top:0px;margin-Bottom:0px"><span style=" font-size:12pt;font-family:Arial"> <br>Olaf Weiser<br> <br>IBM Systems, SpectrumScale Client Adoption<br>-------------------------------------------------------------------------------------------------------------------------------------------<br>IBM Deutschland<br>IBM Allee 1<br>71139 Ehningen<br>Phone: +49-170-579-44-66<br>E-Mail: olaf.weiser@de.ibm.com<br>-------------------------------------------------------------------------------------------------------------------------------------------<br>IBM Deutschland GmbH / Vorsitzender des Aufsichtsrats: Martin Jetter<br>Geschäftsführung: Gregor Pillen (Vorsitzender), Agnes Heftberger, Norbert
Janzen, Markus Koerner, Christian Noll, Nicole Reimer<br>Sitz der Gesellschaft: Ehningen / Registergericht: Amtsgericht Stuttgart,
HRB 14562 / WEEE-Reg.-Nr. DE 99369940</span></p><p style="margin-top:0px;margin-Bottom:0px"><span style=" font-size:12pt;font-family:Arial"> </span></p><p style="margin-top:0px;margin-Bottom:0px"><span style=" font-size:12pt;font-family:Arial"> </span></p><p style="margin-top:0px;margin-Bottom:0px"><span style=" font-size:12pt;font-family:Arial"> </span></p><p style="margin-top:0px;margin-Bottom:0px"><span style=" font-size:12pt;font-family:Arial">-----
Ursprüngliche Nachricht -----<br>Von: "Billich Heinrich Rainer (ID SD)" <heinrich.billich@id.ethz.ch><br>Gesendet von: gpfsug-discuss-bounces@spectrumscale.org<br>An: "gpfsug main discussion list" <gpfsug-discuss@spectrumscale.org><br>CC:<br>Betreff: [EXTERNAL] [gpfsug-discuss] /tmp/mmfs vanishes randomly?<br>Datum: Mo, 8. Nov 2021 10:35<br> </span></p><p style="margin-top:0px;margin-Bottom:0px"><span style=" font-size:12pt;font-family:Courier New">Hello,<br><br>We use /tmp/mmfs as dataStructureDump directory. Since a while I notice
that this directory randomly vanishes. Mmhealth does not complain but just
notes that it will no longer monitor the directory. Still I doubt that
trace collection and similar will create the directory when needed?<br><br>Do you know of any spectrum scale internal mechanism that could cause /tmp/mmfs
to get deleted? It happens on ESS nodes, with a plain IBM installation,
too. It happens just on one or two nodes at a time, it's no cluster-wide
cleanup or similar. We run scale 5.0.5 and ESS 6.0.2.2 and 6.0.2.2.<br><br>Thank you,<br><br>Mmhealth message:<br>local_fs_path_not_found INFO The configured
dataStructureDump path /tmp/mmfs does not exists. Skipping monitoring.<br><br>Kind regards,<br><br>Heiner<br>---<br>=======================<br>Heinrich Billich<br>ETH Zürich<br>Informatikdienste<br>Tel.: +41 44 632 72 56<br>heinrich.billich@id.ethz.ch<br>========================<br> <br> <br><br><br>_______________________________________________<br>gpfsug-discuss mailing list<br>gpfsug-discuss at spectrumscale.org</span><span style=" font-size:12pt;color:blue;font-family:Courier New"><u><br></u></span><a href="http://gpfsug.org/mailman/listinfo/gpfsug-discuss" target="_blank"><span style=" font-size:12pt;color:blue;font-family:Courier New"><u>http://gpfsug.org/mailman/listinfo/gpfsug-discuss</u></span></a><span style=" font-size:12pt;font-family:Courier New"></span></p><p style="margin-top:0px;margin-Bottom:0px"><span style=" font-size:12pt;font-family:Arial"> </span></p><p style="margin-top:0px;margin-Bottom:0px"><span style=" font-size:12pt;font-family:Calibri"><br><br></span><tt><span style=" font-size:10pt">_______________________________________________<br>gpfsug-discuss mailing list<br>gpfsug-discuss at spectrumscale.org<br></span></tt><a href="http://gpfsug.org/mailman/listinfo/gpfsug-discuss"><tt><span style=" font-size:10pt">http://gpfsug.org/mailman/listinfo/gpfsug-discuss</span></tt></a><tt><span style=" font-size:10pt"><br></span></tt></p><p style="margin-top:0px;margin-Bottom:0px"></p><p style="margin-top:0px;margin-Bottom:0px"></p><BR>
<BR>