<html xmlns:o="urn:schemas-microsoft-com:office:office" xmlns:w="urn:schemas-microsoft-com:office:word" xmlns:m="http://schemas.microsoft.com/office/2004/12/omml" xmlns="http://www.w3.org/TR/REC-html40">
<head>
<meta http-equiv="Content-Type" content="text/html; charset=utf-8">
<meta name="Generator" content="Microsoft Word 15 (filtered medium)">
<style><!--
/* Font Definitions */
@font-face
{font-family:"Cambria Math";
panose-1:2 4 5 3 5 4 6 3 2 4;}
@font-face
{font-family:Calibri;
panose-1:2 15 5 2 2 2 4 3 2 4;}
@font-face
{font-family:Consolas;
panose-1:2 11 6 9 2 2 4 3 2 4;}
/* Style Definitions */
p.MsoNormal, li.MsoNormal, div.MsoNormal
{margin:0cm;
font-size:11.0pt;
font-family:"Calibri",sans-serif;}
a:link, span.MsoHyperlink
{mso-style-priority:99;
color:blue;
text-decoration:underline;}
pre
{mso-style-priority:99;
mso-style-link:"HTML Preformatted Char";
margin:0cm;
margin-bottom:.0001pt;
font-size:10.0pt;
font-family:"Courier New";}
span.HTMLPreformattedChar
{mso-style-name:"HTML Preformatted Char";
mso-style-priority:99;
mso-style-link:"HTML Preformatted";
font-family:"Consolas",serif;}
span.EmailStyle20
{mso-style-type:personal-reply;
font-family:"Calibri",sans-serif;
color:windowtext;}
.MsoChpDefault
{mso-style-type:export-only;
font-size:10.0pt;}
@page WordSection1
{size:612.0pt 792.0pt;
margin:72.0pt 72.0pt 72.0pt 72.0pt;}
div.WordSection1
{page:WordSection1;}
--></style>
</head>
<body lang="en-CH" link="blue" vlink="purple" style="word-wrap:break-word">
<div class="WordSection1">
<p class="MsoNormal"><span lang="EN-US" style="mso-fareast-language:EN-US">Hello Olaf,<o:p></o:p></span></p>
<p class="MsoNormal"><span lang="EN-US" style="mso-fareast-language:EN-US"><o:p> </o:p></span></p>
<p class="MsoNormal"><span lang="EN-US" style="mso-fareast-language:EN-US">Thank you, you are right. I was ignorant about the systemd-tmpfiles* services and timers. The cleanup in /tmp wasn’t present in RHEL7, at least not on our nodes. I consider to modify
the configuration a bit to keep the directory /tmp/mmfs - or even create it – but to clean it’s content .<o:p></o:p></span></p>
<p class="MsoNormal"><span lang="EN-US" style="mso-fareast-language:EN-US"><o:p> </o:p></span></p>
<p class="MsoNormal"><span lang="EN-US" style="mso-fareast-language:EN-US">Best regards,<o:p></o:p></span></p>
<p class="MsoNormal"><span lang="EN-US" style="mso-fareast-language:EN-US"><o:p> </o:p></span></p>
<p class="MsoNormal"><span lang="EN-US" style="mso-fareast-language:EN-US">Heiner<o:p></o:p></span></p>
<p class="MsoNormal"><span style="mso-fareast-language:EN-US"><o:p> </o:p></span></p>
<div style="border:none;border-top:solid #B5C4DF 1.0pt;padding:3.0pt 0cm 0cm 0cm">
<p class="MsoNormal"><b><span style="font-size:12.0pt;color:black">From: </span></b><span style="font-size:12.0pt;color:black"><gpfsug-discuss-bounces@spectrumscale.org> on behalf of Olaf Weiser <olaf.weiser@de.ibm.com><br>
<b>Reply to: </b>gpfsug main discussion list <gpfsug-discuss@spectrumscale.org><br>
<b>Date: </b>Monday, 8 November 2021 at 10:53<br>
<b>To: </b>"gpfsug-discuss@spectrumscale.org" <gpfsug-discuss@spectrumscale.org><br>
<b>Cc: </b>"gpfsug-discuss@spectrumscale.org" <gpfsug-discuss@spectrumscale.org><br>
<b>Subject: </b>Re: [gpfsug-discuss] /tmp/mmfs vanishes randomly?<o:p></o:p></span></p>
</div>
<div>
<p class="MsoNormal"><o:p> </o:p></p>
</div>
<div>
<div>
<p class="MsoNormal"><span style="font-size:10.0pt;font-family:"Arial",sans-serif">Hallo Heiner,<o:p></o:p></span></p>
</div>
<div>
<p class="MsoNormal"><span style="font-size:10.0pt;font-family:"Arial",sans-serif"> <o:p></o:p></span></p>
</div>
<div>
<p class="MsoNormal"><span style="font-size:10.0pt;font-family:"Arial",sans-serif">multiple levels of answers..<o:p></o:p></span></p>
</div>
<div>
<p class="MsoNormal"><span style="font-size:10.0pt;font-family:"Arial",sans-serif"> <o:p></o:p></span></p>
</div>
<div>
<p class="MsoNormal"><span style="font-size:10.0pt;font-family:"Arial",sans-serif">(1st) ... it the directory is not there, the gpfs trace would create it automatically - just like this:<o:p></o:p></span></p>
</div>
<div>
<p class="MsoNormal"><span style="font-size:10.0pt;font-family:"Courier New";color:black;background:white">[root@ess5-ems1 ~]# ls -l /tmp/mmfs
</span><span style="font-size:10.0pt;font-family:"Courier New""><br>
ls: cannot access '/tmp/mmfs': No such file or directory<br>
[root@ess5-ems1 ~]# mmtracectl --start -N ems5k.mmfsd.net<br>
mmchconfig: Command successfully completed<br>
mmchconfig: Propagating the cluster configuration data to all<br>
affected nodes. This is an asynchronous process.<br>
[root@ess5-ems1 ~]# <br>
[root@ess5-ems1 ~]# <br>
[root@ess5-ems1 ~]# ls -l /tmp/mmfs <br>
total 0<br>
-rw-r--r-- 1 root root 0 Nov 8 10:47 lxtrace.trcerr.ems5k<br>
[root@ess5-ems1 ~]# </span><span style="font-size:10.0pt;font-family:"Arial",sans-serif"><br>
<br>
<o:p></o:p></span></p>
</div>
<div>
<div>
<div>
<div>
<div>
<p class="MsoNormal"><span style="font-size:10.0pt;font-family:"Arial",sans-serif">(2nd) I think - the cleaning of /tmp is something done by the OS -<o:p></o:p></span></p>
</div>
<div>
<pre>please check - <o:p></o:p></pre>
<pre>systemctl status systemd-tmpfiles-setup.service<o:p></o:p></pre>
</div>
<div>
<p class="MsoNormal"><span style="font-size:10.0pt;font-family:"Arial",sans-serif">or look at this config file<o:p></o:p></span></p>
</div>
<div>
<p class="MsoNormal"><span style="font-size:10.0pt;font-family:"Courier New";color:black;background:white">[root@ess5-ems1 ~]# cat /usr/lib/tmpfiles.d/tmp.conf
</span><span style="font-size:10.0pt;font-family:"Courier New""><br>
# This file is part of systemd.<br>
#<br>
# systemd is free software; you can redistribute it and/or modify it<br>
# under the terms of the GNU Lesser General Public License as published by<br>
# the Free Software Foundation; either version 2.1 of the License, or<br>
# (at your option) any later version.<br>
<br>
# See tmpfiles.d(5) for details<br>
<br>
# Clear tmp directories separately, to make them easier to override<br>
q /tmp 1777 root root 10d<br>
q /var/tmp 1777 root root 30d<br>
<br>
# Exclude namespace mountpoints created with PrivateTmp=yes<br>
x /tmp/systemd-private-%b-*<br>
X /tmp/systemd-private-%b-*/tmp<br>
x /var/tmp/systemd-private-%b-*<br>
X /var/tmp/systemd-private-%b-*/tmp<br>
<br>
# Remove top-level private temporary directories on each boot<br>
R! /tmp/systemd-private-*<br>
R! /var/tmp/systemd-private-*<br>
[root@ess5-ems1 ~]# </span><span style="font-size:10.0pt;font-family:"Arial",sans-serif"><br>
<o:p></o:p></span></p>
</div>
<div>
<p class="MsoNormal"><span style="font-size:10.0pt;font-family:"Arial",sans-serif"> <o:p></o:p></span></p>
</div>
<div>
<p class="MsoNormal"><span style="font-size:10.0pt;font-family:"Arial",sans-serif">hope this helps -<o:p></o:p></span></p>
</div>
<div>
<p class="MsoNormal"><span style="font-size:10.0pt;font-family:"Arial",sans-serif">cheers<o:p></o:p></span></p>
</div>
<div>
<p class="MsoNormal"><span style="font-size:10.0pt;font-family:"Arial",sans-serif"> <o:p></o:p></span></p>
</div>
<div>
<p class="MsoNormal"><span style="font-size:10.0pt;font-family:"Arial",sans-serif"> <o:p></o:p></span></p>
</div>
<div>
<p class="MsoNormal"><span style="font-size:10.0pt;font-family:"Arial",sans-serif"> <o:p></o:p></span></p>
</div>
<div>
<p class="MsoNormal"><span style="font-size:10.0pt;font-family:"Arial",sans-serif">Mit freundlichen Grüßen / Kind regards<o:p></o:p></span></p>
</div>
<div style="margin-top:7.5pt">
<div>
<div>
<p class="MsoNormal"><span style="font-size:8.0pt;font-family:"Arial",sans-serif"> <br>
Olaf Weiser<br>
<br>
IBM Systems, SpectrumScale Client Adoption<br>
-------------------------------------------------------------------------------------------------------------------------------------------<br>
IBM Deutschland<br>
IBM Allee 1<br>
71139 Ehningen<br>
Phone: +49-170-579-44-66<br>
E-Mail: olaf.weiser@de.ibm.com<br>
-------------------------------------------------------------------------------------------------------------------------------------------<br>
IBM Deutschland GmbH / Vorsitzender des Aufsichtsrats: Martin Jetter<br>
Geschäftsführung: Gregor Pillen (Vorsitzender), Agnes Heftberger, Norbert Janzen, Markus Koerner, Christian Noll, Nicole Reimer<br>
Sitz der Gesellschaft: Ehningen / Registergericht: Amtsgericht Stuttgart, HRB 14562 / WEEE-Reg.-Nr. DE 99369940<o:p></o:p></span></p>
</div>
<div>
<p class="MsoNormal"><span style="font-size:8.0pt;font-family:"Arial",sans-serif"> <o:p></o:p></span></p>
</div>
</div>
</div>
</div>
</div>
</div>
</div>
<div>
<p class="MsoNormal"><span style="font-size:10.0pt;font-family:"Arial",sans-serif"> <o:p></o:p></span></p>
</div>
<div>
<p class="MsoNormal"><span style="font-size:10.0pt;font-family:"Arial",sans-serif"> <o:p></o:p></span></p>
</div>
<blockquote style="border:none;border-left:solid #AAAAAA 1.5pt;padding:0cm 0cm 0cm 4.0pt;margin-left:3.75pt;margin-top:5.0pt;margin-right:0cm;margin-bottom:5.0pt">
<p class="MsoNormal"><span style="font-size:10.0pt;font-family:"Arial",sans-serif">----- Ursprüngliche Nachricht -----<br>
Von: "Billich Heinrich Rainer (ID SD)" <heinrich.billich@id.ethz.ch><br>
Gesendet von: gpfsug-discuss-bounces@spectrumscale.org<br>
An: "gpfsug main discussion list" <gpfsug-discuss@spectrumscale.org><br>
CC:<br>
Betreff: [EXTERNAL] [gpfsug-discuss] /tmp/mmfs vanishes randomly?<br>
Datum: Mo, 8. Nov 2021 10:35<br>
<o:p></o:p></span></p>
<div>
<p class="MsoNormal"><span style="font-size:10.0pt;font-family:"Courier New"">Hello,<br>
<br>
We use /tmp/mmfs as dataStructureDump directory. Since a while I notice that this directory randomly vanishes. Mmhealth does not complain but just notes that it will no longer monitor the directory. Still I doubt that trace collection and similar will create
the directory when needed?<br>
<br>
Do you know of any spectrum scale internal mechanism that could cause /tmp/mmfs to get deleted? It happens on ESS nodes, with a plain IBM installation, too. It happens just on one or two nodes at a time, it's no cluster-wide cleanup or similar. We run scale
5.0.5 and ESS 6.0.2.2 and 6.0.2.2.<br>
<br>
Thank you,<br>
<br>
Mmhealth message:<br>
local_fs_path_not_found INFO The configured dataStructureDump path /tmp/mmfs does not exists. Skipping monitoring.<br>
<br>
Kind regards,<br>
<br>
Heiner<br>
---<br>
=======================<br>
Heinrich Billich<br>
ETH Zürich<br>
Informatikdienste<br>
Tel.: +41 44 632 72 56<br>
heinrich.billich@id.ethz.ch<br>
========================<br>
<br>
<br>
<br>
<br>
_______________________________________________<br>
gpfsug-discuss mailing list<br>
gpfsug-discuss at spectrumscale.org<br>
<a href="http://gpfsug.org/mailman/listinfo/gpfsug-discuss" target="_blank">http://gpfsug.org/mailman/listinfo/gpfsug-discuss</a> </span><span style="font-size:10.0pt;font-family:"Arial",sans-serif"><o:p></o:p></span></p>
</div>
</blockquote>
<div>
<p class="MsoNormal"><span style="font-size:10.0pt;font-family:"Arial",sans-serif"> <o:p></o:p></span></p>
</div>
</div>
<p class="MsoNormal"><br>
<br>
<br>
<o:p></o:p></p>
</div>
</body>
</html>