[gpfsug-discuss] Mismatch between local and Scale directories

Tue Jun 30 13:28:33 BST 2020

Hi Yaron,

Thank you for your reply.

No, /var is not full and all other disks have free space also.

Best regards

Pedro Real Baptista
Consulting | Analytics & Cognitive
Deloitte Consultores, S.A.
Av. Eng. Duarte Pacheco, 7, 1070-100 Lisboa, Portugal
M: +351 962369236
pebaptista at deloitte.pt<mailto:%20pebaptista at deloitte.pt> | www.deloitte.pt<http://www.deloitte.pt/>

[cid:image019.png at 01D64EE2.55AE9AD0]<http://www.deloitte.pt/>

From: gpfsug-discuss-bounces at spectrumscale.org <gpfsug-discuss-bounces at spectrumscale.org> On Behalf Of Yaron Daniel
Sent: 30 de junho de 2020 13:06
To: gpfsug main discussion list <gpfsug-discuss at spectrumscale.org>
Subject: [EXT] Re: [gpfsug-discuss] Mismatch between local and Scale directories

HI

what is the output of :
#df -h

Look like /, /var is full ?

Regards

________________________________

Yaron Daniel
 94 Em Ha'Moshavot Rd
[cid:image002.gif at 01D64EE2.55A85940]
Storage Architect - IL Lab Services (Storage)
 Petach Tiqva, 49527
IBM Global Markets, Systems HW Sales
 Israel

Phone:
+972-3-916-5672

Fax:
+972-3-916-5672

Mobile:
+972-52-8395593

e-mail:
yard at il.ibm.com<mailto:yard at il.ibm.com>

Webex:            https://ibm.webex.com/meet/yard<Webex:%20%20%20%20%20%20%20%20%20%20%20%20%20https://ibm.webex.com/meet/yard%0dIBM%20Israel>
IBM Israel<Webex:%20%20%20%20%20%20%20%20%20%20%20%20%20https://ibm.webex.com/meet/yard%0dIBM%20Israel>

  [IBM Storage for Cyber Resiliency & Modern Data Protection V1] [cid:image004.jpg at 01D64EE2.55A85940] [cid:image005.jpg at 01D64EE2.55A85940] [cid:image006.jpg at 01D64EE2.55A85940] [cid:image007.jpg at 01D64EE2.55A85940]
[cid:image008.jpg at 01D64EE2.55A85940][cid:image009.jpg at 01D64EE2.55A85940][cid:image010.jpg at 01D64EE2.55A85940] [IBM Storage and Cloud Essentials] [cid:image012.jpg at 01D64EE2.55A85940]

From:        "Baptista, Pedro Real" <pebaptista at deloitte.pt<mailto:pebaptista at deloitte.pt>>
To:        "gpfsug-discuss at spectrumscale.org<mailto:gpfsug-discuss at spectrumscale.org>" <gpfsug-discuss at spectrumscale.org<mailto:gpfsug-discuss at spectrumscale.org>>
Date:        30/06/2020 14:54
Subject:        [EXTERNAL] [gpfsug-discuss] Mismatch between local and Scale directories
Sent by:        gpfsug-discuss-bounces at spectrumscale.org<mailto:gpfsug-discuss-bounces at spectrumscale.org>
________________________________

Hi all,

I'm finding diferences between my local directories (Hadoop cluster) and GPFS filesystem. I've linked both yarn and mapreduce directories to Scale.

For example, in one specific worker node:

[cid:image013.png at 01D64EE2.55A85940]

If I list the usercache folder, I see differences.

Local:

[cid:image014.png at 01D64EE2.55A85940]

GPFS

[cid:image015.png at 01D64EE2.55A85940]

I see that GPFS is working ok in the node

[cid:image016.png at 01D64EE2.55A85940]

However, if I check the node health:

[cid:image017.png at 01D64EE2.55A85940]

I'm new to Spectrum Scale and I don't know what's csm_resync_needed and local_fs_filled.

Can anyone give a hand with this?

Best regards,

Pedro Real Baptista
Consulting | Analytics & Cognitive
Deloitte Consultores, S.A.
Av. Eng. Duarte Pacheco, 7, 1070-100 Lisboa, Portugal
M: +351 962369236
pebaptista at deloitte.pt<mailto:%20pebaptista at deloitte.pt>| www.deloitte.pt<http://secure-web.cisco.com/1rJhl7ESWYrTmt1WoVdb6kWjihCNE8HMLybWnRnzY5Y1r-z_Inptagcam9z0AVh1nWVm8zad5VeQwzrz1QszH5nUOlyTGb2v4yzGu92aCricPjOoikjmy31svec85RmOYKkoKUgAj6wC-hoOhF7HX9rYgaKGfZS1mDeO_uq7izfjGCZu8ANk_v33Jrsg8WtVjARiBQVrCgTl0ghg-eH170fllK4e_8AsSRQ-agoa15wA76wzW1k83MCwTt9zJcIFR93_tOcl0i4VbjFJylSRZL5c0Ia7sO1wazIRbVG61y7Q_54jY_RhtWcMgYQP97GAB/http%3A%2F%2Fwww.deloitte.pt%2F>

[cid:image018.png at 01D64EE2.55A85940]<http://secure-web.cisco.com/1rJhl7ESWYrTmt1WoVdb6kWjihCNE8HMLybWnRnzY5Y1r-z_Inptagcam9z0AVh1nWVm8zad5VeQwzrz1QszH5nUOlyTGb2v4yzGu92aCricPjOoikjmy31svec85RmOYKkoKUgAj6wC-hoOhF7HX9rYgaKGfZS1mDeO_uq7izfjGCZu8ANk_v33Jrsg8WtVjARiBQVrCgTl0ghg-eH170fllK4e_8AsSRQ-agoa15wA76wzW1k83MCwTt9zJcIFR93_tOcl0i4VbjFJylSRZL5c0Ia7sO1wazIRbVG61y7Q_54jY_RhtWcMgYQP97GAB/http%3A%2F%2Fwww.deloitte.pt%2F>

*Disclaimer:*

Deloitte refers to a Deloitte member firm, one of its related entities, or Deloitte Touche Tohmatsu Limited ("DTTL").
Each Deloitte member firm is a separate legal entity and a member of DTTL. DTTL does not provide services to clients.
Please see www.deloitte.com/about<http://www.deloitte.com/about>to learn more.

Privileged/Confidential Information may be contained in this message. If you are not the addressee indicated in this message (or responsible for delivery of the message to such person), you may not copy or deliver this message to anyone. In such case, you should destroy this message and kindly notify the sender by reply email. Please advise immediately if you or your employer do not consent to Internet email for messages of this kind. Opinions, conclusions and other information in this message that do not relate to the official business of my firm shall be understood as neither given nor endorsed by it._______________________________________________
gpfsug-discuss mailing list
gpfsug-discuss at spectrumscale.org
http://gpfsug.org/mailman/listinfo/gpfsug-discuss<http://secure-web.cisco.com/1HMlNwUFuvF1Cxz4WEr5vNOzTCiigxD1EkNgqCxytj5F_2uhft0nUnqEsuaNiccKA5pGjtyNHgYytzvHetLNWkwCSOwN9vEGg3SiCRNiqnEFTU3sQWCUdRHvOTmxFaR8R4OH_UNsSiJyi_DXPVf-VeKsXEqw8UPLQeAatNNdzfwPtA10hBmG5-ZMvJELI5N6c8S_z8J4zy7sxgdEkLO-CzygqSZm_FRz13HXbplzA29PByMkU-iiBFjCtpQHfv5eIlcyfi7pMmWv38kzIpYmGKtN83ZtJD1nq0_llxQc8r5hBqx7ob2P4LslqIAFetkxx/http%3A%2F%2Fgpfsug.org%2Fmailman%2Flistinfo%2Fgpfsug-discuss>

*Disclaimer:*

Deloitte refers to a Deloitte member firm, one of its related entities, or Deloitte Touche Tohmatsu Limited (“DTTL”).
Each Deloitte member firm is a separate legal entity and a member of DTTL. DTTL does not provide services to clients.
Please see www.deloitte.com/about <http://www.deloitte.com/about> to learn more.

Privileged/Confidential Information may be contained in this message. If you are not the addressee indicated in this message (or responsible for delivery of the message to such person), you may not copy or deliver this message to anyone. In such case, you should destroy this message and kindly notify the sender by reply email. Please advise immediately if you or your employer do not consent to Internet email for messages of this kind. Opinions, conclusions and other information in this message that do not relate to the official business of my firm shall be understood as neither given nor endorsed by it.
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://gpfsug.org/pipermail/gpfsug-discuss_gpfsug.org/attachments/20200630/acaa1e82/attachment-0002.htm>
-------------- next part --------------
A non-text attachment was scrubbed...
Name: image002.gif
Type: image/gif
Size: 1114 bytes
Desc: image002.gif
URL: <http://gpfsug.org/pipermail/gpfsug-discuss_gpfsug.org/attachments/20200630/acaa1e82/attachment-0006.gif>
-------------- next part --------------
A non-text attachment was scrubbed...
Name: image003.gif
Type: image/gif
Size: 4105 bytes
Desc: image003.gif
URL: <http://gpfsug.org/pipermail/gpfsug-discuss_gpfsug.org/attachments/20200630/acaa1e82/attachment-0007.gif>
-------------- next part --------------
A non-text attachment was scrubbed...
Name: image004.jpg
Type: image/jpeg
Size: 3847 bytes
Desc: image004.jpg
URL: <http://gpfsug.org/pipermail/gpfsug-discuss_gpfsug.org/attachments/20200630/acaa1e82/attachment-0016.jpg>
-------------- next part --------------
A non-text attachment was scrubbed...
Name: image005.jpg
Type: image/jpeg
Size: 4266 bytes
Desc: image005.jpg
URL: <http://gpfsug.org/pipermail/gpfsug-discuss_gpfsug.org/attachments/20200630/acaa1e82/attachment-0017.jpg>
-------------- next part --------------
A non-text attachment was scrubbed...
Name: image006.jpg
Type: image/jpeg
Size: 3747 bytes
Desc: image006.jpg
URL: <http://gpfsug.org/pipermail/gpfsug-discuss_gpfsug.org/attachments/20200630/acaa1e82/attachment-0018.jpg>
-------------- next part --------------
A non-text attachment was scrubbed...
Name: image007.jpg
Type: image/jpeg
Size: 3793 bytes
Desc: image007.jpg
URL: <http://gpfsug.org/pipermail/gpfsug-discuss_gpfsug.org/attachments/20200630/acaa1e82/attachment-0019.jpg>
-------------- next part --------------
A non-text attachment was scrubbed...
Name: image008.jpg
Type: image/jpeg
Size: 4301 bytes
Desc: image008.jpg
URL: <http://gpfsug.org/pipermail/gpfsug-discuss_gpfsug.org/attachments/20200630/acaa1e82/attachment-0020.jpg>
-------------- next part --------------
A non-text attachment was scrubbed...
Name: image009.jpg
Type: image/jpeg
Size: 3739 bytes
Desc: image009.jpg
URL: <http://gpfsug.org/pipermail/gpfsug-discuss_gpfsug.org/attachments/20200630/acaa1e82/attachment-0021.jpg>
-------------- next part --------------
A non-text attachment was scrubbed...
Name: image010.jpg
Type: image/jpeg
Size: 3855 bytes
Desc: image010.jpg
URL: <http://gpfsug.org/pipermail/gpfsug-discuss_gpfsug.org/attachments/20200630/acaa1e82/attachment-0022.jpg>
-------------- next part --------------
A non-text attachment was scrubbed...
Name: image011.gif
Type: image/gif
Size: 4084 bytes
Desc: image011.gif
URL: <http://gpfsug.org/pipermail/gpfsug-discuss_gpfsug.org/attachments/20200630/acaa1e82/attachment-0008.gif>
-------------- next part --------------
A non-text attachment was scrubbed...
Name: image012.jpg
Type: image/jpeg
Size: 3776 bytes
Desc: image012.jpg
URL: <http://gpfsug.org/pipermail/gpfsug-discuss_gpfsug.org/attachments/20200630/acaa1e82/attachment-0023.jpg>
-------------- next part --------------
A non-text attachment was scrubbed...
Name: image013.png
Type: image/png
Size: 15587 bytes
Desc: image013.png
URL: <http://gpfsug.org/pipermail/gpfsug-discuss_gpfsug.org/attachments/20200630/acaa1e82/attachment-0014.png>
-------------- next part --------------
A non-text attachment was scrubbed...
Name: image014.png
Type: image/png
Size: 11114 bytes
Desc: image014.png
URL: <http://gpfsug.org/pipermail/gpfsug-discuss_gpfsug.org/attachments/20200630/acaa1e82/attachment-0015.png>
-------------- next part --------------
A non-text attachment was scrubbed...
Name: image015.png
Type: image/png
Size: 17038 bytes
Desc: image015.png
URL: <http://gpfsug.org/pipermail/gpfsug-discuss_gpfsug.org/attachments/20200630/acaa1e82/attachment-0016.png>
-------------- next part --------------
A non-text attachment was scrubbed...
Name: image016.png
Type: image/png
Size: 5902 bytes
Desc: image016.png
URL: <http://gpfsug.org/pipermail/gpfsug-discuss_gpfsug.org/attachments/20200630/acaa1e82/attachment-0017.png>
-------------- next part --------------
A non-text attachment was scrubbed...
Name: image017.png
Type: image/png
Size: 23157 bytes
Desc: image017.png
URL: <http://gpfsug.org/pipermail/gpfsug-discuss_gpfsug.org/attachments/20200630/acaa1e82/attachment-0018.png>
-------------- next part --------------
A non-text attachment was scrubbed...
Name: image018.png
Type: image/png
Size: 2030 bytes
Desc: image018.png
URL: <http://gpfsug.org/pipermail/gpfsug-discuss_gpfsug.org/attachments/20200630/acaa1e82/attachment-0019.png>
-------------- next part --------------
A non-text attachment was scrubbed...
Name: image019.png
Type: image/png
Size: 2030 bytes
Desc: image019.png
URL: <http://gpfsug.org/pipermail/gpfsug-discuss_gpfsug.org/attachments/20200630/acaa1e82/attachment-0020.png>