[gpfsug-discuss] Mismatch between local and Scale directories

[Baptista, Pedro Real]

Hi all,

I'm finding diferences between my local directories (Hadoop cluster) and GPFS filesystem. I've linked both yarn and mapreduce directories to Scale.

For example, in one specific worker node:

[cid:image001.png at 01D64EDC.48F92EF0]

If I list the usercache folder, I see differences.

Local:

[cid:image002.png at 01D64EDC.48F92EF0]

GPFS

[cid:image003.png at 01D64EDC.48F92EF0]

I see that GPFS is working ok in the node

[cid:image004.png at 01D64EDC.48F92EF0]

However, if I check the node health:

[cid:image007.png at 01D64EDC.8102E2F0]

I'm new to Spectrum Scale and I don't know what's csm_resync_needed and local_fs_filled.

Can anyone give a hand with this?

Best regards,

Pedro Real Baptista
Consulting | Analytics & Cognitive
Deloitte Consultores, S.A.
Av. Eng. Duarte Pacheco, 7, 1070-100 Lisboa, Portugal
M: +351 962369236
pebaptista at deloitte.pt<mailto:%20pebaptista at deloitte.pt> | www.deloitte.pt<http://www.deloitte.pt/>

[cid:image008.png at 01D64EDC.8102E2F0]<http://www.deloitte.pt/>

*Disclaimer:*

Deloitte refers to a Deloitte member firm, one of its related entities, or Deloitte Touche Tohmatsu Limited (“DTTL”).
Each Deloitte member firm is a separate legal entity and a member of DTTL. DTTL does not provide services to clients.
Please see www.deloitte.com/about <http://www.deloitte.com/about> to learn more.

Privileged/Confidential Information may be contained in this message. If you are not the addressee indicated in this message (or responsible for delivery of the message to such person), you may not copy or deliver this message to anyone. In such case, you should destroy this message and kindly notify the sender by reply email. Please advise immediately if you or your employer do not consent to Internet email for messages of this kind. Opinions, conclusions and other information in this message that do not relate to the official business of my firm shall be understood as neither given nor endorsed by it.
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://gpfsug.org/pipermail/gpfsug-discuss_gpfsug.org/attachments/20200630/8ef3e1da/attachment-0001.htm>
-------------- next part --------------
A non-text attachment was scrubbed...
Name: image001.png
Type: image/png
Size: 15587 bytes
Desc: image001.png
URL: <http://gpfsug.org/pipermail/gpfsug-discuss_gpfsug.org/attachments/20200630/8ef3e1da/attachment-0006.png>
-------------- next part --------------
A non-text attachment was scrubbed...
Name: image002.png
Type: image/png
Size: 11114 bytes
Desc: image002.png
URL: <http://gpfsug.org/pipermail/gpfsug-discuss_gpfsug.org/attachments/20200630/8ef3e1da/attachment-0007.png>
-------------- next part --------------
A non-text attachment was scrubbed...
Name: image003.png
Type: image/png
Size: 17038 bytes
Desc: image003.png
URL: <http://gpfsug.org/pipermail/gpfsug-discuss_gpfsug.org/attachments/20200630/8ef3e1da/attachment-0008.png>
-------------- next part --------------
A non-text attachment was scrubbed...
Name: image004.png
Type: image/png
Size: 5902 bytes
Desc: image004.png
URL: <http://gpfsug.org/pipermail/gpfsug-discuss_gpfsug.org/attachments/20200630/8ef3e1da/attachment-0009.png>
-------------- next part --------------
A non-text attachment was scrubbed...
Name: image007.png
Type: image/png
Size: 23157 bytes
Desc: image007.png
URL: <http://gpfsug.org/pipermail/gpfsug-discuss_gpfsug.org/attachments/20200630/8ef3e1da/attachment-0010.png>
-------------- next part --------------
A non-text attachment was scrubbed...
Name: image008.png
Type: image/png
Size: 2030 bytes
Desc: image008.png
URL: <http://gpfsug.org/pipermail/gpfsug-discuss_gpfsug.org/attachments/20200630/8ef3e1da/attachment-0011.png>