[gpfsug-discuss] quickest way to delete all files (and directories) in a file system

[Frederick Stock]

For speed Olaf’s recommendation is the best option.  If you really do not want to remove the file systems and recreate them, and the version of Scale is fairly current, you could use the mmfind command to simplify creating a policy to remove the files.  Still removing 50M files will take some time.

Fred

Fred Stock, Spectrum Scale Development Advocacy
stockf at us.ibm.com<mailto:stockf at us.ibm.com> | 720-430-8821



From: gpfsug-discuss <gpfsug-discuss-bounces at gpfsug.org> on behalf of Olaf Weiser <olaf.weiser at de.ibm.com>
Date: Thursday, June 30, 2022 at 8:09 AM
To: 'gpfsug main discussion list' <gpfsug-discuss at spectrumscale.org>
Subject: [EXTERNAL] Re: [gpfsug-discuss] quickest way to delete all files (and directories) in a file system
Hi Tina, I think its much faster to recreate the file system after that .. it is enough to do mmauth grant {RemoteClusterName | all} -f {Device in my case ..its always ... grant all -f all 😉 ‍ ‍ ‍ ‍ ‍ ‍ ‍ ‍ ‍ ‍ ‍ ‍ ‍ ‍ ‍ ‍ ‍ ‍ ‍ ‍ ‍ ‍ ‍ ‍ ‍ ‍ ‍ ‍ ‍ ‍ ‍ ‍ ‍ ‍ ‍ ‍ ‍ ‍ ‍ ‍ ‍ ‍ ‍ ‍ ‍ ‍ ‍ ‍
ZjQcmQRYFpfptBannerStart
This Message Is From an External Sender
This message came from outside your organization.
ZjQcmQRYFpfptBannerEnd
Hi Tina,
I think its much faster to recreate the file system
after that .. it is enough to     do

mmauth grant  {RemoteClusterName | all} -f {Device
in my case ..its always ... grant all -f all 😉

and every remote mount will  work  as before.. the remote cluster key information is in the cluster CCR  .. not in the filesystem..

Pay attention.. when you 'll create the file system, it will be created with the current code's version... in Case remote cluster is backlevel.. don't forget to specify --version

have fun 😉




________________________________
Von: gpfsug-discuss <gpfsug-discuss-bounces at gpfsug.org> im Auftrag von Tina Friedrich <tina.friedrich at it.ox.ac.uk>
Gesendet: Donnerstag, 30. Juni 2022 13:31
An: 'gpfsug main discussion list' <gpfsug-discuss at spectrumscale.org>
Betreff: [EXTERNAL] [gpfsug-discuss] quickest way to delete all files (and directories) in a file system

Hello everyone,

this should be a simple question, but we can't quite figure out how to
best proceed.

We have some file systems that we want to, basically, empty out. As in
remove all files and directories currently on them. Both contain a
pretty large number of files/directories (something like 50,000,000,
with sometimes silly characters in the file names). 'rm -rf' clearly
isn't the way to go forward.

We've come up with either 'mmapplypolicy' (i.e. a policy to remove all
files) or removing and re-creating the file systems as options (open to
other suggestions!).

We want the file systems still; ideally without having to redo the
authentication and key swaps etc for the 'remote' clusters using them.

This is a Lenovo DSS, but I don't think it makes much of a difference.

So - what's the best way to proceed?

If it is mmapplypolicy - does anyone have a (tested/known working)
example of a policy to simply remove all files?

Thanks,
Tina

--
Tina Friedrich, Advanced Research Computing Snr HPC Systems Administrator

Research Computing and Support Services
IT Services, University of Oxford
http://www.arc.ox.ac.uk<http://www.arc.ox.ac.uk>  http://www.it.ox.ac.uk<http://www.it.ox.ac.uk>

_______________________________________________
gpfsug-discuss mailing list
gpfsug-discuss at gpfsug.org
http://gpfsug.org/mailman/listinfo/gpfsug-discuss_gpfsug.org<http://gpfsug.org/mailman/listinfo/gpfsug-discuss_gpfsug.org>
H
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://gpfsug.org/pipermail/gpfsug-discuss_gpfsug.org/attachments/20220630/9d2c0a4b/attachment-0003.htm>