From crobson at ocf.co.uk Mon Apr 2 09:26:10 2012 From: crobson at ocf.co.uk (Claire Robson) Date: Mon, 2 Apr 2012 09:26:10 +0100 Subject: [gpfsug-discuss] Understanding and Improving Computational Science Storage Access through Continuous Characterization Message-ID: Hi All, Andreas Landhaeusser has kindly sent over some further information following his presentation at the last User Group meeting, details are below: Measuring the storage performance, http://www.storageconference.org/2011/Papers/Research/1.Carns.pdf ANL developed Darshan for characterization and improving I/O performance of workloads http://www.mcs.anl.gov/research/projects/darshan/ Thanks, Claire GPFS User Group Secretary From Jez.Tucker at rushes.co.uk Wed Apr 11 16:19:58 2012 From: Jez.Tucker at rushes.co.uk (Jez Tucker) Date: Wed, 11 Apr 2012 15:19:58 +0000 Subject: [gpfsug-discuss] GPFS 3.5 Announcement Message-ID: <39571EA9316BE44899D59C7A640C13F502FBFB@WARVWEXC2.uk.deluxe-eu.com> FYI: http://www-01.ibm.com/common/ssi/cgi-bin/ssialias?subtype=ca&infotype=an&appname=iSource&supplier=877&letternum=ENUSZP12-0057 --- Jez Tucker Senior Sysadmin Rushes GPFSUG Chairman (chair at gpfsug.org) Rushes Postproduction Limited, 66 Old Compton Street, London W1D 4UH tel: +44 (0)20 7437 8676 web: http://www.rushes.co.uk The information contained in this e-mail is confidential and may be subject to legal privilege. If you are not the intended recipient, you must not use, copy, distribute or disclose the e-mail or any part of its contents or take any action in reliance on it. If you have received this e-mail in error, please e-mail the sender by replying to this message. All reasonable precautions have been taken to ensure no viruses are present in this e-mail. Rushes Postproduction Limited cannot accept responsibility for loss or damage arising from the use of this e-mail or attachments and recommend that you subject these to your virus checking procedures prior to use. -------------- next part -------------- An HTML attachment was scrubbed... URL: From orlando.richards at ed.ac.uk Thu Apr 12 09:02:05 2012 From: orlando.richards at ed.ac.uk (Orlando Richards) Date: Thu, 12 Apr 2012 09:02:05 +0100 Subject: [gpfsug-discuss] GPFS 3.5 Announcement In-Reply-To: <39571EA9316BE44899D59C7A640C13F502FBFB@WARVWEXC2.uk.deluxe-eu.com> References: <39571EA9316BE44899D59C7A640C13F502FBFB@WARVWEXC2.uk.deluxe-eu.com> Message-ID: <4F868BFD.4030306@ed.ac.uk> Good stuff - thanks for forwarding that on Jez. I wonder what the "improved small file performance" is. Also interesting to see mention of a "fileset owner": "Each fileset owner now has the ability to control quotas for users and groups of their fileset." I'll look forward to giving this a good kick about on April 20th - I've already booked a slot in my diary ;) -- Orlando On 11/04/12 16:19, Jez Tucker wrote: > FYI: > > http://www-01.ibm.com/common/ssi/cgi-bin/ssialias?subtype=ca&infotype=an&appname=iSource&supplier=877&letternum=ENUSZP12-0057 > > > --- > > Jez Tucker > > Senior Sysadmin > > Rushes > > GPFSUG Chairman (chair at gpfsug.org) > > > Rushes Postproduction Limited, 66 Old Compton Street, London W1D 4UH > tel: +44 (0)20 7437 8676 > web: http://www.rushes.co.uk > The information contained in this e-mail is confidential and may be > subject to legal privilege. If you are not the intended recipient, you > must not use, copy, distribute or disclose the e-mail or any part of its > contents or take any action in reliance on it. If you have received this > e-mail in error, please e-mail the sender by replying to this message. > All reasonable precautions have been taken to ensure no viruses are > present in this e-mail. Rushes Postproduction Limited cannot accept > responsibility for loss or damage arising from the use of this e-mail or > attachments and recommend that you subject these to your virus checking > procedures prior to use. > > > _______________________________________________ > gpfsug-discuss mailing list > gpfsug-discuss at gpfsug.org > http://gpfsug.org/mailman/listinfo/gpfsug-discuss -- -- Dr Orlando Richards Information Services IT Infrastructure Division Unix Section Tel: 0131 650 4994 The University of Edinburgh is a charitable body, registered in Scotland, with registration number SC005336. From ANDREWD at uk.ibm.com Thu Apr 12 17:02:33 2012 From: ANDREWD at uk.ibm.com (Andrew Downes1) Date: Thu, 12 Apr 2012 16:02:33 +0000 Subject: [gpfsug-discuss] AUTO: Andrew Downes is out of the office (returning 16/04/2012) Message-ID: I am out of the office until 16/04/2012. In my absence please contact Matt Ayres mailto:m_ayres at uk.ibm.com 07710-981527 In case of urgency, please contact our manager Andy Jenkins mailto:JENKINSA at uk.ibm.com 07921-108940 Note: This is an automated response to your message "gpfsug-discuss Digest, Vol 4, Issue 2" sent on 12/4/2012 11:00:01. This is the only notification you will receive while this person is away. From sfadden at us.ibm.com Thu Apr 12 17:29:39 2012 From: sfadden at us.ibm.com (Scott Fadden) Date: Thu, 12 Apr 2012 09:29:39 -0700 Subject: [gpfsug-discuss] GPFS 3.5 Announcement In-Reply-To: <4F868BFD.4030306@ed.ac.uk> References: <39571EA9316BE44899D59C7A640C13F502FBFB@WARVWEXC2.uk.deluxe-eu.com> <4F868BFD.4030306@ed.ac.uk> Message-ID: There are a number of small file performance improvements around memory utilization of small file IO, updated algorithms for prefetching, inode cache management and logging. "Each fileset owner now has the ability to control quotas for users and groups of their fileset." This just means that each fileset can be managed independently. There is no new "owner" context in GPFS 3.5. Scott Fadden From: Orlando Richards To: gpfsug-discuss at gpfsug.org, Date: 04/12/2012 01:04 AM Subject: Re: [gpfsug-discuss] GPFS 3.5 Announcement Sent by: gpfsug-discuss-bounces at gpfsug.org Good stuff - thanks for forwarding that on Jez. I wonder what the "improved small file performance" is. Also interesting to see mention of a "fileset owner": "Each fileset owner now has the ability to control quotas for users and groups of their fileset." I'll look forward to giving this a good kick about on April 20th - I've already booked a slot in my diary ;) -- Orlando On 11/04/12 16:19, Jez Tucker wrote: > FYI: > > http://www-01.ibm.com/common/ssi/cgi-bin/ssialias?subtype=ca&infotype=an&appname=iSource&supplier=877&letternum=ENUSZP12-0057 > < http://www-01.ibm.com/common/ssi/cgi-bin/ssialias?subtype=ca&infotype=an&appname=iSource&supplier=877&letternum=ENUSZP12-0057 > > > --- > > Jez Tucker > > Senior Sysadmin > > Rushes > > GPFSUG Chairman (chair at gpfsug.org) > > > Rushes Postproduction Limited, 66 Old Compton Street, London W1D 4UH > tel: +44 (0)20 7437 8676 > web: http://www.rushes.co.uk > The information contained in this e-mail is confidential and may be > subject to legal privilege. If you are not the intended recipient, you > must not use, copy, distribute or disclose the e-mail or any part of its > contents or take any action in reliance on it. If you have received this > e-mail in error, please e-mail the sender by replying to this message. > All reasonable precautions have been taken to ensure no viruses are > present in this e-mail. Rushes Postproduction Limited cannot accept > responsibility for loss or damage arising from the use of this e-mail or > attachments and recommend that you subject these to your virus checking > procedures prior to use. > > > _______________________________________________ > gpfsug-discuss mailing list > gpfsug-discuss at gpfsug.org > http://gpfsug.org/mailman/listinfo/gpfsug-discuss -- -- Dr Orlando Richards Information Services IT Infrastructure Division Unix Section Tel: 0131 650 4994 The University of Edinburgh is a charitable body, registered in Scotland, with registration number SC005336. _______________________________________________ gpfsug-discuss mailing list gpfsug-discuss at gpfsug.org http://gpfsug.org/mailman/listinfo/gpfsug-discuss -------------- next part -------------- An HTML attachment was scrubbed... URL: From Jez.Tucker at rushes.co.uk Tue Apr 17 17:13:15 2012 From: Jez.Tucker at rushes.co.uk (Jez Tucker) Date: Tue, 17 Apr 2012 16:13:15 +0000 Subject: [gpfsug-discuss] Next user group content Message-ID: <39571EA9316BE44899D59C7A640C13F50319BB@WARVWEXC2.uk.deluxe-eu.com> Hello all I'm starting to plan the next UG. [Reminds me that I need to put the minutes of the last group up too]. Items that we _may_ be able to show/talk about are: - V7000 / V7000 Unified. Rolled GPFS storage product. http://www-03.ibm.com/systems/storage/disk/storwize_v7000/ - WARP. GPFS super I/O many streaming video solution. http://canditmedia.com/solutions.html - Kove XPD2. Metadata acceleration. http://kove.com/xpress Which, if any, of these are of interest? Or, please suggest an area/product you would like us to explore. Jez --- Jez Tucker Senior Sysadmin Rushes GPFSUG Chairman (chair at gpfsug.org) -------------- next part -------------- An HTML attachment was scrubbed... URL: From crobson at ocf.co.uk Mon Apr 23 09:51:43 2012 From: crobson at ocf.co.uk (Claire Robson) Date: Mon, 23 Apr 2012 09:51:43 +0100 Subject: [gpfsug-discuss] Next user group meeting date In-Reply-To: <39571EA9316BE44899D59C7A640C13F50319BB@WARVWEXC2.uk.deluxe-eu.com> References: <39571EA9316BE44899D59C7A640C13F50319BB@WARVWEXC2.uk.deluxe-eu.com> Message-ID: Dear All, Paul Tomlinson, AWE has very kindly offered to host our next Group meeting. The date we propose is Thursday 20th September and the meeting will take place in the Reading area. If anyone has any serious objections to this date please let me know by Monday 1st May. Otherwise we will confirm plans for this date shortly. Thanks, Claire Robson GPFS UG Secretary (secretary at gpfsug.org From: gpfsug-discuss-bounces at gpfsug.org [mailto:gpfsug-discuss-bounces at gpfsug.org] On Behalf Of Jez Tucker Sent: 17 April 2012 17:13 To: gpfsug main discussion list Subject: [gpfsug-discuss] Next user group content Hello all I'm starting to plan the next UG. [Reminds me that I need to put the minutes of the last group up too]. Items that we _may_ be able to show/talk about are: - V7000 / V7000 Unified. Rolled GPFS storage product. http://www-03.ibm.com/systems/storage/disk/storwize_v7000/ - WARP. GPFS super I/O many streaming video solution. http://canditmedia.com/solutions.html - Kove XPD2. Metadata acceleration. http://kove.com/xpress Which, if any, of these are of interest? Or, please suggest an area/product you would like us to explore. Jez --- Jez Tucker Senior Sysadmin Rushes GPFSUG Chairman (chair at gpfsug.org) -------------- next part -------------- An HTML attachment was scrubbed... URL: From mail at arif-ali.co.uk Wed Apr 25 19:20:09 2012 From: mail at arif-ali.co.uk (Arif Ali) Date: Wed, 25 Apr 2012 19:20:09 +0100 Subject: [gpfsug-discuss] GPFS 3.5 Announcement In-Reply-To: <39571EA9316BE44899D59C7A640C13F502FBFB@WARVWEXC2.uk.deluxe-eu.com> References: <39571EA9316BE44899D59C7A640C13F502FBFB@WARVWEXC2.uk.deluxe-eu.com> Message-ID: <4F984059.40301@arif-ali.co.uk> Hi all, I have (with help from Barry) found that 3.5 also have .deb packages available. Well, I delved in, and tried installing them on my laptop, to see if it would compile. 3 things come from my experience so far 1. The compilation detects my machine as debian, in-fact it is Ubuntu, so the testing in the configure needs to change such that it checks for lsb-release before the debian_version in /etc. But in the meantime "make LINUX_DISTRIBUTION=UBUNTU_LINUX Autoconfig" does the job, i.e after copying config/env.mcr.sample to config/env.mcr 2. At the moment with 3.5.0-1, the compilation does not succeed on 11.10. Is there any documentation out there that shows which flavours of Ubuntu/Debian are in-fact supported. I will try it on an older karmic test machine that I have already, and see how far I get. 3. The documentations on http://publib.boulder.ibm.com/infocenter/clresctr/vxrx/index.jsp don't give any indication of Ubuntu/Debian support any pointers from anyone would be great regards, *Arif* On 11/04/12 16:19, Jez Tucker wrote: > > FYI: > > http://www-01.ibm.com/common/ssi/cgi-bin/ssialias?subtype=ca&infotype=an&appname=iSource&supplier=877&letternum=ENUSZP12-0057 > > > --- > > Jez Tucker > > Senior Sysadmin > > Rushes > > GPFSUG Chairman (chair at gpfsug.org) > > > Rushes Postproduction Limited, 66 Old Compton Street, London W1D 4UH > tel: +44 (0)20 7437 8676 > web: http://www.rushes.co.uk > The information contained in this e-mail is confidential and may be > subject to legal privilege. If you are not the intended recipient, you > must not use, copy, distribute or disclose the e-mail or any part of > its contents or take any action in reliance on it. If you have > received this e-mail in error, please e-mail the sender by replying to > this message. All reasonable precautions have been taken to ensure no > viruses are present in this e-mail. Rushes Postproduction Limited > cannot accept responsibility for loss or damage arising from the use > of this e-mail or attachments and recommend that you subject these to > your virus checking procedures prior to use. > > > _______________________________________________ > gpfsug-discuss mailing list > gpfsug-discuss at gpfsug.org > http://gpfsug.org/mailman/listinfo/gpfsug-discuss -------------- next part -------------- An HTML attachment was scrubbed... URL: From j.buzzard at dundee.ac.uk Wed Apr 25 19:27:24 2012 From: j.buzzard at dundee.ac.uk (Jonathan Buzzard) Date: Wed, 25 Apr 2012 19:27:24 +0100 Subject: [gpfsug-discuss] GPFS 3.5 Announcement In-Reply-To: <4F984059.40301@arif-ali.co.uk> References: <39571EA9316BE44899D59C7A640C13F502FBFB@WARVWEXC2.uk.deluxe-eu.com> <4F984059.40301@arif-ali.co.uk> Message-ID: <4F98420C.6000707@dundee.ac.uk> Arif Ali wrote: > Hi all, > > I have (with help from Barry) found that 3.5 also have .deb packages > available. > > Well, I delved in, and tried installing them on my laptop, to see if it > would compile. > > 3 things come from my experience so far > > 1. The compilation detects my machine as debian, in-fact it is Ubuntu, > so the testing in the configure needs to change such that it checks for > lsb-release before the debian_version in /etc. But in the meantime "make > LINUX_DISTRIBUTION=UBUNTU_LINUX Autoconfig" does the job, i.e after > copying config/env.mcr.sample to config/env.mcr > > 2. At the moment with 3.5.0-1, the compilation does not succeed on > 11.10. Is there any documentation out there that shows which flavours of > Ubuntu/Debian are in-fact supported. I will try it on an older karmic > test machine that I have already, and see how far I get. > Yes the updated FAQ says that Debian 6 (aka squeeze) is the only supported version, so you are out of luck with Ubuntu. The FAQ also says that 3.5.0-1 supports mounting DMAPI enabled file systems on Windows, and gives contradictory information on 3.40-13 being able to do the same. Another gotya is that 3.5 only supports the TSM 6.3 client for backup, so if like us you have yet to upgrade your servers past 5.5.x you cannot upgrade :-( I will also add that if you download the latest vfs_gpfs from git it has patches to report disk sizes bases on quotas, in particular fileset quotas. JAB. -- Jonathan A. Buzzard Tel: +441382-386998 Storage Administrator, College of Life Sciences University of Dundee, DD1 5EH From bevans at canditmedia.co.uk Wed Apr 25 19:34:45 2012 From: bevans at canditmedia.co.uk (Barry Evans) Date: Wed, 25 Apr 2012 19:34:45 +0100 Subject: [gpfsug-discuss] GPFS 3.5 Announcement In-Reply-To: <4F98420C.6000707@dundee.ac.uk> References: <39571EA9316BE44899D59C7A640C13F502FBFB@WARVWEXC2.uk.deluxe-eu.com> <4F984059.40301@arif-ali.co.uk> <4F98420C.6000707@dundee.ac.uk> Message-ID: <320BB048-EAFB-4FA8-89D2-BB4CAB2658D0@canditmedia.co.uk> Also watch out for the hotfix requirement on Windows 2008 R2 SP1 (the faq says there isn't a requirment, but there is - check the forum for the link) - they may have updated the faq by now now. > I will also add that if you download the latest vfs_gpfs from git it has patches to report disk sizes bases on quotas, in particular fileset quotas. that sounds verrrrrryyy nice, have you tried it out? Cheers, Barry On 25 Apr 2012, at 19:27, Jonathan Buzzard wrote: > Arif Ali wrote: >> Hi all, >> I have (with help from Barry) found that 3.5 also have .deb packages available. >> Well, I delved in, and tried installing them on my laptop, to see if it would compile. >> 3 things come from my experience so far >> 1. The compilation detects my machine as debian, in-fact it is Ubuntu, so the testing in the configure needs to change such that it checks for lsb-release before the debian_version in /etc. But in the meantime "make LINUX_DISTRIBUTION=UBUNTU_LINUX Autoconfig" does the job, i.e after copying config/env.mcr.sample to config/env.mcr >> 2. At the moment with 3.5.0-1, the compilation does not succeed on 11.10. Is there any documentation out there that shows which flavours of Ubuntu/Debian are in-fact supported. I will try it on an older karmic test machine that I have already, and see how far I get. > > Yes the updated FAQ says that Debian 6 (aka squeeze) is the only supported version, so you are out of luck with Ubuntu. > > The FAQ also says that 3.5.0-1 supports mounting DMAPI enabled file systems on Windows, and gives contradictory information on 3.40-13 being able to do the same. > > Another gotya is that 3.5 only supports the TSM 6.3 client for backup, so if like us you have yet to upgrade your servers past 5.5.x you cannot upgrade :-( > > I will also add that if you download the latest vfs_gpfs from git it has patches to report disk sizes bases on quotas, in particular fileset quotas. > > > JAB. > > -- > Jonathan A. Buzzard Tel: +441382-386998 > Storage Administrator, College of Life Sciences > University of Dundee, DD1 5EH > _______________________________________________ > gpfsug-discuss mailing list > gpfsug-discuss at gpfsug.org > http://gpfsug.org/mailman/listinfo/gpfsug-discuss From j.buzzard at dundee.ac.uk Wed Apr 25 23:09:59 2012 From: j.buzzard at dundee.ac.uk (Jonathan Buzzard) Date: Wed, 25 Apr 2012 23:09:59 +0100 Subject: [gpfsug-discuss] GPFS 3.5 Announcement In-Reply-To: <320BB048-EAFB-4FA8-89D2-BB4CAB2658D0@canditmedia.co.uk> References: <39571EA9316BE44899D59C7A640C13F502FBFB@WARVWEXC2.uk.deluxe-eu.com> <4F984059.40301@arif-ali.co.uk> <4F98420C.6000707@dundee.ac.uk> <320BB048-EAFB-4FA8-89D2-BB4CAB2658D0@canditmedia.co.uk> Message-ID: <4F987637.7070203@dundee.ac.uk> Barry Evans wrote: [SNIP] >> I will also add that if you download the latest vfs_gpfs from git >> it has patches to report disk sizes bases on quotas, in particular >> fileset quotas. > > that sounds verrrrrryyy nice, have you tried it out? > No, because it uses soft quotas. What I do is set the soft quota at 95% of the hard quota and use it to indicate that people are running low, it is fed into zenoss. The grace period is then set really high (3000 days was about as high as it would go reliably) with the actual limit and the charge back to the users being based on the fileset hard quota. The advantage of this method is that the alert in zenoss is triggered by an SNMP trap which is better than polling every five minutes. Therefore I continue to use my mmdfree command that I wrote which is based of hard quotas. I admit my usage of hard and soft quotas is rather unusual but it does works well. JAB. -- Jonathan A. Buzzard Tel: +441382-386998 Storage Administrator, College of Life Sciences University of Dundee, DD1 5EH From crobson at ocf.co.uk Mon Apr 2 09:26:10 2012 From: crobson at ocf.co.uk (Claire Robson) Date: Mon, 2 Apr 2012 09:26:10 +0100 Subject: [gpfsug-discuss] Understanding and Improving Computational Science Storage Access through Continuous Characterization Message-ID: Hi All, Andreas Landhaeusser has kindly sent over some further information following his presentation at the last User Group meeting, details are below: Measuring the storage performance, http://www.storageconference.org/2011/Papers/Research/1.Carns.pdf ANL developed Darshan for characterization and improving I/O performance of workloads http://www.mcs.anl.gov/research/projects/darshan/ Thanks, Claire GPFS User Group Secretary From Jez.Tucker at rushes.co.uk Wed Apr 11 16:19:58 2012 From: Jez.Tucker at rushes.co.uk (Jez Tucker) Date: Wed, 11 Apr 2012 15:19:58 +0000 Subject: [gpfsug-discuss] GPFS 3.5 Announcement Message-ID: <39571EA9316BE44899D59C7A640C13F502FBFB@WARVWEXC2.uk.deluxe-eu.com> FYI: http://www-01.ibm.com/common/ssi/cgi-bin/ssialias?subtype=ca&infotype=an&appname=iSource&supplier=877&letternum=ENUSZP12-0057 --- Jez Tucker Senior Sysadmin Rushes GPFSUG Chairman (chair at gpfsug.org) Rushes Postproduction Limited, 66 Old Compton Street, London W1D 4UH tel: +44 (0)20 7437 8676 web: http://www.rushes.co.uk The information contained in this e-mail is confidential and may be subject to legal privilege. If you are not the intended recipient, you must not use, copy, distribute or disclose the e-mail or any part of its contents or take any action in reliance on it. If you have received this e-mail in error, please e-mail the sender by replying to this message. All reasonable precautions have been taken to ensure no viruses are present in this e-mail. Rushes Postproduction Limited cannot accept responsibility for loss or damage arising from the use of this e-mail or attachments and recommend that you subject these to your virus checking procedures prior to use. -------------- next part -------------- An HTML attachment was scrubbed... URL: From orlando.richards at ed.ac.uk Thu Apr 12 09:02:05 2012 From: orlando.richards at ed.ac.uk (Orlando Richards) Date: Thu, 12 Apr 2012 09:02:05 +0100 Subject: [gpfsug-discuss] GPFS 3.5 Announcement In-Reply-To: <39571EA9316BE44899D59C7A640C13F502FBFB@WARVWEXC2.uk.deluxe-eu.com> References: <39571EA9316BE44899D59C7A640C13F502FBFB@WARVWEXC2.uk.deluxe-eu.com> Message-ID: <4F868BFD.4030306@ed.ac.uk> Good stuff - thanks for forwarding that on Jez. I wonder what the "improved small file performance" is. Also interesting to see mention of a "fileset owner": "Each fileset owner now has the ability to control quotas for users and groups of their fileset." I'll look forward to giving this a good kick about on April 20th - I've already booked a slot in my diary ;) -- Orlando On 11/04/12 16:19, Jez Tucker wrote: > FYI: > > http://www-01.ibm.com/common/ssi/cgi-bin/ssialias?subtype=ca&infotype=an&appname=iSource&supplier=877&letternum=ENUSZP12-0057 > > > --- > > Jez Tucker > > Senior Sysadmin > > Rushes > > GPFSUG Chairman (chair at gpfsug.org) > > > Rushes Postproduction Limited, 66 Old Compton Street, London W1D 4UH > tel: +44 (0)20 7437 8676 > web: http://www.rushes.co.uk > The information contained in this e-mail is confidential and may be > subject to legal privilege. If you are not the intended recipient, you > must not use, copy, distribute or disclose the e-mail or any part of its > contents or take any action in reliance on it. If you have received this > e-mail in error, please e-mail the sender by replying to this message. > All reasonable precautions have been taken to ensure no viruses are > present in this e-mail. Rushes Postproduction Limited cannot accept > responsibility for loss or damage arising from the use of this e-mail or > attachments and recommend that you subject these to your virus checking > procedures prior to use. > > > _______________________________________________ > gpfsug-discuss mailing list > gpfsug-discuss at gpfsug.org > http://gpfsug.org/mailman/listinfo/gpfsug-discuss -- -- Dr Orlando Richards Information Services IT Infrastructure Division Unix Section Tel: 0131 650 4994 The University of Edinburgh is a charitable body, registered in Scotland, with registration number SC005336. From ANDREWD at uk.ibm.com Thu Apr 12 17:02:33 2012 From: ANDREWD at uk.ibm.com (Andrew Downes1) Date: Thu, 12 Apr 2012 16:02:33 +0000 Subject: [gpfsug-discuss] AUTO: Andrew Downes is out of the office (returning 16/04/2012) Message-ID: I am out of the office until 16/04/2012. In my absence please contact Matt Ayres mailto:m_ayres at uk.ibm.com 07710-981527 In case of urgency, please contact our manager Andy Jenkins mailto:JENKINSA at uk.ibm.com 07921-108940 Note: This is an automated response to your message "gpfsug-discuss Digest, Vol 4, Issue 2" sent on 12/4/2012 11:00:01. This is the only notification you will receive while this person is away. From sfadden at us.ibm.com Thu Apr 12 17:29:39 2012 From: sfadden at us.ibm.com (Scott Fadden) Date: Thu, 12 Apr 2012 09:29:39 -0700 Subject: [gpfsug-discuss] GPFS 3.5 Announcement In-Reply-To: <4F868BFD.4030306@ed.ac.uk> References: <39571EA9316BE44899D59C7A640C13F502FBFB@WARVWEXC2.uk.deluxe-eu.com> <4F868BFD.4030306@ed.ac.uk> Message-ID: There are a number of small file performance improvements around memory utilization of small file IO, updated algorithms for prefetching, inode cache management and logging. "Each fileset owner now has the ability to control quotas for users and groups of their fileset." This just means that each fileset can be managed independently. There is no new "owner" context in GPFS 3.5. Scott Fadden From: Orlando Richards To: gpfsug-discuss at gpfsug.org, Date: 04/12/2012 01:04 AM Subject: Re: [gpfsug-discuss] GPFS 3.5 Announcement Sent by: gpfsug-discuss-bounces at gpfsug.org Good stuff - thanks for forwarding that on Jez. I wonder what the "improved small file performance" is. Also interesting to see mention of a "fileset owner": "Each fileset owner now has the ability to control quotas for users and groups of their fileset." I'll look forward to giving this a good kick about on April 20th - I've already booked a slot in my diary ;) -- Orlando On 11/04/12 16:19, Jez Tucker wrote: > FYI: > > http://www-01.ibm.com/common/ssi/cgi-bin/ssialias?subtype=ca&infotype=an&appname=iSource&supplier=877&letternum=ENUSZP12-0057 > < http://www-01.ibm.com/common/ssi/cgi-bin/ssialias?subtype=ca&infotype=an&appname=iSource&supplier=877&letternum=ENUSZP12-0057 > > > --- > > Jez Tucker > > Senior Sysadmin > > Rushes > > GPFSUG Chairman (chair at gpfsug.org) > > > Rushes Postproduction Limited, 66 Old Compton Street, London W1D 4UH > tel: +44 (0)20 7437 8676 > web: http://www.rushes.co.uk > The information contained in this e-mail is confidential and may be > subject to legal privilege. If you are not the intended recipient, you > must not use, copy, distribute or disclose the e-mail or any part of its > contents or take any action in reliance on it. If you have received this > e-mail in error, please e-mail the sender by replying to this message. > All reasonable precautions have been taken to ensure no viruses are > present in this e-mail. Rushes Postproduction Limited cannot accept > responsibility for loss or damage arising from the use of this e-mail or > attachments and recommend that you subject these to your virus checking > procedures prior to use. > > > _______________________________________________ > gpfsug-discuss mailing list > gpfsug-discuss at gpfsug.org > http://gpfsug.org/mailman/listinfo/gpfsug-discuss -- -- Dr Orlando Richards Information Services IT Infrastructure Division Unix Section Tel: 0131 650 4994 The University of Edinburgh is a charitable body, registered in Scotland, with registration number SC005336. _______________________________________________ gpfsug-discuss mailing list gpfsug-discuss at gpfsug.org http://gpfsug.org/mailman/listinfo/gpfsug-discuss -------------- next part -------------- An HTML attachment was scrubbed... URL: From Jez.Tucker at rushes.co.uk Tue Apr 17 17:13:15 2012 From: Jez.Tucker at rushes.co.uk (Jez Tucker) Date: Tue, 17 Apr 2012 16:13:15 +0000 Subject: [gpfsug-discuss] Next user group content Message-ID: <39571EA9316BE44899D59C7A640C13F50319BB@WARVWEXC2.uk.deluxe-eu.com> Hello all I'm starting to plan the next UG. [Reminds me that I need to put the minutes of the last group up too]. Items that we _may_ be able to show/talk about are: - V7000 / V7000 Unified. Rolled GPFS storage product. http://www-03.ibm.com/systems/storage/disk/storwize_v7000/ - WARP. GPFS super I/O many streaming video solution. http://canditmedia.com/solutions.html - Kove XPD2. Metadata acceleration. http://kove.com/xpress Which, if any, of these are of interest? Or, please suggest an area/product you would like us to explore. Jez --- Jez Tucker Senior Sysadmin Rushes GPFSUG Chairman (chair at gpfsug.org) -------------- next part -------------- An HTML attachment was scrubbed... URL: From crobson at ocf.co.uk Mon Apr 23 09:51:43 2012 From: crobson at ocf.co.uk (Claire Robson) Date: Mon, 23 Apr 2012 09:51:43 +0100 Subject: [gpfsug-discuss] Next user group meeting date In-Reply-To: <39571EA9316BE44899D59C7A640C13F50319BB@WARVWEXC2.uk.deluxe-eu.com> References: <39571EA9316BE44899D59C7A640C13F50319BB@WARVWEXC2.uk.deluxe-eu.com> Message-ID: Dear All, Paul Tomlinson, AWE has very kindly offered to host our next Group meeting. The date we propose is Thursday 20th September and the meeting will take place in the Reading area. If anyone has any serious objections to this date please let me know by Monday 1st May. Otherwise we will confirm plans for this date shortly. Thanks, Claire Robson GPFS UG Secretary (secretary at gpfsug.org From: gpfsug-discuss-bounces at gpfsug.org [mailto:gpfsug-discuss-bounces at gpfsug.org] On Behalf Of Jez Tucker Sent: 17 April 2012 17:13 To: gpfsug main discussion list Subject: [gpfsug-discuss] Next user group content Hello all I'm starting to plan the next UG. [Reminds me that I need to put the minutes of the last group up too]. Items that we _may_ be able to show/talk about are: - V7000 / V7000 Unified. Rolled GPFS storage product. http://www-03.ibm.com/systems/storage/disk/storwize_v7000/ - WARP. GPFS super I/O many streaming video solution. http://canditmedia.com/solutions.html - Kove XPD2. Metadata acceleration. http://kove.com/xpress Which, if any, of these are of interest? Or, please suggest an area/product you would like us to explore. Jez --- Jez Tucker Senior Sysadmin Rushes GPFSUG Chairman (chair at gpfsug.org) -------------- next part -------------- An HTML attachment was scrubbed... URL: From mail at arif-ali.co.uk Wed Apr 25 19:20:09 2012 From: mail at arif-ali.co.uk (Arif Ali) Date: Wed, 25 Apr 2012 19:20:09 +0100 Subject: [gpfsug-discuss] GPFS 3.5 Announcement In-Reply-To: <39571EA9316BE44899D59C7A640C13F502FBFB@WARVWEXC2.uk.deluxe-eu.com> References: <39571EA9316BE44899D59C7A640C13F502FBFB@WARVWEXC2.uk.deluxe-eu.com> Message-ID: <4F984059.40301@arif-ali.co.uk> Hi all, I have (with help from Barry) found that 3.5 also have .deb packages available. Well, I delved in, and tried installing them on my laptop, to see if it would compile. 3 things come from my experience so far 1. The compilation detects my machine as debian, in-fact it is Ubuntu, so the testing in the configure needs to change such that it checks for lsb-release before the debian_version in /etc. But in the meantime "make LINUX_DISTRIBUTION=UBUNTU_LINUX Autoconfig" does the job, i.e after copying config/env.mcr.sample to config/env.mcr 2. At the moment with 3.5.0-1, the compilation does not succeed on 11.10. Is there any documentation out there that shows which flavours of Ubuntu/Debian are in-fact supported. I will try it on an older karmic test machine that I have already, and see how far I get. 3. The documentations on http://publib.boulder.ibm.com/infocenter/clresctr/vxrx/index.jsp don't give any indication of Ubuntu/Debian support any pointers from anyone would be great regards, *Arif* On 11/04/12 16:19, Jez Tucker wrote: > > FYI: > > http://www-01.ibm.com/common/ssi/cgi-bin/ssialias?subtype=ca&infotype=an&appname=iSource&supplier=877&letternum=ENUSZP12-0057 > > > --- > > Jez Tucker > > Senior Sysadmin > > Rushes > > GPFSUG Chairman (chair at gpfsug.org) > > > Rushes Postproduction Limited, 66 Old Compton Street, London W1D 4UH > tel: +44 (0)20 7437 8676 > web: http://www.rushes.co.uk > The information contained in this e-mail is confidential and may be > subject to legal privilege. If you are not the intended recipient, you > must not use, copy, distribute or disclose the e-mail or any part of > its contents or take any action in reliance on it. If you have > received this e-mail in error, please e-mail the sender by replying to > this message. All reasonable precautions have been taken to ensure no > viruses are present in this e-mail. Rushes Postproduction Limited > cannot accept responsibility for loss or damage arising from the use > of this e-mail or attachments and recommend that you subject these to > your virus checking procedures prior to use. > > > _______________________________________________ > gpfsug-discuss mailing list > gpfsug-discuss at gpfsug.org > http://gpfsug.org/mailman/listinfo/gpfsug-discuss -------------- next part -------------- An HTML attachment was scrubbed... URL: From j.buzzard at dundee.ac.uk Wed Apr 25 19:27:24 2012 From: j.buzzard at dundee.ac.uk (Jonathan Buzzard) Date: Wed, 25 Apr 2012 19:27:24 +0100 Subject: [gpfsug-discuss] GPFS 3.5 Announcement In-Reply-To: <4F984059.40301@arif-ali.co.uk> References: <39571EA9316BE44899D59C7A640C13F502FBFB@WARVWEXC2.uk.deluxe-eu.com> <4F984059.40301@arif-ali.co.uk> Message-ID: <4F98420C.6000707@dundee.ac.uk> Arif Ali wrote: > Hi all, > > I have (with help from Barry) found that 3.5 also have .deb packages > available. > > Well, I delved in, and tried installing them on my laptop, to see if it > would compile. > > 3 things come from my experience so far > > 1. The compilation detects my machine as debian, in-fact it is Ubuntu, > so the testing in the configure needs to change such that it checks for > lsb-release before the debian_version in /etc. But in the meantime "make > LINUX_DISTRIBUTION=UBUNTU_LINUX Autoconfig" does the job, i.e after > copying config/env.mcr.sample to config/env.mcr > > 2. At the moment with 3.5.0-1, the compilation does not succeed on > 11.10. Is there any documentation out there that shows which flavours of > Ubuntu/Debian are in-fact supported. I will try it on an older karmic > test machine that I have already, and see how far I get. > Yes the updated FAQ says that Debian 6 (aka squeeze) is the only supported version, so you are out of luck with Ubuntu. The FAQ also says that 3.5.0-1 supports mounting DMAPI enabled file systems on Windows, and gives contradictory information on 3.40-13 being able to do the same. Another gotya is that 3.5 only supports the TSM 6.3 client for backup, so if like us you have yet to upgrade your servers past 5.5.x you cannot upgrade :-( I will also add that if you download the latest vfs_gpfs from git it has patches to report disk sizes bases on quotas, in particular fileset quotas. JAB. -- Jonathan A. Buzzard Tel: +441382-386998 Storage Administrator, College of Life Sciences University of Dundee, DD1 5EH From bevans at canditmedia.co.uk Wed Apr 25 19:34:45 2012 From: bevans at canditmedia.co.uk (Barry Evans) Date: Wed, 25 Apr 2012 19:34:45 +0100 Subject: [gpfsug-discuss] GPFS 3.5 Announcement In-Reply-To: <4F98420C.6000707@dundee.ac.uk> References: <39571EA9316BE44899D59C7A640C13F502FBFB@WARVWEXC2.uk.deluxe-eu.com> <4F984059.40301@arif-ali.co.uk> <4F98420C.6000707@dundee.ac.uk> Message-ID: <320BB048-EAFB-4FA8-89D2-BB4CAB2658D0@canditmedia.co.uk> Also watch out for the hotfix requirement on Windows 2008 R2 SP1 (the faq says there isn't a requirment, but there is - check the forum for the link) - they may have updated the faq by now now. > I will also add that if you download the latest vfs_gpfs from git it has patches to report disk sizes bases on quotas, in particular fileset quotas. that sounds verrrrrryyy nice, have you tried it out? Cheers, Barry On 25 Apr 2012, at 19:27, Jonathan Buzzard wrote: > Arif Ali wrote: >> Hi all, >> I have (with help from Barry) found that 3.5 also have .deb packages available. >> Well, I delved in, and tried installing them on my laptop, to see if it would compile. >> 3 things come from my experience so far >> 1. The compilation detects my machine as debian, in-fact it is Ubuntu, so the testing in the configure needs to change such that it checks for lsb-release before the debian_version in /etc. But in the meantime "make LINUX_DISTRIBUTION=UBUNTU_LINUX Autoconfig" does the job, i.e after copying config/env.mcr.sample to config/env.mcr >> 2. At the moment with 3.5.0-1, the compilation does not succeed on 11.10. Is there any documentation out there that shows which flavours of Ubuntu/Debian are in-fact supported. I will try it on an older karmic test machine that I have already, and see how far I get. > > Yes the updated FAQ says that Debian 6 (aka squeeze) is the only supported version, so you are out of luck with Ubuntu. > > The FAQ also says that 3.5.0-1 supports mounting DMAPI enabled file systems on Windows, and gives contradictory information on 3.40-13 being able to do the same. > > Another gotya is that 3.5 only supports the TSM 6.3 client for backup, so if like us you have yet to upgrade your servers past 5.5.x you cannot upgrade :-( > > I will also add that if you download the latest vfs_gpfs from git it has patches to report disk sizes bases on quotas, in particular fileset quotas. > > > JAB. > > -- > Jonathan A. Buzzard Tel: +441382-386998 > Storage Administrator, College of Life Sciences > University of Dundee, DD1 5EH > _______________________________________________ > gpfsug-discuss mailing list > gpfsug-discuss at gpfsug.org > http://gpfsug.org/mailman/listinfo/gpfsug-discuss From j.buzzard at dundee.ac.uk Wed Apr 25 23:09:59 2012 From: j.buzzard at dundee.ac.uk (Jonathan Buzzard) Date: Wed, 25 Apr 2012 23:09:59 +0100 Subject: [gpfsug-discuss] GPFS 3.5 Announcement In-Reply-To: <320BB048-EAFB-4FA8-89D2-BB4CAB2658D0@canditmedia.co.uk> References: <39571EA9316BE44899D59C7A640C13F502FBFB@WARVWEXC2.uk.deluxe-eu.com> <4F984059.40301@arif-ali.co.uk> <4F98420C.6000707@dundee.ac.uk> <320BB048-EAFB-4FA8-89D2-BB4CAB2658D0@canditmedia.co.uk> Message-ID: <4F987637.7070203@dundee.ac.uk> Barry Evans wrote: [SNIP] >> I will also add that if you download the latest vfs_gpfs from git >> it has patches to report disk sizes bases on quotas, in particular >> fileset quotas. > > that sounds verrrrrryyy nice, have you tried it out? > No, because it uses soft quotas. What I do is set the soft quota at 95% of the hard quota and use it to indicate that people are running low, it is fed into zenoss. The grace period is then set really high (3000 days was about as high as it would go reliably) with the actual limit and the charge back to the users being based on the fileset hard quota. The advantage of this method is that the alert in zenoss is triggered by an SNMP trap which is better than polling every five minutes. Therefore I continue to use my mmdfree command that I wrote which is based of hard quotas. I admit my usage of hard and soft quotas is rather unusual but it does works well. JAB. -- Jonathan A. Buzzard Tel: +441382-386998 Storage Administrator, College of Life Sciences University of Dundee, DD1 5EH From crobson at ocf.co.uk Mon Apr 2 09:26:10 2012 From: crobson at ocf.co.uk (Claire Robson) Date: Mon, 2 Apr 2012 09:26:10 +0100 Subject: [gpfsug-discuss] Understanding and Improving Computational Science Storage Access through Continuous Characterization Message-ID: Hi All, Andreas Landhaeusser has kindly sent over some further information following his presentation at the last User Group meeting, details are below: Measuring the storage performance, http://www.storageconference.org/2011/Papers/Research/1.Carns.pdf ANL developed Darshan for characterization and improving I/O performance of workloads http://www.mcs.anl.gov/research/projects/darshan/ Thanks, Claire GPFS User Group Secretary From Jez.Tucker at rushes.co.uk Wed Apr 11 16:19:58 2012 From: Jez.Tucker at rushes.co.uk (Jez Tucker) Date: Wed, 11 Apr 2012 15:19:58 +0000 Subject: [gpfsug-discuss] GPFS 3.5 Announcement Message-ID: <39571EA9316BE44899D59C7A640C13F502FBFB@WARVWEXC2.uk.deluxe-eu.com> FYI: http://www-01.ibm.com/common/ssi/cgi-bin/ssialias?subtype=ca&infotype=an&appname=iSource&supplier=877&letternum=ENUSZP12-0057 --- Jez Tucker Senior Sysadmin Rushes GPFSUG Chairman (chair at gpfsug.org) Rushes Postproduction Limited, 66 Old Compton Street, London W1D 4UH tel: +44 (0)20 7437 8676 web: http://www.rushes.co.uk The information contained in this e-mail is confidential and may be subject to legal privilege. If you are not the intended recipient, you must not use, copy, distribute or disclose the e-mail or any part of its contents or take any action in reliance on it. If you have received this e-mail in error, please e-mail the sender by replying to this message. All reasonable precautions have been taken to ensure no viruses are present in this e-mail. Rushes Postproduction Limited cannot accept responsibility for loss or damage arising from the use of this e-mail or attachments and recommend that you subject these to your virus checking procedures prior to use. -------------- next part -------------- An HTML attachment was scrubbed... URL: From orlando.richards at ed.ac.uk Thu Apr 12 09:02:05 2012 From: orlando.richards at ed.ac.uk (Orlando Richards) Date: Thu, 12 Apr 2012 09:02:05 +0100 Subject: [gpfsug-discuss] GPFS 3.5 Announcement In-Reply-To: <39571EA9316BE44899D59C7A640C13F502FBFB@WARVWEXC2.uk.deluxe-eu.com> References: <39571EA9316BE44899D59C7A640C13F502FBFB@WARVWEXC2.uk.deluxe-eu.com> Message-ID: <4F868BFD.4030306@ed.ac.uk> Good stuff - thanks for forwarding that on Jez. I wonder what the "improved small file performance" is. Also interesting to see mention of a "fileset owner": "Each fileset owner now has the ability to control quotas for users and groups of their fileset." I'll look forward to giving this a good kick about on April 20th - I've already booked a slot in my diary ;) -- Orlando On 11/04/12 16:19, Jez Tucker wrote: > FYI: > > http://www-01.ibm.com/common/ssi/cgi-bin/ssialias?subtype=ca&infotype=an&appname=iSource&supplier=877&letternum=ENUSZP12-0057 > > > --- > > Jez Tucker > > Senior Sysadmin > > Rushes > > GPFSUG Chairman (chair at gpfsug.org) > > > Rushes Postproduction Limited, 66 Old Compton Street, London W1D 4UH > tel: +44 (0)20 7437 8676 > web: http://www.rushes.co.uk > The information contained in this e-mail is confidential and may be > subject to legal privilege. If you are not the intended recipient, you > must not use, copy, distribute or disclose the e-mail or any part of its > contents or take any action in reliance on it. If you have received this > e-mail in error, please e-mail the sender by replying to this message. > All reasonable precautions have been taken to ensure no viruses are > present in this e-mail. Rushes Postproduction Limited cannot accept > responsibility for loss or damage arising from the use of this e-mail or > attachments and recommend that you subject these to your virus checking > procedures prior to use. > > > _______________________________________________ > gpfsug-discuss mailing list > gpfsug-discuss at gpfsug.org > http://gpfsug.org/mailman/listinfo/gpfsug-discuss -- -- Dr Orlando Richards Information Services IT Infrastructure Division Unix Section Tel: 0131 650 4994 The University of Edinburgh is a charitable body, registered in Scotland, with registration number SC005336. From ANDREWD at uk.ibm.com Thu Apr 12 17:02:33 2012 From: ANDREWD at uk.ibm.com (Andrew Downes1) Date: Thu, 12 Apr 2012 16:02:33 +0000 Subject: [gpfsug-discuss] AUTO: Andrew Downes is out of the office (returning 16/04/2012) Message-ID: I am out of the office until 16/04/2012. In my absence please contact Matt Ayres mailto:m_ayres at uk.ibm.com 07710-981527 In case of urgency, please contact our manager Andy Jenkins mailto:JENKINSA at uk.ibm.com 07921-108940 Note: This is an automated response to your message "gpfsug-discuss Digest, Vol 4, Issue 2" sent on 12/4/2012 11:00:01. This is the only notification you will receive while this person is away. From sfadden at us.ibm.com Thu Apr 12 17:29:39 2012 From: sfadden at us.ibm.com (Scott Fadden) Date: Thu, 12 Apr 2012 09:29:39 -0700 Subject: [gpfsug-discuss] GPFS 3.5 Announcement In-Reply-To: <4F868BFD.4030306@ed.ac.uk> References: <39571EA9316BE44899D59C7A640C13F502FBFB@WARVWEXC2.uk.deluxe-eu.com> <4F868BFD.4030306@ed.ac.uk> Message-ID: There are a number of small file performance improvements around memory utilization of small file IO, updated algorithms for prefetching, inode cache management and logging. "Each fileset owner now has the ability to control quotas for users and groups of their fileset." This just means that each fileset can be managed independently. There is no new "owner" context in GPFS 3.5. Scott Fadden From: Orlando Richards To: gpfsug-discuss at gpfsug.org, Date: 04/12/2012 01:04 AM Subject: Re: [gpfsug-discuss] GPFS 3.5 Announcement Sent by: gpfsug-discuss-bounces at gpfsug.org Good stuff - thanks for forwarding that on Jez. I wonder what the "improved small file performance" is. Also interesting to see mention of a "fileset owner": "Each fileset owner now has the ability to control quotas for users and groups of their fileset." I'll look forward to giving this a good kick about on April 20th - I've already booked a slot in my diary ;) -- Orlando On 11/04/12 16:19, Jez Tucker wrote: > FYI: > > http://www-01.ibm.com/common/ssi/cgi-bin/ssialias?subtype=ca&infotype=an&appname=iSource&supplier=877&letternum=ENUSZP12-0057 > < http://www-01.ibm.com/common/ssi/cgi-bin/ssialias?subtype=ca&infotype=an&appname=iSource&supplier=877&letternum=ENUSZP12-0057 > > > --- > > Jez Tucker > > Senior Sysadmin > > Rushes > > GPFSUG Chairman (chair at gpfsug.org) > > > Rushes Postproduction Limited, 66 Old Compton Street, London W1D 4UH > tel: +44 (0)20 7437 8676 > web: http://www.rushes.co.uk > The information contained in this e-mail is confidential and may be > subject to legal privilege. If you are not the intended recipient, you > must not use, copy, distribute or disclose the e-mail or any part of its > contents or take any action in reliance on it. If you have received this > e-mail in error, please e-mail the sender by replying to this message. > All reasonable precautions have been taken to ensure no viruses are > present in this e-mail. Rushes Postproduction Limited cannot accept > responsibility for loss or damage arising from the use of this e-mail or > attachments and recommend that you subject these to your virus checking > procedures prior to use. > > > _______________________________________________ > gpfsug-discuss mailing list > gpfsug-discuss at gpfsug.org > http://gpfsug.org/mailman/listinfo/gpfsug-discuss -- -- Dr Orlando Richards Information Services IT Infrastructure Division Unix Section Tel: 0131 650 4994 The University of Edinburgh is a charitable body, registered in Scotland, with registration number SC005336. _______________________________________________ gpfsug-discuss mailing list gpfsug-discuss at gpfsug.org http://gpfsug.org/mailman/listinfo/gpfsug-discuss -------------- next part -------------- An HTML attachment was scrubbed... URL: From Jez.Tucker at rushes.co.uk Tue Apr 17 17:13:15 2012 From: Jez.Tucker at rushes.co.uk (Jez Tucker) Date: Tue, 17 Apr 2012 16:13:15 +0000 Subject: [gpfsug-discuss] Next user group content Message-ID: <39571EA9316BE44899D59C7A640C13F50319BB@WARVWEXC2.uk.deluxe-eu.com> Hello all I'm starting to plan the next UG. [Reminds me that I need to put the minutes of the last group up too]. Items that we _may_ be able to show/talk about are: - V7000 / V7000 Unified. Rolled GPFS storage product. http://www-03.ibm.com/systems/storage/disk/storwize_v7000/ - WARP. GPFS super I/O many streaming video solution. http://canditmedia.com/solutions.html - Kove XPD2. Metadata acceleration. http://kove.com/xpress Which, if any, of these are of interest? Or, please suggest an area/product you would like us to explore. Jez --- Jez Tucker Senior Sysadmin Rushes GPFSUG Chairman (chair at gpfsug.org) -------------- next part -------------- An HTML attachment was scrubbed... URL: From crobson at ocf.co.uk Mon Apr 23 09:51:43 2012 From: crobson at ocf.co.uk (Claire Robson) Date: Mon, 23 Apr 2012 09:51:43 +0100 Subject: [gpfsug-discuss] Next user group meeting date In-Reply-To: <39571EA9316BE44899D59C7A640C13F50319BB@WARVWEXC2.uk.deluxe-eu.com> References: <39571EA9316BE44899D59C7A640C13F50319BB@WARVWEXC2.uk.deluxe-eu.com> Message-ID: Dear All, Paul Tomlinson, AWE has very kindly offered to host our next Group meeting. The date we propose is Thursday 20th September and the meeting will take place in the Reading area. If anyone has any serious objections to this date please let me know by Monday 1st May. Otherwise we will confirm plans for this date shortly. Thanks, Claire Robson GPFS UG Secretary (secretary at gpfsug.org From: gpfsug-discuss-bounces at gpfsug.org [mailto:gpfsug-discuss-bounces at gpfsug.org] On Behalf Of Jez Tucker Sent: 17 April 2012 17:13 To: gpfsug main discussion list Subject: [gpfsug-discuss] Next user group content Hello all I'm starting to plan the next UG. [Reminds me that I need to put the minutes of the last group up too]. Items that we _may_ be able to show/talk about are: - V7000 / V7000 Unified. Rolled GPFS storage product. http://www-03.ibm.com/systems/storage/disk/storwize_v7000/ - WARP. GPFS super I/O many streaming video solution. http://canditmedia.com/solutions.html - Kove XPD2. Metadata acceleration. http://kove.com/xpress Which, if any, of these are of interest? Or, please suggest an area/product you would like us to explore. Jez --- Jez Tucker Senior Sysadmin Rushes GPFSUG Chairman (chair at gpfsug.org) -------------- next part -------------- An HTML attachment was scrubbed... URL: From mail at arif-ali.co.uk Wed Apr 25 19:20:09 2012 From: mail at arif-ali.co.uk (Arif Ali) Date: Wed, 25 Apr 2012 19:20:09 +0100 Subject: [gpfsug-discuss] GPFS 3.5 Announcement In-Reply-To: <39571EA9316BE44899D59C7A640C13F502FBFB@WARVWEXC2.uk.deluxe-eu.com> References: <39571EA9316BE44899D59C7A640C13F502FBFB@WARVWEXC2.uk.deluxe-eu.com> Message-ID: <4F984059.40301@arif-ali.co.uk> Hi all, I have (with help from Barry) found that 3.5 also have .deb packages available. Well, I delved in, and tried installing them on my laptop, to see if it would compile. 3 things come from my experience so far 1. The compilation detects my machine as debian, in-fact it is Ubuntu, so the testing in the configure needs to change such that it checks for lsb-release before the debian_version in /etc. But in the meantime "make LINUX_DISTRIBUTION=UBUNTU_LINUX Autoconfig" does the job, i.e after copying config/env.mcr.sample to config/env.mcr 2. At the moment with 3.5.0-1, the compilation does not succeed on 11.10. Is there any documentation out there that shows which flavours of Ubuntu/Debian are in-fact supported. I will try it on an older karmic test machine that I have already, and see how far I get. 3. The documentations on http://publib.boulder.ibm.com/infocenter/clresctr/vxrx/index.jsp don't give any indication of Ubuntu/Debian support any pointers from anyone would be great regards, *Arif* On 11/04/12 16:19, Jez Tucker wrote: > > FYI: > > http://www-01.ibm.com/common/ssi/cgi-bin/ssialias?subtype=ca&infotype=an&appname=iSource&supplier=877&letternum=ENUSZP12-0057 > > > --- > > Jez Tucker > > Senior Sysadmin > > Rushes > > GPFSUG Chairman (chair at gpfsug.org) > > > Rushes Postproduction Limited, 66 Old Compton Street, London W1D 4UH > tel: +44 (0)20 7437 8676 > web: http://www.rushes.co.uk > The information contained in this e-mail is confidential and may be > subject to legal privilege. If you are not the intended recipient, you > must not use, copy, distribute or disclose the e-mail or any part of > its contents or take any action in reliance on it. If you have > received this e-mail in error, please e-mail the sender by replying to > this message. All reasonable precautions have been taken to ensure no > viruses are present in this e-mail. Rushes Postproduction Limited > cannot accept responsibility for loss or damage arising from the use > of this e-mail or attachments and recommend that you subject these to > your virus checking procedures prior to use. > > > _______________________________________________ > gpfsug-discuss mailing list > gpfsug-discuss at gpfsug.org > http://gpfsug.org/mailman/listinfo/gpfsug-discuss -------------- next part -------------- An HTML attachment was scrubbed... URL: From j.buzzard at dundee.ac.uk Wed Apr 25 19:27:24 2012 From: j.buzzard at dundee.ac.uk (Jonathan Buzzard) Date: Wed, 25 Apr 2012 19:27:24 +0100 Subject: [gpfsug-discuss] GPFS 3.5 Announcement In-Reply-To: <4F984059.40301@arif-ali.co.uk> References: <39571EA9316BE44899D59C7A640C13F502FBFB@WARVWEXC2.uk.deluxe-eu.com> <4F984059.40301@arif-ali.co.uk> Message-ID: <4F98420C.6000707@dundee.ac.uk> Arif Ali wrote: > Hi all, > > I have (with help from Barry) found that 3.5 also have .deb packages > available. > > Well, I delved in, and tried installing them on my laptop, to see if it > would compile. > > 3 things come from my experience so far > > 1. The compilation detects my machine as debian, in-fact it is Ubuntu, > so the testing in the configure needs to change such that it checks for > lsb-release before the debian_version in /etc. But in the meantime "make > LINUX_DISTRIBUTION=UBUNTU_LINUX Autoconfig" does the job, i.e after > copying config/env.mcr.sample to config/env.mcr > > 2. At the moment with 3.5.0-1, the compilation does not succeed on > 11.10. Is there any documentation out there that shows which flavours of > Ubuntu/Debian are in-fact supported. I will try it on an older karmic > test machine that I have already, and see how far I get. > Yes the updated FAQ says that Debian 6 (aka squeeze) is the only supported version, so you are out of luck with Ubuntu. The FAQ also says that 3.5.0-1 supports mounting DMAPI enabled file systems on Windows, and gives contradictory information on 3.40-13 being able to do the same. Another gotya is that 3.5 only supports the TSM 6.3 client for backup, so if like us you have yet to upgrade your servers past 5.5.x you cannot upgrade :-( I will also add that if you download the latest vfs_gpfs from git it has patches to report disk sizes bases on quotas, in particular fileset quotas. JAB. -- Jonathan A. Buzzard Tel: +441382-386998 Storage Administrator, College of Life Sciences University of Dundee, DD1 5EH From bevans at canditmedia.co.uk Wed Apr 25 19:34:45 2012 From: bevans at canditmedia.co.uk (Barry Evans) Date: Wed, 25 Apr 2012 19:34:45 +0100 Subject: [gpfsug-discuss] GPFS 3.5 Announcement In-Reply-To: <4F98420C.6000707@dundee.ac.uk> References: <39571EA9316BE44899D59C7A640C13F502FBFB@WARVWEXC2.uk.deluxe-eu.com> <4F984059.40301@arif-ali.co.uk> <4F98420C.6000707@dundee.ac.uk> Message-ID: <320BB048-EAFB-4FA8-89D2-BB4CAB2658D0@canditmedia.co.uk> Also watch out for the hotfix requirement on Windows 2008 R2 SP1 (the faq says there isn't a requirment, but there is - check the forum for the link) - they may have updated the faq by now now. > I will also add that if you download the latest vfs_gpfs from git it has patches to report disk sizes bases on quotas, in particular fileset quotas. that sounds verrrrrryyy nice, have you tried it out? Cheers, Barry On 25 Apr 2012, at 19:27, Jonathan Buzzard wrote: > Arif Ali wrote: >> Hi all, >> I have (with help from Barry) found that 3.5 also have .deb packages available. >> Well, I delved in, and tried installing them on my laptop, to see if it would compile. >> 3 things come from my experience so far >> 1. The compilation detects my machine as debian, in-fact it is Ubuntu, so the testing in the configure needs to change such that it checks for lsb-release before the debian_version in /etc. But in the meantime "make LINUX_DISTRIBUTION=UBUNTU_LINUX Autoconfig" does the job, i.e after copying config/env.mcr.sample to config/env.mcr >> 2. At the moment with 3.5.0-1, the compilation does not succeed on 11.10. Is there any documentation out there that shows which flavours of Ubuntu/Debian are in-fact supported. I will try it on an older karmic test machine that I have already, and see how far I get. > > Yes the updated FAQ says that Debian 6 (aka squeeze) is the only supported version, so you are out of luck with Ubuntu. > > The FAQ also says that 3.5.0-1 supports mounting DMAPI enabled file systems on Windows, and gives contradictory information on 3.40-13 being able to do the same. > > Another gotya is that 3.5 only supports the TSM 6.3 client for backup, so if like us you have yet to upgrade your servers past 5.5.x you cannot upgrade :-( > > I will also add that if you download the latest vfs_gpfs from git it has patches to report disk sizes bases on quotas, in particular fileset quotas. > > > JAB. > > -- > Jonathan A. Buzzard Tel: +441382-386998 > Storage Administrator, College of Life Sciences > University of Dundee, DD1 5EH > _______________________________________________ > gpfsug-discuss mailing list > gpfsug-discuss at gpfsug.org > http://gpfsug.org/mailman/listinfo/gpfsug-discuss From j.buzzard at dundee.ac.uk Wed Apr 25 23:09:59 2012 From: j.buzzard at dundee.ac.uk (Jonathan Buzzard) Date: Wed, 25 Apr 2012 23:09:59 +0100 Subject: [gpfsug-discuss] GPFS 3.5 Announcement In-Reply-To: <320BB048-EAFB-4FA8-89D2-BB4CAB2658D0@canditmedia.co.uk> References: <39571EA9316BE44899D59C7A640C13F502FBFB@WARVWEXC2.uk.deluxe-eu.com> <4F984059.40301@arif-ali.co.uk> <4F98420C.6000707@dundee.ac.uk> <320BB048-EAFB-4FA8-89D2-BB4CAB2658D0@canditmedia.co.uk> Message-ID: <4F987637.7070203@dundee.ac.uk> Barry Evans wrote: [SNIP] >> I will also add that if you download the latest vfs_gpfs from git >> it has patches to report disk sizes bases on quotas, in particular >> fileset quotas. > > that sounds verrrrrryyy nice, have you tried it out? > No, because it uses soft quotas. What I do is set the soft quota at 95% of the hard quota and use it to indicate that people are running low, it is fed into zenoss. The grace period is then set really high (3000 days was about as high as it would go reliably) with the actual limit and the charge back to the users being based on the fileset hard quota. The advantage of this method is that the alert in zenoss is triggered by an SNMP trap which is better than polling every five minutes. Therefore I continue to use my mmdfree command that I wrote which is based of hard quotas. I admit my usage of hard and soft quotas is rather unusual but it does works well. JAB. -- Jonathan A. Buzzard Tel: +441382-386998 Storage Administrator, College of Life Sciences University of Dundee, DD1 5EH From crobson at ocf.co.uk Mon Apr 2 09:26:10 2012 From: crobson at ocf.co.uk (Claire Robson) Date: Mon, 2 Apr 2012 09:26:10 +0100 Subject: [gpfsug-discuss] Understanding and Improving Computational Science Storage Access through Continuous Characterization Message-ID: Hi All, Andreas Landhaeusser has kindly sent over some further information following his presentation at the last User Group meeting, details are below: Measuring the storage performance, http://www.storageconference.org/2011/Papers/Research/1.Carns.pdf ANL developed Darshan for characterization and improving I/O performance of workloads http://www.mcs.anl.gov/research/projects/darshan/ Thanks, Claire GPFS User Group Secretary From Jez.Tucker at rushes.co.uk Wed Apr 11 16:19:58 2012 From: Jez.Tucker at rushes.co.uk (Jez Tucker) Date: Wed, 11 Apr 2012 15:19:58 +0000 Subject: [gpfsug-discuss] GPFS 3.5 Announcement Message-ID: <39571EA9316BE44899D59C7A640C13F502FBFB@WARVWEXC2.uk.deluxe-eu.com> FYI: http://www-01.ibm.com/common/ssi/cgi-bin/ssialias?subtype=ca&infotype=an&appname=iSource&supplier=877&letternum=ENUSZP12-0057 --- Jez Tucker Senior Sysadmin Rushes GPFSUG Chairman (chair at gpfsug.org) Rushes Postproduction Limited, 66 Old Compton Street, London W1D 4UH tel: +44 (0)20 7437 8676 web: http://www.rushes.co.uk The information contained in this e-mail is confidential and may be subject to legal privilege. If you are not the intended recipient, you must not use, copy, distribute or disclose the e-mail or any part of its contents or take any action in reliance on it. If you have received this e-mail in error, please e-mail the sender by replying to this message. All reasonable precautions have been taken to ensure no viruses are present in this e-mail. Rushes Postproduction Limited cannot accept responsibility for loss or damage arising from the use of this e-mail or attachments and recommend that you subject these to your virus checking procedures prior to use. -------------- next part -------------- An HTML attachment was scrubbed... URL: From orlando.richards at ed.ac.uk Thu Apr 12 09:02:05 2012 From: orlando.richards at ed.ac.uk (Orlando Richards) Date: Thu, 12 Apr 2012 09:02:05 +0100 Subject: [gpfsug-discuss] GPFS 3.5 Announcement In-Reply-To: <39571EA9316BE44899D59C7A640C13F502FBFB@WARVWEXC2.uk.deluxe-eu.com> References: <39571EA9316BE44899D59C7A640C13F502FBFB@WARVWEXC2.uk.deluxe-eu.com> Message-ID: <4F868BFD.4030306@ed.ac.uk> Good stuff - thanks for forwarding that on Jez. I wonder what the "improved small file performance" is. Also interesting to see mention of a "fileset owner": "Each fileset owner now has the ability to control quotas for users and groups of their fileset." I'll look forward to giving this a good kick about on April 20th - I've already booked a slot in my diary ;) -- Orlando On 11/04/12 16:19, Jez Tucker wrote: > FYI: > > http://www-01.ibm.com/common/ssi/cgi-bin/ssialias?subtype=ca&infotype=an&appname=iSource&supplier=877&letternum=ENUSZP12-0057 > > > --- > > Jez Tucker > > Senior Sysadmin > > Rushes > > GPFSUG Chairman (chair at gpfsug.org) > > > Rushes Postproduction Limited, 66 Old Compton Street, London W1D 4UH > tel: +44 (0)20 7437 8676 > web: http://www.rushes.co.uk > The information contained in this e-mail is confidential and may be > subject to legal privilege. If you are not the intended recipient, you > must not use, copy, distribute or disclose the e-mail or any part of its > contents or take any action in reliance on it. If you have received this > e-mail in error, please e-mail the sender by replying to this message. > All reasonable precautions have been taken to ensure no viruses are > present in this e-mail. Rushes Postproduction Limited cannot accept > responsibility for loss or damage arising from the use of this e-mail or > attachments and recommend that you subject these to your virus checking > procedures prior to use. > > > _______________________________________________ > gpfsug-discuss mailing list > gpfsug-discuss at gpfsug.org > http://gpfsug.org/mailman/listinfo/gpfsug-discuss -- -- Dr Orlando Richards Information Services IT Infrastructure Division Unix Section Tel: 0131 650 4994 The University of Edinburgh is a charitable body, registered in Scotland, with registration number SC005336. From ANDREWD at uk.ibm.com Thu Apr 12 17:02:33 2012 From: ANDREWD at uk.ibm.com (Andrew Downes1) Date: Thu, 12 Apr 2012 16:02:33 +0000 Subject: [gpfsug-discuss] AUTO: Andrew Downes is out of the office (returning 16/04/2012) Message-ID: I am out of the office until 16/04/2012. In my absence please contact Matt Ayres mailto:m_ayres at uk.ibm.com 07710-981527 In case of urgency, please contact our manager Andy Jenkins mailto:JENKINSA at uk.ibm.com 07921-108940 Note: This is an automated response to your message "gpfsug-discuss Digest, Vol 4, Issue 2" sent on 12/4/2012 11:00:01. This is the only notification you will receive while this person is away. From sfadden at us.ibm.com Thu Apr 12 17:29:39 2012 From: sfadden at us.ibm.com (Scott Fadden) Date: Thu, 12 Apr 2012 09:29:39 -0700 Subject: [gpfsug-discuss] GPFS 3.5 Announcement In-Reply-To: <4F868BFD.4030306@ed.ac.uk> References: <39571EA9316BE44899D59C7A640C13F502FBFB@WARVWEXC2.uk.deluxe-eu.com> <4F868BFD.4030306@ed.ac.uk> Message-ID: There are a number of small file performance improvements around memory utilization of small file IO, updated algorithms for prefetching, inode cache management and logging. "Each fileset owner now has the ability to control quotas for users and groups of their fileset." This just means that each fileset can be managed independently. There is no new "owner" context in GPFS 3.5. Scott Fadden From: Orlando Richards To: gpfsug-discuss at gpfsug.org, Date: 04/12/2012 01:04 AM Subject: Re: [gpfsug-discuss] GPFS 3.5 Announcement Sent by: gpfsug-discuss-bounces at gpfsug.org Good stuff - thanks for forwarding that on Jez. I wonder what the "improved small file performance" is. Also interesting to see mention of a "fileset owner": "Each fileset owner now has the ability to control quotas for users and groups of their fileset." I'll look forward to giving this a good kick about on April 20th - I've already booked a slot in my diary ;) -- Orlando On 11/04/12 16:19, Jez Tucker wrote: > FYI: > > http://www-01.ibm.com/common/ssi/cgi-bin/ssialias?subtype=ca&infotype=an&appname=iSource&supplier=877&letternum=ENUSZP12-0057 > < http://www-01.ibm.com/common/ssi/cgi-bin/ssialias?subtype=ca&infotype=an&appname=iSource&supplier=877&letternum=ENUSZP12-0057 > > > --- > > Jez Tucker > > Senior Sysadmin > > Rushes > > GPFSUG Chairman (chair at gpfsug.org) > > > Rushes Postproduction Limited, 66 Old Compton Street, London W1D 4UH > tel: +44 (0)20 7437 8676 > web: http://www.rushes.co.uk > The information contained in this e-mail is confidential and may be > subject to legal privilege. If you are not the intended recipient, you > must not use, copy, distribute or disclose the e-mail or any part of its > contents or take any action in reliance on it. If you have received this > e-mail in error, please e-mail the sender by replying to this message. > All reasonable precautions have been taken to ensure no viruses are > present in this e-mail. Rushes Postproduction Limited cannot accept > responsibility for loss or damage arising from the use of this e-mail or > attachments and recommend that you subject these to your virus checking > procedures prior to use. > > > _______________________________________________ > gpfsug-discuss mailing list > gpfsug-discuss at gpfsug.org > http://gpfsug.org/mailman/listinfo/gpfsug-discuss -- -- Dr Orlando Richards Information Services IT Infrastructure Division Unix Section Tel: 0131 650 4994 The University of Edinburgh is a charitable body, registered in Scotland, with registration number SC005336. _______________________________________________ gpfsug-discuss mailing list gpfsug-discuss at gpfsug.org http://gpfsug.org/mailman/listinfo/gpfsug-discuss -------------- next part -------------- An HTML attachment was scrubbed... URL: From Jez.Tucker at rushes.co.uk Tue Apr 17 17:13:15 2012 From: Jez.Tucker at rushes.co.uk (Jez Tucker) Date: Tue, 17 Apr 2012 16:13:15 +0000 Subject: [gpfsug-discuss] Next user group content Message-ID: <39571EA9316BE44899D59C7A640C13F50319BB@WARVWEXC2.uk.deluxe-eu.com> Hello all I'm starting to plan the next UG. [Reminds me that I need to put the minutes of the last group up too]. Items that we _may_ be able to show/talk about are: - V7000 / V7000 Unified. Rolled GPFS storage product. http://www-03.ibm.com/systems/storage/disk/storwize_v7000/ - WARP. GPFS super I/O many streaming video solution. http://canditmedia.com/solutions.html - Kove XPD2. Metadata acceleration. http://kove.com/xpress Which, if any, of these are of interest? Or, please suggest an area/product you would like us to explore. Jez --- Jez Tucker Senior Sysadmin Rushes GPFSUG Chairman (chair at gpfsug.org) -------------- next part -------------- An HTML attachment was scrubbed... URL: From crobson at ocf.co.uk Mon Apr 23 09:51:43 2012 From: crobson at ocf.co.uk (Claire Robson) Date: Mon, 23 Apr 2012 09:51:43 +0100 Subject: [gpfsug-discuss] Next user group meeting date In-Reply-To: <39571EA9316BE44899D59C7A640C13F50319BB@WARVWEXC2.uk.deluxe-eu.com> References: <39571EA9316BE44899D59C7A640C13F50319BB@WARVWEXC2.uk.deluxe-eu.com> Message-ID: Dear All, Paul Tomlinson, AWE has very kindly offered to host our next Group meeting. The date we propose is Thursday 20th September and the meeting will take place in the Reading area. If anyone has any serious objections to this date please let me know by Monday 1st May. Otherwise we will confirm plans for this date shortly. Thanks, Claire Robson GPFS UG Secretary (secretary at gpfsug.org From: gpfsug-discuss-bounces at gpfsug.org [mailto:gpfsug-discuss-bounces at gpfsug.org] On Behalf Of Jez Tucker Sent: 17 April 2012 17:13 To: gpfsug main discussion list Subject: [gpfsug-discuss] Next user group content Hello all I'm starting to plan the next UG. [Reminds me that I need to put the minutes of the last group up too]. Items that we _may_ be able to show/talk about are: - V7000 / V7000 Unified. Rolled GPFS storage product. http://www-03.ibm.com/systems/storage/disk/storwize_v7000/ - WARP. GPFS super I/O many streaming video solution. http://canditmedia.com/solutions.html - Kove XPD2. Metadata acceleration. http://kove.com/xpress Which, if any, of these are of interest? Or, please suggest an area/product you would like us to explore. Jez --- Jez Tucker Senior Sysadmin Rushes GPFSUG Chairman (chair at gpfsug.org) -------------- next part -------------- An HTML attachment was scrubbed... URL: From mail at arif-ali.co.uk Wed Apr 25 19:20:09 2012 From: mail at arif-ali.co.uk (Arif Ali) Date: Wed, 25 Apr 2012 19:20:09 +0100 Subject: [gpfsug-discuss] GPFS 3.5 Announcement In-Reply-To: <39571EA9316BE44899D59C7A640C13F502FBFB@WARVWEXC2.uk.deluxe-eu.com> References: <39571EA9316BE44899D59C7A640C13F502FBFB@WARVWEXC2.uk.deluxe-eu.com> Message-ID: <4F984059.40301@arif-ali.co.uk> Hi all, I have (with help from Barry) found that 3.5 also have .deb packages available. Well, I delved in, and tried installing them on my laptop, to see if it would compile. 3 things come from my experience so far 1. The compilation detects my machine as debian, in-fact it is Ubuntu, so the testing in the configure needs to change such that it checks for lsb-release before the debian_version in /etc. But in the meantime "make LINUX_DISTRIBUTION=UBUNTU_LINUX Autoconfig" does the job, i.e after copying config/env.mcr.sample to config/env.mcr 2. At the moment with 3.5.0-1, the compilation does not succeed on 11.10. Is there any documentation out there that shows which flavours of Ubuntu/Debian are in-fact supported. I will try it on an older karmic test machine that I have already, and see how far I get. 3. The documentations on http://publib.boulder.ibm.com/infocenter/clresctr/vxrx/index.jsp don't give any indication of Ubuntu/Debian support any pointers from anyone would be great regards, *Arif* On 11/04/12 16:19, Jez Tucker wrote: > > FYI: > > http://www-01.ibm.com/common/ssi/cgi-bin/ssialias?subtype=ca&infotype=an&appname=iSource&supplier=877&letternum=ENUSZP12-0057 > > > --- > > Jez Tucker > > Senior Sysadmin > > Rushes > > GPFSUG Chairman (chair at gpfsug.org) > > > Rushes Postproduction Limited, 66 Old Compton Street, London W1D 4UH > tel: +44 (0)20 7437 8676 > web: http://www.rushes.co.uk > The information contained in this e-mail is confidential and may be > subject to legal privilege. If you are not the intended recipient, you > must not use, copy, distribute or disclose the e-mail or any part of > its contents or take any action in reliance on it. If you have > received this e-mail in error, please e-mail the sender by replying to > this message. All reasonable precautions have been taken to ensure no > viruses are present in this e-mail. Rushes Postproduction Limited > cannot accept responsibility for loss or damage arising from the use > of this e-mail or attachments and recommend that you subject these to > your virus checking procedures prior to use. > > > _______________________________________________ > gpfsug-discuss mailing list > gpfsug-discuss at gpfsug.org > http://gpfsug.org/mailman/listinfo/gpfsug-discuss -------------- next part -------------- An HTML attachment was scrubbed... URL: From j.buzzard at dundee.ac.uk Wed Apr 25 19:27:24 2012 From: j.buzzard at dundee.ac.uk (Jonathan Buzzard) Date: Wed, 25 Apr 2012 19:27:24 +0100 Subject: [gpfsug-discuss] GPFS 3.5 Announcement In-Reply-To: <4F984059.40301@arif-ali.co.uk> References: <39571EA9316BE44899D59C7A640C13F502FBFB@WARVWEXC2.uk.deluxe-eu.com> <4F984059.40301@arif-ali.co.uk> Message-ID: <4F98420C.6000707@dundee.ac.uk> Arif Ali wrote: > Hi all, > > I have (with help from Barry) found that 3.5 also have .deb packages > available. > > Well, I delved in, and tried installing them on my laptop, to see if it > would compile. > > 3 things come from my experience so far > > 1. The compilation detects my machine as debian, in-fact it is Ubuntu, > so the testing in the configure needs to change such that it checks for > lsb-release before the debian_version in /etc. But in the meantime "make > LINUX_DISTRIBUTION=UBUNTU_LINUX Autoconfig" does the job, i.e after > copying config/env.mcr.sample to config/env.mcr > > 2. At the moment with 3.5.0-1, the compilation does not succeed on > 11.10. Is there any documentation out there that shows which flavours of > Ubuntu/Debian are in-fact supported. I will try it on an older karmic > test machine that I have already, and see how far I get. > Yes the updated FAQ says that Debian 6 (aka squeeze) is the only supported version, so you are out of luck with Ubuntu. The FAQ also says that 3.5.0-1 supports mounting DMAPI enabled file systems on Windows, and gives contradictory information on 3.40-13 being able to do the same. Another gotya is that 3.5 only supports the TSM 6.3 client for backup, so if like us you have yet to upgrade your servers past 5.5.x you cannot upgrade :-( I will also add that if you download the latest vfs_gpfs from git it has patches to report disk sizes bases on quotas, in particular fileset quotas. JAB. -- Jonathan A. Buzzard Tel: +441382-386998 Storage Administrator, College of Life Sciences University of Dundee, DD1 5EH From bevans at canditmedia.co.uk Wed Apr 25 19:34:45 2012 From: bevans at canditmedia.co.uk (Barry Evans) Date: Wed, 25 Apr 2012 19:34:45 +0100 Subject: [gpfsug-discuss] GPFS 3.5 Announcement In-Reply-To: <4F98420C.6000707@dundee.ac.uk> References: <39571EA9316BE44899D59C7A640C13F502FBFB@WARVWEXC2.uk.deluxe-eu.com> <4F984059.40301@arif-ali.co.uk> <4F98420C.6000707@dundee.ac.uk> Message-ID: <320BB048-EAFB-4FA8-89D2-BB4CAB2658D0@canditmedia.co.uk> Also watch out for the hotfix requirement on Windows 2008 R2 SP1 (the faq says there isn't a requirment, but there is - check the forum for the link) - they may have updated the faq by now now. > I will also add that if you download the latest vfs_gpfs from git it has patches to report disk sizes bases on quotas, in particular fileset quotas. that sounds verrrrrryyy nice, have you tried it out? Cheers, Barry On 25 Apr 2012, at 19:27, Jonathan Buzzard wrote: > Arif Ali wrote: >> Hi all, >> I have (with help from Barry) found that 3.5 also have .deb packages available. >> Well, I delved in, and tried installing them on my laptop, to see if it would compile. >> 3 things come from my experience so far >> 1. The compilation detects my machine as debian, in-fact it is Ubuntu, so the testing in the configure needs to change such that it checks for lsb-release before the debian_version in /etc. But in the meantime "make LINUX_DISTRIBUTION=UBUNTU_LINUX Autoconfig" does the job, i.e after copying config/env.mcr.sample to config/env.mcr >> 2. At the moment with 3.5.0-1, the compilation does not succeed on 11.10. Is there any documentation out there that shows which flavours of Ubuntu/Debian are in-fact supported. I will try it on an older karmic test machine that I have already, and see how far I get. > > Yes the updated FAQ says that Debian 6 (aka squeeze) is the only supported version, so you are out of luck with Ubuntu. > > The FAQ also says that 3.5.0-1 supports mounting DMAPI enabled file systems on Windows, and gives contradictory information on 3.40-13 being able to do the same. > > Another gotya is that 3.5 only supports the TSM 6.3 client for backup, so if like us you have yet to upgrade your servers past 5.5.x you cannot upgrade :-( > > I will also add that if you download the latest vfs_gpfs from git it has patches to report disk sizes bases on quotas, in particular fileset quotas. > > > JAB. > > -- > Jonathan A. Buzzard Tel: +441382-386998 > Storage Administrator, College of Life Sciences > University of Dundee, DD1 5EH > _______________________________________________ > gpfsug-discuss mailing list > gpfsug-discuss at gpfsug.org > http://gpfsug.org/mailman/listinfo/gpfsug-discuss From j.buzzard at dundee.ac.uk Wed Apr 25 23:09:59 2012 From: j.buzzard at dundee.ac.uk (Jonathan Buzzard) Date: Wed, 25 Apr 2012 23:09:59 +0100 Subject: [gpfsug-discuss] GPFS 3.5 Announcement In-Reply-To: <320BB048-EAFB-4FA8-89D2-BB4CAB2658D0@canditmedia.co.uk> References: <39571EA9316BE44899D59C7A640C13F502FBFB@WARVWEXC2.uk.deluxe-eu.com> <4F984059.40301@arif-ali.co.uk> <4F98420C.6000707@dundee.ac.uk> <320BB048-EAFB-4FA8-89D2-BB4CAB2658D0@canditmedia.co.uk> Message-ID: <4F987637.7070203@dundee.ac.uk> Barry Evans wrote: [SNIP] >> I will also add that if you download the latest vfs_gpfs from git >> it has patches to report disk sizes bases on quotas, in particular >> fileset quotas. > > that sounds verrrrrryyy nice, have you tried it out? > No, because it uses soft quotas. What I do is set the soft quota at 95% of the hard quota and use it to indicate that people are running low, it is fed into zenoss. The grace period is then set really high (3000 days was about as high as it would go reliably) with the actual limit and the charge back to the users being based on the fileset hard quota. The advantage of this method is that the alert in zenoss is triggered by an SNMP trap which is better than polling every five minutes. Therefore I continue to use my mmdfree command that I wrote which is based of hard quotas. I admit my usage of hard and soft quotas is rather unusual but it does works well. JAB. -- Jonathan A. Buzzard Tel: +441382-386998 Storage Administrator, College of Life Sciences University of Dundee, DD1 5EH