From sabujp at gmail.com  Wed Apr  2 22:05:51 2014
From: sabujp at gmail.com (Sabuj Pattanayek)
Date: Wed, 2 Apr 2014 16:05:51 -0500
Subject: [gpfsug-discuss] question about why unix extensions = no is
 recommended when using samba + gpfs?
In-Reply-To: <1394716131.2612.24.camel@buzzard.phy.strath.ac.uk>
References: <CAEeMGHvH84GDv6yEnPgKtNwOhyvXLkbvV2XGtf3vHpJgSuu=Lg@mail.gmail.com>
	<1394705361.16270.9.camel@buzzard.phy.strath.ac.uk>
	<CAEeMGHu4EaiEqa6=qJjHL+4GnkOnQeqh+h5azTHB-1QuqUiTMw@mail.gmail.com>
	<1394716131.2612.24.camel@buzzard.phy.strath.ac.uk>
Message-ID: <CAEeMGHvG4Jf_gZLfKfs8TyERib8L+r42_uWRqP6DQzHvj7_5dg@mail.gmail.com>

So I've been using the recommended gpfs:acl = yes mode for a while on
windows/cifs/smb only shares and today came across a bug where Microsoft
Office (2010, haven't tried other versions) on Windows 7/8 refuses to save
or save as. It can clearly create tmp files (e.g. those ~$... files when it
opens a file) and I can right click -> create a new file, edit files in
notepad/wordpad, drag and drop files between explorer windows but whenever
I try to save a doc/docx or xls/xlsx file it always throws the error dialog
:

There has been a network or file permission error. The network connection
may be lost. (mapped drive:\folder\fileName.docx)

( OK )   ( Help )

Was this information helpful?

If i switch to gpfs:acl = no and then use vfs_acl_xattr instead it works
fine. MS Office on OSX does not have this problem

It's similar to this issue :

https://www.ibm.com/developerworks/community/forums/html/topic?id=77777777-0000-0000-0000-000014299075

Anyone have any ideas without having to use acl_xattr? Again I'm using
sernet samba 4.1.6 and gpfs 3.5.0.11 .

Thanks,
Sabuj



-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://gpfsug.org/pipermail/gpfsug-discuss_gpfsug.org/attachments/20140402/db2df795/attachment.htm>

From sabujp at gmail.com  Wed Apr  2 22:24:14 2014
From: sabujp at gmail.com (Sabuj Pattanayek)
Date: Wed, 2 Apr 2014 16:24:14 -0500
Subject: [gpfsug-discuss] question about why unix extensions = no is
 recommended when using samba + gpfs?
In-Reply-To: <CAEeMGHvG4Jf_gZLfKfs8TyERib8L+r42_uWRqP6DQzHvj7_5dg@mail.gmail.com>
References: <CAEeMGHvH84GDv6yEnPgKtNwOhyvXLkbvV2XGtf3vHpJgSuu=Lg@mail.gmail.com>
	<1394705361.16270.9.camel@buzzard.phy.strath.ac.uk>
	<CAEeMGHu4EaiEqa6=qJjHL+4GnkOnQeqh+h5azTHB-1QuqUiTMw@mail.gmail.com>
	<1394716131.2612.24.camel@buzzard.phy.strath.ac.uk>
	<CAEeMGHvG4Jf_gZLfKfs8TyERib8L+r42_uWRqP6DQzHvj7_5dg@mail.gmail.com>
Message-ID: <CAEeMGHuO5JUNAWAyWv6Oo3rPLvpzKfF0AWdGzgnxyr=nBfVMeQ@mail.gmail.com>

Seems like the workaround for now is to set :

gpfs:sharemodes = no

https://bugzilla.samba.org/show_bug.cgi?id=6762

Could be a regression? Haven't tried 3.5.0.17 yet, but we will be upgrading
to that soon.


On Wed, Apr 2, 2014 at 4:05 PM, Sabuj Pattanayek <sabujp at gmail.com> wrote:

> So I've been using the recommended gpfs:acl = yes mode for a while on
> windows/cifs/smb only shares and today came across a bug where Microsoft
> Office (2010, haven't tried other versions) on Windows 7/8 refuses to save
> or save as. It can clearly create tmp files (e.g. those ~$... files when it
> opens a file) and I can right click -> create a new file, edit files in
> notepad/wordpad, drag and drop files between explorer windows but whenever
> I try to save a doc/docx or xls/xlsx file it always throws the error dialog
> :
>
> There has been a network or file permission error. The network connection
> may be lost. (mapped drive:\folder\fileName.docx)
>
> ( OK )   ( Help )
>
> Was this information helpful?
>
> If i switch to gpfs:acl = no and then use vfs_acl_xattr instead it works
> fine. MS Office on OSX does not have this problem
>
> It's similar to this issue :
>
>
> https://www.ibm.com/developerworks/community/forums/html/topic?id=77777777-0000-0000-0000-000014299075
>
> Anyone have any ideas without having to use acl_xattr? Again I'm using
> sernet samba 4.1.6 and gpfs 3.5.0.11 .
>
> Thanks,
> Sabuj
>
>
>
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://gpfsug.org/pipermail/gpfsug-discuss_gpfsug.org/attachments/20140402/42d9eb85/attachment.htm>

From jonathan at buzzard.me.uk  Wed Apr  2 22:36:28 2014
From: jonathan at buzzard.me.uk (Jonathan Buzzard)
Date: Wed, 02 Apr 2014 22:36:28 +0100
Subject: [gpfsug-discuss] question about why unix extensions = no is
 recommended when using samba + gpfs?
In-Reply-To: <CAEeMGHuO5JUNAWAyWv6Oo3rPLvpzKfF0AWdGzgnxyr=nBfVMeQ@mail.gmail.com>
References: <CAEeMGHvH84GDv6yEnPgKtNwOhyvXLkbvV2XGtf3vHpJgSuu=Lg@mail.gmail.com>
	<1394705361.16270.9.camel@buzzard.phy.strath.ac.uk>
	<CAEeMGHu4EaiEqa6=qJjHL+4GnkOnQeqh+h5azTHB-1QuqUiTMw@mail.gmail.com>
	<1394716131.2612.24.camel@buzzard.phy.strath.ac.uk>
	<CAEeMGHvG4Jf_gZLfKfs8TyERib8L+r42_uWRqP6DQzHvj7_5dg@mail.gmail.com>
	<CAEeMGHuO5JUNAWAyWv6Oo3rPLvpzKfF0AWdGzgnxyr=nBfVMeQ@mail.gmail.com>
Message-ID: <533C82DC.9090402@buzzard.me.uk>

On 02/04/14 22:24, Sabuj Pattanayek wrote:
> Seems like the workaround for now is to set :
>
> gpfs:sharemodes = no
>
> https://bugzilla.samba.org/show_bug.cgi?id=6762

That is doggy ancient ticket, and fixed.


# store DOS attributes in extended attributes (vfs_gpfs then stores them 
in the file system)
	ea support = yes
	store dos attributes = yes
	map readonly = no
	map archive = no
	map system = no
	map hidden = no

Will most likely fix it for you. It is down to Office 2007 onwards 
trying to preserve ACL's on a save. So you should find a save as works, 
no ACL's to preserve but saving an existing file does not.


JAB.

-- 
Jonathan A. Buzzard                 Email: jonathan (at) buzzard.me.uk
Fife, United Kingdom.


From sabujp at gmail.com  Wed Apr  2 22:42:35 2014
From: sabujp at gmail.com (Sabuj Pattanayek)
Date: Wed, 2 Apr 2014 16:42:35 -0500
Subject: [gpfsug-discuss] question about why unix extensions = no is
 recommended when using samba + gpfs?
In-Reply-To: <533C82DC.9090402@buzzard.me.uk>
References: <CAEeMGHvH84GDv6yEnPgKtNwOhyvXLkbvV2XGtf3vHpJgSuu=Lg@mail.gmail.com>
	<1394705361.16270.9.camel@buzzard.phy.strath.ac.uk>
	<CAEeMGHu4EaiEqa6=qJjHL+4GnkOnQeqh+h5azTHB-1QuqUiTMw@mail.gmail.com>
	<1394716131.2612.24.camel@buzzard.phy.strath.ac.uk>
	<CAEeMGHvG4Jf_gZLfKfs8TyERib8L+r42_uWRqP6DQzHvj7_5dg@mail.gmail.com>
	<CAEeMGHuO5JUNAWAyWv6Oo3rPLvpzKfF0AWdGzgnxyr=nBfVMeQ@mail.gmail.com>
	<533C82DC.9090402@buzzard.me.uk>
Message-ID: <CAEeMGHtGDRLQiM4qP62Yuwpp9td+9PCjATNf=S1SS3xhEqw40A@mail.gmail.com>

Yup, I had those settings set already, and neither save as or save worked.


On Wed, Apr 2, 2014 at 4:36 PM, Jonathan Buzzard <jonathan at buzzard.me.uk>wrote:

> On 02/04/14 22:24, Sabuj Pattanayek wrote:
>
>> Seems like the workaround for now is to set :
>>
>> gpfs:sharemodes = no
>>
>> https://bugzilla.samba.org/show_bug.cgi?id=6762
>>
>
> That is doggy ancient ticket, and fixed.
>
>
> # store DOS attributes in extended attributes (vfs_gpfs then stores them
> in the file system)
>         ea support = yes
>         store dos attributes = yes
>         map readonly = no
>         map archive = no
>         map system = no
>         map hidden = no
>
> Will most likely fix it for you. It is down to Office 2007 onwards trying
> to preserve ACL's on a save. So you should find a save as works, no ACL's
> to preserve but saving an existing file does not.
>
>
>
> JAB.
>
> --
> Jonathan A. Buzzard                 Email: jonathan (at) buzzard.me.uk
> Fife, United Kingdom.
> _______________________________________________
> gpfsug-discuss mailing list
> gpfsug-discuss at gpfsug.org
> http://gpfsug.org/mailman/listinfo/gpfsug-discuss
>
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://gpfsug.org/pipermail/gpfsug-discuss_gpfsug.org/attachments/20140402/2827b7c1/attachment.htm>

From jonathan at buzzard.me.uk  Wed Apr  2 23:08:40 2014
From: jonathan at buzzard.me.uk (Jonathan Buzzard)
Date: Wed, 02 Apr 2014 23:08:40 +0100
Subject: [gpfsug-discuss] question about why unix extensions = no is
 recommended when using samba + gpfs?
In-Reply-To: <CAEeMGHtGDRLQiM4qP62Yuwpp9td+9PCjATNf=S1SS3xhEqw40A@mail.gmail.com>
References: <CAEeMGHvH84GDv6yEnPgKtNwOhyvXLkbvV2XGtf3vHpJgSuu=Lg@mail.gmail.com>
	<1394705361.16270.9.camel@buzzard.phy.strath.ac.uk>
	<CAEeMGHu4EaiEqa6=qJjHL+4GnkOnQeqh+h5azTHB-1QuqUiTMw@mail.gmail.com>
	<1394716131.2612.24.camel@buzzard.phy.strath.ac.uk>
	<CAEeMGHvG4Jf_gZLfKfs8TyERib8L+r42_uWRqP6DQzHvj7_5dg@mail.gmail.com>
	<CAEeMGHuO5JUNAWAyWv6Oo3rPLvpzKfF0AWdGzgnxyr=nBfVMeQ@mail.gmail.com>
	<533C82DC.9090402@buzzard.me.uk>
	<CAEeMGHtGDRLQiM4qP62Yuwpp9td+9PCjATNf=S1SS3xhEqw40A@mail.gmail.com>
Message-ID: <533C8A68.7040304@buzzard.me.uk>

On 02/04/14 22:42, Sabuj Pattanayek wrote:
> Yup, I had those settings set already, and neither save as or save worked.
>

You need to provide more information. Much more of your smb.conf, what 
OS, Samba, and GPFS, along with your GPFS config.

Have you tested that the DOS attributes are correctly being stored in 
the GPFS file system?

It explicitly does work. The issues are all around Office trying to 
preserve ACL's which the vast majority of software does not.

Are you running with NFSv4 ACL's *ONLY* on GPFS? Using Posix or Posix 
and NFSv4 together is likely to lead to problems.


JAB.

-- 
Jonathan A. Buzzard                 Email: jonathan (at) buzzard.me.uk
Fife, United Kingdom.


From sabujp at gmail.com  Thu Apr  3 03:08:40 2014
From: sabujp at gmail.com (Sabuj Pattanayek)
Date: Wed, 2 Apr 2014 21:08:40 -0500
Subject: [gpfsug-discuss] question about why unix extensions = no is
 recommended when using samba + gpfs?
In-Reply-To: <533C8A68.7040304@buzzard.me.uk>
References: <CAEeMGHvH84GDv6yEnPgKtNwOhyvXLkbvV2XGtf3vHpJgSuu=Lg@mail.gmail.com>
	<1394705361.16270.9.camel@buzzard.phy.strath.ac.uk>
	<CAEeMGHu4EaiEqa6=qJjHL+4GnkOnQeqh+h5azTHB-1QuqUiTMw@mail.gmail.com>
	<1394716131.2612.24.camel@buzzard.phy.strath.ac.uk>
	<CAEeMGHvG4Jf_gZLfKfs8TyERib8L+r42_uWRqP6DQzHvj7_5dg@mail.gmail.com>
	<CAEeMGHuO5JUNAWAyWv6Oo3rPLvpzKfF0AWdGzgnxyr=nBfVMeQ@mail.gmail.com>
	<533C82DC.9090402@buzzard.me.uk>
	<CAEeMGHtGDRLQiM4qP62Yuwpp9td+9PCjATNf=S1SS3xhEqw40A@mail.gmail.com>
	<533C8A68.7040304@buzzard.me.uk>
Message-ID: <CAEeMGHvFDgP-7i-fy8KnFCoJra13CB5X6RNKacjBWUUq2Zp8HA@mail.gmail.com>

On Wed, Apr 2, 2014 at 5:08 PM, Jonathan Buzzard <jonathan at buzzard.me.uk>wrote:

> On 02/04/14 22:42, Sabuj Pattanayek wrote:
>
>> Yup, I had those settings set already, and neither save as or save worked.
>>
>>
> You need to provide more information. Much more of your smb.conf, what OS,
> Samba, and GPFS, along with your GPFS config.
>

rhel  6.3, 2.6.32-279.31.1.el6.x86_64, sernet samba 4.1.6, ctdb
1.0.114.7-1, gpfs 3.5.0.11, gpfs config farther down :

### smb.conf ###

[global]
workgroup = DOMAIN
netbios name = gpfs-smb-server
password server = dc-1.ds.domain.edu dc-2.ds.domain.edu dc-3.ds.domain.edu
realm = DS.DOMAIN.EDU
security = ads
encrypt passwords = yes
allow trusted domains = No
idmap config *:backend = tdb
idmap config *:range = 4000000 - 5000000
idmap config DOMAIN : backend  = rid
idmap config DOMAIN : range    = 5000001 - 9000000
template shell = /bin/bash
template homedir = /home/%U
winbind offline logon = false
winbind trusted domains only = no
winbind use default domain = yes
# ldap handles users
winbind enum users  = no
winbind enum groups = no
winbind expand groups = 3
server string = SMB
log file = /var/log/samba/log.%m
max log size = 50
passdb backend = tdbsam

clustering = yes
unix extensions = yes

include = /etc/samba/template_shares.conf
include = /etc/samba/test_shares.conf

### template_shares.conf ###

[template_nfs4]
comment = GPFS Cluster on smb using %R protocol
path = /dors/testfs
writeable = yes
vfs objects = shadow_copy2 gpfs fileid
ea support = yes
store dos attributes = yes
access based share enum = yes
map readonly = no
map archive = no
map system = no
mangled names = no
force unknown acl user = yes
locking = yes
notify:inotify = no
shadow:snapdir = .snapshots
shadow:localtime = yes
shadow:format = %Y%m%d_%H:%M
shadow:fixinodes = yes
shadow:snapdirseverywhere = yes
shadow:sort = desc
# vfs_gpfs settings
gpfs:acl = yes
gpfs:winattr = yes
gpfs:dfreequota = yes
nfs4:mode = simple
nfs4:chown = yes
nfs4:acedup = merge
## needed to turn off sharemodes, msoffice on windows couldn't save
# https://bugzilla.samba.org/show_bug.cgi?id=6762
gpfs:sharemodes = no
gpfs:leases = yes
posix locking = yes
kernel oplocks = no
kernel share modes = yes
fileid:algorithm = fsname



>
> Have you tested that the DOS attributes are correctly being stored in the
> GPFS file system?
>

No, but they're all set to no, including map hidden which was missing above
but according to man smb.conf is by default set to no, so wouldn't these
not be mapped/stored in GPFS anyways? What EA file would these be stored in
if these were set to yes?


>
> It explicitly does work. The issues are all around Office trying to
> preserve ACL's which the vast majority of software does not.
>

Understood, but again, with the setup above, I had to turn sharemodes off
to get it to work. Setting it to no was mentioned in a comment in that
samba bug by Volker, i.e. I just didn't think of that myself, so there must
be some correlation.


> Are you running with NFSv4 ACL's *ONLY* on GPFS? Using Posix or Posix and
> NFSv4 together is likely to lead to problems.


posix + nfs4, it can be problematic but we're working around it.

# mmlsfs dors
flag                value                    description
------------------- ------------------------
-----------------------------------
 -f                 2048                     Minimum fragment size in bytes
(system pool)
                    32768                    Minimum fragment size in bytes
(other pools)
 -i                 512                      Inode size in bytes
 -I                 32768                    Indirect block size in bytes
 -m                 1                        Default number of metadata
replicas
 -M                 2                        Maximum number of metadata
replicas
 -r                 1                        Default number of data replicas
 -R                 2                        Maximum number of data replicas
 -j                 scatter                  Block allocation type
 -D                 nfs4                     File locking semantics in
effect
 -k                 all                      ACL semantics in effect
 -n                 2000                     Estimated number of nodes that
will mount file system
 -B                 65536                    Block size (system pool)
                    1048576                  Block size (other pools)
 -Q                 user;group;fileset       Quotas enforced
                    none                     Default quotas enabled
 --filesetdf        Yes                      Fileset df enabled?
 -V                 13.23 (3.5.0.7)          File system version
 --create-time      Thu Nov  7 11:29:46 2013 File system creation time
 -u                 Yes                      Support for large LUNs?
 -z                 No                       Is DMAPI enabled?
 -L                 16777216                 Logfile size
 -E                 Yes                      Exact mtime mount option
 -S                 No                       Suppress atime mount option
 -K                 whenpossible             Strict replica allocation
option
 --fastea           Yes                      Fast external attributes
enabled?
 --inode-limit      524288000                Maximum number of inodes
 -P                 system;capacity;fast     Disk storage pools in file
system
 -d
3T_7K_0;3T_7K_1;3T_7K_2;3T_7K_3;3T_7K_4;3T_7K_5;3T_7K_6;3T_7K_7;3T_7K_8;3T_7K_9;3T_7K_10;3T_7K_11;3T_7K_12;3T_7K_13;900GB_10K_0;900GB_10K_1;900GB_10K_2;900GB_10K_3;
 -d
900GB_10K_4;900GB_10K_5;900GB_10K_6;900GB_10K_7;900GB_10K_8;900GB_10K_9;900GB_10K_10;900GB_10K_11;900GB_10K_12;900GB_10K_13;900GB_10K_14;900GB_10K_15;900GB_10K_16;
 -d
900GB_10K_17;900GB_10K_18;900GB_10K_19;400GB_SSD_0;400GB_SSD_1;400GB_SSD_2;400GB_SSD_3;400GB_SSD_4
 Disks in file system
 --perfileset-quota yes                      Per-fileset quota enforcement
 -A                 yes                      Automatic mount option
 -o                 none                     Additional mount options
 -T                 /dors                    Default mount point
 --mount-priority   0                        Mount priority

A funny thing I noticed was that if I set security settings through the
security properties dialog in windows on a share with gpfs:acl = yes, it
sets posix acl's and doesn't automatically promote the acl's to nfs4. The
top level acl on a share directory has to be set to nfs4 before you set
users loose on it and at least one acl (a user / group on that directory)
has to have DirInherit:FileInherit otherwise files and directories beneath
that directory don't get set with nfs4 acl's which then breaks things like
Windows being able to discern the difference between full and modify
privileges (since posix only provides rwx, samba doesn't seem to care about
the 'c' acl provided by gpfs).

Several other strange behaviors I noticed :

* Turning inheritance off through the windows security -> advanced dialog
doesn't work unless you delete (or add I guess, but didn't try adding an
acl) some acl, either the group/user that you're trying to disable
inheritance for (which then means you have to re-add that group with
inheritance disabled) or some other group / user that you don't care about.
For example to disable inheritance on a directory for a group, you'd add a
dummy user/group acl to that directory, disable inheritance for the
group/user you want to disable inheritance for, then delete that dummy
group, otherwise clicking apply -> ok, backing out and then going back in
doesn't change the inheritance settings in either the advanced security
dialog or FileInherit, DirInherit, or Inherit acls in the output of
mmgetacl.

* robocopy y: z: /mir /COPY:DATSO throws "something is wrong with the
device. Failed to set NTACL ... " error 31 errors if your'e trying to copy
ACLs and data from some other share, but it still ends up copying the ACL's
properly! The problem is that robocopy doesn't complete, it only descends
one directory level at a time per robocopy run when it throws all these
errors. So you have to keep running robocopy in a loop from a .bat script
or manually keep running it until you think it's actually copied over all
the ACL's. This doesn't happen with acl_xattr, but acl_xattr has other
issues as well.

* Does any of the auditing tab stuff work? Samba has auditing via log
files, but this seems to be something that's stored in NTFS?

* I haven't tried anything from the quota tab, can it actually set GPFS
quotas somehow? I guess in windows you can set per directory quotas, the
closest thing would be filesets linked to directories with user/group
quotas within that fileset, but I don't think that tab is going to let you
do that.

Thanks,
Sabuj
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://gpfsug.org/pipermail/gpfsug-discuss_gpfsug.org/attachments/20140402/d5dedd94/attachment.htm>

From sabujp at gmail.com  Thu Apr  3 03:11:43 2014
From: sabujp at gmail.com (Sabuj Pattanayek)
Date: Wed, 2 Apr 2014 21:11:43 -0500
Subject: [gpfsug-discuss] question about why unix extensions = no is
 recommended when using samba + gpfs?
In-Reply-To: <CAEeMGHvFDgP-7i-fy8KnFCoJra13CB5X6RNKacjBWUUq2Zp8HA@mail.gmail.com>
References: <CAEeMGHvH84GDv6yEnPgKtNwOhyvXLkbvV2XGtf3vHpJgSuu=Lg@mail.gmail.com>
	<1394705361.16270.9.camel@buzzard.phy.strath.ac.uk>
	<CAEeMGHu4EaiEqa6=qJjHL+4GnkOnQeqh+h5azTHB-1QuqUiTMw@mail.gmail.com>
	<1394716131.2612.24.camel@buzzard.phy.strath.ac.uk>
	<CAEeMGHvG4Jf_gZLfKfs8TyERib8L+r42_uWRqP6DQzHvj7_5dg@mail.gmail.com>
	<CAEeMGHuO5JUNAWAyWv6Oo3rPLvpzKfF0AWdGzgnxyr=nBfVMeQ@mail.gmail.com>
	<533C82DC.9090402@buzzard.me.uk>
	<CAEeMGHtGDRLQiM4qP62Yuwpp9td+9PCjATNf=S1SS3xhEqw40A@mail.gmail.com>
	<533C8A68.7040304@buzzard.me.uk>
	<CAEeMGHvFDgP-7i-fy8KnFCoJra13CB5X6RNKacjBWUUq2Zp8HA@mail.gmail.com>
Message-ID: <CAEeMGHsaX+3+zEcbCOAM689a_ZFKd5hqkmEGjfHcZ3mxNjG-_Q@mail.gmail.com>

Forgot one,

### test_shares.conf ###

[testfs]
comment = GPFS Cluster on DORS using %R protocol
path = /dors/testfs
copy = template_nfs4
admin users = "DOMAIN\userImLoggingInWith"


It doesn't matter if I login with an "admin user" or a regular user allowed
by NFS4 (NTACLs) set via the security tab. The same problems happen with
save/save as unless gpfs:sharemodes = no .


On Wed, Apr 2, 2014 at 9:08 PM, Sabuj Pattanayek <sabujp at gmail.com> wrote:

>
>
>
> On Wed, Apr 2, 2014 at 5:08 PM, Jonathan Buzzard <jonathan at buzzard.me.uk>wrote:
>
>> On 02/04/14 22:42, Sabuj Pattanayek wrote:
>>
>>> Yup, I had those settings set already, and neither save as or save
>>> worked.
>>>
>>>
>> You need to provide more information. Much more of your smb.conf, what
>> OS, Samba, and GPFS, along with your GPFS config.
>>
>
> rhel  6.3, 2.6.32-279.31.1.el6.x86_64, sernet samba 4.1.6, ctdb
> 1.0.114.7-1, gpfs 3.5.0.11, gpfs config farther down :
>
> ### smb.conf ###
>
> [global]
> workgroup = DOMAIN
> netbios name = gpfs-smb-server
> password server = dc-1.ds.domain.edu dc-2.ds.domain.edu dc-3.ds.domain.edu
> realm = DS.DOMAIN.EDU
> security = ads
> encrypt passwords = yes
> allow trusted domains = No
> idmap config *:backend = tdb
> idmap config *:range = 4000000 - 5000000
> idmap config DOMAIN : backend  = rid
> idmap config DOMAIN : range    = 5000001 - 9000000
> template shell = /bin/bash
> template homedir = /home/%U
> winbind offline logon = false
> winbind trusted domains only = no
> winbind use default domain = yes
> # ldap handles users
> winbind enum users  = no
> winbind enum groups = no
> winbind expand groups = 3
> server string = SMB
> log file = /var/log/samba/log.%m
> max log size = 50
> passdb backend = tdbsam
>
> clustering = yes
> unix extensions = yes
>
> include = /etc/samba/template_shares.conf
> include = /etc/samba/test_shares.conf
>
> ### template_shares.conf ###
>
> [template_nfs4]
> comment = GPFS Cluster on smb using %R protocol
> path = /dors/testfs
> writeable = yes
> vfs objects = shadow_copy2 gpfs fileid
> ea support = yes
> store dos attributes = yes
> access based share enum = yes
> map readonly = no
> map archive = no
> map system = no
> mangled names = no
> force unknown acl user = yes
> locking = yes
> notify:inotify = no
> shadow:snapdir = .snapshots
> shadow:localtime = yes
> shadow:format = %Y%m%d_%H:%M
> shadow:fixinodes = yes
> shadow:snapdirseverywhere = yes
> shadow:sort = desc
> # vfs_gpfs settings
> gpfs:acl = yes
> gpfs:winattr = yes
> gpfs:dfreequota = yes
> nfs4:mode = simple
> nfs4:chown = yes
> nfs4:acedup = merge
> ## needed to turn off sharemodes, msoffice on windows couldn't save
> # https://bugzilla.samba.org/show_bug.cgi?id=6762
> gpfs:sharemodes = no
> gpfs:leases = yes
> posix locking = yes
> kernel oplocks = no
> kernel share modes = yes
> fileid:algorithm = fsname
>
>
>
>>
>> Have you tested that the DOS attributes are correctly being stored in the
>> GPFS file system?
>>
>
> No, but they're all set to no, including map hidden which was missing
> above but according to man smb.conf is by default set to no, so wouldn't
> these not be mapped/stored in GPFS anyways? What EA file would these be
> stored in if these were set to yes?
>
>
>>
>> It explicitly does work. The issues are all around Office trying to
>> preserve ACL's which the vast majority of software does not.
>>
>
> Understood, but again, with the setup above, I had to turn sharemodes off
> to get it to work. Setting it to no was mentioned in a comment in that
> samba bug by Volker, i.e. I just didn't think of that myself, so there must
> be some correlation.
>
>
>> Are you running with NFSv4 ACL's *ONLY* on GPFS? Using Posix or Posix and
>> NFSv4 together is likely to lead to problems.
>
>
> posix + nfs4, it can be problematic but we're working around it.
>
> # mmlsfs dors
> flag                value                    description
> ------------------- ------------------------
> -----------------------------------
>  -f                 2048                     Minimum fragment size in
> bytes (system pool)
>                     32768                    Minimum fragment size in
> bytes (other pools)
>  -i                 512                      Inode size in bytes
>  -I                 32768                    Indirect block size in bytes
>  -m                 1                        Default number of metadata
> replicas
>  -M                 2                        Maximum number of metadata
> replicas
>  -r                 1                        Default number of data
> replicas
>  -R                 2                        Maximum number of data
> replicas
>  -j                 scatter                  Block allocation type
>  -D                 nfs4                     File locking semantics in
> effect
>  -k                 all                      ACL semantics in effect
>  -n                 2000                     Estimated number of nodes
> that will mount file system
>  -B                 65536                    Block size (system pool)
>                     1048576                  Block size (other pools)
>  -Q                 user;group;fileset       Quotas enforced
>                     none                     Default quotas enabled
>  --filesetdf        Yes                      Fileset df enabled?
>  -V                 13.23 (3.5.0.7)          File system version
>  --create-time      Thu Nov  7 11:29:46 2013 File system creation time
>  -u                 Yes                      Support for large LUNs?
>  -z                 No                       Is DMAPI enabled?
>  -L                 16777216                 Logfile size
>  -E                 Yes                      Exact mtime mount option
>  -S                 No                       Suppress atime mount option
>  -K                 whenpossible             Strict replica allocation
> option
>  --fastea           Yes                      Fast external attributes
> enabled?
>  --inode-limit      524288000                Maximum number of inodes
>  -P                 system;capacity;fast     Disk storage pools in file
> system
>  -d
> 3T_7K_0;3T_7K_1;3T_7K_2;3T_7K_3;3T_7K_4;3T_7K_5;3T_7K_6;3T_7K_7;3T_7K_8;3T_7K_9;3T_7K_10;3T_7K_11;3T_7K_12;3T_7K_13;900GB_10K_0;900GB_10K_1;900GB_10K_2;900GB_10K_3;
>  -d
> 900GB_10K_4;900GB_10K_5;900GB_10K_6;900GB_10K_7;900GB_10K_8;900GB_10K_9;900GB_10K_10;900GB_10K_11;900GB_10K_12;900GB_10K_13;900GB_10K_14;900GB_10K_15;900GB_10K_16;
>  -d
> 900GB_10K_17;900GB_10K_18;900GB_10K_19;400GB_SSD_0;400GB_SSD_1;400GB_SSD_2;400GB_SSD_3;400GB_SSD_4
>  Disks in file system
>  --perfileset-quota yes                      Per-fileset quota enforcement
>  -A                 yes                      Automatic mount option
>  -o                 none                     Additional mount options
>  -T                 /dors                    Default mount point
>  --mount-priority   0                        Mount priority
>
> A funny thing I noticed was that if I set security settings through the
> security properties dialog in windows on a share with gpfs:acl = yes, it
> sets posix acl's and doesn't automatically promote the acl's to nfs4. The
> top level acl on a share directory has to be set to nfs4 before you set
> users loose on it and at least one acl (a user / group on that directory)
> has to have DirInherit:FileInherit otherwise files and directories beneath
> that directory don't get set with nfs4 acl's which then breaks things like
> Windows being able to discern the difference between full and modify
> privileges (since posix only provides rwx, samba doesn't seem to care about
> the 'c' acl provided by gpfs).
>
> Several other strange behaviors I noticed :
>
> * Turning inheritance off through the windows security -> advanced dialog
> doesn't work unless you delete (or add I guess, but didn't try adding an
> acl) some acl, either the group/user that you're trying to disable
> inheritance for (which then means you have to re-add that group with
> inheritance disabled) or some other group / user that you don't care about.
> For example to disable inheritance on a directory for a group, you'd add a
> dummy user/group acl to that directory, disable inheritance for the
> group/user you want to disable inheritance for, then delete that dummy
> group, otherwise clicking apply -> ok, backing out and then going back in
> doesn't change the inheritance settings in either the advanced security
> dialog or FileInherit, DirInherit, or Inherit acls in the output of
> mmgetacl.
>
> * robocopy y: z: /mir /COPY:DATSO throws "something is wrong with the
> device. Failed to set NTACL ... " error 31 errors if your'e trying to copy
> ACLs and data from some other share, but it still ends up copying the ACL's
> properly! The problem is that robocopy doesn't complete, it only descends
> one directory level at a time per robocopy run when it throws all these
> errors. So you have to keep running robocopy in a loop from a .bat script
> or manually keep running it until you think it's actually copied over all
> the ACL's. This doesn't happen with acl_xattr, but acl_xattr has other
> issues as well.
>
> * Does any of the auditing tab stuff work? Samba has auditing via log
> files, but this seems to be something that's stored in NTFS?
>
> * I haven't tried anything from the quota tab, can it actually set GPFS
> quotas somehow? I guess in windows you can set per directory quotas, the
> closest thing would be filesets linked to directories with user/group
> quotas within that fileset, but I don't think that tab is going to let you
> do that.
>
> Thanks,
> Sabuj
>
>
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://gpfsug.org/pipermail/gpfsug-discuss_gpfsug.org/attachments/20140402/660ee76b/attachment.htm>

From jonathan at buzzard.me.uk  Thu Apr  3 15:45:29 2014
From: jonathan at buzzard.me.uk (Jonathan Buzzard)
Date: Thu, 03 Apr 2014 15:45:29 +0100
Subject: [gpfsug-discuss] question about why unix extensions = no is
 recommended when using samba + gpfs?
In-Reply-To: <CAEeMGHvFDgP-7i-fy8KnFCoJra13CB5X6RNKacjBWUUq2Zp8HA@mail.gmail.com>
References: <CAEeMGHvH84GDv6yEnPgKtNwOhyvXLkbvV2XGtf3vHpJgSuu=Lg@mail.gmail.com>
	<1394705361.16270.9.camel@buzzard.phy.strath.ac.uk>
	<CAEeMGHu4EaiEqa6=qJjHL+4GnkOnQeqh+h5azTHB-1QuqUiTMw@mail.gmail.com>
	<1394716131.2612.24.camel@buzzard.phy.strath.ac.uk>
	<CAEeMGHvG4Jf_gZLfKfs8TyERib8L+r42_uWRqP6DQzHvj7_5dg@mail.gmail.com>
	<CAEeMGHuO5JUNAWAyWv6Oo3rPLvpzKfF0AWdGzgnxyr=nBfVMeQ@mail.gmail.com>
	<533C82DC.9090402@buzzard.me.uk>
	<CAEeMGHtGDRLQiM4qP62Yuwpp9td+9PCjATNf=S1SS3xhEqw40A@mail.gmail.com>
	<533C8A68.7040304@buzzard.me.uk>
	<CAEeMGHvFDgP-7i-fy8KnFCoJra13CB5X6RNKacjBWUUq2Zp8HA@mail.gmail.com>
Message-ID: <533D7409.3090002@buzzard.me.uk>

On 03/04/14 03:08, Sabuj Pattanayek wrote:

[SNIP]
>
> include = /etc/samba/template_shares.conf
> include = /etc/samba/test_shares.conf

That is stupid, you need to use registry share definitions with CTDB. 
Having them in files is bad bad bad.

>
> ### template_shares.conf ###
>
> [template_nfs4]
> comment = GPFS Cluster on smb using %R protocol
> path = /dors/testfs
> writeable = yes
> vfs objects = shadow_copy2 gpfs fileid

Hum, might have changed in Samba 4.x but in Samba 3.5/3.6 you can only 
have one vfs objects line in the entire smb.conf file and I did not 
thing it was a per share option either. Well you can have more than one, 
but the later ones just override the previous ones.

> ea support = yes
> store dos attributes = yes
> access based share enum = yes
> map readonly = no
> map archive = no
> map system = no
> mangled names = no
> force unknown acl user = yes
> locking = yes
> notify:inotify = no
> shadow:snapdir = .snapshots
> shadow:localtime = yes
> shadow:format = %Y%m%d_%H:%M
> shadow:fixinodes = yes
> shadow:snapdirseverywhere = yes
> shadow:sort = desc
> # vfs_gpfs settings
> gpfs:acl = yes
> gpfs:winattr = yes
> gpfs:dfreequota = yes
> nfs4:mode = simple
> nfs4:chown = yes
> nfs4:acedup = merge
> ## needed to turn off sharemodes, msoffice on windows couldn't save
> # https://bugzilla.samba.org/show_bug.cgi?id=6762
> gpfs:sharemodes = no

I am not well versed with Samba 4.x but a quick check says that share 
modes = yes conflicts with SMB2 and durable handles. Given in Samba 4.1 
max protocol is SMB2 by default ...

I have not seen a definitive answer anywhere about whether SMB2 and CTDB 
can be used in combination and if so what versions of CTDB/Samba one 
should be using however.

> gpfs:leases = yes
> posix locking = yes
> kernel oplocks = no
> kernel share modes = yes
> fileid:algorithm = fsname
>
>
>
>     Have you tested that the DOS attributes are correctly being stored
>     in the GPFS file system?
>
>
> No, but they're all set to no, including map hidden which was missing
> above but according to man smb.conf is by default set to no, so wouldn't
> these not be mapped/stored in GPFS anyways? What EA file would these be
> stored in if these were set to yes?

They are not stored in an extended attribute they are stored in the GPFS 
file system itself. The various settings that I listed are so that Samba 
tells the GPFS VFS module to store them in the extended attributes. 
Howeve the GPFS VFS module then goes and stores/retrieves them directly 
from the file system. It's all part of GPFS being able to run on 
Windows. There are genuine file creation times as well

I suggest that you explicitly test and make sure it is working.

>
>
>     It explicitly does work. The issues are all around Office trying to
>     preserve ACL's which the vast majority of software does not.
>
>
> Understood, but again, with the setup above, I had to turn sharemodes
> off to get it to work. Setting it to no was mentioned in a comment in u
> that samba bug by Volker, i.e. I just didn't think of that myself, so
> there must be some correlation.
>
>
>     Are you running with NFSv4 ACL's *ONLY* on GPFS? Using Posix or
>     Posix and NFSv4 together is likely to lead to problems.
>
>
> posix + nfs4, it can be problematic but we're working around it.
>

Put simply no you are not working around it, it is the cause of your 
issues with Office. More precisely the issue with Office is down to how 
the mapping of NTFS ACLS to GPFS is working, because storing the NTFS 
ACLS in extended attributes works. I am telling you don't mix Posix and 
NFSv4 ACL's in GPFS it won't work. Whether you listen is up to you.

I suggest you use a development/test GPFS cluster to verify it.


JAB.

-- 
Jonathan A. Buzzard                 Email: jonathan (at) buzzard.me.uk
Fife, United Kingdom.


From sabujp at gmail.com  Thu Apr  3 18:23:59 2014
From: sabujp at gmail.com (Sabuj Pattanayek)
Date: Thu, 3 Apr 2014 12:23:59 -0500
Subject: [gpfsug-discuss] question about why unix extensions = no is
 recommended when using samba + gpfs?
In-Reply-To: <533D7409.3090002@buzzard.me.uk>
References: <CAEeMGHvH84GDv6yEnPgKtNwOhyvXLkbvV2XGtf3vHpJgSuu=Lg@mail.gmail.com>
	<1394705361.16270.9.camel@buzzard.phy.strath.ac.uk>
	<CAEeMGHu4EaiEqa6=qJjHL+4GnkOnQeqh+h5azTHB-1QuqUiTMw@mail.gmail.com>
	<1394716131.2612.24.camel@buzzard.phy.strath.ac.uk>
	<CAEeMGHvG4Jf_gZLfKfs8TyERib8L+r42_uWRqP6DQzHvj7_5dg@mail.gmail.com>
	<CAEeMGHuO5JUNAWAyWv6Oo3rPLvpzKfF0AWdGzgnxyr=nBfVMeQ@mail.gmail.com>
	<533C82DC.9090402@buzzard.me.uk>
	<CAEeMGHtGDRLQiM4qP62Yuwpp9td+9PCjATNf=S1SS3xhEqw40A@mail.gmail.com>
	<533C8A68.7040304@buzzard.me.uk>
	<CAEeMGHvFDgP-7i-fy8KnFCoJra13CB5X6RNKacjBWUUq2Zp8HA@mail.gmail.com>
	<533D7409.3090002@buzzard.me.uk>
Message-ID: <CAEeMGHs7UyiFfu6zi5SZHvcUW0aYhQ21dYptVz_CcB5UaPww-A@mail.gmail.com>

> include = /etc/samba/template_shares.conf
>> include = /etc/samba/test_shares.conf
>>
>
> That is stupid, you need to use registry share definitions with CTDB.
> Having them in files is bad bad bad.


Will look into it.


> ### template_shares.conf ###
>
>>
>> [template_nfs4]
>> comment = GPFS Cluster on smb using %R protocol
>> path = /dors/testfs
>> writeable = yes
>> vfs objects = shadow_copy2 gpfs fileid
>>
>
> Hum, might have changed in Samba 4.x but in Samba 3.5/3.6 you can only
> have one vfs objects line in the entire smb.conf file and I did not thing
> it was a per share option either. Well you can have more than one, but the
> later ones just override the previous ones.



Yup, it's definitely per share in 4.1.x and the later ones probably do
override the previous one if the same vfs functions are overloaded, but in
the case above there's no overlap and shadow_copy2 and gpfs do work.



>
> I am not well versed with Samba 4.x but a quick check says that share
> modes = yes conflicts with SMB2 and durable handles. Given in Samba 4.1 max
> protocol is SMB2 by default ...
>

I was able to do SMB2 (at least in terms of performance over SMBv1) with
sharemodes = yes or sharemodes = no. Durable / persistent handles don't
work in that active read/write I/O will not continue if  smb/ctdb is
disabled on one of the samba nodes. The client will not have to
re-map/re-connect but any active I/O other than file deletions and perhaps
metadata operations will continue unaffected.


>
> I have not seen a definitive answer anywhere about whether SMB2 and CTDB
> can be used in combination and if so what versions of CTDB/Samba one should
> be using however.


I'm using ctdb 1.0.114 packaged by sernet along with sernet samba 4.1.6 .
They said they would release re-packaged v2 rpm at some point. Again, SMB2
works in so far as I can tell with its much improved read/write performance
over SMB1.


>>
>> No, but they're all set to no, including map hidden which was missing
>> above but according to man smb.conf is by default set to no, so wouldn't
>> these not be mapped/stored in GPFS anyways? What EA file would these be
>> stored in if these were set to yes?
>>
>
> They are not stored in an extended attribute they are stored in the GPFS
> file system itself. The various settings that I listed are so that Samba
> tells the GPFS VFS module to store them in the extended attributes. Howeve
> the GPFS VFS module then goes and stores/retrieves them directly from the
> file system. It's all part of GPFS being able to run on Windows. There are
> genuine file creation times as well
>
> I suggest that you explicitly test and make sure it is working.
>

Yup, they're working, they're being stored wherever they're supposed to be
stored in GPFS itself. I set a file to hidden and it disappeared from the
explorer window. Went into a command prompt and ran dir/a and it appeared.
Then ran mmlsattr -L on the file and it showed ARCHIVE HIDDEN in the
Windows attributes section.



> Put simply no you are not working around it, it is the cause of your
> issues with Office. More precisely the issue with Office is down to how the
> mapping of NTFS ACLS to GPFS is working, because storing the NTFS ACLS in
> extended attributes works. I am telling you don't mix Posix and NFSv4 ACL's
> in GPFS it won't work. Whether you listen is up to you.
>

It doesn't work if the ACL on the file is POSIX or has been promoted to
NFS4. In any case, we have need for the ACLs support to be both POSIX and
NFS4 where needed for the window shares and we can't/won't split up the
filesystem.


>
> I suggest you use a development/test GPFS cluster to verify it.


Yes, we're going to need a test/dev cluster for testing these for future
upgrades, etc so I will try an FS that's pure nfs4 ACLs only and see if it
behaves any differently.
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://gpfsug.org/pipermail/gpfsug-discuss_gpfsug.org/attachments/20140403/5f38f99f/attachment.htm>

From sabujp at gmail.com  Thu Apr  3 18:26:00 2014
From: sabujp at gmail.com (Sabuj Pattanayek)
Date: Thu, 3 Apr 2014 12:26:00 -0500
Subject: [gpfsug-discuss] question about why unix extensions = no is
 recommended when using samba + gpfs?
In-Reply-To: <CAEeMGHs7UyiFfu6zi5SZHvcUW0aYhQ21dYptVz_CcB5UaPww-A@mail.gmail.com>
References: <CAEeMGHvH84GDv6yEnPgKtNwOhyvXLkbvV2XGtf3vHpJgSuu=Lg@mail.gmail.com>
	<1394705361.16270.9.camel@buzzard.phy.strath.ac.uk>
	<CAEeMGHu4EaiEqa6=qJjHL+4GnkOnQeqh+h5azTHB-1QuqUiTMw@mail.gmail.com>
	<1394716131.2612.24.camel@buzzard.phy.strath.ac.uk>
	<CAEeMGHvG4Jf_gZLfKfs8TyERib8L+r42_uWRqP6DQzHvj7_5dg@mail.gmail.com>
	<CAEeMGHuO5JUNAWAyWv6Oo3rPLvpzKfF0AWdGzgnxyr=nBfVMeQ@mail.gmail.com>
	<533C82DC.9090402@buzzard.me.uk>
	<CAEeMGHtGDRLQiM4qP62Yuwpp9td+9PCjATNf=S1SS3xhEqw40A@mail.gmail.com>
	<533C8A68.7040304@buzzard.me.uk>
	<CAEeMGHvFDgP-7i-fy8KnFCoJra13CB5X6RNKacjBWUUq2Zp8HA@mail.gmail.com>
	<533D7409.3090002@buzzard.me.uk>
	<CAEeMGHs7UyiFfu6zi5SZHvcUW0aYhQ21dYptVz_CcB5UaPww-A@mail.gmail.com>
Message-ID: <CAEeMGHuNe8tWuYZM_XbrV7LNqfrpCC4Um7Vo6FJeeYRiJ4HzSQ@mail.gmail.com>

I was able to do SMB2 (at least in terms of performance over SMBv1) with
> sharemodes = yes or sharemodes = no. Durable / persistent handles don't
> work in that active read/write I/O will not continue if  smb/ctdb is
> disabled on one of the samba nodes. The client will not have to
> re-map/re-connect but any active I/O other than file deletions and perhaps
> metadata operations will continue unaffected.
>

should be "any active I/O other than file deletions and perhaps metadata
operations will be disrupted"
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://gpfsug.org/pipermail/gpfsug-discuss_gpfsug.org/attachments/20140403/9b0bf53a/attachment.htm>

From jonathan at buzzard.me.uk  Thu Apr  3 19:26:08 2014
From: jonathan at buzzard.me.uk (Jonathan Buzzard)
Date: Thu, 03 Apr 2014 19:26:08 +0100
Subject: [gpfsug-discuss] question about why unix extensions = no is
 recommended when using samba + gpfs?
In-Reply-To: <CAEeMGHs7UyiFfu6zi5SZHvcUW0aYhQ21dYptVz_CcB5UaPww-A@mail.gmail.com>
References: <CAEeMGHvH84GDv6yEnPgKtNwOhyvXLkbvV2XGtf3vHpJgSuu=Lg@mail.gmail.com>
	<1394705361.16270.9.camel@buzzard.phy.strath.ac.uk>
	<CAEeMGHu4EaiEqa6=qJjHL+4GnkOnQeqh+h5azTHB-1QuqUiTMw@mail.gmail.com>
	<1394716131.2612.24.camel@buzzard.phy.strath.ac.uk>
	<CAEeMGHvG4Jf_gZLfKfs8TyERib8L+r42_uWRqP6DQzHvj7_5dg@mail.gmail.com>
	<CAEeMGHuO5JUNAWAyWv6Oo3rPLvpzKfF0AWdGzgnxyr=nBfVMeQ@mail.gmail.com>
	<533C82DC.9090402@buzzard.me.uk>
	<CAEeMGHtGDRLQiM4qP62Yuwpp9td+9PCjATNf=S1SS3xhEqw40A@mail.gmail.com>
	<533C8A68.7040304@buzzard.me.uk>
	<CAEeMGHvFDgP-7i-fy8KnFCoJra13CB5X6RNKacjBWUUq2Zp8HA@mail.gmail.com>
	<533D7409.3090002@buzzard.me.uk>
	<CAEeMGHs7UyiFfu6zi5SZHvcUW0aYhQ21dYptVz_CcB5UaPww-A@mail.gmail.com>
Message-ID: <533DA7C0.4050106@buzzard.me.uk>

On 03/04/14 18:23, Sabuj Pattanayek wrote:

[SNIP]

>
> It doesn't work if the ACL on the file is POSIX or has been promoted to
> NFS4. In any case, we have need for the ACLs support to be both POSIX
> and NFS4 where needed for the window shares and we can't/won't split up
> the filesystem.
>

Client side Linux has support NFSv4 or more specifically NFSv4.1 for 
some time. The issue is the fact that the RichACL patches seem to have 
been stuck in limbo for years now.

Not that I have tried it even in development, but there is an 
alternative to the Linux kernel NFS server which sucks anyway as 
visibility into what is going on is near none existent.

It's the NFS-Ganesha server and according to the documentation it 
supports full NFSv4.1 and has GPFS support for a backend file system.

     https://github.com/nfs-ganesha/nfs-ganesha/wiki

That could potentially remove your "requirement" for Posix ACL's. That 
is you could go full NFSv4 ACL's in GPFS and an area could be accessed 
either by NFSv4 or SMB without the ACL's in GPFS getting mucked up. It 
is however not clear if NFSv4 ACL's are supported yet. I note that the 
latest versions of CTDB have support for NFS-Ganesha.

>
>     I suggest you use a development/test GPFS cluster to verify it.
>
> Yes, we're going to need a test/dev cluster for testing these for future
> upgrades, etc so I will try an FS that's pure nfs4 ACLs only and see if
> it behaves any differently.

I never cease to be amazed that people are doing large scale file 
servers with Linux/GPFS/Samba and don't have a test/dev cluster.

JAB.

-- 
Jonathan A. Buzzard                 Email: jonathan (at) buzzard.me.uk
Fife, United Kingdom.


From sabujp at gmail.com  Thu Apr  3 19:50:03 2014
From: sabujp at gmail.com (Sabuj Pattanayek)
Date: Thu, 3 Apr 2014 13:50:03 -0500
Subject: [gpfsug-discuss] question about why unix extensions = no is
 recommended when using samba + gpfs?
In-Reply-To: <533DA7C0.4050106@buzzard.me.uk>
References: <CAEeMGHvH84GDv6yEnPgKtNwOhyvXLkbvV2XGtf3vHpJgSuu=Lg@mail.gmail.com>
	<1394705361.16270.9.camel@buzzard.phy.strath.ac.uk>
	<CAEeMGHu4EaiEqa6=qJjHL+4GnkOnQeqh+h5azTHB-1QuqUiTMw@mail.gmail.com>
	<1394716131.2612.24.camel@buzzard.phy.strath.ac.uk>
	<CAEeMGHvG4Jf_gZLfKfs8TyERib8L+r42_uWRqP6DQzHvj7_5dg@mail.gmail.com>
	<CAEeMGHuO5JUNAWAyWv6Oo3rPLvpzKfF0AWdGzgnxyr=nBfVMeQ@mail.gmail.com>
	<533C82DC.9090402@buzzard.me.uk>
	<CAEeMGHtGDRLQiM4qP62Yuwpp9td+9PCjATNf=S1SS3xhEqw40A@mail.gmail.com>
	<533C8A68.7040304@buzzard.me.uk>
	<CAEeMGHvFDgP-7i-fy8KnFCoJra13CB5X6RNKacjBWUUq2Zp8HA@mail.gmail.com>
	<533D7409.3090002@buzzard.me.uk>
	<CAEeMGHs7UyiFfu6zi5SZHvcUW0aYhQ21dYptVz_CcB5UaPww-A@mail.gmail.com>
	<533DA7C0.4050106@buzzard.me.uk>
Message-ID: <CAEeMGHteKg6DPyiE4igPoCZfjq29MFzyTJe8-Xj-EKFCXVtdkg@mail.gmail.com>

> It's the NFS-Ganesha server and according to the documentation it supports
> full NFSv4.1 and has GPFS support for a backend file system.
>

Yup, that could be a future possibility, but getting everyone who's using
the system to move to non-posix ACLs (whom I have no control over) won't
work. NFSv3 and POSIX + POSIX extended ACLs aren't going anywhere soon
because of their simplicity and availability.


> I never cease to be amazed that people are doing large scale file servers
> with Linux/GPFS/Samba and don't have a test/dev cluster.


We do, using it for testing hasn't been necessary since our production
system was our test system since it wasn't being used in production, the
samba part is still only being used very minimally and we've done as much
testing as we could prior to letting a few users on who discovered some of
these problems that we've worked around.
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://gpfsug.org/pipermail/gpfsug-discuss_gpfsug.org/attachments/20140403/65190ee1/attachment.htm>

From bevans at pixitmedia.com  Thu Apr 17 16:08:23 2014
From: bevans at pixitmedia.com (Barry Evans)
Date: Thu, 17 Apr 2014 16:08:23 +0100
Subject: [gpfsug-discuss] PixStor Launch Party after GPFS User Group meeting
Message-ID: <534FEE67.2080204@pixitmedia.com>

Hello all,

I'd like to invite all attendees of the GPFS User Group Meeting on the 
29th of April to join Pixit Media, ArcaStream and Arrow to the launch 
party of Pixit Media's new unified storage and network architecture for 
media, PixStor (which of course is powered by GPFS). We will also be 
launching our new storage brand for research computing, ArcaStream. But 
most importantly...

FREE DRINKS AND FOOD! (and a few prizes too)

The event will be held at the Mulberry Bush Pub, just a 2 minute walk 
across the road from IBM South Bank, and will start straight after the 
GPFS User Group meeting finishes up and last until the pub close. If 
you'd like to attend, please register at 
http://www.pixitmedia.com/launchparty - hope to see you all there!

Barry Evans
Technical Director/Co-Founder
Pixit Media/ArcaStream



Disclaimer - This party does not form a part of of the actual GPFS user 
group meeting

-- 
This email is confidential in that it is intended for the exclusive 
attention of the addressee(s) indicated. If you are not the intended 
recipient, this email should not be read or disclosed to any other person. 
Please notify the sender immediately and delete this email from your 
computer system. Any opinions expressed are not necessarily those of the 
company from which this email was sent and, whilst to the best of our 
knowledge no viruses or defects exist, no responsibility can be accepted 
for any loss or damage arising from its receipt or subsequent use of this 
email.


From orlando.richards at ed.ac.uk  Fri Apr 18 10:29:15 2014
From: orlando.richards at ed.ac.uk (Orlando Richards)
Date: Fri, 18 Apr 2014 10:29:15 +0100
Subject: [gpfsug-discuss] PixStor Launch Party after GPFS User Group
	meeting
In-Reply-To: <534FEE67.2080204@pixitmedia.com>
References: <534FEE67.2080204@pixitmedia.com>
Message-ID: <5350F06B.4060005@ed.ac.uk>

On 17/04/14 16:08, Barry Evans wrote:
> Hello all,
>
> I'd like to invite all attendees of the GPFS User Group Meeting on the
> 29th of April to join Pixit Media, ArcaStream and Arrow to the launch
> party of Pixit Media's new unified storage and network architecture for
> media, PixStor (which of course is powered by GPFS). We will also be
> launching our new storage brand for research computing, ArcaStream. But
> most importantly...
>
> FREE DRINKS AND FOOD! (and a few prizes too)
>
> The event will be held at the Mulberry Bush Pub, just a 2 minute walk
> across the road from IBM South Bank, and will start straight after the
> GPFS User Group meeting finishes up and last until the pub close. If
> you'd like to attend, please register at
> http://www.pixitmedia.com/launchparty - hope to see you all there!
>
> Barry Evans
> Technical Director/Co-Founder
> Pixit Media/ArcaStream
>
>
>
> Disclaimer - This party does not form a part of of the actual GPFS user
> group meeting
>

Hi Barry,

The link on your web page takes you to a kids toys website ;)

I think you want:
http://www.mulberrybushpub.com/



-- 
             --
    Dr Orlando Richards
   Information Services
IT Infrastructure Division
        Unix Section
     Tel: 0131 650 4994
   skype: orlando.richards

The University of Edinburgh is a charitable body, registered in 
Scotland, with registration number SC005336.


From bevans at pixitmedia.com  Fri Apr 18 16:51:23 2014
From: bevans at pixitmedia.com (Barry Evans)
Date: Fri, 18 Apr 2014 16:51:23 +0100
Subject: [gpfsug-discuss] PixStor Launch Party after GPFS User Group
	meeting
In-Reply-To: <5350F06B.4060005@ed.ac.uk>
References: <534FEE67.2080204@pixitmedia.com> <5350F06B.4060005@ed.ac.uk>
Message-ID: <535149FB.20308@pixitmedia.com>


Well that's embarrassing... ;)

Fixed - Thanks Orlando!


> Orlando Richards <mailto:orlando.richards at ed.ac.uk>
> 18 April 2014 10:29
>
>
> Hi Barry,
>
> The link on your web page takes you to a kids toys website ;)
>
> I think you want:
> http://www.mulberrybushpub.com/
>
>
>
> Barry Evans <mailto:bevans at pixitmedia.com>
> 17 April 2014 16:08
> Hello all,
>
> I'd like to invite all attendees of the GPFS User Group Meeting on the 
> 29th of April to join Pixit Media, ArcaStream and Arrow to the launch 
> party of Pixit Media's new unified storage and network architecture 
> for media, PixStor (which of course is powered by GPFS). We will also 
> be launching our new storage brand for research computing, ArcaStream. 
> But most importantly...
>
> FREE DRINKS AND FOOD! (and a few prizes too)
>
> The event will be held at the Mulberry Bush Pub, just a 2 minute walk 
> across the road from IBM South Bank, and will start straight after the 
> GPFS User Group meeting finishes up and last until the pub close. If 
> you'd like to attend, please register at 
> http://www.pixitmedia.com/launchparty - hope to see you all there!
>
> Barry Evans
> Technical Director/Co-Founder
> Pixit Media/ArcaStream
>
>
>
> Disclaimer - This party does not form a part of of the actual GPFS 
> user group meeting

-- 
This email is confidential in that it is intended for the exclusive 
attention of the addressee(s) indicated. If you are not the intended 
recipient, this email should not be read or disclosed to any other person. 
Please notify the sender immediately and delete this email from your 
computer system. Any opinions expressed are not necessarily those of the 
company from which this email was sent and, whilst to the best of our 
knowledge no viruses or defects exist, no responsibility can be accepted 
for any loss or damage arising from its receipt or subsequent use of this 
email.
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://gpfsug.org/pipermail/gpfsug-discuss_gpfsug.org/attachments/20140418/ba3d6bc6/attachment.htm>
-------------- next part --------------
A non-text attachment was scrubbed...
Name: postbox-contact.jpg
Type: image/jpeg
Size: 1256 bytes
Desc: not available
URL: <http://gpfsug.org/pipermail/gpfsug-discuss_gpfsug.org/attachments/20140418/ba3d6bc6/attachment.jpg>
-------------- next part --------------
A non-text attachment was scrubbed...
Name: compose-unknown-contact.jpg
Type: image/jpeg
Size: 770 bytes
Desc: not available
URL: <http://gpfsug.org/pipermail/gpfsug-discuss_gpfsug.org/attachments/20140418/ba3d6bc6/attachment-0001.jpg>

From orlando.richards at ed.ac.uk  Wed Apr 23 14:22:46 2014
From: orlando.richards at ed.ac.uk (Orlando Richards)
Date: Wed, 23 Apr 2014 14:22:46 +0100
Subject: [gpfsug-discuss] Final details for GPFS User Group Meeting 29/4
In-Reply-To: <CAEKnjWJOoweYnDbQ=q5i=aTFjOkYFaSp7o0Uan_T+t63C=sH=A@mail.gmail.com>
References: <CAEKnjWJOoweYnDbQ=q5i=aTFjOkYFaSp7o0Uan_T+t63C=sH=A@mail.gmail.com>
Message-ID: <5357BEA6.20202@ed.ac.uk>

On 23/04/14 13:03, Secretary GPFS UG wrote:
> Unfortunately there is a tube strike planned from around 21:00 on Monday
> 28 April until the morning of Thursday 1 May which may impact your
> journey so please allow yourself plenty of time to register before the
> first presentation gets underway at 11am.
>

Ugh. Any Londoners have advice on how to get to/from Paddington with 
tube strikes ongoing?

-- 
             --
    Dr Orlando Richards
   Information Services
IT Infrastructure Division
        Unix Section
     Tel: 0131 650 4994
   skype: orlando.richards

The University of Edinburgh is a charitable body, registered in 
Scotland, with registration number SC005336.


From bevans at pixitmedia.com  Wed Apr 23 14:37:40 2014
From: bevans at pixitmedia.com (Barry Evans)
Date: Wed, 23 Apr 2014 14:37:40 +0100
Subject: [gpfsug-discuss] Final details for GPFS User Group Meeting 29/4
In-Reply-To: <5357BEA6.20202@ed.ac.uk>
References: <CAEKnjWJOoweYnDbQ=q5i=aTFjOkYFaSp7o0Uan_T+t63C=sH=A@mail.gmail.com>
	<5357BEA6.20202@ed.ac.uk>
Message-ID: <5357C224.6050800@pixitmedia.com>

Last time I think Bakerloo from Paddington to Waterloo was 'OK' - no 
idea if it will be the same this time around. The bigger stations seemed 
to cope pretty well, Central line excluded.

Cheers,
Barry

Orlando Richards wrote:
>
> On 23/04/14 13:03, Secretary GPFS UG wrote:
>>
>> Unfortunately there is a tube strike planned from around 21:00 on Monday
>> 28 April until the morning of Thursday 1 May which may impact your
>> journey so please allow yourself plenty of time to register before the
>> first presentation gets underway at 11am.
>>
>
>
> Ugh. Any Londoners have advice on how to get to/from Paddington with
> tube strikes ongoing?

-- 
This email is confidential in that it is intended for the exclusive 
attention of the addressee(s) indicated. If you are not the intended 
recipient, this email should not be read or disclosed to any other person. 
Please notify the sender immediately and delete this email from your 
computer system. Any opinions expressed are not necessarily those of the 
company from which this email was sent and, whilst to the best of our 
knowledge no viruses or defects exist, no responsibility can be accepted 
for any loss or damage arising from its receipt or subsequent use of this 
email.
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://gpfsug.org/pipermail/gpfsug-discuss_gpfsug.org/attachments/20140423/0d699dbb/attachment.htm>

From Sandra.McLaughlin at astrazeneca.com  Wed Apr 23 15:02:24 2014
From: Sandra.McLaughlin at astrazeneca.com (McLaughlin, Sandra M)
Date: Wed, 23 Apr 2014 14:02:24 +0000
Subject: [gpfsug-discuss] Final details for GPFS User Group Meeting 29/4
In-Reply-To: <5357C224.6050800@pixitmedia.com>
References: <CAEKnjWJOoweYnDbQ=q5i=aTFjOkYFaSp7o0Uan_T+t63C=sH=A@mail.gmail.com>
	<5357BEA6.20202@ed.ac.uk> <5357C224.6050800@pixitmedia.com>
Message-ID: <117e0d974a314151bfd033002b9e553b@DBXPR04MB031.eurprd04.prod.outlook.com>

I was in London last time as well (can?t believe my luck really, that it?s happening again) and the Victoria and Northern lines were OK, and Euston, Victoria and Waterloo were not too bad. So, it wasn?t nearly as bad as I was expecting.

Sandra.

From: gpfsug-discuss-bounces at gpfsug.org [mailto:gpfsug-discuss-bounces at gpfsug.org] On Behalf Of Barry Evans
Sent: 23 April 2014 14:38
To: gpfsug main discussion list
Subject: Re: [gpfsug-discuss] Final details for GPFS User Group Meeting 29/4

Last time I think Bakerloo from Paddington to Waterloo was 'OK' - no idea if it will be the same this time around. The bigger stations seemed to cope pretty well, Central line excluded.

Cheers,
Barry

Orlando Richards wrote:


On 23/04/14 13:03, Secretary GPFS UG wrote:


Unfortunately there is a tube strike planned from around 21:00 on Monday
28 April until the morning of Thursday 1 May which may impact your
journey so please allow yourself plenty of time to register before the
first presentation gets underway at 11am.


Ugh. Any Londoners have advice on how to get to/from Paddington with
tube strikes ongoing?

[https://ci3.googleusercontent.com/proxy/RHzzP7ozZOO_Rz1yGW5TDRhNOfSN5T0D6OEeEfbCAYlYGEUhlUCQkZ7T74jyNAbZ3QtuhRg-Ma1WcWYTzawl94g=s0-d-e1-ft#http://pixitmedia.com/sig/PixitEmailSig.png]
This email is confidential in that it is intended for the exclusive attention of the addressee(s) indicated. If you are not the intended recipient, this email should not be read or disclosed to any other person. Please notify the sender immediately and delete this email from your computer system. Any opinions expressed are not necessarily those of the company from which this email was sent and, whilst to the best of our knowledge no viruses or defects exist, no responsibility can be accepted for any loss or damage arising from its receipt or subsequent use of this email.

--------------------------------------------------------------------------
AstraZeneca UK Limited is a company incorporated in England and Wales with registered number: 03674842 and a registered office at 2 Kingdom Street, London, W2 6BD.
Confidentiality Notice: This message is private and may contain confidential, proprietary and legally privileged information. If you have received this message in error, please notify us and remove it from your system and note that you must not copy, distribute or take any action in reliance on it. Any unauthorised use or disclosure of the contents of this message is not permitted and may be unlawful.
Disclaimer: Email messages may be subject to delays, interception, non-delivery and unauthorised alterations. Therefore, information expressed in this message is not given or endorsed by AstraZeneca UK Limited unless otherwise notified by an authorised representative independent of this message. No contractual relationship is created by this message by any person unless specifically indicated by agreement in writing other than email.
Monitoring: AstraZeneca UK Limited may monitor email traffic data and content for the purposes of the prevention and detection of crime, ensuring the security of our computer systems and checking Compliance with our Code of Conduct and Policies.
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://gpfsug.org/pipermail/gpfsug-discuss_gpfsug.org/attachments/20140423/e79c7343/attachment.htm>

From orlando.richards at ed.ac.uk  Wed Apr 23 15:07:43 2014
From: orlando.richards at ed.ac.uk (Orlando Richards)
Date: Wed, 23 Apr 2014 15:07:43 +0100
Subject: [gpfsug-discuss] Final details for GPFS User Group Meeting 29/4
In-Reply-To: <117e0d974a314151bfd033002b9e553b@DBXPR04MB031.eurprd04.prod.outlook.com>
References: <CAEKnjWJOoweYnDbQ=q5i=aTFjOkYFaSp7o0Uan_T+t63C=sH=A@mail.gmail.com>	<5357BEA6.20202@ed.ac.uk>
	<5357C224.6050800@pixitmedia.com>
	<117e0d974a314151bfd033002b9e553b@DBXPR04MB031.eurprd04.prod.outlook.com>
Message-ID: <5357C92F.1040407@ed.ac.uk>


Good to hear - thanks both!

On 23/04/14 15:02, McLaughlin, Sandra M wrote:
> I was in London last time as well (can?t believe my luck really, that
> it?s happening again) and the Victoria and Northern lines were OK, and
> Euston, Victoria and Waterloo were not too bad. So, it wasn?t nearly as
> bad as I was expecting.
>
> Sandra.
>
> ------------------------------------------------------------------------
>
> AstraZeneca UK Limited is a company incorporated in England and Wales
> with registered number: 03674842 and a registered office at 2 Kingdom
> Street, London, W2 6BD.
>
> *Confidentiality Notice: *This message is private and may contain
> confidential, proprietary and legally privileged information. If you
> have received this message in error, please notify us and remove it from
> your system and note that you must not copy, distribute or take any
> action in reliance on it. Any unauthorised use or disclosure of the
> contents of this message is not permitted and may be unlawful.
>
> *Disclaimer:* Email messages may be subject to delays, interception,
> non-delivery and unauthorised alterations. Therefore, information
> expressed in this message is not given or endorsed by AstraZeneca UK
> Limited unless otherwise notified by an authorised representative
> independent of this message. No contractual relationship is created by
> this message by any person unless specifically indicated by agreement in
> writing other than email.
>
> *Monitoring: *AstraZeneca UK Limited may monitor email traffic data and
> content for the purposes of the prevention and detection of crime,
> ensuring the security of our computer systems and checking compliance
> with our Code of Conduct and policies.
>
> *From:*gpfsug-discuss-bounces at gpfsug.org
> [mailto:gpfsug-discuss-bounces at gpfsug.org] *On Behalf Of *Barry Evans
> *Sent:* 23 April 2014 14:38
> *To:* gpfsug main discussion list
> *Subject:* Re: [gpfsug-discuss] Final details for GPFS User Group
> Meeting 29/4
>
> Last time I think Bakerloo from Paddington to Waterloo was 'OK' - no
> idea if it will be the same this time around. The bigger stations seemed
> to cope pretty well, Central line excluded.
>
> Cheers,
> Barry
>
> Orlando Richards wrote:
>
>
> On 23/04/14 13:03, Secretary GPFS UG wrote:
>
>
> Unfortunately there is a tube strike planned from around 21:00 on Monday
> 28 April until the morning of Thursday 1 May which may impact your
> journey so please allow yourself plenty of time to register before the
> first presentation gets underway at 11am.
>
>
>
> Ugh. Any Londoners have advice on how to get to/from Paddington with
> tube strikes ongoing?
>
>
> This email is confidential in that it is intended for the exclusive
> attention of the addressee(s) indicated. If you are not the intended
> recipient, this email should not be read or disclosed to any other
> person. Please notify the sender immediately and delete this email from
> your computer system. Any opinions expressed are not necessarily those
> of the company from which this email was sent and, whilst to the best of
> our knowledge no viruses or defects exist, no responsibility can be
> accepted for any loss or damage arising from its receipt or subsequent
> use of this email.
>
>
>
> _______________________________________________
> gpfsug-discuss mailing list
> gpfsug-discuss at gpfsug.org
> http://gpfsug.org/mailman/listinfo/gpfsug-discuss
>


-- 
             --
    Dr Orlando Richards
   Information Services
IT Infrastructure Division
        Unix Section
     Tel: 0131 650 4994
   skype: orlando.richards

The University of Edinburgh is a charitable body, registered in 
Scotland, with registration number SC005336.


From chair at gpfsug.org  Wed Apr 23 15:16:27 2014
From: chair at gpfsug.org (Jez Tucker (Chair))
Date: Wed, 23 Apr 2014 15:16:27 +0100
Subject: [gpfsug-discuss] Final details for GPFS User Group Meeting 29/4
In-Reply-To: <5357BEA6.20202@ed.ac.uk>
References: <CAEKnjWJOoweYnDbQ=q5i=aTFjOkYFaSp7o0Uan_T+t63C=sH=A@mail.gmail.com>
	<5357BEA6.20202@ed.ac.uk>
Message-ID: <5357CB3B.4070200@gpfsug.org>

Indeed.
Best laid plans hey?

As others have said, on the day it's usually not that bad if other lines 
are running some tube trains.
Hopefully, they'll call it off at the last moment alike the previous two 
threatened strikes.

We'll handle the day as it pans out.

Jez


On 23/04/14 14:22, Orlando Richards wrote:
> On 23/04/14 13:03, Secretary GPFS UG wrote:
>> Unfortunately there is a tube strike planned from around 21:00 on Monday
>> 28 April until the morning of Thursday 1 May which may impact your
>> journey so please allow yourself plenty of time to register before the
>> first presentation gets underway at 11am.
>>
>
> Ugh. Any Londoners have advice on how to get to/from Paddington with 
> tube strikes ongoing?
>



From chair at gpfsug.org  Fri Apr 25 11:47:42 2014
From: chair at gpfsug.org (Jez Tucker (Chair))
Date: Fri, 25 Apr 2014 11:47:42 +0100
Subject: [gpfsug-discuss] Most tube lines are running during the strike on
	the 29th April
Message-ID: <535A3D4E.7020108@gpfsug.org>

Hi all,

   If you're attending the GPFS User Group on 29th April, you'll no 
doubt be aware of the RMT strike that will be affecting some Tube lines.

It looks like it's not all that bad.  Most lines will be running, bar 
the Central line, Waterloo & City and inner-London Piccadilly.

For precise information, see the PDF on this page: 
http://www.tfl.gov.uk/modes/tube/services-we-expect-to-run

(However, I'd still leave extra time for the journey if at all possible).

See you there.

Best regards,

Jez

GPFS UG Chair




From johnlang at us.ibm.com  Mon Apr 28 21:10:57 2014
From: johnlang at us.ibm.com (John Langlois)
Date: Mon, 28 Apr 2014 16:10:57 -0400
Subject: [gpfsug-discuss] Hello
Message-ID: <OFE9E0899E.22752ABB-ON85257CC8.006E8563-85257CC8.006EEEDA@us.ibm.com>

Hello,

My name is John Langlois and I will be sharing GPFS Product Management 
responsibilities.   Find me on: 

I am very interesting in monitoring this community of GPFS users.  And I 
welcome unsolicited feedback on the problems that you face in your jobs 
every day and how you might use GPFS today or (with a new feature) to 
solve those problems.  What consumes most of your time?  If you had a 
magic wand, how would you use it?   You can write me to help influence the 
future directions of this technology. 

I look forward to collaborating with all of you.

If you are open to a phone interview (again about the jobs you perform), 
please let me know.  I'd love to talk with you directly.


Regards,

John M. Langlois
IBM Software Defined Environment Product Manager

Phone: 1-919-267-6767
E-mail: johnlang at us.ibm.com
Find me on:   and within IBM on:  


-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://gpfsug.org/pipermail/gpfsug-discuss_gpfsug.org/attachments/20140428/976a795d/attachment.htm>
-------------- next part --------------
A non-text attachment was scrubbed...
Name: not available
Type: image/jpeg
Size: 518 bytes
Desc: not available
URL: <http://gpfsug.org/pipermail/gpfsug-discuss_gpfsug.org/attachments/20140428/976a795d/attachment.jpe>
-------------- next part --------------
A non-text attachment was scrubbed...
Name: not available
Type: image/jpeg
Size: 518 bytes
Desc: not available
URL: <http://gpfsug.org/pipermail/gpfsug-discuss_gpfsug.org/attachments/20140428/976a795d/attachment-0001.jpe>
-------------- next part --------------
A non-text attachment was scrubbed...
Name: not available
Type: image/jpeg
Size: 525 bytes
Desc: not available
URL: <http://gpfsug.org/pipermail/gpfsug-discuss_gpfsug.org/attachments/20140428/976a795d/attachment-0002.jpe>
-------------- next part --------------
A non-text attachment was scrubbed...
Name: not available
Type: image/jpeg
Size: 1208 bytes
Desc: not available
URL: <http://gpfsug.org/pipermail/gpfsug-discuss_gpfsug.org/attachments/20140428/976a795d/attachment-0003.jpe>
-------------- next part --------------
A non-text attachment was scrubbed...
Name: not available
Type: image/gif
Size: 1851 bytes
Desc: not available
URL: <http://gpfsug.org/pipermail/gpfsug-discuss_gpfsug.org/attachments/20140428/976a795d/attachment.gif>

From sabujp at gmail.com  Wed Apr  2 22:05:51 2014
From: sabujp at gmail.com (Sabuj Pattanayek)
Date: Wed, 2 Apr 2014 16:05:51 -0500
Subject: [gpfsug-discuss] question about why unix extensions = no is
 recommended when using samba + gpfs?
In-Reply-To: <1394716131.2612.24.camel@buzzard.phy.strath.ac.uk>
References: <CAEeMGHvH84GDv6yEnPgKtNwOhyvXLkbvV2XGtf3vHpJgSuu=Lg@mail.gmail.com>
	<1394705361.16270.9.camel@buzzard.phy.strath.ac.uk>
	<CAEeMGHu4EaiEqa6=qJjHL+4GnkOnQeqh+h5azTHB-1QuqUiTMw@mail.gmail.com>
	<1394716131.2612.24.camel@buzzard.phy.strath.ac.uk>
Message-ID: <CAEeMGHvG4Jf_gZLfKfs8TyERib8L+r42_uWRqP6DQzHvj7_5dg@mail.gmail.com>

So I've been using the recommended gpfs:acl = yes mode for a while on
windows/cifs/smb only shares and today came across a bug where Microsoft
Office (2010, haven't tried other versions) on Windows 7/8 refuses to save
or save as. It can clearly create tmp files (e.g. those ~$... files when it
opens a file) and I can right click -> create a new file, edit files in
notepad/wordpad, drag and drop files between explorer windows but whenever
I try to save a doc/docx or xls/xlsx file it always throws the error dialog
:

There has been a network or file permission error. The network connection
may be lost. (mapped drive:\folder\fileName.docx)

( OK )   ( Help )

Was this information helpful?

If i switch to gpfs:acl = no and then use vfs_acl_xattr instead it works
fine. MS Office on OSX does not have this problem

It's similar to this issue :

https://www.ibm.com/developerworks/community/forums/html/topic?id=77777777-0000-0000-0000-000014299075

Anyone have any ideas without having to use acl_xattr? Again I'm using
sernet samba 4.1.6 and gpfs 3.5.0.11 .

Thanks,
Sabuj



-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://gpfsug.org/pipermail/gpfsug-discuss_gpfsug.org/attachments/20140402/db2df795/attachment-0001.htm>

From sabujp at gmail.com  Wed Apr  2 22:24:14 2014
From: sabujp at gmail.com (Sabuj Pattanayek)
Date: Wed, 2 Apr 2014 16:24:14 -0500
Subject: [gpfsug-discuss] question about why unix extensions = no is
 recommended when using samba + gpfs?
In-Reply-To: <CAEeMGHvG4Jf_gZLfKfs8TyERib8L+r42_uWRqP6DQzHvj7_5dg@mail.gmail.com>
References: <CAEeMGHvH84GDv6yEnPgKtNwOhyvXLkbvV2XGtf3vHpJgSuu=Lg@mail.gmail.com>
	<1394705361.16270.9.camel@buzzard.phy.strath.ac.uk>
	<CAEeMGHu4EaiEqa6=qJjHL+4GnkOnQeqh+h5azTHB-1QuqUiTMw@mail.gmail.com>
	<1394716131.2612.24.camel@buzzard.phy.strath.ac.uk>
	<CAEeMGHvG4Jf_gZLfKfs8TyERib8L+r42_uWRqP6DQzHvj7_5dg@mail.gmail.com>
Message-ID: <CAEeMGHuO5JUNAWAyWv6Oo3rPLvpzKfF0AWdGzgnxyr=nBfVMeQ@mail.gmail.com>

Seems like the workaround for now is to set :

gpfs:sharemodes = no

https://bugzilla.samba.org/show_bug.cgi?id=6762

Could be a regression? Haven't tried 3.5.0.17 yet, but we will be upgrading
to that soon.


On Wed, Apr 2, 2014 at 4:05 PM, Sabuj Pattanayek <sabujp at gmail.com> wrote:

> So I've been using the recommended gpfs:acl = yes mode for a while on
> windows/cifs/smb only shares and today came across a bug where Microsoft
> Office (2010, haven't tried other versions) on Windows 7/8 refuses to save
> or save as. It can clearly create tmp files (e.g. those ~$... files when it
> opens a file) and I can right click -> create a new file, edit files in
> notepad/wordpad, drag and drop files between explorer windows but whenever
> I try to save a doc/docx or xls/xlsx file it always throws the error dialog
> :
>
> There has been a network or file permission error. The network connection
> may be lost. (mapped drive:\folder\fileName.docx)
>
> ( OK )   ( Help )
>
> Was this information helpful?
>
> If i switch to gpfs:acl = no and then use vfs_acl_xattr instead it works
> fine. MS Office on OSX does not have this problem
>
> It's similar to this issue :
>
>
> https://www.ibm.com/developerworks/community/forums/html/topic?id=77777777-0000-0000-0000-000014299075
>
> Anyone have any ideas without having to use acl_xattr? Again I'm using
> sernet samba 4.1.6 and gpfs 3.5.0.11 .
>
> Thanks,
> Sabuj
>
>
>
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://gpfsug.org/pipermail/gpfsug-discuss_gpfsug.org/attachments/20140402/42d9eb85/attachment-0001.htm>

From jonathan at buzzard.me.uk  Wed Apr  2 22:36:28 2014
From: jonathan at buzzard.me.uk (Jonathan Buzzard)
Date: Wed, 02 Apr 2014 22:36:28 +0100
Subject: [gpfsug-discuss] question about why unix extensions = no is
 recommended when using samba + gpfs?
In-Reply-To: <CAEeMGHuO5JUNAWAyWv6Oo3rPLvpzKfF0AWdGzgnxyr=nBfVMeQ@mail.gmail.com>
References: <CAEeMGHvH84GDv6yEnPgKtNwOhyvXLkbvV2XGtf3vHpJgSuu=Lg@mail.gmail.com>
	<1394705361.16270.9.camel@buzzard.phy.strath.ac.uk>
	<CAEeMGHu4EaiEqa6=qJjHL+4GnkOnQeqh+h5azTHB-1QuqUiTMw@mail.gmail.com>
	<1394716131.2612.24.camel@buzzard.phy.strath.ac.uk>
	<CAEeMGHvG4Jf_gZLfKfs8TyERib8L+r42_uWRqP6DQzHvj7_5dg@mail.gmail.com>
	<CAEeMGHuO5JUNAWAyWv6Oo3rPLvpzKfF0AWdGzgnxyr=nBfVMeQ@mail.gmail.com>
Message-ID: <533C82DC.9090402@buzzard.me.uk>

On 02/04/14 22:24, Sabuj Pattanayek wrote:
> Seems like the workaround for now is to set :
>
> gpfs:sharemodes = no
>
> https://bugzilla.samba.org/show_bug.cgi?id=6762

That is doggy ancient ticket, and fixed.


# store DOS attributes in extended attributes (vfs_gpfs then stores them 
in the file system)
	ea support = yes
	store dos attributes = yes
	map readonly = no
	map archive = no
	map system = no
	map hidden = no

Will most likely fix it for you. It is down to Office 2007 onwards 
trying to preserve ACL's on a save. So you should find a save as works, 
no ACL's to preserve but saving an existing file does not.


JAB.

-- 
Jonathan A. Buzzard                 Email: jonathan (at) buzzard.me.uk
Fife, United Kingdom.


From sabujp at gmail.com  Wed Apr  2 22:42:35 2014
From: sabujp at gmail.com (Sabuj Pattanayek)
Date: Wed, 2 Apr 2014 16:42:35 -0500
Subject: [gpfsug-discuss] question about why unix extensions = no is
 recommended when using samba + gpfs?
In-Reply-To: <533C82DC.9090402@buzzard.me.uk>
References: <CAEeMGHvH84GDv6yEnPgKtNwOhyvXLkbvV2XGtf3vHpJgSuu=Lg@mail.gmail.com>
	<1394705361.16270.9.camel@buzzard.phy.strath.ac.uk>
	<CAEeMGHu4EaiEqa6=qJjHL+4GnkOnQeqh+h5azTHB-1QuqUiTMw@mail.gmail.com>
	<1394716131.2612.24.camel@buzzard.phy.strath.ac.uk>
	<CAEeMGHvG4Jf_gZLfKfs8TyERib8L+r42_uWRqP6DQzHvj7_5dg@mail.gmail.com>
	<CAEeMGHuO5JUNAWAyWv6Oo3rPLvpzKfF0AWdGzgnxyr=nBfVMeQ@mail.gmail.com>
	<533C82DC.9090402@buzzard.me.uk>
Message-ID: <CAEeMGHtGDRLQiM4qP62Yuwpp9td+9PCjATNf=S1SS3xhEqw40A@mail.gmail.com>

Yup, I had those settings set already, and neither save as or save worked.


On Wed, Apr 2, 2014 at 4:36 PM, Jonathan Buzzard <jonathan at buzzard.me.uk>wrote:

> On 02/04/14 22:24, Sabuj Pattanayek wrote:
>
>> Seems like the workaround for now is to set :
>>
>> gpfs:sharemodes = no
>>
>> https://bugzilla.samba.org/show_bug.cgi?id=6762
>>
>
> That is doggy ancient ticket, and fixed.
>
>
> # store DOS attributes in extended attributes (vfs_gpfs then stores them
> in the file system)
>         ea support = yes
>         store dos attributes = yes
>         map readonly = no
>         map archive = no
>         map system = no
>         map hidden = no
>
> Will most likely fix it for you. It is down to Office 2007 onwards trying
> to preserve ACL's on a save. So you should find a save as works, no ACL's
> to preserve but saving an existing file does not.
>
>
>
> JAB.
>
> --
> Jonathan A. Buzzard                 Email: jonathan (at) buzzard.me.uk
> Fife, United Kingdom.
> _______________________________________________
> gpfsug-discuss mailing list
> gpfsug-discuss at gpfsug.org
> http://gpfsug.org/mailman/listinfo/gpfsug-discuss
>
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://gpfsug.org/pipermail/gpfsug-discuss_gpfsug.org/attachments/20140402/2827b7c1/attachment-0001.htm>

From jonathan at buzzard.me.uk  Wed Apr  2 23:08:40 2014
From: jonathan at buzzard.me.uk (Jonathan Buzzard)
Date: Wed, 02 Apr 2014 23:08:40 +0100
Subject: [gpfsug-discuss] question about why unix extensions = no is
 recommended when using samba + gpfs?
In-Reply-To: <CAEeMGHtGDRLQiM4qP62Yuwpp9td+9PCjATNf=S1SS3xhEqw40A@mail.gmail.com>
References: <CAEeMGHvH84GDv6yEnPgKtNwOhyvXLkbvV2XGtf3vHpJgSuu=Lg@mail.gmail.com>
	<1394705361.16270.9.camel@buzzard.phy.strath.ac.uk>
	<CAEeMGHu4EaiEqa6=qJjHL+4GnkOnQeqh+h5azTHB-1QuqUiTMw@mail.gmail.com>
	<1394716131.2612.24.camel@buzzard.phy.strath.ac.uk>
	<CAEeMGHvG4Jf_gZLfKfs8TyERib8L+r42_uWRqP6DQzHvj7_5dg@mail.gmail.com>
	<CAEeMGHuO5JUNAWAyWv6Oo3rPLvpzKfF0AWdGzgnxyr=nBfVMeQ@mail.gmail.com>
	<533C82DC.9090402@buzzard.me.uk>
	<CAEeMGHtGDRLQiM4qP62Yuwpp9td+9PCjATNf=S1SS3xhEqw40A@mail.gmail.com>
Message-ID: <533C8A68.7040304@buzzard.me.uk>

On 02/04/14 22:42, Sabuj Pattanayek wrote:
> Yup, I had those settings set already, and neither save as or save worked.
>

You need to provide more information. Much more of your smb.conf, what 
OS, Samba, and GPFS, along with your GPFS config.

Have you tested that the DOS attributes are correctly being stored in 
the GPFS file system?

It explicitly does work. The issues are all around Office trying to 
preserve ACL's which the vast majority of software does not.

Are you running with NFSv4 ACL's *ONLY* on GPFS? Using Posix or Posix 
and NFSv4 together is likely to lead to problems.


JAB.

-- 
Jonathan A. Buzzard                 Email: jonathan (at) buzzard.me.uk
Fife, United Kingdom.


From sabujp at gmail.com  Thu Apr  3 03:08:40 2014
From: sabujp at gmail.com (Sabuj Pattanayek)
Date: Wed, 2 Apr 2014 21:08:40 -0500
Subject: [gpfsug-discuss] question about why unix extensions = no is
 recommended when using samba + gpfs?
In-Reply-To: <533C8A68.7040304@buzzard.me.uk>
References: <CAEeMGHvH84GDv6yEnPgKtNwOhyvXLkbvV2XGtf3vHpJgSuu=Lg@mail.gmail.com>
	<1394705361.16270.9.camel@buzzard.phy.strath.ac.uk>
	<CAEeMGHu4EaiEqa6=qJjHL+4GnkOnQeqh+h5azTHB-1QuqUiTMw@mail.gmail.com>
	<1394716131.2612.24.camel@buzzard.phy.strath.ac.uk>
	<CAEeMGHvG4Jf_gZLfKfs8TyERib8L+r42_uWRqP6DQzHvj7_5dg@mail.gmail.com>
	<CAEeMGHuO5JUNAWAyWv6Oo3rPLvpzKfF0AWdGzgnxyr=nBfVMeQ@mail.gmail.com>
	<533C82DC.9090402@buzzard.me.uk>
	<CAEeMGHtGDRLQiM4qP62Yuwpp9td+9PCjATNf=S1SS3xhEqw40A@mail.gmail.com>
	<533C8A68.7040304@buzzard.me.uk>
Message-ID: <CAEeMGHvFDgP-7i-fy8KnFCoJra13CB5X6RNKacjBWUUq2Zp8HA@mail.gmail.com>

On Wed, Apr 2, 2014 at 5:08 PM, Jonathan Buzzard <jonathan at buzzard.me.uk>wrote:

> On 02/04/14 22:42, Sabuj Pattanayek wrote:
>
>> Yup, I had those settings set already, and neither save as or save worked.
>>
>>
> You need to provide more information. Much more of your smb.conf, what OS,
> Samba, and GPFS, along with your GPFS config.
>

rhel  6.3, 2.6.32-279.31.1.el6.x86_64, sernet samba 4.1.6, ctdb
1.0.114.7-1, gpfs 3.5.0.11, gpfs config farther down :

### smb.conf ###

[global]
workgroup = DOMAIN
netbios name = gpfs-smb-server
password server = dc-1.ds.domain.edu dc-2.ds.domain.edu dc-3.ds.domain.edu
realm = DS.DOMAIN.EDU
security = ads
encrypt passwords = yes
allow trusted domains = No
idmap config *:backend = tdb
idmap config *:range = 4000000 - 5000000
idmap config DOMAIN : backend  = rid
idmap config DOMAIN : range    = 5000001 - 9000000
template shell = /bin/bash
template homedir = /home/%U
winbind offline logon = false
winbind trusted domains only = no
winbind use default domain = yes
# ldap handles users
winbind enum users  = no
winbind enum groups = no
winbind expand groups = 3
server string = SMB
log file = /var/log/samba/log.%m
max log size = 50
passdb backend = tdbsam

clustering = yes
unix extensions = yes

include = /etc/samba/template_shares.conf
include = /etc/samba/test_shares.conf

### template_shares.conf ###

[template_nfs4]
comment = GPFS Cluster on smb using %R protocol
path = /dors/testfs
writeable = yes
vfs objects = shadow_copy2 gpfs fileid
ea support = yes
store dos attributes = yes
access based share enum = yes
map readonly = no
map archive = no
map system = no
mangled names = no
force unknown acl user = yes
locking = yes
notify:inotify = no
shadow:snapdir = .snapshots
shadow:localtime = yes
shadow:format = %Y%m%d_%H:%M
shadow:fixinodes = yes
shadow:snapdirseverywhere = yes
shadow:sort = desc
# vfs_gpfs settings
gpfs:acl = yes
gpfs:winattr = yes
gpfs:dfreequota = yes
nfs4:mode = simple
nfs4:chown = yes
nfs4:acedup = merge
## needed to turn off sharemodes, msoffice on windows couldn't save
# https://bugzilla.samba.org/show_bug.cgi?id=6762
gpfs:sharemodes = no
gpfs:leases = yes
posix locking = yes
kernel oplocks = no
kernel share modes = yes
fileid:algorithm = fsname



>
> Have you tested that the DOS attributes are correctly being stored in the
> GPFS file system?
>

No, but they're all set to no, including map hidden which was missing above
but according to man smb.conf is by default set to no, so wouldn't these
not be mapped/stored in GPFS anyways? What EA file would these be stored in
if these were set to yes?


>
> It explicitly does work. The issues are all around Office trying to
> preserve ACL's which the vast majority of software does not.
>

Understood, but again, with the setup above, I had to turn sharemodes off
to get it to work. Setting it to no was mentioned in a comment in that
samba bug by Volker, i.e. I just didn't think of that myself, so there must
be some correlation.


> Are you running with NFSv4 ACL's *ONLY* on GPFS? Using Posix or Posix and
> NFSv4 together is likely to lead to problems.


posix + nfs4, it can be problematic but we're working around it.

# mmlsfs dors
flag                value                    description
------------------- ------------------------
-----------------------------------
 -f                 2048                     Minimum fragment size in bytes
(system pool)
                    32768                    Minimum fragment size in bytes
(other pools)
 -i                 512                      Inode size in bytes
 -I                 32768                    Indirect block size in bytes
 -m                 1                        Default number of metadata
replicas
 -M                 2                        Maximum number of metadata
replicas
 -r                 1                        Default number of data replicas
 -R                 2                        Maximum number of data replicas
 -j                 scatter                  Block allocation type
 -D                 nfs4                     File locking semantics in
effect
 -k                 all                      ACL semantics in effect
 -n                 2000                     Estimated number of nodes that
will mount file system
 -B                 65536                    Block size (system pool)
                    1048576                  Block size (other pools)
 -Q                 user;group;fileset       Quotas enforced
                    none                     Default quotas enabled
 --filesetdf        Yes                      Fileset df enabled?
 -V                 13.23 (3.5.0.7)          File system version
 --create-time      Thu Nov  7 11:29:46 2013 File system creation time
 -u                 Yes                      Support for large LUNs?
 -z                 No                       Is DMAPI enabled?
 -L                 16777216                 Logfile size
 -E                 Yes                      Exact mtime mount option
 -S                 No                       Suppress atime mount option
 -K                 whenpossible             Strict replica allocation
option
 --fastea           Yes                      Fast external attributes
enabled?
 --inode-limit      524288000                Maximum number of inodes
 -P                 system;capacity;fast     Disk storage pools in file
system
 -d
3T_7K_0;3T_7K_1;3T_7K_2;3T_7K_3;3T_7K_4;3T_7K_5;3T_7K_6;3T_7K_7;3T_7K_8;3T_7K_9;3T_7K_10;3T_7K_11;3T_7K_12;3T_7K_13;900GB_10K_0;900GB_10K_1;900GB_10K_2;900GB_10K_3;
 -d
900GB_10K_4;900GB_10K_5;900GB_10K_6;900GB_10K_7;900GB_10K_8;900GB_10K_9;900GB_10K_10;900GB_10K_11;900GB_10K_12;900GB_10K_13;900GB_10K_14;900GB_10K_15;900GB_10K_16;
 -d
900GB_10K_17;900GB_10K_18;900GB_10K_19;400GB_SSD_0;400GB_SSD_1;400GB_SSD_2;400GB_SSD_3;400GB_SSD_4
 Disks in file system
 --perfileset-quota yes                      Per-fileset quota enforcement
 -A                 yes                      Automatic mount option
 -o                 none                     Additional mount options
 -T                 /dors                    Default mount point
 --mount-priority   0                        Mount priority

A funny thing I noticed was that if I set security settings through the
security properties dialog in windows on a share with gpfs:acl = yes, it
sets posix acl's and doesn't automatically promote the acl's to nfs4. The
top level acl on a share directory has to be set to nfs4 before you set
users loose on it and at least one acl (a user / group on that directory)
has to have DirInherit:FileInherit otherwise files and directories beneath
that directory don't get set with nfs4 acl's which then breaks things like
Windows being able to discern the difference between full and modify
privileges (since posix only provides rwx, samba doesn't seem to care about
the 'c' acl provided by gpfs).

Several other strange behaviors I noticed :

* Turning inheritance off through the windows security -> advanced dialog
doesn't work unless you delete (or add I guess, but didn't try adding an
acl) some acl, either the group/user that you're trying to disable
inheritance for (which then means you have to re-add that group with
inheritance disabled) or some other group / user that you don't care about.
For example to disable inheritance on a directory for a group, you'd add a
dummy user/group acl to that directory, disable inheritance for the
group/user you want to disable inheritance for, then delete that dummy
group, otherwise clicking apply -> ok, backing out and then going back in
doesn't change the inheritance settings in either the advanced security
dialog or FileInherit, DirInherit, or Inherit acls in the output of
mmgetacl.

* robocopy y: z: /mir /COPY:DATSO throws "something is wrong with the
device. Failed to set NTACL ... " error 31 errors if your'e trying to copy
ACLs and data from some other share, but it still ends up copying the ACL's
properly! The problem is that robocopy doesn't complete, it only descends
one directory level at a time per robocopy run when it throws all these
errors. So you have to keep running robocopy in a loop from a .bat script
or manually keep running it until you think it's actually copied over all
the ACL's. This doesn't happen with acl_xattr, but acl_xattr has other
issues as well.

* Does any of the auditing tab stuff work? Samba has auditing via log
files, but this seems to be something that's stored in NTFS?

* I haven't tried anything from the quota tab, can it actually set GPFS
quotas somehow? I guess in windows you can set per directory quotas, the
closest thing would be filesets linked to directories with user/group
quotas within that fileset, but I don't think that tab is going to let you
do that.

Thanks,
Sabuj
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://gpfsug.org/pipermail/gpfsug-discuss_gpfsug.org/attachments/20140402/d5dedd94/attachment-0001.htm>

From sabujp at gmail.com  Thu Apr  3 03:11:43 2014
From: sabujp at gmail.com (Sabuj Pattanayek)
Date: Wed, 2 Apr 2014 21:11:43 -0500
Subject: [gpfsug-discuss] question about why unix extensions = no is
 recommended when using samba + gpfs?
In-Reply-To: <CAEeMGHvFDgP-7i-fy8KnFCoJra13CB5X6RNKacjBWUUq2Zp8HA@mail.gmail.com>
References: <CAEeMGHvH84GDv6yEnPgKtNwOhyvXLkbvV2XGtf3vHpJgSuu=Lg@mail.gmail.com>
	<1394705361.16270.9.camel@buzzard.phy.strath.ac.uk>
	<CAEeMGHu4EaiEqa6=qJjHL+4GnkOnQeqh+h5azTHB-1QuqUiTMw@mail.gmail.com>
	<1394716131.2612.24.camel@buzzard.phy.strath.ac.uk>
	<CAEeMGHvG4Jf_gZLfKfs8TyERib8L+r42_uWRqP6DQzHvj7_5dg@mail.gmail.com>
	<CAEeMGHuO5JUNAWAyWv6Oo3rPLvpzKfF0AWdGzgnxyr=nBfVMeQ@mail.gmail.com>
	<533C82DC.9090402@buzzard.me.uk>
	<CAEeMGHtGDRLQiM4qP62Yuwpp9td+9PCjATNf=S1SS3xhEqw40A@mail.gmail.com>
	<533C8A68.7040304@buzzard.me.uk>
	<CAEeMGHvFDgP-7i-fy8KnFCoJra13CB5X6RNKacjBWUUq2Zp8HA@mail.gmail.com>
Message-ID: <CAEeMGHsaX+3+zEcbCOAM689a_ZFKd5hqkmEGjfHcZ3mxNjG-_Q@mail.gmail.com>

Forgot one,

### test_shares.conf ###

[testfs]
comment = GPFS Cluster on DORS using %R protocol
path = /dors/testfs
copy = template_nfs4
admin users = "DOMAIN\userImLoggingInWith"


It doesn't matter if I login with an "admin user" or a regular user allowed
by NFS4 (NTACLs) set via the security tab. The same problems happen with
save/save as unless gpfs:sharemodes = no .


On Wed, Apr 2, 2014 at 9:08 PM, Sabuj Pattanayek <sabujp at gmail.com> wrote:

>
>
>
> On Wed, Apr 2, 2014 at 5:08 PM, Jonathan Buzzard <jonathan at buzzard.me.uk>wrote:
>
>> On 02/04/14 22:42, Sabuj Pattanayek wrote:
>>
>>> Yup, I had those settings set already, and neither save as or save
>>> worked.
>>>
>>>
>> You need to provide more information. Much more of your smb.conf, what
>> OS, Samba, and GPFS, along with your GPFS config.
>>
>
> rhel  6.3, 2.6.32-279.31.1.el6.x86_64, sernet samba 4.1.6, ctdb
> 1.0.114.7-1, gpfs 3.5.0.11, gpfs config farther down :
>
> ### smb.conf ###
>
> [global]
> workgroup = DOMAIN
> netbios name = gpfs-smb-server
> password server = dc-1.ds.domain.edu dc-2.ds.domain.edu dc-3.ds.domain.edu
> realm = DS.DOMAIN.EDU
> security = ads
> encrypt passwords = yes
> allow trusted domains = No
> idmap config *:backend = tdb
> idmap config *:range = 4000000 - 5000000
> idmap config DOMAIN : backend  = rid
> idmap config DOMAIN : range    = 5000001 - 9000000
> template shell = /bin/bash
> template homedir = /home/%U
> winbind offline logon = false
> winbind trusted domains only = no
> winbind use default domain = yes
> # ldap handles users
> winbind enum users  = no
> winbind enum groups = no
> winbind expand groups = 3
> server string = SMB
> log file = /var/log/samba/log.%m
> max log size = 50
> passdb backend = tdbsam
>
> clustering = yes
> unix extensions = yes
>
> include = /etc/samba/template_shares.conf
> include = /etc/samba/test_shares.conf
>
> ### template_shares.conf ###
>
> [template_nfs4]
> comment = GPFS Cluster on smb using %R protocol
> path = /dors/testfs
> writeable = yes
> vfs objects = shadow_copy2 gpfs fileid
> ea support = yes
> store dos attributes = yes
> access based share enum = yes
> map readonly = no
> map archive = no
> map system = no
> mangled names = no
> force unknown acl user = yes
> locking = yes
> notify:inotify = no
> shadow:snapdir = .snapshots
> shadow:localtime = yes
> shadow:format = %Y%m%d_%H:%M
> shadow:fixinodes = yes
> shadow:snapdirseverywhere = yes
> shadow:sort = desc
> # vfs_gpfs settings
> gpfs:acl = yes
> gpfs:winattr = yes
> gpfs:dfreequota = yes
> nfs4:mode = simple
> nfs4:chown = yes
> nfs4:acedup = merge
> ## needed to turn off sharemodes, msoffice on windows couldn't save
> # https://bugzilla.samba.org/show_bug.cgi?id=6762
> gpfs:sharemodes = no
> gpfs:leases = yes
> posix locking = yes
> kernel oplocks = no
> kernel share modes = yes
> fileid:algorithm = fsname
>
>
>
>>
>> Have you tested that the DOS attributes are correctly being stored in the
>> GPFS file system?
>>
>
> No, but they're all set to no, including map hidden which was missing
> above but according to man smb.conf is by default set to no, so wouldn't
> these not be mapped/stored in GPFS anyways? What EA file would these be
> stored in if these were set to yes?
>
>
>>
>> It explicitly does work. The issues are all around Office trying to
>> preserve ACL's which the vast majority of software does not.
>>
>
> Understood, but again, with the setup above, I had to turn sharemodes off
> to get it to work. Setting it to no was mentioned in a comment in that
> samba bug by Volker, i.e. I just didn't think of that myself, so there must
> be some correlation.
>
>
>> Are you running with NFSv4 ACL's *ONLY* on GPFS? Using Posix or Posix and
>> NFSv4 together is likely to lead to problems.
>
>
> posix + nfs4, it can be problematic but we're working around it.
>
> # mmlsfs dors
> flag                value                    description
> ------------------- ------------------------
> -----------------------------------
>  -f                 2048                     Minimum fragment size in
> bytes (system pool)
>                     32768                    Minimum fragment size in
> bytes (other pools)
>  -i                 512                      Inode size in bytes
>  -I                 32768                    Indirect block size in bytes
>  -m                 1                        Default number of metadata
> replicas
>  -M                 2                        Maximum number of metadata
> replicas
>  -r                 1                        Default number of data
> replicas
>  -R                 2                        Maximum number of data
> replicas
>  -j                 scatter                  Block allocation type
>  -D                 nfs4                     File locking semantics in
> effect
>  -k                 all                      ACL semantics in effect
>  -n                 2000                     Estimated number of nodes
> that will mount file system
>  -B                 65536                    Block size (system pool)
>                     1048576                  Block size (other pools)
>  -Q                 user;group;fileset       Quotas enforced
>                     none                     Default quotas enabled
>  --filesetdf        Yes                      Fileset df enabled?
>  -V                 13.23 (3.5.0.7)          File system version
>  --create-time      Thu Nov  7 11:29:46 2013 File system creation time
>  -u                 Yes                      Support for large LUNs?
>  -z                 No                       Is DMAPI enabled?
>  -L                 16777216                 Logfile size
>  -E                 Yes                      Exact mtime mount option
>  -S                 No                       Suppress atime mount option
>  -K                 whenpossible             Strict replica allocation
> option
>  --fastea           Yes                      Fast external attributes
> enabled?
>  --inode-limit      524288000                Maximum number of inodes
>  -P                 system;capacity;fast     Disk storage pools in file
> system
>  -d
> 3T_7K_0;3T_7K_1;3T_7K_2;3T_7K_3;3T_7K_4;3T_7K_5;3T_7K_6;3T_7K_7;3T_7K_8;3T_7K_9;3T_7K_10;3T_7K_11;3T_7K_12;3T_7K_13;900GB_10K_0;900GB_10K_1;900GB_10K_2;900GB_10K_3;
>  -d
> 900GB_10K_4;900GB_10K_5;900GB_10K_6;900GB_10K_7;900GB_10K_8;900GB_10K_9;900GB_10K_10;900GB_10K_11;900GB_10K_12;900GB_10K_13;900GB_10K_14;900GB_10K_15;900GB_10K_16;
>  -d
> 900GB_10K_17;900GB_10K_18;900GB_10K_19;400GB_SSD_0;400GB_SSD_1;400GB_SSD_2;400GB_SSD_3;400GB_SSD_4
>  Disks in file system
>  --perfileset-quota yes                      Per-fileset quota enforcement
>  -A                 yes                      Automatic mount option
>  -o                 none                     Additional mount options
>  -T                 /dors                    Default mount point
>  --mount-priority   0                        Mount priority
>
> A funny thing I noticed was that if I set security settings through the
> security properties dialog in windows on a share with gpfs:acl = yes, it
> sets posix acl's and doesn't automatically promote the acl's to nfs4. The
> top level acl on a share directory has to be set to nfs4 before you set
> users loose on it and at least one acl (a user / group on that directory)
> has to have DirInherit:FileInherit otherwise files and directories beneath
> that directory don't get set with nfs4 acl's which then breaks things like
> Windows being able to discern the difference between full and modify
> privileges (since posix only provides rwx, samba doesn't seem to care about
> the 'c' acl provided by gpfs).
>
> Several other strange behaviors I noticed :
>
> * Turning inheritance off through the windows security -> advanced dialog
> doesn't work unless you delete (or add I guess, but didn't try adding an
> acl) some acl, either the group/user that you're trying to disable
> inheritance for (which then means you have to re-add that group with
> inheritance disabled) or some other group / user that you don't care about.
> For example to disable inheritance on a directory for a group, you'd add a
> dummy user/group acl to that directory, disable inheritance for the
> group/user you want to disable inheritance for, then delete that dummy
> group, otherwise clicking apply -> ok, backing out and then going back in
> doesn't change the inheritance settings in either the advanced security
> dialog or FileInherit, DirInherit, or Inherit acls in the output of
> mmgetacl.
>
> * robocopy y: z: /mir /COPY:DATSO throws "something is wrong with the
> device. Failed to set NTACL ... " error 31 errors if your'e trying to copy
> ACLs and data from some other share, but it still ends up copying the ACL's
> properly! The problem is that robocopy doesn't complete, it only descends
> one directory level at a time per robocopy run when it throws all these
> errors. So you have to keep running robocopy in a loop from a .bat script
> or manually keep running it until you think it's actually copied over all
> the ACL's. This doesn't happen with acl_xattr, but acl_xattr has other
> issues as well.
>
> * Does any of the auditing tab stuff work? Samba has auditing via log
> files, but this seems to be something that's stored in NTFS?
>
> * I haven't tried anything from the quota tab, can it actually set GPFS
> quotas somehow? I guess in windows you can set per directory quotas, the
> closest thing would be filesets linked to directories with user/group
> quotas within that fileset, but I don't think that tab is going to let you
> do that.
>
> Thanks,
> Sabuj
>
>
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://gpfsug.org/pipermail/gpfsug-discuss_gpfsug.org/attachments/20140402/660ee76b/attachment-0001.htm>

From jonathan at buzzard.me.uk  Thu Apr  3 15:45:29 2014
From: jonathan at buzzard.me.uk (Jonathan Buzzard)
Date: Thu, 03 Apr 2014 15:45:29 +0100
Subject: [gpfsug-discuss] question about why unix extensions = no is
 recommended when using samba + gpfs?
In-Reply-To: <CAEeMGHvFDgP-7i-fy8KnFCoJra13CB5X6RNKacjBWUUq2Zp8HA@mail.gmail.com>
References: <CAEeMGHvH84GDv6yEnPgKtNwOhyvXLkbvV2XGtf3vHpJgSuu=Lg@mail.gmail.com>
	<1394705361.16270.9.camel@buzzard.phy.strath.ac.uk>
	<CAEeMGHu4EaiEqa6=qJjHL+4GnkOnQeqh+h5azTHB-1QuqUiTMw@mail.gmail.com>
	<1394716131.2612.24.camel@buzzard.phy.strath.ac.uk>
	<CAEeMGHvG4Jf_gZLfKfs8TyERib8L+r42_uWRqP6DQzHvj7_5dg@mail.gmail.com>
	<CAEeMGHuO5JUNAWAyWv6Oo3rPLvpzKfF0AWdGzgnxyr=nBfVMeQ@mail.gmail.com>
	<533C82DC.9090402@buzzard.me.uk>
	<CAEeMGHtGDRLQiM4qP62Yuwpp9td+9PCjATNf=S1SS3xhEqw40A@mail.gmail.com>
	<533C8A68.7040304@buzzard.me.uk>
	<CAEeMGHvFDgP-7i-fy8KnFCoJra13CB5X6RNKacjBWUUq2Zp8HA@mail.gmail.com>
Message-ID: <533D7409.3090002@buzzard.me.uk>

On 03/04/14 03:08, Sabuj Pattanayek wrote:

[SNIP]
>
> include = /etc/samba/template_shares.conf
> include = /etc/samba/test_shares.conf

That is stupid, you need to use registry share definitions with CTDB. 
Having them in files is bad bad bad.

>
> ### template_shares.conf ###
>
> [template_nfs4]
> comment = GPFS Cluster on smb using %R protocol
> path = /dors/testfs
> writeable = yes
> vfs objects = shadow_copy2 gpfs fileid

Hum, might have changed in Samba 4.x but in Samba 3.5/3.6 you can only 
have one vfs objects line in the entire smb.conf file and I did not 
thing it was a per share option either. Well you can have more than one, 
but the later ones just override the previous ones.

> ea support = yes
> store dos attributes = yes
> access based share enum = yes
> map readonly = no
> map archive = no
> map system = no
> mangled names = no
> force unknown acl user = yes
> locking = yes
> notify:inotify = no
> shadow:snapdir = .snapshots
> shadow:localtime = yes
> shadow:format = %Y%m%d_%H:%M
> shadow:fixinodes = yes
> shadow:snapdirseverywhere = yes
> shadow:sort = desc
> # vfs_gpfs settings
> gpfs:acl = yes
> gpfs:winattr = yes
> gpfs:dfreequota = yes
> nfs4:mode = simple
> nfs4:chown = yes
> nfs4:acedup = merge
> ## needed to turn off sharemodes, msoffice on windows couldn't save
> # https://bugzilla.samba.org/show_bug.cgi?id=6762
> gpfs:sharemodes = no

I am not well versed with Samba 4.x but a quick check says that share 
modes = yes conflicts with SMB2 and durable handles. Given in Samba 4.1 
max protocol is SMB2 by default ...

I have not seen a definitive answer anywhere about whether SMB2 and CTDB 
can be used in combination and if so what versions of CTDB/Samba one 
should be using however.

> gpfs:leases = yes
> posix locking = yes
> kernel oplocks = no
> kernel share modes = yes
> fileid:algorithm = fsname
>
>
>
>     Have you tested that the DOS attributes are correctly being stored
>     in the GPFS file system?
>
>
> No, but they're all set to no, including map hidden which was missing
> above but according to man smb.conf is by default set to no, so wouldn't
> these not be mapped/stored in GPFS anyways? What EA file would these be
> stored in if these were set to yes?

They are not stored in an extended attribute they are stored in the GPFS 
file system itself. The various settings that I listed are so that Samba 
tells the GPFS VFS module to store them in the extended attributes. 
Howeve the GPFS VFS module then goes and stores/retrieves them directly 
from the file system. It's all part of GPFS being able to run on 
Windows. There are genuine file creation times as well

I suggest that you explicitly test and make sure it is working.

>
>
>     It explicitly does work. The issues are all around Office trying to
>     preserve ACL's which the vast majority of software does not.
>
>
> Understood, but again, with the setup above, I had to turn sharemodes
> off to get it to work. Setting it to no was mentioned in a comment in u
> that samba bug by Volker, i.e. I just didn't think of that myself, so
> there must be some correlation.
>
>
>     Are you running with NFSv4 ACL's *ONLY* on GPFS? Using Posix or
>     Posix and NFSv4 together is likely to lead to problems.
>
>
> posix + nfs4, it can be problematic but we're working around it.
>

Put simply no you are not working around it, it is the cause of your 
issues with Office. More precisely the issue with Office is down to how 
the mapping of NTFS ACLS to GPFS is working, because storing the NTFS 
ACLS in extended attributes works. I am telling you don't mix Posix and 
NFSv4 ACL's in GPFS it won't work. Whether you listen is up to you.

I suggest you use a development/test GPFS cluster to verify it.


JAB.

-- 
Jonathan A. Buzzard                 Email: jonathan (at) buzzard.me.uk
Fife, United Kingdom.


From sabujp at gmail.com  Thu Apr  3 18:23:59 2014
From: sabujp at gmail.com (Sabuj Pattanayek)
Date: Thu, 3 Apr 2014 12:23:59 -0500
Subject: [gpfsug-discuss] question about why unix extensions = no is
 recommended when using samba + gpfs?
In-Reply-To: <533D7409.3090002@buzzard.me.uk>
References: <CAEeMGHvH84GDv6yEnPgKtNwOhyvXLkbvV2XGtf3vHpJgSuu=Lg@mail.gmail.com>
	<1394705361.16270.9.camel@buzzard.phy.strath.ac.uk>
	<CAEeMGHu4EaiEqa6=qJjHL+4GnkOnQeqh+h5azTHB-1QuqUiTMw@mail.gmail.com>
	<1394716131.2612.24.camel@buzzard.phy.strath.ac.uk>
	<CAEeMGHvG4Jf_gZLfKfs8TyERib8L+r42_uWRqP6DQzHvj7_5dg@mail.gmail.com>
	<CAEeMGHuO5JUNAWAyWv6Oo3rPLvpzKfF0AWdGzgnxyr=nBfVMeQ@mail.gmail.com>
	<533C82DC.9090402@buzzard.me.uk>
	<CAEeMGHtGDRLQiM4qP62Yuwpp9td+9PCjATNf=S1SS3xhEqw40A@mail.gmail.com>
	<533C8A68.7040304@buzzard.me.uk>
	<CAEeMGHvFDgP-7i-fy8KnFCoJra13CB5X6RNKacjBWUUq2Zp8HA@mail.gmail.com>
	<533D7409.3090002@buzzard.me.uk>
Message-ID: <CAEeMGHs7UyiFfu6zi5SZHvcUW0aYhQ21dYptVz_CcB5UaPww-A@mail.gmail.com>

> include = /etc/samba/template_shares.conf
>> include = /etc/samba/test_shares.conf
>>
>
> That is stupid, you need to use registry share definitions with CTDB.
> Having them in files is bad bad bad.


Will look into it.


> ### template_shares.conf ###
>
>>
>> [template_nfs4]
>> comment = GPFS Cluster on smb using %R protocol
>> path = /dors/testfs
>> writeable = yes
>> vfs objects = shadow_copy2 gpfs fileid
>>
>
> Hum, might have changed in Samba 4.x but in Samba 3.5/3.6 you can only
> have one vfs objects line in the entire smb.conf file and I did not thing
> it was a per share option either. Well you can have more than one, but the
> later ones just override the previous ones.



Yup, it's definitely per share in 4.1.x and the later ones probably do
override the previous one if the same vfs functions are overloaded, but in
the case above there's no overlap and shadow_copy2 and gpfs do work.



>
> I am not well versed with Samba 4.x but a quick check says that share
> modes = yes conflicts with SMB2 and durable handles. Given in Samba 4.1 max
> protocol is SMB2 by default ...
>

I was able to do SMB2 (at least in terms of performance over SMBv1) with
sharemodes = yes or sharemodes = no. Durable / persistent handles don't
work in that active read/write I/O will not continue if  smb/ctdb is
disabled on one of the samba nodes. The client will not have to
re-map/re-connect but any active I/O other than file deletions and perhaps
metadata operations will continue unaffected.


>
> I have not seen a definitive answer anywhere about whether SMB2 and CTDB
> can be used in combination and if so what versions of CTDB/Samba one should
> be using however.


I'm using ctdb 1.0.114 packaged by sernet along with sernet samba 4.1.6 .
They said they would release re-packaged v2 rpm at some point. Again, SMB2
works in so far as I can tell with its much improved read/write performance
over SMB1.


>>
>> No, but they're all set to no, including map hidden which was missing
>> above but according to man smb.conf is by default set to no, so wouldn't
>> these not be mapped/stored in GPFS anyways? What EA file would these be
>> stored in if these were set to yes?
>>
>
> They are not stored in an extended attribute they are stored in the GPFS
> file system itself. The various settings that I listed are so that Samba
> tells the GPFS VFS module to store them in the extended attributes. Howeve
> the GPFS VFS module then goes and stores/retrieves them directly from the
> file system. It's all part of GPFS being able to run on Windows. There are
> genuine file creation times as well
>
> I suggest that you explicitly test and make sure it is working.
>

Yup, they're working, they're being stored wherever they're supposed to be
stored in GPFS itself. I set a file to hidden and it disappeared from the
explorer window. Went into a command prompt and ran dir/a and it appeared.
Then ran mmlsattr -L on the file and it showed ARCHIVE HIDDEN in the
Windows attributes section.



> Put simply no you are not working around it, it is the cause of your
> issues with Office. More precisely the issue with Office is down to how the
> mapping of NTFS ACLS to GPFS is working, because storing the NTFS ACLS in
> extended attributes works. I am telling you don't mix Posix and NFSv4 ACL's
> in GPFS it won't work. Whether you listen is up to you.
>

It doesn't work if the ACL on the file is POSIX or has been promoted to
NFS4. In any case, we have need for the ACLs support to be both POSIX and
NFS4 where needed for the window shares and we can't/won't split up the
filesystem.


>
> I suggest you use a development/test GPFS cluster to verify it.


Yes, we're going to need a test/dev cluster for testing these for future
upgrades, etc so I will try an FS that's pure nfs4 ACLs only and see if it
behaves any differently.
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://gpfsug.org/pipermail/gpfsug-discuss_gpfsug.org/attachments/20140403/5f38f99f/attachment-0001.htm>

From sabujp at gmail.com  Thu Apr  3 18:26:00 2014
From: sabujp at gmail.com (Sabuj Pattanayek)
Date: Thu, 3 Apr 2014 12:26:00 -0500
Subject: [gpfsug-discuss] question about why unix extensions = no is
 recommended when using samba + gpfs?
In-Reply-To: <CAEeMGHs7UyiFfu6zi5SZHvcUW0aYhQ21dYptVz_CcB5UaPww-A@mail.gmail.com>
References: <CAEeMGHvH84GDv6yEnPgKtNwOhyvXLkbvV2XGtf3vHpJgSuu=Lg@mail.gmail.com>
	<1394705361.16270.9.camel@buzzard.phy.strath.ac.uk>
	<CAEeMGHu4EaiEqa6=qJjHL+4GnkOnQeqh+h5azTHB-1QuqUiTMw@mail.gmail.com>
	<1394716131.2612.24.camel@buzzard.phy.strath.ac.uk>
	<CAEeMGHvG4Jf_gZLfKfs8TyERib8L+r42_uWRqP6DQzHvj7_5dg@mail.gmail.com>
	<CAEeMGHuO5JUNAWAyWv6Oo3rPLvpzKfF0AWdGzgnxyr=nBfVMeQ@mail.gmail.com>
	<533C82DC.9090402@buzzard.me.uk>
	<CAEeMGHtGDRLQiM4qP62Yuwpp9td+9PCjATNf=S1SS3xhEqw40A@mail.gmail.com>
	<533C8A68.7040304@buzzard.me.uk>
	<CAEeMGHvFDgP-7i-fy8KnFCoJra13CB5X6RNKacjBWUUq2Zp8HA@mail.gmail.com>
	<533D7409.3090002@buzzard.me.uk>
	<CAEeMGHs7UyiFfu6zi5SZHvcUW0aYhQ21dYptVz_CcB5UaPww-A@mail.gmail.com>
Message-ID: <CAEeMGHuNe8tWuYZM_XbrV7LNqfrpCC4Um7Vo6FJeeYRiJ4HzSQ@mail.gmail.com>

I was able to do SMB2 (at least in terms of performance over SMBv1) with
> sharemodes = yes or sharemodes = no. Durable / persistent handles don't
> work in that active read/write I/O will not continue if  smb/ctdb is
> disabled on one of the samba nodes. The client will not have to
> re-map/re-connect but any active I/O other than file deletions and perhaps
> metadata operations will continue unaffected.
>

should be "any active I/O other than file deletions and perhaps metadata
operations will be disrupted"
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://gpfsug.org/pipermail/gpfsug-discuss_gpfsug.org/attachments/20140403/9b0bf53a/attachment-0001.htm>

From jonathan at buzzard.me.uk  Thu Apr  3 19:26:08 2014
From: jonathan at buzzard.me.uk (Jonathan Buzzard)
Date: Thu, 03 Apr 2014 19:26:08 +0100
Subject: [gpfsug-discuss] question about why unix extensions = no is
 recommended when using samba + gpfs?
In-Reply-To: <CAEeMGHs7UyiFfu6zi5SZHvcUW0aYhQ21dYptVz_CcB5UaPww-A@mail.gmail.com>
References: <CAEeMGHvH84GDv6yEnPgKtNwOhyvXLkbvV2XGtf3vHpJgSuu=Lg@mail.gmail.com>
	<1394705361.16270.9.camel@buzzard.phy.strath.ac.uk>
	<CAEeMGHu4EaiEqa6=qJjHL+4GnkOnQeqh+h5azTHB-1QuqUiTMw@mail.gmail.com>
	<1394716131.2612.24.camel@buzzard.phy.strath.ac.uk>
	<CAEeMGHvG4Jf_gZLfKfs8TyERib8L+r42_uWRqP6DQzHvj7_5dg@mail.gmail.com>
	<CAEeMGHuO5JUNAWAyWv6Oo3rPLvpzKfF0AWdGzgnxyr=nBfVMeQ@mail.gmail.com>
	<533C82DC.9090402@buzzard.me.uk>
	<CAEeMGHtGDRLQiM4qP62Yuwpp9td+9PCjATNf=S1SS3xhEqw40A@mail.gmail.com>
	<533C8A68.7040304@buzzard.me.uk>
	<CAEeMGHvFDgP-7i-fy8KnFCoJra13CB5X6RNKacjBWUUq2Zp8HA@mail.gmail.com>
	<533D7409.3090002@buzzard.me.uk>
	<CAEeMGHs7UyiFfu6zi5SZHvcUW0aYhQ21dYptVz_CcB5UaPww-A@mail.gmail.com>
Message-ID: <533DA7C0.4050106@buzzard.me.uk>

On 03/04/14 18:23, Sabuj Pattanayek wrote:

[SNIP]

>
> It doesn't work if the ACL on the file is POSIX or has been promoted to
> NFS4. In any case, we have need for the ACLs support to be both POSIX
> and NFS4 where needed for the window shares and we can't/won't split up
> the filesystem.
>

Client side Linux has support NFSv4 or more specifically NFSv4.1 for 
some time. The issue is the fact that the RichACL patches seem to have 
been stuck in limbo for years now.

Not that I have tried it even in development, but there is an 
alternative to the Linux kernel NFS server which sucks anyway as 
visibility into what is going on is near none existent.

It's the NFS-Ganesha server and according to the documentation it 
supports full NFSv4.1 and has GPFS support for a backend file system.

     https://github.com/nfs-ganesha/nfs-ganesha/wiki

That could potentially remove your "requirement" for Posix ACL's. That 
is you could go full NFSv4 ACL's in GPFS and an area could be accessed 
either by NFSv4 or SMB without the ACL's in GPFS getting mucked up. It 
is however not clear if NFSv4 ACL's are supported yet. I note that the 
latest versions of CTDB have support for NFS-Ganesha.

>
>     I suggest you use a development/test GPFS cluster to verify it.
>
> Yes, we're going to need a test/dev cluster for testing these for future
> upgrades, etc so I will try an FS that's pure nfs4 ACLs only and see if
> it behaves any differently.

I never cease to be amazed that people are doing large scale file 
servers with Linux/GPFS/Samba and don't have a test/dev cluster.

JAB.

-- 
Jonathan A. Buzzard                 Email: jonathan (at) buzzard.me.uk
Fife, United Kingdom.


From sabujp at gmail.com  Thu Apr  3 19:50:03 2014
From: sabujp at gmail.com (Sabuj Pattanayek)
Date: Thu, 3 Apr 2014 13:50:03 -0500
Subject: [gpfsug-discuss] question about why unix extensions = no is
 recommended when using samba + gpfs?
In-Reply-To: <533DA7C0.4050106@buzzard.me.uk>
References: <CAEeMGHvH84GDv6yEnPgKtNwOhyvXLkbvV2XGtf3vHpJgSuu=Lg@mail.gmail.com>
	<1394705361.16270.9.camel@buzzard.phy.strath.ac.uk>
	<CAEeMGHu4EaiEqa6=qJjHL+4GnkOnQeqh+h5azTHB-1QuqUiTMw@mail.gmail.com>
	<1394716131.2612.24.camel@buzzard.phy.strath.ac.uk>
	<CAEeMGHvG4Jf_gZLfKfs8TyERib8L+r42_uWRqP6DQzHvj7_5dg@mail.gmail.com>
	<CAEeMGHuO5JUNAWAyWv6Oo3rPLvpzKfF0AWdGzgnxyr=nBfVMeQ@mail.gmail.com>
	<533C82DC.9090402@buzzard.me.uk>
	<CAEeMGHtGDRLQiM4qP62Yuwpp9td+9PCjATNf=S1SS3xhEqw40A@mail.gmail.com>
	<533C8A68.7040304@buzzard.me.uk>
	<CAEeMGHvFDgP-7i-fy8KnFCoJra13CB5X6RNKacjBWUUq2Zp8HA@mail.gmail.com>
	<533D7409.3090002@buzzard.me.uk>
	<CAEeMGHs7UyiFfu6zi5SZHvcUW0aYhQ21dYptVz_CcB5UaPww-A@mail.gmail.com>
	<533DA7C0.4050106@buzzard.me.uk>
Message-ID: <CAEeMGHteKg6DPyiE4igPoCZfjq29MFzyTJe8-Xj-EKFCXVtdkg@mail.gmail.com>

> It's the NFS-Ganesha server and according to the documentation it supports
> full NFSv4.1 and has GPFS support for a backend file system.
>

Yup, that could be a future possibility, but getting everyone who's using
the system to move to non-posix ACLs (whom I have no control over) won't
work. NFSv3 and POSIX + POSIX extended ACLs aren't going anywhere soon
because of their simplicity and availability.


> I never cease to be amazed that people are doing large scale file servers
> with Linux/GPFS/Samba and don't have a test/dev cluster.


We do, using it for testing hasn't been necessary since our production
system was our test system since it wasn't being used in production, the
samba part is still only being used very minimally and we've done as much
testing as we could prior to letting a few users on who discovered some of
these problems that we've worked around.
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://gpfsug.org/pipermail/gpfsug-discuss_gpfsug.org/attachments/20140403/65190ee1/attachment-0001.htm>

From bevans at pixitmedia.com  Thu Apr 17 16:08:23 2014
From: bevans at pixitmedia.com (Barry Evans)
Date: Thu, 17 Apr 2014 16:08:23 +0100
Subject: [gpfsug-discuss] PixStor Launch Party after GPFS User Group meeting
Message-ID: <534FEE67.2080204@pixitmedia.com>

Hello all,

I'd like to invite all attendees of the GPFS User Group Meeting on the 
29th of April to join Pixit Media, ArcaStream and Arrow to the launch 
party of Pixit Media's new unified storage and network architecture for 
media, PixStor (which of course is powered by GPFS). We will also be 
launching our new storage brand for research computing, ArcaStream. But 
most importantly...

FREE DRINKS AND FOOD! (and a few prizes too)

The event will be held at the Mulberry Bush Pub, just a 2 minute walk 
across the road from IBM South Bank, and will start straight after the 
GPFS User Group meeting finishes up and last until the pub close. If 
you'd like to attend, please register at 
http://www.pixitmedia.com/launchparty - hope to see you all there!

Barry Evans
Technical Director/Co-Founder
Pixit Media/ArcaStream



Disclaimer - This party does not form a part of of the actual GPFS user 
group meeting

-- 
This email is confidential in that it is intended for the exclusive 
attention of the addressee(s) indicated. If you are not the intended 
recipient, this email should not be read or disclosed to any other person. 
Please notify the sender immediately and delete this email from your 
computer system. Any opinions expressed are not necessarily those of the 
company from which this email was sent and, whilst to the best of our 
knowledge no viruses or defects exist, no responsibility can be accepted 
for any loss or damage arising from its receipt or subsequent use of this 
email.


From orlando.richards at ed.ac.uk  Fri Apr 18 10:29:15 2014
From: orlando.richards at ed.ac.uk (Orlando Richards)
Date: Fri, 18 Apr 2014 10:29:15 +0100
Subject: [gpfsug-discuss] PixStor Launch Party after GPFS User Group
	meeting
In-Reply-To: <534FEE67.2080204@pixitmedia.com>
References: <534FEE67.2080204@pixitmedia.com>
Message-ID: <5350F06B.4060005@ed.ac.uk>

On 17/04/14 16:08, Barry Evans wrote:
> Hello all,
>
> I'd like to invite all attendees of the GPFS User Group Meeting on the
> 29th of April to join Pixit Media, ArcaStream and Arrow to the launch
> party of Pixit Media's new unified storage and network architecture for
> media, PixStor (which of course is powered by GPFS). We will also be
> launching our new storage brand for research computing, ArcaStream. But
> most importantly...
>
> FREE DRINKS AND FOOD! (and a few prizes too)
>
> The event will be held at the Mulberry Bush Pub, just a 2 minute walk
> across the road from IBM South Bank, and will start straight after the
> GPFS User Group meeting finishes up and last until the pub close. If
> you'd like to attend, please register at
> http://www.pixitmedia.com/launchparty - hope to see you all there!
>
> Barry Evans
> Technical Director/Co-Founder
> Pixit Media/ArcaStream
>
>
>
> Disclaimer - This party does not form a part of of the actual GPFS user
> group meeting
>

Hi Barry,

The link on your web page takes you to a kids toys website ;)

I think you want:
http://www.mulberrybushpub.com/



-- 
             --
    Dr Orlando Richards
   Information Services
IT Infrastructure Division
        Unix Section
     Tel: 0131 650 4994
   skype: orlando.richards

The University of Edinburgh is a charitable body, registered in 
Scotland, with registration number SC005336.


From bevans at pixitmedia.com  Fri Apr 18 16:51:23 2014
From: bevans at pixitmedia.com (Barry Evans)
Date: Fri, 18 Apr 2014 16:51:23 +0100
Subject: [gpfsug-discuss] PixStor Launch Party after GPFS User Group
	meeting
In-Reply-To: <5350F06B.4060005@ed.ac.uk>
References: <534FEE67.2080204@pixitmedia.com> <5350F06B.4060005@ed.ac.uk>
Message-ID: <535149FB.20308@pixitmedia.com>


Well that's embarrassing... ;)

Fixed - Thanks Orlando!


> Orlando Richards <mailto:orlando.richards at ed.ac.uk>
> 18 April 2014 10:29
>
>
> Hi Barry,
>
> The link on your web page takes you to a kids toys website ;)
>
> I think you want:
> http://www.mulberrybushpub.com/
>
>
>
> Barry Evans <mailto:bevans at pixitmedia.com>
> 17 April 2014 16:08
> Hello all,
>
> I'd like to invite all attendees of the GPFS User Group Meeting on the 
> 29th of April to join Pixit Media, ArcaStream and Arrow to the launch 
> party of Pixit Media's new unified storage and network architecture 
> for media, PixStor (which of course is powered by GPFS). We will also 
> be launching our new storage brand for research computing, ArcaStream. 
> But most importantly...
>
> FREE DRINKS AND FOOD! (and a few prizes too)
>
> The event will be held at the Mulberry Bush Pub, just a 2 minute walk 
> across the road from IBM South Bank, and will start straight after the 
> GPFS User Group meeting finishes up and last until the pub close. If 
> you'd like to attend, please register at 
> http://www.pixitmedia.com/launchparty - hope to see you all there!
>
> Barry Evans
> Technical Director/Co-Founder
> Pixit Media/ArcaStream
>
>
>
> Disclaimer - This party does not form a part of of the actual GPFS 
> user group meeting

-- 
This email is confidential in that it is intended for the exclusive 
attention of the addressee(s) indicated. If you are not the intended 
recipient, this email should not be read or disclosed to any other person. 
Please notify the sender immediately and delete this email from your 
computer system. Any opinions expressed are not necessarily those of the 
company from which this email was sent and, whilst to the best of our 
knowledge no viruses or defects exist, no responsibility can be accepted 
for any loss or damage arising from its receipt or subsequent use of this 
email.
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://gpfsug.org/pipermail/gpfsug-discuss_gpfsug.org/attachments/20140418/ba3d6bc6/attachment-0001.htm>
-------------- next part --------------
A non-text attachment was scrubbed...
Name: postbox-contact.jpg
Type: image/jpeg
Size: 1256 bytes
Desc: not available
URL: <http://gpfsug.org/pipermail/gpfsug-discuss_gpfsug.org/attachments/20140418/ba3d6bc6/attachment-0002.jpg>
-------------- next part --------------
A non-text attachment was scrubbed...
Name: compose-unknown-contact.jpg
Type: image/jpeg
Size: 770 bytes
Desc: not available
URL: <http://gpfsug.org/pipermail/gpfsug-discuss_gpfsug.org/attachments/20140418/ba3d6bc6/attachment-0003.jpg>

From orlando.richards at ed.ac.uk  Wed Apr 23 14:22:46 2014
From: orlando.richards at ed.ac.uk (Orlando Richards)
Date: Wed, 23 Apr 2014 14:22:46 +0100
Subject: [gpfsug-discuss] Final details for GPFS User Group Meeting 29/4
In-Reply-To: <CAEKnjWJOoweYnDbQ=q5i=aTFjOkYFaSp7o0Uan_T+t63C=sH=A@mail.gmail.com>
References: <CAEKnjWJOoweYnDbQ=q5i=aTFjOkYFaSp7o0Uan_T+t63C=sH=A@mail.gmail.com>
Message-ID: <5357BEA6.20202@ed.ac.uk>

On 23/04/14 13:03, Secretary GPFS UG wrote:
> Unfortunately there is a tube strike planned from around 21:00 on Monday
> 28 April until the morning of Thursday 1 May which may impact your
> journey so please allow yourself plenty of time to register before the
> first presentation gets underway at 11am.
>

Ugh. Any Londoners have advice on how to get to/from Paddington with 
tube strikes ongoing?

-- 
             --
    Dr Orlando Richards
   Information Services
IT Infrastructure Division
        Unix Section
     Tel: 0131 650 4994
   skype: orlando.richards

The University of Edinburgh is a charitable body, registered in 
Scotland, with registration number SC005336.


From bevans at pixitmedia.com  Wed Apr 23 14:37:40 2014
From: bevans at pixitmedia.com (Barry Evans)
Date: Wed, 23 Apr 2014 14:37:40 +0100
Subject: [gpfsug-discuss] Final details for GPFS User Group Meeting 29/4
In-Reply-To: <5357BEA6.20202@ed.ac.uk>
References: <CAEKnjWJOoweYnDbQ=q5i=aTFjOkYFaSp7o0Uan_T+t63C=sH=A@mail.gmail.com>
	<5357BEA6.20202@ed.ac.uk>
Message-ID: <5357C224.6050800@pixitmedia.com>

Last time I think Bakerloo from Paddington to Waterloo was 'OK' - no 
idea if it will be the same this time around. The bigger stations seemed 
to cope pretty well, Central line excluded.

Cheers,
Barry

Orlando Richards wrote:
>
> On 23/04/14 13:03, Secretary GPFS UG wrote:
>>
>> Unfortunately there is a tube strike planned from around 21:00 on Monday
>> 28 April until the morning of Thursday 1 May which may impact your
>> journey so please allow yourself plenty of time to register before the
>> first presentation gets underway at 11am.
>>
>
>
> Ugh. Any Londoners have advice on how to get to/from Paddington with
> tube strikes ongoing?

-- 
This email is confidential in that it is intended for the exclusive 
attention of the addressee(s) indicated. If you are not the intended 
recipient, this email should not be read or disclosed to any other person. 
Please notify the sender immediately and delete this email from your 
computer system. Any opinions expressed are not necessarily those of the 
company from which this email was sent and, whilst to the best of our 
knowledge no viruses or defects exist, no responsibility can be accepted 
for any loss or damage arising from its receipt or subsequent use of this 
email.
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://gpfsug.org/pipermail/gpfsug-discuss_gpfsug.org/attachments/20140423/0d699dbb/attachment-0001.htm>

From Sandra.McLaughlin at astrazeneca.com  Wed Apr 23 15:02:24 2014
From: Sandra.McLaughlin at astrazeneca.com (McLaughlin, Sandra M)
Date: Wed, 23 Apr 2014 14:02:24 +0000
Subject: [gpfsug-discuss] Final details for GPFS User Group Meeting 29/4
In-Reply-To: <5357C224.6050800@pixitmedia.com>
References: <CAEKnjWJOoweYnDbQ=q5i=aTFjOkYFaSp7o0Uan_T+t63C=sH=A@mail.gmail.com>
	<5357BEA6.20202@ed.ac.uk> <5357C224.6050800@pixitmedia.com>
Message-ID: <117e0d974a314151bfd033002b9e553b@DBXPR04MB031.eurprd04.prod.outlook.com>

I was in London last time as well (can?t believe my luck really, that it?s happening again) and the Victoria and Northern lines were OK, and Euston, Victoria and Waterloo were not too bad. So, it wasn?t nearly as bad as I was expecting.

Sandra.

From: gpfsug-discuss-bounces at gpfsug.org [mailto:gpfsug-discuss-bounces at gpfsug.org] On Behalf Of Barry Evans
Sent: 23 April 2014 14:38
To: gpfsug main discussion list
Subject: Re: [gpfsug-discuss] Final details for GPFS User Group Meeting 29/4

Last time I think Bakerloo from Paddington to Waterloo was 'OK' - no idea if it will be the same this time around. The bigger stations seemed to cope pretty well, Central line excluded.

Cheers,
Barry

Orlando Richards wrote:


On 23/04/14 13:03, Secretary GPFS UG wrote:


Unfortunately there is a tube strike planned from around 21:00 on Monday
28 April until the morning of Thursday 1 May which may impact your
journey so please allow yourself plenty of time to register before the
first presentation gets underway at 11am.


Ugh. Any Londoners have advice on how to get to/from Paddington with
tube strikes ongoing?

[https://ci3.googleusercontent.com/proxy/RHzzP7ozZOO_Rz1yGW5TDRhNOfSN5T0D6OEeEfbCAYlYGEUhlUCQkZ7T74jyNAbZ3QtuhRg-Ma1WcWYTzawl94g=s0-d-e1-ft#http://pixitmedia.com/sig/PixitEmailSig.png]
This email is confidential in that it is intended for the exclusive attention of the addressee(s) indicated. If you are not the intended recipient, this email should not be read or disclosed to any other person. Please notify the sender immediately and delete this email from your computer system. Any opinions expressed are not necessarily those of the company from which this email was sent and, whilst to the best of our knowledge no viruses or defects exist, no responsibility can be accepted for any loss or damage arising from its receipt or subsequent use of this email.

--------------------------------------------------------------------------
AstraZeneca UK Limited is a company incorporated in England and Wales with registered number: 03674842 and a registered office at 2 Kingdom Street, London, W2 6BD.
Confidentiality Notice: This message is private and may contain confidential, proprietary and legally privileged information. If you have received this message in error, please notify us and remove it from your system and note that you must not copy, distribute or take any action in reliance on it. Any unauthorised use or disclosure of the contents of this message is not permitted and may be unlawful.
Disclaimer: Email messages may be subject to delays, interception, non-delivery and unauthorised alterations. Therefore, information expressed in this message is not given or endorsed by AstraZeneca UK Limited unless otherwise notified by an authorised representative independent of this message. No contractual relationship is created by this message by any person unless specifically indicated by agreement in writing other than email.
Monitoring: AstraZeneca UK Limited may monitor email traffic data and content for the purposes of the prevention and detection of crime, ensuring the security of our computer systems and checking Compliance with our Code of Conduct and Policies.
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://gpfsug.org/pipermail/gpfsug-discuss_gpfsug.org/attachments/20140423/e79c7343/attachment-0001.htm>

From orlando.richards at ed.ac.uk  Wed Apr 23 15:07:43 2014
From: orlando.richards at ed.ac.uk (Orlando Richards)
Date: Wed, 23 Apr 2014 15:07:43 +0100
Subject: [gpfsug-discuss] Final details for GPFS User Group Meeting 29/4
In-Reply-To: <117e0d974a314151bfd033002b9e553b@DBXPR04MB031.eurprd04.prod.outlook.com>
References: <CAEKnjWJOoweYnDbQ=q5i=aTFjOkYFaSp7o0Uan_T+t63C=sH=A@mail.gmail.com>	<5357BEA6.20202@ed.ac.uk>
	<5357C224.6050800@pixitmedia.com>
	<117e0d974a314151bfd033002b9e553b@DBXPR04MB031.eurprd04.prod.outlook.com>
Message-ID: <5357C92F.1040407@ed.ac.uk>


Good to hear - thanks both!

On 23/04/14 15:02, McLaughlin, Sandra M wrote:
> I was in London last time as well (can?t believe my luck really, that
> it?s happening again) and the Victoria and Northern lines were OK, and
> Euston, Victoria and Waterloo were not too bad. So, it wasn?t nearly as
> bad as I was expecting.
>
> Sandra.
>
> ------------------------------------------------------------------------
>
> AstraZeneca UK Limited is a company incorporated in England and Wales
> with registered number: 03674842 and a registered office at 2 Kingdom
> Street, London, W2 6BD.
>
> *Confidentiality Notice: *This message is private and may contain
> confidential, proprietary and legally privileged information. If you
> have received this message in error, please notify us and remove it from
> your system and note that you must not copy, distribute or take any
> action in reliance on it. Any unauthorised use or disclosure of the
> contents of this message is not permitted and may be unlawful.
>
> *Disclaimer:* Email messages may be subject to delays, interception,
> non-delivery and unauthorised alterations. Therefore, information
> expressed in this message is not given or endorsed by AstraZeneca UK
> Limited unless otherwise notified by an authorised representative
> independent of this message. No contractual relationship is created by
> this message by any person unless specifically indicated by agreement in
> writing other than email.
>
> *Monitoring: *AstraZeneca UK Limited may monitor email traffic data and
> content for the purposes of the prevention and detection of crime,
> ensuring the security of our computer systems and checking compliance
> with our Code of Conduct and policies.
>
> *From:*gpfsug-discuss-bounces at gpfsug.org
> [mailto:gpfsug-discuss-bounces at gpfsug.org] *On Behalf Of *Barry Evans
> *Sent:* 23 April 2014 14:38
> *To:* gpfsug main discussion list
> *Subject:* Re: [gpfsug-discuss] Final details for GPFS User Group
> Meeting 29/4
>
> Last time I think Bakerloo from Paddington to Waterloo was 'OK' - no
> idea if it will be the same this time around. The bigger stations seemed
> to cope pretty well, Central line excluded.
>
> Cheers,
> Barry
>
> Orlando Richards wrote:
>
>
> On 23/04/14 13:03, Secretary GPFS UG wrote:
>
>
> Unfortunately there is a tube strike planned from around 21:00 on Monday
> 28 April until the morning of Thursday 1 May which may impact your
> journey so please allow yourself plenty of time to register before the
> first presentation gets underway at 11am.
>
>
>
> Ugh. Any Londoners have advice on how to get to/from Paddington with
> tube strikes ongoing?
>
>
> This email is confidential in that it is intended for the exclusive
> attention of the addressee(s) indicated. If you are not the intended
> recipient, this email should not be read or disclosed to any other
> person. Please notify the sender immediately and delete this email from
> your computer system. Any opinions expressed are not necessarily those
> of the company from which this email was sent and, whilst to the best of
> our knowledge no viruses or defects exist, no responsibility can be
> accepted for any loss or damage arising from its receipt or subsequent
> use of this email.
>
>
>
> _______________________________________________
> gpfsug-discuss mailing list
> gpfsug-discuss at gpfsug.org
> http://gpfsug.org/mailman/listinfo/gpfsug-discuss
>


-- 
             --
    Dr Orlando Richards
   Information Services
IT Infrastructure Division
        Unix Section
     Tel: 0131 650 4994
   skype: orlando.richards

The University of Edinburgh is a charitable body, registered in 
Scotland, with registration number SC005336.


From chair at gpfsug.org  Wed Apr 23 15:16:27 2014
From: chair at gpfsug.org (Jez Tucker (Chair))
Date: Wed, 23 Apr 2014 15:16:27 +0100
Subject: [gpfsug-discuss] Final details for GPFS User Group Meeting 29/4
In-Reply-To: <5357BEA6.20202@ed.ac.uk>
References: <CAEKnjWJOoweYnDbQ=q5i=aTFjOkYFaSp7o0Uan_T+t63C=sH=A@mail.gmail.com>
	<5357BEA6.20202@ed.ac.uk>
Message-ID: <5357CB3B.4070200@gpfsug.org>

Indeed.
Best laid plans hey?

As others have said, on the day it's usually not that bad if other lines 
are running some tube trains.
Hopefully, they'll call it off at the last moment alike the previous two 
threatened strikes.

We'll handle the day as it pans out.

Jez


On 23/04/14 14:22, Orlando Richards wrote:
> On 23/04/14 13:03, Secretary GPFS UG wrote:
>> Unfortunately there is a tube strike planned from around 21:00 on Monday
>> 28 April until the morning of Thursday 1 May which may impact your
>> journey so please allow yourself plenty of time to register before the
>> first presentation gets underway at 11am.
>>
>
> Ugh. Any Londoners have advice on how to get to/from Paddington with 
> tube strikes ongoing?
>



From chair at gpfsug.org  Fri Apr 25 11:47:42 2014
From: chair at gpfsug.org (Jez Tucker (Chair))
Date: Fri, 25 Apr 2014 11:47:42 +0100
Subject: [gpfsug-discuss] Most tube lines are running during the strike on
	the 29th April
Message-ID: <535A3D4E.7020108@gpfsug.org>

Hi all,

   If you're attending the GPFS User Group on 29th April, you'll no 
doubt be aware of the RMT strike that will be affecting some Tube lines.

It looks like it's not all that bad.  Most lines will be running, bar 
the Central line, Waterloo & City and inner-London Piccadilly.

For precise information, see the PDF on this page: 
http://www.tfl.gov.uk/modes/tube/services-we-expect-to-run

(However, I'd still leave extra time for the journey if at all possible).

See you there.

Best regards,

Jez

GPFS UG Chair




From johnlang at us.ibm.com  Mon Apr 28 21:10:57 2014
From: johnlang at us.ibm.com (John Langlois)
Date: Mon, 28 Apr 2014 16:10:57 -0400
Subject: [gpfsug-discuss] Hello
Message-ID: <OFE9E0899E.22752ABB-ON85257CC8.006E8563-85257CC8.006EEEDA@us.ibm.com>

Hello,

My name is John Langlois and I will be sharing GPFS Product Management 
responsibilities.   Find me on: 

I am very interesting in monitoring this community of GPFS users.  And I 
welcome unsolicited feedback on the problems that you face in your jobs 
every day and how you might use GPFS today or (with a new feature) to 
solve those problems.  What consumes most of your time?  If you had a 
magic wand, how would you use it?   You can write me to help influence the 
future directions of this technology. 

I look forward to collaborating with all of you.

If you are open to a phone interview (again about the jobs you perform), 
please let me know.  I'd love to talk with you directly.


Regards,

John M. Langlois
IBM Software Defined Environment Product Manager

Phone: 1-919-267-6767
E-mail: johnlang at us.ibm.com
Find me on:   and within IBM on:  


-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://gpfsug.org/pipermail/gpfsug-discuss_gpfsug.org/attachments/20140428/976a795d/attachment-0001.htm>
-------------- next part --------------
A non-text attachment was scrubbed...
Name: not available
Type: image/jpeg
Size: 518 bytes
Desc: not available
URL: <http://gpfsug.org/pipermail/gpfsug-discuss_gpfsug.org/attachments/20140428/976a795d/attachment-0004.jpe>
-------------- next part --------------
A non-text attachment was scrubbed...
Name: not available
Type: image/jpeg
Size: 518 bytes
Desc: not available
URL: <http://gpfsug.org/pipermail/gpfsug-discuss_gpfsug.org/attachments/20140428/976a795d/attachment-0005.jpe>
-------------- next part --------------
A non-text attachment was scrubbed...
Name: not available
Type: image/jpeg
Size: 525 bytes
Desc: not available
URL: <http://gpfsug.org/pipermail/gpfsug-discuss_gpfsug.org/attachments/20140428/976a795d/attachment-0006.jpe>
-------------- next part --------------
A non-text attachment was scrubbed...
Name: not available
Type: image/jpeg
Size: 1208 bytes
Desc: not available
URL: <http://gpfsug.org/pipermail/gpfsug-discuss_gpfsug.org/attachments/20140428/976a795d/attachment-0007.jpe>
-------------- next part --------------
A non-text attachment was scrubbed...
Name: not available
Type: image/gif
Size: 1851 bytes
Desc: not available
URL: <http://gpfsug.org/pipermail/gpfsug-discuss_gpfsug.org/attachments/20140428/976a795d/attachment-0001.gif>

From sabujp at gmail.com  Wed Apr  2 22:05:51 2014
From: sabujp at gmail.com (Sabuj Pattanayek)
Date: Wed, 2 Apr 2014 16:05:51 -0500
Subject: [gpfsug-discuss] question about why unix extensions = no is
 recommended when using samba + gpfs?
In-Reply-To: <1394716131.2612.24.camel@buzzard.phy.strath.ac.uk>
References: <CAEeMGHvH84GDv6yEnPgKtNwOhyvXLkbvV2XGtf3vHpJgSuu=Lg@mail.gmail.com>
	<1394705361.16270.9.camel@buzzard.phy.strath.ac.uk>
	<CAEeMGHu4EaiEqa6=qJjHL+4GnkOnQeqh+h5azTHB-1QuqUiTMw@mail.gmail.com>
	<1394716131.2612.24.camel@buzzard.phy.strath.ac.uk>
Message-ID: <CAEeMGHvG4Jf_gZLfKfs8TyERib8L+r42_uWRqP6DQzHvj7_5dg@mail.gmail.com>

So I've been using the recommended gpfs:acl = yes mode for a while on
windows/cifs/smb only shares and today came across a bug where Microsoft
Office (2010, haven't tried other versions) on Windows 7/8 refuses to save
or save as. It can clearly create tmp files (e.g. those ~$... files when it
opens a file) and I can right click -> create a new file, edit files in
notepad/wordpad, drag and drop files between explorer windows but whenever
I try to save a doc/docx or xls/xlsx file it always throws the error dialog
:

There has been a network or file permission error. The network connection
may be lost. (mapped drive:\folder\fileName.docx)

( OK )   ( Help )

Was this information helpful?

If i switch to gpfs:acl = no and then use vfs_acl_xattr instead it works
fine. MS Office on OSX does not have this problem

It's similar to this issue :

https://www.ibm.com/developerworks/community/forums/html/topic?id=77777777-0000-0000-0000-000014299075

Anyone have any ideas without having to use acl_xattr? Again I'm using
sernet samba 4.1.6 and gpfs 3.5.0.11 .

Thanks,
Sabuj



-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://gpfsug.org/pipermail/gpfsug-discuss_gpfsug.org/attachments/20140402/db2df795/attachment-0002.htm>

From sabujp at gmail.com  Wed Apr  2 22:24:14 2014
From: sabujp at gmail.com (Sabuj Pattanayek)
Date: Wed, 2 Apr 2014 16:24:14 -0500
Subject: [gpfsug-discuss] question about why unix extensions = no is
 recommended when using samba + gpfs?
In-Reply-To: <CAEeMGHvG4Jf_gZLfKfs8TyERib8L+r42_uWRqP6DQzHvj7_5dg@mail.gmail.com>
References: <CAEeMGHvH84GDv6yEnPgKtNwOhyvXLkbvV2XGtf3vHpJgSuu=Lg@mail.gmail.com>
	<1394705361.16270.9.camel@buzzard.phy.strath.ac.uk>
	<CAEeMGHu4EaiEqa6=qJjHL+4GnkOnQeqh+h5azTHB-1QuqUiTMw@mail.gmail.com>
	<1394716131.2612.24.camel@buzzard.phy.strath.ac.uk>
	<CAEeMGHvG4Jf_gZLfKfs8TyERib8L+r42_uWRqP6DQzHvj7_5dg@mail.gmail.com>
Message-ID: <CAEeMGHuO5JUNAWAyWv6Oo3rPLvpzKfF0AWdGzgnxyr=nBfVMeQ@mail.gmail.com>

Seems like the workaround for now is to set :

gpfs:sharemodes = no

https://bugzilla.samba.org/show_bug.cgi?id=6762

Could be a regression? Haven't tried 3.5.0.17 yet, but we will be upgrading
to that soon.


On Wed, Apr 2, 2014 at 4:05 PM, Sabuj Pattanayek <sabujp at gmail.com> wrote:

> So I've been using the recommended gpfs:acl = yes mode for a while on
> windows/cifs/smb only shares and today came across a bug where Microsoft
> Office (2010, haven't tried other versions) on Windows 7/8 refuses to save
> or save as. It can clearly create tmp files (e.g. those ~$... files when it
> opens a file) and I can right click -> create a new file, edit files in
> notepad/wordpad, drag and drop files between explorer windows but whenever
> I try to save a doc/docx or xls/xlsx file it always throws the error dialog
> :
>
> There has been a network or file permission error. The network connection
> may be lost. (mapped drive:\folder\fileName.docx)
>
> ( OK )   ( Help )
>
> Was this information helpful?
>
> If i switch to gpfs:acl = no and then use vfs_acl_xattr instead it works
> fine. MS Office on OSX does not have this problem
>
> It's similar to this issue :
>
>
> https://www.ibm.com/developerworks/community/forums/html/topic?id=77777777-0000-0000-0000-000014299075
>
> Anyone have any ideas without having to use acl_xattr? Again I'm using
> sernet samba 4.1.6 and gpfs 3.5.0.11 .
>
> Thanks,
> Sabuj
>
>
>
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://gpfsug.org/pipermail/gpfsug-discuss_gpfsug.org/attachments/20140402/42d9eb85/attachment-0002.htm>

From jonathan at buzzard.me.uk  Wed Apr  2 22:36:28 2014
From: jonathan at buzzard.me.uk (Jonathan Buzzard)
Date: Wed, 02 Apr 2014 22:36:28 +0100
Subject: [gpfsug-discuss] question about why unix extensions = no is
 recommended when using samba + gpfs?
In-Reply-To: <CAEeMGHuO5JUNAWAyWv6Oo3rPLvpzKfF0AWdGzgnxyr=nBfVMeQ@mail.gmail.com>
References: <CAEeMGHvH84GDv6yEnPgKtNwOhyvXLkbvV2XGtf3vHpJgSuu=Lg@mail.gmail.com>
	<1394705361.16270.9.camel@buzzard.phy.strath.ac.uk>
	<CAEeMGHu4EaiEqa6=qJjHL+4GnkOnQeqh+h5azTHB-1QuqUiTMw@mail.gmail.com>
	<1394716131.2612.24.camel@buzzard.phy.strath.ac.uk>
	<CAEeMGHvG4Jf_gZLfKfs8TyERib8L+r42_uWRqP6DQzHvj7_5dg@mail.gmail.com>
	<CAEeMGHuO5JUNAWAyWv6Oo3rPLvpzKfF0AWdGzgnxyr=nBfVMeQ@mail.gmail.com>
Message-ID: <533C82DC.9090402@buzzard.me.uk>

On 02/04/14 22:24, Sabuj Pattanayek wrote:
> Seems like the workaround for now is to set :
>
> gpfs:sharemodes = no
>
> https://bugzilla.samba.org/show_bug.cgi?id=6762

That is doggy ancient ticket, and fixed.


# store DOS attributes in extended attributes (vfs_gpfs then stores them 
in the file system)
	ea support = yes
	store dos attributes = yes
	map readonly = no
	map archive = no
	map system = no
	map hidden = no

Will most likely fix it for you. It is down to Office 2007 onwards 
trying to preserve ACL's on a save. So you should find a save as works, 
no ACL's to preserve but saving an existing file does not.


JAB.

-- 
Jonathan A. Buzzard                 Email: jonathan (at) buzzard.me.uk
Fife, United Kingdom.


From sabujp at gmail.com  Wed Apr  2 22:42:35 2014
From: sabujp at gmail.com (Sabuj Pattanayek)
Date: Wed, 2 Apr 2014 16:42:35 -0500
Subject: [gpfsug-discuss] question about why unix extensions = no is
 recommended when using samba + gpfs?
In-Reply-To: <533C82DC.9090402@buzzard.me.uk>
References: <CAEeMGHvH84GDv6yEnPgKtNwOhyvXLkbvV2XGtf3vHpJgSuu=Lg@mail.gmail.com>
	<1394705361.16270.9.camel@buzzard.phy.strath.ac.uk>
	<CAEeMGHu4EaiEqa6=qJjHL+4GnkOnQeqh+h5azTHB-1QuqUiTMw@mail.gmail.com>
	<1394716131.2612.24.camel@buzzard.phy.strath.ac.uk>
	<CAEeMGHvG4Jf_gZLfKfs8TyERib8L+r42_uWRqP6DQzHvj7_5dg@mail.gmail.com>
	<CAEeMGHuO5JUNAWAyWv6Oo3rPLvpzKfF0AWdGzgnxyr=nBfVMeQ@mail.gmail.com>
	<533C82DC.9090402@buzzard.me.uk>
Message-ID: <CAEeMGHtGDRLQiM4qP62Yuwpp9td+9PCjATNf=S1SS3xhEqw40A@mail.gmail.com>

Yup, I had those settings set already, and neither save as or save worked.


On Wed, Apr 2, 2014 at 4:36 PM, Jonathan Buzzard <jonathan at buzzard.me.uk>wrote:

> On 02/04/14 22:24, Sabuj Pattanayek wrote:
>
>> Seems like the workaround for now is to set :
>>
>> gpfs:sharemodes = no
>>
>> https://bugzilla.samba.org/show_bug.cgi?id=6762
>>
>
> That is doggy ancient ticket, and fixed.
>
>
> # store DOS attributes in extended attributes (vfs_gpfs then stores them
> in the file system)
>         ea support = yes
>         store dos attributes = yes
>         map readonly = no
>         map archive = no
>         map system = no
>         map hidden = no
>
> Will most likely fix it for you. It is down to Office 2007 onwards trying
> to preserve ACL's on a save. So you should find a save as works, no ACL's
> to preserve but saving an existing file does not.
>
>
>
> JAB.
>
> --
> Jonathan A. Buzzard                 Email: jonathan (at) buzzard.me.uk
> Fife, United Kingdom.
> _______________________________________________
> gpfsug-discuss mailing list
> gpfsug-discuss at gpfsug.org
> http://gpfsug.org/mailman/listinfo/gpfsug-discuss
>
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://gpfsug.org/pipermail/gpfsug-discuss_gpfsug.org/attachments/20140402/2827b7c1/attachment-0002.htm>

From jonathan at buzzard.me.uk  Wed Apr  2 23:08:40 2014
From: jonathan at buzzard.me.uk (Jonathan Buzzard)
Date: Wed, 02 Apr 2014 23:08:40 +0100
Subject: [gpfsug-discuss] question about why unix extensions = no is
 recommended when using samba + gpfs?
In-Reply-To: <CAEeMGHtGDRLQiM4qP62Yuwpp9td+9PCjATNf=S1SS3xhEqw40A@mail.gmail.com>
References: <CAEeMGHvH84GDv6yEnPgKtNwOhyvXLkbvV2XGtf3vHpJgSuu=Lg@mail.gmail.com>
	<1394705361.16270.9.camel@buzzard.phy.strath.ac.uk>
	<CAEeMGHu4EaiEqa6=qJjHL+4GnkOnQeqh+h5azTHB-1QuqUiTMw@mail.gmail.com>
	<1394716131.2612.24.camel@buzzard.phy.strath.ac.uk>
	<CAEeMGHvG4Jf_gZLfKfs8TyERib8L+r42_uWRqP6DQzHvj7_5dg@mail.gmail.com>
	<CAEeMGHuO5JUNAWAyWv6Oo3rPLvpzKfF0AWdGzgnxyr=nBfVMeQ@mail.gmail.com>
	<533C82DC.9090402@buzzard.me.uk>
	<CAEeMGHtGDRLQiM4qP62Yuwpp9td+9PCjATNf=S1SS3xhEqw40A@mail.gmail.com>
Message-ID: <533C8A68.7040304@buzzard.me.uk>

On 02/04/14 22:42, Sabuj Pattanayek wrote:
> Yup, I had those settings set already, and neither save as or save worked.
>

You need to provide more information. Much more of your smb.conf, what 
OS, Samba, and GPFS, along with your GPFS config.

Have you tested that the DOS attributes are correctly being stored in 
the GPFS file system?

It explicitly does work. The issues are all around Office trying to 
preserve ACL's which the vast majority of software does not.

Are you running with NFSv4 ACL's *ONLY* on GPFS? Using Posix or Posix 
and NFSv4 together is likely to lead to problems.


JAB.

-- 
Jonathan A. Buzzard                 Email: jonathan (at) buzzard.me.uk
Fife, United Kingdom.


From sabujp at gmail.com  Thu Apr  3 03:08:40 2014
From: sabujp at gmail.com (Sabuj Pattanayek)
Date: Wed, 2 Apr 2014 21:08:40 -0500
Subject: [gpfsug-discuss] question about why unix extensions = no is
 recommended when using samba + gpfs?
In-Reply-To: <533C8A68.7040304@buzzard.me.uk>
References: <CAEeMGHvH84GDv6yEnPgKtNwOhyvXLkbvV2XGtf3vHpJgSuu=Lg@mail.gmail.com>
	<1394705361.16270.9.camel@buzzard.phy.strath.ac.uk>
	<CAEeMGHu4EaiEqa6=qJjHL+4GnkOnQeqh+h5azTHB-1QuqUiTMw@mail.gmail.com>
	<1394716131.2612.24.camel@buzzard.phy.strath.ac.uk>
	<CAEeMGHvG4Jf_gZLfKfs8TyERib8L+r42_uWRqP6DQzHvj7_5dg@mail.gmail.com>
	<CAEeMGHuO5JUNAWAyWv6Oo3rPLvpzKfF0AWdGzgnxyr=nBfVMeQ@mail.gmail.com>
	<533C82DC.9090402@buzzard.me.uk>
	<CAEeMGHtGDRLQiM4qP62Yuwpp9td+9PCjATNf=S1SS3xhEqw40A@mail.gmail.com>
	<533C8A68.7040304@buzzard.me.uk>
Message-ID: <CAEeMGHvFDgP-7i-fy8KnFCoJra13CB5X6RNKacjBWUUq2Zp8HA@mail.gmail.com>

On Wed, Apr 2, 2014 at 5:08 PM, Jonathan Buzzard <jonathan at buzzard.me.uk>wrote:

> On 02/04/14 22:42, Sabuj Pattanayek wrote:
>
>> Yup, I had those settings set already, and neither save as or save worked.
>>
>>
> You need to provide more information. Much more of your smb.conf, what OS,
> Samba, and GPFS, along with your GPFS config.
>

rhel  6.3, 2.6.32-279.31.1.el6.x86_64, sernet samba 4.1.6, ctdb
1.0.114.7-1, gpfs 3.5.0.11, gpfs config farther down :

### smb.conf ###

[global]
workgroup = DOMAIN
netbios name = gpfs-smb-server
password server = dc-1.ds.domain.edu dc-2.ds.domain.edu dc-3.ds.domain.edu
realm = DS.DOMAIN.EDU
security = ads
encrypt passwords = yes
allow trusted domains = No
idmap config *:backend = tdb
idmap config *:range = 4000000 - 5000000
idmap config DOMAIN : backend  = rid
idmap config DOMAIN : range    = 5000001 - 9000000
template shell = /bin/bash
template homedir = /home/%U
winbind offline logon = false
winbind trusted domains only = no
winbind use default domain = yes
# ldap handles users
winbind enum users  = no
winbind enum groups = no
winbind expand groups = 3
server string = SMB
log file = /var/log/samba/log.%m
max log size = 50
passdb backend = tdbsam

clustering = yes
unix extensions = yes

include = /etc/samba/template_shares.conf
include = /etc/samba/test_shares.conf

### template_shares.conf ###

[template_nfs4]
comment = GPFS Cluster on smb using %R protocol
path = /dors/testfs
writeable = yes
vfs objects = shadow_copy2 gpfs fileid
ea support = yes
store dos attributes = yes
access based share enum = yes
map readonly = no
map archive = no
map system = no
mangled names = no
force unknown acl user = yes
locking = yes
notify:inotify = no
shadow:snapdir = .snapshots
shadow:localtime = yes
shadow:format = %Y%m%d_%H:%M
shadow:fixinodes = yes
shadow:snapdirseverywhere = yes
shadow:sort = desc
# vfs_gpfs settings
gpfs:acl = yes
gpfs:winattr = yes
gpfs:dfreequota = yes
nfs4:mode = simple
nfs4:chown = yes
nfs4:acedup = merge
## needed to turn off sharemodes, msoffice on windows couldn't save
# https://bugzilla.samba.org/show_bug.cgi?id=6762
gpfs:sharemodes = no
gpfs:leases = yes
posix locking = yes
kernel oplocks = no
kernel share modes = yes
fileid:algorithm = fsname



>
> Have you tested that the DOS attributes are correctly being stored in the
> GPFS file system?
>

No, but they're all set to no, including map hidden which was missing above
but according to man smb.conf is by default set to no, so wouldn't these
not be mapped/stored in GPFS anyways? What EA file would these be stored in
if these were set to yes?


>
> It explicitly does work. The issues are all around Office trying to
> preserve ACL's which the vast majority of software does not.
>

Understood, but again, with the setup above, I had to turn sharemodes off
to get it to work. Setting it to no was mentioned in a comment in that
samba bug by Volker, i.e. I just didn't think of that myself, so there must
be some correlation.


> Are you running with NFSv4 ACL's *ONLY* on GPFS? Using Posix or Posix and
> NFSv4 together is likely to lead to problems.


posix + nfs4, it can be problematic but we're working around it.

# mmlsfs dors
flag                value                    description
------------------- ------------------------
-----------------------------------
 -f                 2048                     Minimum fragment size in bytes
(system pool)
                    32768                    Minimum fragment size in bytes
(other pools)
 -i                 512                      Inode size in bytes
 -I                 32768                    Indirect block size in bytes
 -m                 1                        Default number of metadata
replicas
 -M                 2                        Maximum number of metadata
replicas
 -r                 1                        Default number of data replicas
 -R                 2                        Maximum number of data replicas
 -j                 scatter                  Block allocation type
 -D                 nfs4                     File locking semantics in
effect
 -k                 all                      ACL semantics in effect
 -n                 2000                     Estimated number of nodes that
will mount file system
 -B                 65536                    Block size (system pool)
                    1048576                  Block size (other pools)
 -Q                 user;group;fileset       Quotas enforced
                    none                     Default quotas enabled
 --filesetdf        Yes                      Fileset df enabled?
 -V                 13.23 (3.5.0.7)          File system version
 --create-time      Thu Nov  7 11:29:46 2013 File system creation time
 -u                 Yes                      Support for large LUNs?
 -z                 No                       Is DMAPI enabled?
 -L                 16777216                 Logfile size
 -E                 Yes                      Exact mtime mount option
 -S                 No                       Suppress atime mount option
 -K                 whenpossible             Strict replica allocation
option
 --fastea           Yes                      Fast external attributes
enabled?
 --inode-limit      524288000                Maximum number of inodes
 -P                 system;capacity;fast     Disk storage pools in file
system
 -d
3T_7K_0;3T_7K_1;3T_7K_2;3T_7K_3;3T_7K_4;3T_7K_5;3T_7K_6;3T_7K_7;3T_7K_8;3T_7K_9;3T_7K_10;3T_7K_11;3T_7K_12;3T_7K_13;900GB_10K_0;900GB_10K_1;900GB_10K_2;900GB_10K_3;
 -d
900GB_10K_4;900GB_10K_5;900GB_10K_6;900GB_10K_7;900GB_10K_8;900GB_10K_9;900GB_10K_10;900GB_10K_11;900GB_10K_12;900GB_10K_13;900GB_10K_14;900GB_10K_15;900GB_10K_16;
 -d
900GB_10K_17;900GB_10K_18;900GB_10K_19;400GB_SSD_0;400GB_SSD_1;400GB_SSD_2;400GB_SSD_3;400GB_SSD_4
 Disks in file system
 --perfileset-quota yes                      Per-fileset quota enforcement
 -A                 yes                      Automatic mount option
 -o                 none                     Additional mount options
 -T                 /dors                    Default mount point
 --mount-priority   0                        Mount priority

A funny thing I noticed was that if I set security settings through the
security properties dialog in windows on a share with gpfs:acl = yes, it
sets posix acl's and doesn't automatically promote the acl's to nfs4. The
top level acl on a share directory has to be set to nfs4 before you set
users loose on it and at least one acl (a user / group on that directory)
has to have DirInherit:FileInherit otherwise files and directories beneath
that directory don't get set with nfs4 acl's which then breaks things like
Windows being able to discern the difference between full and modify
privileges (since posix only provides rwx, samba doesn't seem to care about
the 'c' acl provided by gpfs).

Several other strange behaviors I noticed :

* Turning inheritance off through the windows security -> advanced dialog
doesn't work unless you delete (or add I guess, but didn't try adding an
acl) some acl, either the group/user that you're trying to disable
inheritance for (which then means you have to re-add that group with
inheritance disabled) or some other group / user that you don't care about.
For example to disable inheritance on a directory for a group, you'd add a
dummy user/group acl to that directory, disable inheritance for the
group/user you want to disable inheritance for, then delete that dummy
group, otherwise clicking apply -> ok, backing out and then going back in
doesn't change the inheritance settings in either the advanced security
dialog or FileInherit, DirInherit, or Inherit acls in the output of
mmgetacl.

* robocopy y: z: /mir /COPY:DATSO throws "something is wrong with the
device. Failed to set NTACL ... " error 31 errors if your'e trying to copy
ACLs and data from some other share, but it still ends up copying the ACL's
properly! The problem is that robocopy doesn't complete, it only descends
one directory level at a time per robocopy run when it throws all these
errors. So you have to keep running robocopy in a loop from a .bat script
or manually keep running it until you think it's actually copied over all
the ACL's. This doesn't happen with acl_xattr, but acl_xattr has other
issues as well.

* Does any of the auditing tab stuff work? Samba has auditing via log
files, but this seems to be something that's stored in NTFS?

* I haven't tried anything from the quota tab, can it actually set GPFS
quotas somehow? I guess in windows you can set per directory quotas, the
closest thing would be filesets linked to directories with user/group
quotas within that fileset, but I don't think that tab is going to let you
do that.

Thanks,
Sabuj
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://gpfsug.org/pipermail/gpfsug-discuss_gpfsug.org/attachments/20140402/d5dedd94/attachment-0002.htm>

From sabujp at gmail.com  Thu Apr  3 03:11:43 2014
From: sabujp at gmail.com (Sabuj Pattanayek)
Date: Wed, 2 Apr 2014 21:11:43 -0500
Subject: [gpfsug-discuss] question about why unix extensions = no is
 recommended when using samba + gpfs?
In-Reply-To: <CAEeMGHvFDgP-7i-fy8KnFCoJra13CB5X6RNKacjBWUUq2Zp8HA@mail.gmail.com>
References: <CAEeMGHvH84GDv6yEnPgKtNwOhyvXLkbvV2XGtf3vHpJgSuu=Lg@mail.gmail.com>
	<1394705361.16270.9.camel@buzzard.phy.strath.ac.uk>
	<CAEeMGHu4EaiEqa6=qJjHL+4GnkOnQeqh+h5azTHB-1QuqUiTMw@mail.gmail.com>
	<1394716131.2612.24.camel@buzzard.phy.strath.ac.uk>
	<CAEeMGHvG4Jf_gZLfKfs8TyERib8L+r42_uWRqP6DQzHvj7_5dg@mail.gmail.com>
	<CAEeMGHuO5JUNAWAyWv6Oo3rPLvpzKfF0AWdGzgnxyr=nBfVMeQ@mail.gmail.com>
	<533C82DC.9090402@buzzard.me.uk>
	<CAEeMGHtGDRLQiM4qP62Yuwpp9td+9PCjATNf=S1SS3xhEqw40A@mail.gmail.com>
	<533C8A68.7040304@buzzard.me.uk>
	<CAEeMGHvFDgP-7i-fy8KnFCoJra13CB5X6RNKacjBWUUq2Zp8HA@mail.gmail.com>
Message-ID: <CAEeMGHsaX+3+zEcbCOAM689a_ZFKd5hqkmEGjfHcZ3mxNjG-_Q@mail.gmail.com>

Forgot one,

### test_shares.conf ###

[testfs]
comment = GPFS Cluster on DORS using %R protocol
path = /dors/testfs
copy = template_nfs4
admin users = "DOMAIN\userImLoggingInWith"


It doesn't matter if I login with an "admin user" or a regular user allowed
by NFS4 (NTACLs) set via the security tab. The same problems happen with
save/save as unless gpfs:sharemodes = no .


On Wed, Apr 2, 2014 at 9:08 PM, Sabuj Pattanayek <sabujp at gmail.com> wrote:

>
>
>
> On Wed, Apr 2, 2014 at 5:08 PM, Jonathan Buzzard <jonathan at buzzard.me.uk>wrote:
>
>> On 02/04/14 22:42, Sabuj Pattanayek wrote:
>>
>>> Yup, I had those settings set already, and neither save as or save
>>> worked.
>>>
>>>
>> You need to provide more information. Much more of your smb.conf, what
>> OS, Samba, and GPFS, along with your GPFS config.
>>
>
> rhel  6.3, 2.6.32-279.31.1.el6.x86_64, sernet samba 4.1.6, ctdb
> 1.0.114.7-1, gpfs 3.5.0.11, gpfs config farther down :
>
> ### smb.conf ###
>
> [global]
> workgroup = DOMAIN
> netbios name = gpfs-smb-server
> password server = dc-1.ds.domain.edu dc-2.ds.domain.edu dc-3.ds.domain.edu
> realm = DS.DOMAIN.EDU
> security = ads
> encrypt passwords = yes
> allow trusted domains = No
> idmap config *:backend = tdb
> idmap config *:range = 4000000 - 5000000
> idmap config DOMAIN : backend  = rid
> idmap config DOMAIN : range    = 5000001 - 9000000
> template shell = /bin/bash
> template homedir = /home/%U
> winbind offline logon = false
> winbind trusted domains only = no
> winbind use default domain = yes
> # ldap handles users
> winbind enum users  = no
> winbind enum groups = no
> winbind expand groups = 3
> server string = SMB
> log file = /var/log/samba/log.%m
> max log size = 50
> passdb backend = tdbsam
>
> clustering = yes
> unix extensions = yes
>
> include = /etc/samba/template_shares.conf
> include = /etc/samba/test_shares.conf
>
> ### template_shares.conf ###
>
> [template_nfs4]
> comment = GPFS Cluster on smb using %R protocol
> path = /dors/testfs
> writeable = yes
> vfs objects = shadow_copy2 gpfs fileid
> ea support = yes
> store dos attributes = yes
> access based share enum = yes
> map readonly = no
> map archive = no
> map system = no
> mangled names = no
> force unknown acl user = yes
> locking = yes
> notify:inotify = no
> shadow:snapdir = .snapshots
> shadow:localtime = yes
> shadow:format = %Y%m%d_%H:%M
> shadow:fixinodes = yes
> shadow:snapdirseverywhere = yes
> shadow:sort = desc
> # vfs_gpfs settings
> gpfs:acl = yes
> gpfs:winattr = yes
> gpfs:dfreequota = yes
> nfs4:mode = simple
> nfs4:chown = yes
> nfs4:acedup = merge
> ## needed to turn off sharemodes, msoffice on windows couldn't save
> # https://bugzilla.samba.org/show_bug.cgi?id=6762
> gpfs:sharemodes = no
> gpfs:leases = yes
> posix locking = yes
> kernel oplocks = no
> kernel share modes = yes
> fileid:algorithm = fsname
>
>
>
>>
>> Have you tested that the DOS attributes are correctly being stored in the
>> GPFS file system?
>>
>
> No, but they're all set to no, including map hidden which was missing
> above but according to man smb.conf is by default set to no, so wouldn't
> these not be mapped/stored in GPFS anyways? What EA file would these be
> stored in if these were set to yes?
>
>
>>
>> It explicitly does work. The issues are all around Office trying to
>> preserve ACL's which the vast majority of software does not.
>>
>
> Understood, but again, with the setup above, I had to turn sharemodes off
> to get it to work. Setting it to no was mentioned in a comment in that
> samba bug by Volker, i.e. I just didn't think of that myself, so there must
> be some correlation.
>
>
>> Are you running with NFSv4 ACL's *ONLY* on GPFS? Using Posix or Posix and
>> NFSv4 together is likely to lead to problems.
>
>
> posix + nfs4, it can be problematic but we're working around it.
>
> # mmlsfs dors
> flag                value                    description
> ------------------- ------------------------
> -----------------------------------
>  -f                 2048                     Minimum fragment size in
> bytes (system pool)
>                     32768                    Minimum fragment size in
> bytes (other pools)
>  -i                 512                      Inode size in bytes
>  -I                 32768                    Indirect block size in bytes
>  -m                 1                        Default number of metadata
> replicas
>  -M                 2                        Maximum number of metadata
> replicas
>  -r                 1                        Default number of data
> replicas
>  -R                 2                        Maximum number of data
> replicas
>  -j                 scatter                  Block allocation type
>  -D                 nfs4                     File locking semantics in
> effect
>  -k                 all                      ACL semantics in effect
>  -n                 2000                     Estimated number of nodes
> that will mount file system
>  -B                 65536                    Block size (system pool)
>                     1048576                  Block size (other pools)
>  -Q                 user;group;fileset       Quotas enforced
>                     none                     Default quotas enabled
>  --filesetdf        Yes                      Fileset df enabled?
>  -V                 13.23 (3.5.0.7)          File system version
>  --create-time      Thu Nov  7 11:29:46 2013 File system creation time
>  -u                 Yes                      Support for large LUNs?
>  -z                 No                       Is DMAPI enabled?
>  -L                 16777216                 Logfile size
>  -E                 Yes                      Exact mtime mount option
>  -S                 No                       Suppress atime mount option
>  -K                 whenpossible             Strict replica allocation
> option
>  --fastea           Yes                      Fast external attributes
> enabled?
>  --inode-limit      524288000                Maximum number of inodes
>  -P                 system;capacity;fast     Disk storage pools in file
> system
>  -d
> 3T_7K_0;3T_7K_1;3T_7K_2;3T_7K_3;3T_7K_4;3T_7K_5;3T_7K_6;3T_7K_7;3T_7K_8;3T_7K_9;3T_7K_10;3T_7K_11;3T_7K_12;3T_7K_13;900GB_10K_0;900GB_10K_1;900GB_10K_2;900GB_10K_3;
>  -d
> 900GB_10K_4;900GB_10K_5;900GB_10K_6;900GB_10K_7;900GB_10K_8;900GB_10K_9;900GB_10K_10;900GB_10K_11;900GB_10K_12;900GB_10K_13;900GB_10K_14;900GB_10K_15;900GB_10K_16;
>  -d
> 900GB_10K_17;900GB_10K_18;900GB_10K_19;400GB_SSD_0;400GB_SSD_1;400GB_SSD_2;400GB_SSD_3;400GB_SSD_4
>  Disks in file system
>  --perfileset-quota yes                      Per-fileset quota enforcement
>  -A                 yes                      Automatic mount option
>  -o                 none                     Additional mount options
>  -T                 /dors                    Default mount point
>  --mount-priority   0                        Mount priority
>
> A funny thing I noticed was that if I set security settings through the
> security properties dialog in windows on a share with gpfs:acl = yes, it
> sets posix acl's and doesn't automatically promote the acl's to nfs4. The
> top level acl on a share directory has to be set to nfs4 before you set
> users loose on it and at least one acl (a user / group on that directory)
> has to have DirInherit:FileInherit otherwise files and directories beneath
> that directory don't get set with nfs4 acl's which then breaks things like
> Windows being able to discern the difference between full and modify
> privileges (since posix only provides rwx, samba doesn't seem to care about
> the 'c' acl provided by gpfs).
>
> Several other strange behaviors I noticed :
>
> * Turning inheritance off through the windows security -> advanced dialog
> doesn't work unless you delete (or add I guess, but didn't try adding an
> acl) some acl, either the group/user that you're trying to disable
> inheritance for (which then means you have to re-add that group with
> inheritance disabled) or some other group / user that you don't care about.
> For example to disable inheritance on a directory for a group, you'd add a
> dummy user/group acl to that directory, disable inheritance for the
> group/user you want to disable inheritance for, then delete that dummy
> group, otherwise clicking apply -> ok, backing out and then going back in
> doesn't change the inheritance settings in either the advanced security
> dialog or FileInherit, DirInherit, or Inherit acls in the output of
> mmgetacl.
>
> * robocopy y: z: /mir /COPY:DATSO throws "something is wrong with the
> device. Failed to set NTACL ... " error 31 errors if your'e trying to copy
> ACLs and data from some other share, but it still ends up copying the ACL's
> properly! The problem is that robocopy doesn't complete, it only descends
> one directory level at a time per robocopy run when it throws all these
> errors. So you have to keep running robocopy in a loop from a .bat script
> or manually keep running it until you think it's actually copied over all
> the ACL's. This doesn't happen with acl_xattr, but acl_xattr has other
> issues as well.
>
> * Does any of the auditing tab stuff work? Samba has auditing via log
> files, but this seems to be something that's stored in NTFS?
>
> * I haven't tried anything from the quota tab, can it actually set GPFS
> quotas somehow? I guess in windows you can set per directory quotas, the
> closest thing would be filesets linked to directories with user/group
> quotas within that fileset, but I don't think that tab is going to let you
> do that.
>
> Thanks,
> Sabuj
>
>
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://gpfsug.org/pipermail/gpfsug-discuss_gpfsug.org/attachments/20140402/660ee76b/attachment-0002.htm>

From jonathan at buzzard.me.uk  Thu Apr  3 15:45:29 2014
From: jonathan at buzzard.me.uk (Jonathan Buzzard)
Date: Thu, 03 Apr 2014 15:45:29 +0100
Subject: [gpfsug-discuss] question about why unix extensions = no is
 recommended when using samba + gpfs?
In-Reply-To: <CAEeMGHvFDgP-7i-fy8KnFCoJra13CB5X6RNKacjBWUUq2Zp8HA@mail.gmail.com>
References: <CAEeMGHvH84GDv6yEnPgKtNwOhyvXLkbvV2XGtf3vHpJgSuu=Lg@mail.gmail.com>
	<1394705361.16270.9.camel@buzzard.phy.strath.ac.uk>
	<CAEeMGHu4EaiEqa6=qJjHL+4GnkOnQeqh+h5azTHB-1QuqUiTMw@mail.gmail.com>
	<1394716131.2612.24.camel@buzzard.phy.strath.ac.uk>
	<CAEeMGHvG4Jf_gZLfKfs8TyERib8L+r42_uWRqP6DQzHvj7_5dg@mail.gmail.com>
	<CAEeMGHuO5JUNAWAyWv6Oo3rPLvpzKfF0AWdGzgnxyr=nBfVMeQ@mail.gmail.com>
	<533C82DC.9090402@buzzard.me.uk>
	<CAEeMGHtGDRLQiM4qP62Yuwpp9td+9PCjATNf=S1SS3xhEqw40A@mail.gmail.com>
	<533C8A68.7040304@buzzard.me.uk>
	<CAEeMGHvFDgP-7i-fy8KnFCoJra13CB5X6RNKacjBWUUq2Zp8HA@mail.gmail.com>
Message-ID: <533D7409.3090002@buzzard.me.uk>

On 03/04/14 03:08, Sabuj Pattanayek wrote:

[SNIP]
>
> include = /etc/samba/template_shares.conf
> include = /etc/samba/test_shares.conf

That is stupid, you need to use registry share definitions with CTDB. 
Having them in files is bad bad bad.

>
> ### template_shares.conf ###
>
> [template_nfs4]
> comment = GPFS Cluster on smb using %R protocol
> path = /dors/testfs
> writeable = yes
> vfs objects = shadow_copy2 gpfs fileid

Hum, might have changed in Samba 4.x but in Samba 3.5/3.6 you can only 
have one vfs objects line in the entire smb.conf file and I did not 
thing it was a per share option either. Well you can have more than one, 
but the later ones just override the previous ones.

> ea support = yes
> store dos attributes = yes
> access based share enum = yes
> map readonly = no
> map archive = no
> map system = no
> mangled names = no
> force unknown acl user = yes
> locking = yes
> notify:inotify = no
> shadow:snapdir = .snapshots
> shadow:localtime = yes
> shadow:format = %Y%m%d_%H:%M
> shadow:fixinodes = yes
> shadow:snapdirseverywhere = yes
> shadow:sort = desc
> # vfs_gpfs settings
> gpfs:acl = yes
> gpfs:winattr = yes
> gpfs:dfreequota = yes
> nfs4:mode = simple
> nfs4:chown = yes
> nfs4:acedup = merge
> ## needed to turn off sharemodes, msoffice on windows couldn't save
> # https://bugzilla.samba.org/show_bug.cgi?id=6762
> gpfs:sharemodes = no

I am not well versed with Samba 4.x but a quick check says that share 
modes = yes conflicts with SMB2 and durable handles. Given in Samba 4.1 
max protocol is SMB2 by default ...

I have not seen a definitive answer anywhere about whether SMB2 and CTDB 
can be used in combination and if so what versions of CTDB/Samba one 
should be using however.

> gpfs:leases = yes
> posix locking = yes
> kernel oplocks = no
> kernel share modes = yes
> fileid:algorithm = fsname
>
>
>
>     Have you tested that the DOS attributes are correctly being stored
>     in the GPFS file system?
>
>
> No, but they're all set to no, including map hidden which was missing
> above but according to man smb.conf is by default set to no, so wouldn't
> these not be mapped/stored in GPFS anyways? What EA file would these be
> stored in if these were set to yes?

They are not stored in an extended attribute they are stored in the GPFS 
file system itself. The various settings that I listed are so that Samba 
tells the GPFS VFS module to store them in the extended attributes. 
Howeve the GPFS VFS module then goes and stores/retrieves them directly 
from the file system. It's all part of GPFS being able to run on 
Windows. There are genuine file creation times as well

I suggest that you explicitly test and make sure it is working.

>
>
>     It explicitly does work. The issues are all around Office trying to
>     preserve ACL's which the vast majority of software does not.
>
>
> Understood, but again, with the setup above, I had to turn sharemodes
> off to get it to work. Setting it to no was mentioned in a comment in u
> that samba bug by Volker, i.e. I just didn't think of that myself, so
> there must be some correlation.
>
>
>     Are you running with NFSv4 ACL's *ONLY* on GPFS? Using Posix or
>     Posix and NFSv4 together is likely to lead to problems.
>
>
> posix + nfs4, it can be problematic but we're working around it.
>

Put simply no you are not working around it, it is the cause of your 
issues with Office. More precisely the issue with Office is down to how 
the mapping of NTFS ACLS to GPFS is working, because storing the NTFS 
ACLS in extended attributes works. I am telling you don't mix Posix and 
NFSv4 ACL's in GPFS it won't work. Whether you listen is up to you.

I suggest you use a development/test GPFS cluster to verify it.


JAB.

-- 
Jonathan A. Buzzard                 Email: jonathan (at) buzzard.me.uk
Fife, United Kingdom.


From sabujp at gmail.com  Thu Apr  3 18:23:59 2014
From: sabujp at gmail.com (Sabuj Pattanayek)
Date: Thu, 3 Apr 2014 12:23:59 -0500
Subject: [gpfsug-discuss] question about why unix extensions = no is
 recommended when using samba + gpfs?
In-Reply-To: <533D7409.3090002@buzzard.me.uk>
References: <CAEeMGHvH84GDv6yEnPgKtNwOhyvXLkbvV2XGtf3vHpJgSuu=Lg@mail.gmail.com>
	<1394705361.16270.9.camel@buzzard.phy.strath.ac.uk>
	<CAEeMGHu4EaiEqa6=qJjHL+4GnkOnQeqh+h5azTHB-1QuqUiTMw@mail.gmail.com>
	<1394716131.2612.24.camel@buzzard.phy.strath.ac.uk>
	<CAEeMGHvG4Jf_gZLfKfs8TyERib8L+r42_uWRqP6DQzHvj7_5dg@mail.gmail.com>
	<CAEeMGHuO5JUNAWAyWv6Oo3rPLvpzKfF0AWdGzgnxyr=nBfVMeQ@mail.gmail.com>
	<533C82DC.9090402@buzzard.me.uk>
	<CAEeMGHtGDRLQiM4qP62Yuwpp9td+9PCjATNf=S1SS3xhEqw40A@mail.gmail.com>
	<533C8A68.7040304@buzzard.me.uk>
	<CAEeMGHvFDgP-7i-fy8KnFCoJra13CB5X6RNKacjBWUUq2Zp8HA@mail.gmail.com>
	<533D7409.3090002@buzzard.me.uk>
Message-ID: <CAEeMGHs7UyiFfu6zi5SZHvcUW0aYhQ21dYptVz_CcB5UaPww-A@mail.gmail.com>

> include = /etc/samba/template_shares.conf
>> include = /etc/samba/test_shares.conf
>>
>
> That is stupid, you need to use registry share definitions with CTDB.
> Having them in files is bad bad bad.


Will look into it.


> ### template_shares.conf ###
>
>>
>> [template_nfs4]
>> comment = GPFS Cluster on smb using %R protocol
>> path = /dors/testfs
>> writeable = yes
>> vfs objects = shadow_copy2 gpfs fileid
>>
>
> Hum, might have changed in Samba 4.x but in Samba 3.5/3.6 you can only
> have one vfs objects line in the entire smb.conf file and I did not thing
> it was a per share option either. Well you can have more than one, but the
> later ones just override the previous ones.



Yup, it's definitely per share in 4.1.x and the later ones probably do
override the previous one if the same vfs functions are overloaded, but in
the case above there's no overlap and shadow_copy2 and gpfs do work.



>
> I am not well versed with Samba 4.x but a quick check says that share
> modes = yes conflicts with SMB2 and durable handles. Given in Samba 4.1 max
> protocol is SMB2 by default ...
>

I was able to do SMB2 (at least in terms of performance over SMBv1) with
sharemodes = yes or sharemodes = no. Durable / persistent handles don't
work in that active read/write I/O will not continue if  smb/ctdb is
disabled on one of the samba nodes. The client will not have to
re-map/re-connect but any active I/O other than file deletions and perhaps
metadata operations will continue unaffected.


>
> I have not seen a definitive answer anywhere about whether SMB2 and CTDB
> can be used in combination and if so what versions of CTDB/Samba one should
> be using however.


I'm using ctdb 1.0.114 packaged by sernet along with sernet samba 4.1.6 .
They said they would release re-packaged v2 rpm at some point. Again, SMB2
works in so far as I can tell with its much improved read/write performance
over SMB1.


>>
>> No, but they're all set to no, including map hidden which was missing
>> above but according to man smb.conf is by default set to no, so wouldn't
>> these not be mapped/stored in GPFS anyways? What EA file would these be
>> stored in if these were set to yes?
>>
>
> They are not stored in an extended attribute they are stored in the GPFS
> file system itself. The various settings that I listed are so that Samba
> tells the GPFS VFS module to store them in the extended attributes. Howeve
> the GPFS VFS module then goes and stores/retrieves them directly from the
> file system. It's all part of GPFS being able to run on Windows. There are
> genuine file creation times as well
>
> I suggest that you explicitly test and make sure it is working.
>

Yup, they're working, they're being stored wherever they're supposed to be
stored in GPFS itself. I set a file to hidden and it disappeared from the
explorer window. Went into a command prompt and ran dir/a and it appeared.
Then ran mmlsattr -L on the file and it showed ARCHIVE HIDDEN in the
Windows attributes section.



> Put simply no you are not working around it, it is the cause of your
> issues with Office. More precisely the issue with Office is down to how the
> mapping of NTFS ACLS to GPFS is working, because storing the NTFS ACLS in
> extended attributes works. I am telling you don't mix Posix and NFSv4 ACL's
> in GPFS it won't work. Whether you listen is up to you.
>

It doesn't work if the ACL on the file is POSIX or has been promoted to
NFS4. In any case, we have need for the ACLs support to be both POSIX and
NFS4 where needed for the window shares and we can't/won't split up the
filesystem.


>
> I suggest you use a development/test GPFS cluster to verify it.


Yes, we're going to need a test/dev cluster for testing these for future
upgrades, etc so I will try an FS that's pure nfs4 ACLs only and see if it
behaves any differently.
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://gpfsug.org/pipermail/gpfsug-discuss_gpfsug.org/attachments/20140403/5f38f99f/attachment-0002.htm>

From sabujp at gmail.com  Thu Apr  3 18:26:00 2014
From: sabujp at gmail.com (Sabuj Pattanayek)
Date: Thu, 3 Apr 2014 12:26:00 -0500
Subject: [gpfsug-discuss] question about why unix extensions = no is
 recommended when using samba + gpfs?
In-Reply-To: <CAEeMGHs7UyiFfu6zi5SZHvcUW0aYhQ21dYptVz_CcB5UaPww-A@mail.gmail.com>
References: <CAEeMGHvH84GDv6yEnPgKtNwOhyvXLkbvV2XGtf3vHpJgSuu=Lg@mail.gmail.com>
	<1394705361.16270.9.camel@buzzard.phy.strath.ac.uk>
	<CAEeMGHu4EaiEqa6=qJjHL+4GnkOnQeqh+h5azTHB-1QuqUiTMw@mail.gmail.com>
	<1394716131.2612.24.camel@buzzard.phy.strath.ac.uk>
	<CAEeMGHvG4Jf_gZLfKfs8TyERib8L+r42_uWRqP6DQzHvj7_5dg@mail.gmail.com>
	<CAEeMGHuO5JUNAWAyWv6Oo3rPLvpzKfF0AWdGzgnxyr=nBfVMeQ@mail.gmail.com>
	<533C82DC.9090402@buzzard.me.uk>
	<CAEeMGHtGDRLQiM4qP62Yuwpp9td+9PCjATNf=S1SS3xhEqw40A@mail.gmail.com>
	<533C8A68.7040304@buzzard.me.uk>
	<CAEeMGHvFDgP-7i-fy8KnFCoJra13CB5X6RNKacjBWUUq2Zp8HA@mail.gmail.com>
	<533D7409.3090002@buzzard.me.uk>
	<CAEeMGHs7UyiFfu6zi5SZHvcUW0aYhQ21dYptVz_CcB5UaPww-A@mail.gmail.com>
Message-ID: <CAEeMGHuNe8tWuYZM_XbrV7LNqfrpCC4Um7Vo6FJeeYRiJ4HzSQ@mail.gmail.com>

I was able to do SMB2 (at least in terms of performance over SMBv1) with
> sharemodes = yes or sharemodes = no. Durable / persistent handles don't
> work in that active read/write I/O will not continue if  smb/ctdb is
> disabled on one of the samba nodes. The client will not have to
> re-map/re-connect but any active I/O other than file deletions and perhaps
> metadata operations will continue unaffected.
>

should be "any active I/O other than file deletions and perhaps metadata
operations will be disrupted"
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://gpfsug.org/pipermail/gpfsug-discuss_gpfsug.org/attachments/20140403/9b0bf53a/attachment-0002.htm>

From jonathan at buzzard.me.uk  Thu Apr  3 19:26:08 2014
From: jonathan at buzzard.me.uk (Jonathan Buzzard)
Date: Thu, 03 Apr 2014 19:26:08 +0100
Subject: [gpfsug-discuss] question about why unix extensions = no is
 recommended when using samba + gpfs?
In-Reply-To: <CAEeMGHs7UyiFfu6zi5SZHvcUW0aYhQ21dYptVz_CcB5UaPww-A@mail.gmail.com>
References: <CAEeMGHvH84GDv6yEnPgKtNwOhyvXLkbvV2XGtf3vHpJgSuu=Lg@mail.gmail.com>
	<1394705361.16270.9.camel@buzzard.phy.strath.ac.uk>
	<CAEeMGHu4EaiEqa6=qJjHL+4GnkOnQeqh+h5azTHB-1QuqUiTMw@mail.gmail.com>
	<1394716131.2612.24.camel@buzzard.phy.strath.ac.uk>
	<CAEeMGHvG4Jf_gZLfKfs8TyERib8L+r42_uWRqP6DQzHvj7_5dg@mail.gmail.com>
	<CAEeMGHuO5JUNAWAyWv6Oo3rPLvpzKfF0AWdGzgnxyr=nBfVMeQ@mail.gmail.com>
	<533C82DC.9090402@buzzard.me.uk>
	<CAEeMGHtGDRLQiM4qP62Yuwpp9td+9PCjATNf=S1SS3xhEqw40A@mail.gmail.com>
	<533C8A68.7040304@buzzard.me.uk>
	<CAEeMGHvFDgP-7i-fy8KnFCoJra13CB5X6RNKacjBWUUq2Zp8HA@mail.gmail.com>
	<533D7409.3090002@buzzard.me.uk>
	<CAEeMGHs7UyiFfu6zi5SZHvcUW0aYhQ21dYptVz_CcB5UaPww-A@mail.gmail.com>
Message-ID: <533DA7C0.4050106@buzzard.me.uk>

On 03/04/14 18:23, Sabuj Pattanayek wrote:

[SNIP]

>
> It doesn't work if the ACL on the file is POSIX or has been promoted to
> NFS4. In any case, we have need for the ACLs support to be both POSIX
> and NFS4 where needed for the window shares and we can't/won't split up
> the filesystem.
>

Client side Linux has support NFSv4 or more specifically NFSv4.1 for 
some time. The issue is the fact that the RichACL patches seem to have 
been stuck in limbo for years now.

Not that I have tried it even in development, but there is an 
alternative to the Linux kernel NFS server which sucks anyway as 
visibility into what is going on is near none existent.

It's the NFS-Ganesha server and according to the documentation it 
supports full NFSv4.1 and has GPFS support for a backend file system.

     https://github.com/nfs-ganesha/nfs-ganesha/wiki

That could potentially remove your "requirement" for Posix ACL's. That 
is you could go full NFSv4 ACL's in GPFS and an area could be accessed 
either by NFSv4 or SMB without the ACL's in GPFS getting mucked up. It 
is however not clear if NFSv4 ACL's are supported yet. I note that the 
latest versions of CTDB have support for NFS-Ganesha.

>
>     I suggest you use a development/test GPFS cluster to verify it.
>
> Yes, we're going to need a test/dev cluster for testing these for future
> upgrades, etc so I will try an FS that's pure nfs4 ACLs only and see if
> it behaves any differently.

I never cease to be amazed that people are doing large scale file 
servers with Linux/GPFS/Samba and don't have a test/dev cluster.

JAB.

-- 
Jonathan A. Buzzard                 Email: jonathan (at) buzzard.me.uk
Fife, United Kingdom.


From sabujp at gmail.com  Thu Apr  3 19:50:03 2014
From: sabujp at gmail.com (Sabuj Pattanayek)
Date: Thu, 3 Apr 2014 13:50:03 -0500
Subject: [gpfsug-discuss] question about why unix extensions = no is
 recommended when using samba + gpfs?
In-Reply-To: <533DA7C0.4050106@buzzard.me.uk>
References: <CAEeMGHvH84GDv6yEnPgKtNwOhyvXLkbvV2XGtf3vHpJgSuu=Lg@mail.gmail.com>
	<1394705361.16270.9.camel@buzzard.phy.strath.ac.uk>
	<CAEeMGHu4EaiEqa6=qJjHL+4GnkOnQeqh+h5azTHB-1QuqUiTMw@mail.gmail.com>
	<1394716131.2612.24.camel@buzzard.phy.strath.ac.uk>
	<CAEeMGHvG4Jf_gZLfKfs8TyERib8L+r42_uWRqP6DQzHvj7_5dg@mail.gmail.com>
	<CAEeMGHuO5JUNAWAyWv6Oo3rPLvpzKfF0AWdGzgnxyr=nBfVMeQ@mail.gmail.com>
	<533C82DC.9090402@buzzard.me.uk>
	<CAEeMGHtGDRLQiM4qP62Yuwpp9td+9PCjATNf=S1SS3xhEqw40A@mail.gmail.com>
	<533C8A68.7040304@buzzard.me.uk>
	<CAEeMGHvFDgP-7i-fy8KnFCoJra13CB5X6RNKacjBWUUq2Zp8HA@mail.gmail.com>
	<533D7409.3090002@buzzard.me.uk>
	<CAEeMGHs7UyiFfu6zi5SZHvcUW0aYhQ21dYptVz_CcB5UaPww-A@mail.gmail.com>
	<533DA7C0.4050106@buzzard.me.uk>
Message-ID: <CAEeMGHteKg6DPyiE4igPoCZfjq29MFzyTJe8-Xj-EKFCXVtdkg@mail.gmail.com>

> It's the NFS-Ganesha server and according to the documentation it supports
> full NFSv4.1 and has GPFS support for a backend file system.
>

Yup, that could be a future possibility, but getting everyone who's using
the system to move to non-posix ACLs (whom I have no control over) won't
work. NFSv3 and POSIX + POSIX extended ACLs aren't going anywhere soon
because of their simplicity and availability.


> I never cease to be amazed that people are doing large scale file servers
> with Linux/GPFS/Samba and don't have a test/dev cluster.


We do, using it for testing hasn't been necessary since our production
system was our test system since it wasn't being used in production, the
samba part is still only being used very minimally and we've done as much
testing as we could prior to letting a few users on who discovered some of
these problems that we've worked around.
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://gpfsug.org/pipermail/gpfsug-discuss_gpfsug.org/attachments/20140403/65190ee1/attachment-0002.htm>

From bevans at pixitmedia.com  Thu Apr 17 16:08:23 2014
From: bevans at pixitmedia.com (Barry Evans)
Date: Thu, 17 Apr 2014 16:08:23 +0100
Subject: [gpfsug-discuss] PixStor Launch Party after GPFS User Group meeting
Message-ID: <534FEE67.2080204@pixitmedia.com>

Hello all,

I'd like to invite all attendees of the GPFS User Group Meeting on the 
29th of April to join Pixit Media, ArcaStream and Arrow to the launch 
party of Pixit Media's new unified storage and network architecture for 
media, PixStor (which of course is powered by GPFS). We will also be 
launching our new storage brand for research computing, ArcaStream. But 
most importantly...

FREE DRINKS AND FOOD! (and a few prizes too)

The event will be held at the Mulberry Bush Pub, just a 2 minute walk 
across the road from IBM South Bank, and will start straight after the 
GPFS User Group meeting finishes up and last until the pub close. If 
you'd like to attend, please register at 
http://www.pixitmedia.com/launchparty - hope to see you all there!

Barry Evans
Technical Director/Co-Founder
Pixit Media/ArcaStream



Disclaimer - This party does not form a part of of the actual GPFS user 
group meeting

-- 
This email is confidential in that it is intended for the exclusive 
attention of the addressee(s) indicated. If you are not the intended 
recipient, this email should not be read or disclosed to any other person. 
Please notify the sender immediately and delete this email from your 
computer system. Any opinions expressed are not necessarily those of the 
company from which this email was sent and, whilst to the best of our 
knowledge no viruses or defects exist, no responsibility can be accepted 
for any loss or damage arising from its receipt or subsequent use of this 
email.


From orlando.richards at ed.ac.uk  Fri Apr 18 10:29:15 2014
From: orlando.richards at ed.ac.uk (Orlando Richards)
Date: Fri, 18 Apr 2014 10:29:15 +0100
Subject: [gpfsug-discuss] PixStor Launch Party after GPFS User Group
	meeting
In-Reply-To: <534FEE67.2080204@pixitmedia.com>
References: <534FEE67.2080204@pixitmedia.com>
Message-ID: <5350F06B.4060005@ed.ac.uk>

On 17/04/14 16:08, Barry Evans wrote:
> Hello all,
>
> I'd like to invite all attendees of the GPFS User Group Meeting on the
> 29th of April to join Pixit Media, ArcaStream and Arrow to the launch
> party of Pixit Media's new unified storage and network architecture for
> media, PixStor (which of course is powered by GPFS). We will also be
> launching our new storage brand for research computing, ArcaStream. But
> most importantly...
>
> FREE DRINKS AND FOOD! (and a few prizes too)
>
> The event will be held at the Mulberry Bush Pub, just a 2 minute walk
> across the road from IBM South Bank, and will start straight after the
> GPFS User Group meeting finishes up and last until the pub close. If
> you'd like to attend, please register at
> http://www.pixitmedia.com/launchparty - hope to see you all there!
>
> Barry Evans
> Technical Director/Co-Founder
> Pixit Media/ArcaStream
>
>
>
> Disclaimer - This party does not form a part of of the actual GPFS user
> group meeting
>

Hi Barry,

The link on your web page takes you to a kids toys website ;)

I think you want:
http://www.mulberrybushpub.com/



-- 
             --
    Dr Orlando Richards
   Information Services
IT Infrastructure Division
        Unix Section
     Tel: 0131 650 4994
   skype: orlando.richards

The University of Edinburgh is a charitable body, registered in 
Scotland, with registration number SC005336.


From bevans at pixitmedia.com  Fri Apr 18 16:51:23 2014
From: bevans at pixitmedia.com (Barry Evans)
Date: Fri, 18 Apr 2014 16:51:23 +0100
Subject: [gpfsug-discuss] PixStor Launch Party after GPFS User Group
	meeting
In-Reply-To: <5350F06B.4060005@ed.ac.uk>
References: <534FEE67.2080204@pixitmedia.com> <5350F06B.4060005@ed.ac.uk>
Message-ID: <535149FB.20308@pixitmedia.com>


Well that's embarrassing... ;)

Fixed - Thanks Orlando!


> Orlando Richards <mailto:orlando.richards at ed.ac.uk>
> 18 April 2014 10:29
>
>
> Hi Barry,
>
> The link on your web page takes you to a kids toys website ;)
>
> I think you want:
> http://www.mulberrybushpub.com/
>
>
>
> Barry Evans <mailto:bevans at pixitmedia.com>
> 17 April 2014 16:08
> Hello all,
>
> I'd like to invite all attendees of the GPFS User Group Meeting on the 
> 29th of April to join Pixit Media, ArcaStream and Arrow to the launch 
> party of Pixit Media's new unified storage and network architecture 
> for media, PixStor (which of course is powered by GPFS). We will also 
> be launching our new storage brand for research computing, ArcaStream. 
> But most importantly...
>
> FREE DRINKS AND FOOD! (and a few prizes too)
>
> The event will be held at the Mulberry Bush Pub, just a 2 minute walk 
> across the road from IBM South Bank, and will start straight after the 
> GPFS User Group meeting finishes up and last until the pub close. If 
> you'd like to attend, please register at 
> http://www.pixitmedia.com/launchparty - hope to see you all there!
>
> Barry Evans
> Technical Director/Co-Founder
> Pixit Media/ArcaStream
>
>
>
> Disclaimer - This party does not form a part of of the actual GPFS 
> user group meeting

-- 
This email is confidential in that it is intended for the exclusive 
attention of the addressee(s) indicated. If you are not the intended 
recipient, this email should not be read or disclosed to any other person. 
Please notify the sender immediately and delete this email from your 
computer system. Any opinions expressed are not necessarily those of the 
company from which this email was sent and, whilst to the best of our 
knowledge no viruses or defects exist, no responsibility can be accepted 
for any loss or damage arising from its receipt or subsequent use of this 
email.
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://gpfsug.org/pipermail/gpfsug-discuss_gpfsug.org/attachments/20140418/ba3d6bc6/attachment-0002.htm>
-------------- next part --------------
A non-text attachment was scrubbed...
Name: postbox-contact.jpg
Type: image/jpeg
Size: 1256 bytes
Desc: not available
URL: <http://gpfsug.org/pipermail/gpfsug-discuss_gpfsug.org/attachments/20140418/ba3d6bc6/attachment-0004.jpg>
-------------- next part --------------
A non-text attachment was scrubbed...
Name: compose-unknown-contact.jpg
Type: image/jpeg
Size: 770 bytes
Desc: not available
URL: <http://gpfsug.org/pipermail/gpfsug-discuss_gpfsug.org/attachments/20140418/ba3d6bc6/attachment-0005.jpg>

From orlando.richards at ed.ac.uk  Wed Apr 23 14:22:46 2014
From: orlando.richards at ed.ac.uk (Orlando Richards)
Date: Wed, 23 Apr 2014 14:22:46 +0100
Subject: [gpfsug-discuss] Final details for GPFS User Group Meeting 29/4
In-Reply-To: <CAEKnjWJOoweYnDbQ=q5i=aTFjOkYFaSp7o0Uan_T+t63C=sH=A@mail.gmail.com>
References: <CAEKnjWJOoweYnDbQ=q5i=aTFjOkYFaSp7o0Uan_T+t63C=sH=A@mail.gmail.com>
Message-ID: <5357BEA6.20202@ed.ac.uk>

On 23/04/14 13:03, Secretary GPFS UG wrote:
> Unfortunately there is a tube strike planned from around 21:00 on Monday
> 28 April until the morning of Thursday 1 May which may impact your
> journey so please allow yourself plenty of time to register before the
> first presentation gets underway at 11am.
>

Ugh. Any Londoners have advice on how to get to/from Paddington with 
tube strikes ongoing?

-- 
             --
    Dr Orlando Richards
   Information Services
IT Infrastructure Division
        Unix Section
     Tel: 0131 650 4994
   skype: orlando.richards

The University of Edinburgh is a charitable body, registered in 
Scotland, with registration number SC005336.


From bevans at pixitmedia.com  Wed Apr 23 14:37:40 2014
From: bevans at pixitmedia.com (Barry Evans)
Date: Wed, 23 Apr 2014 14:37:40 +0100
Subject: [gpfsug-discuss] Final details for GPFS User Group Meeting 29/4
In-Reply-To: <5357BEA6.20202@ed.ac.uk>
References: <CAEKnjWJOoweYnDbQ=q5i=aTFjOkYFaSp7o0Uan_T+t63C=sH=A@mail.gmail.com>
	<5357BEA6.20202@ed.ac.uk>
Message-ID: <5357C224.6050800@pixitmedia.com>

Last time I think Bakerloo from Paddington to Waterloo was 'OK' - no 
idea if it will be the same this time around. The bigger stations seemed 
to cope pretty well, Central line excluded.

Cheers,
Barry

Orlando Richards wrote:
>
> On 23/04/14 13:03, Secretary GPFS UG wrote:
>>
>> Unfortunately there is a tube strike planned from around 21:00 on Monday
>> 28 April until the morning of Thursday 1 May which may impact your
>> journey so please allow yourself plenty of time to register before the
>> first presentation gets underway at 11am.
>>
>
>
> Ugh. Any Londoners have advice on how to get to/from Paddington with
> tube strikes ongoing?

-- 
This email is confidential in that it is intended for the exclusive 
attention of the addressee(s) indicated. If you are not the intended 
recipient, this email should not be read or disclosed to any other person. 
Please notify the sender immediately and delete this email from your 
computer system. Any opinions expressed are not necessarily those of the 
company from which this email was sent and, whilst to the best of our 
knowledge no viruses or defects exist, no responsibility can be accepted 
for any loss or damage arising from its receipt or subsequent use of this 
email.
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://gpfsug.org/pipermail/gpfsug-discuss_gpfsug.org/attachments/20140423/0d699dbb/attachment-0002.htm>

From Sandra.McLaughlin at astrazeneca.com  Wed Apr 23 15:02:24 2014
From: Sandra.McLaughlin at astrazeneca.com (McLaughlin, Sandra M)
Date: Wed, 23 Apr 2014 14:02:24 +0000
Subject: [gpfsug-discuss] Final details for GPFS User Group Meeting 29/4
In-Reply-To: <5357C224.6050800@pixitmedia.com>
References: <CAEKnjWJOoweYnDbQ=q5i=aTFjOkYFaSp7o0Uan_T+t63C=sH=A@mail.gmail.com>
	<5357BEA6.20202@ed.ac.uk> <5357C224.6050800@pixitmedia.com>
Message-ID: <117e0d974a314151bfd033002b9e553b@DBXPR04MB031.eurprd04.prod.outlook.com>

I was in London last time as well (can?t believe my luck really, that it?s happening again) and the Victoria and Northern lines were OK, and Euston, Victoria and Waterloo were not too bad. So, it wasn?t nearly as bad as I was expecting.

Sandra.

From: gpfsug-discuss-bounces at gpfsug.org [mailto:gpfsug-discuss-bounces at gpfsug.org] On Behalf Of Barry Evans
Sent: 23 April 2014 14:38
To: gpfsug main discussion list
Subject: Re: [gpfsug-discuss] Final details for GPFS User Group Meeting 29/4

Last time I think Bakerloo from Paddington to Waterloo was 'OK' - no idea if it will be the same this time around. The bigger stations seemed to cope pretty well, Central line excluded.

Cheers,
Barry

Orlando Richards wrote:


On 23/04/14 13:03, Secretary GPFS UG wrote:


Unfortunately there is a tube strike planned from around 21:00 on Monday
28 April until the morning of Thursday 1 May which may impact your
journey so please allow yourself plenty of time to register before the
first presentation gets underway at 11am.


Ugh. Any Londoners have advice on how to get to/from Paddington with
tube strikes ongoing?

[https://ci3.googleusercontent.com/proxy/RHzzP7ozZOO_Rz1yGW5TDRhNOfSN5T0D6OEeEfbCAYlYGEUhlUCQkZ7T74jyNAbZ3QtuhRg-Ma1WcWYTzawl94g=s0-d-e1-ft#http://pixitmedia.com/sig/PixitEmailSig.png]
This email is confidential in that it is intended for the exclusive attention of the addressee(s) indicated. If you are not the intended recipient, this email should not be read or disclosed to any other person. Please notify the sender immediately and delete this email from your computer system. Any opinions expressed are not necessarily those of the company from which this email was sent and, whilst to the best of our knowledge no viruses or defects exist, no responsibility can be accepted for any loss or damage arising from its receipt or subsequent use of this email.

--------------------------------------------------------------------------
AstraZeneca UK Limited is a company incorporated in England and Wales with registered number: 03674842 and a registered office at 2 Kingdom Street, London, W2 6BD.
Confidentiality Notice: This message is private and may contain confidential, proprietary and legally privileged information. If you have received this message in error, please notify us and remove it from your system and note that you must not copy, distribute or take any action in reliance on it. Any unauthorised use or disclosure of the contents of this message is not permitted and may be unlawful.
Disclaimer: Email messages may be subject to delays, interception, non-delivery and unauthorised alterations. Therefore, information expressed in this message is not given or endorsed by AstraZeneca UK Limited unless otherwise notified by an authorised representative independent of this message. No contractual relationship is created by this message by any person unless specifically indicated by agreement in writing other than email.
Monitoring: AstraZeneca UK Limited may monitor email traffic data and content for the purposes of the prevention and detection of crime, ensuring the security of our computer systems and checking Compliance with our Code of Conduct and Policies.
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://gpfsug.org/pipermail/gpfsug-discuss_gpfsug.org/attachments/20140423/e79c7343/attachment-0002.htm>

From orlando.richards at ed.ac.uk  Wed Apr 23 15:07:43 2014
From: orlando.richards at ed.ac.uk (Orlando Richards)
Date: Wed, 23 Apr 2014 15:07:43 +0100
Subject: [gpfsug-discuss] Final details for GPFS User Group Meeting 29/4
In-Reply-To: <117e0d974a314151bfd033002b9e553b@DBXPR04MB031.eurprd04.prod.outlook.com>
References: <CAEKnjWJOoweYnDbQ=q5i=aTFjOkYFaSp7o0Uan_T+t63C=sH=A@mail.gmail.com>	<5357BEA6.20202@ed.ac.uk>
	<5357C224.6050800@pixitmedia.com>
	<117e0d974a314151bfd033002b9e553b@DBXPR04MB031.eurprd04.prod.outlook.com>
Message-ID: <5357C92F.1040407@ed.ac.uk>


Good to hear - thanks both!

On 23/04/14 15:02, McLaughlin, Sandra M wrote:
> I was in London last time as well (can?t believe my luck really, that
> it?s happening again) and the Victoria and Northern lines were OK, and
> Euston, Victoria and Waterloo were not too bad. So, it wasn?t nearly as
> bad as I was expecting.
>
> Sandra.
>
> ------------------------------------------------------------------------
>
> AstraZeneca UK Limited is a company incorporated in England and Wales
> with registered number: 03674842 and a registered office at 2 Kingdom
> Street, London, W2 6BD.
>
> *Confidentiality Notice: *This message is private and may contain
> confidential, proprietary and legally privileged information. If you
> have received this message in error, please notify us and remove it from
> your system and note that you must not copy, distribute or take any
> action in reliance on it. Any unauthorised use or disclosure of the
> contents of this message is not permitted and may be unlawful.
>
> *Disclaimer:* Email messages may be subject to delays, interception,
> non-delivery and unauthorised alterations. Therefore, information
> expressed in this message is not given or endorsed by AstraZeneca UK
> Limited unless otherwise notified by an authorised representative
> independent of this message. No contractual relationship is created by
> this message by any person unless specifically indicated by agreement in
> writing other than email.
>
> *Monitoring: *AstraZeneca UK Limited may monitor email traffic data and
> content for the purposes of the prevention and detection of crime,
> ensuring the security of our computer systems and checking compliance
> with our Code of Conduct and policies.
>
> *From:*gpfsug-discuss-bounces at gpfsug.org
> [mailto:gpfsug-discuss-bounces at gpfsug.org] *On Behalf Of *Barry Evans
> *Sent:* 23 April 2014 14:38
> *To:* gpfsug main discussion list
> *Subject:* Re: [gpfsug-discuss] Final details for GPFS User Group
> Meeting 29/4
>
> Last time I think Bakerloo from Paddington to Waterloo was 'OK' - no
> idea if it will be the same this time around. The bigger stations seemed
> to cope pretty well, Central line excluded.
>
> Cheers,
> Barry
>
> Orlando Richards wrote:
>
>
> On 23/04/14 13:03, Secretary GPFS UG wrote:
>
>
> Unfortunately there is a tube strike planned from around 21:00 on Monday
> 28 April until the morning of Thursday 1 May which may impact your
> journey so please allow yourself plenty of time to register before the
> first presentation gets underway at 11am.
>
>
>
> Ugh. Any Londoners have advice on how to get to/from Paddington with
> tube strikes ongoing?
>
>
> This email is confidential in that it is intended for the exclusive
> attention of the addressee(s) indicated. If you are not the intended
> recipient, this email should not be read or disclosed to any other
> person. Please notify the sender immediately and delete this email from
> your computer system. Any opinions expressed are not necessarily those
> of the company from which this email was sent and, whilst to the best of
> our knowledge no viruses or defects exist, no responsibility can be
> accepted for any loss or damage arising from its receipt or subsequent
> use of this email.
>
>
>
> _______________________________________________
> gpfsug-discuss mailing list
> gpfsug-discuss at gpfsug.org
> http://gpfsug.org/mailman/listinfo/gpfsug-discuss
>


-- 
             --
    Dr Orlando Richards
   Information Services
IT Infrastructure Division
        Unix Section
     Tel: 0131 650 4994
   skype: orlando.richards

The University of Edinburgh is a charitable body, registered in 
Scotland, with registration number SC005336.


From chair at gpfsug.org  Wed Apr 23 15:16:27 2014
From: chair at gpfsug.org (Jez Tucker (Chair))
Date: Wed, 23 Apr 2014 15:16:27 +0100
Subject: [gpfsug-discuss] Final details for GPFS User Group Meeting 29/4
In-Reply-To: <5357BEA6.20202@ed.ac.uk>
References: <CAEKnjWJOoweYnDbQ=q5i=aTFjOkYFaSp7o0Uan_T+t63C=sH=A@mail.gmail.com>
	<5357BEA6.20202@ed.ac.uk>
Message-ID: <5357CB3B.4070200@gpfsug.org>

Indeed.
Best laid plans hey?

As others have said, on the day it's usually not that bad if other lines 
are running some tube trains.
Hopefully, they'll call it off at the last moment alike the previous two 
threatened strikes.

We'll handle the day as it pans out.

Jez


On 23/04/14 14:22, Orlando Richards wrote:
> On 23/04/14 13:03, Secretary GPFS UG wrote:
>> Unfortunately there is a tube strike planned from around 21:00 on Monday
>> 28 April until the morning of Thursday 1 May which may impact your
>> journey so please allow yourself plenty of time to register before the
>> first presentation gets underway at 11am.
>>
>
> Ugh. Any Londoners have advice on how to get to/from Paddington with 
> tube strikes ongoing?
>



From chair at gpfsug.org  Fri Apr 25 11:47:42 2014
From: chair at gpfsug.org (Jez Tucker (Chair))
Date: Fri, 25 Apr 2014 11:47:42 +0100
Subject: [gpfsug-discuss] Most tube lines are running during the strike on
	the 29th April
Message-ID: <535A3D4E.7020108@gpfsug.org>

Hi all,

   If you're attending the GPFS User Group on 29th April, you'll no 
doubt be aware of the RMT strike that will be affecting some Tube lines.

It looks like it's not all that bad.  Most lines will be running, bar 
the Central line, Waterloo & City and inner-London Piccadilly.

For precise information, see the PDF on this page: 
http://www.tfl.gov.uk/modes/tube/services-we-expect-to-run

(However, I'd still leave extra time for the journey if at all possible).

See you there.

Best regards,

Jez

GPFS UG Chair




From johnlang at us.ibm.com  Mon Apr 28 21:10:57 2014
From: johnlang at us.ibm.com (John Langlois)
Date: Mon, 28 Apr 2014 16:10:57 -0400
Subject: [gpfsug-discuss] Hello
Message-ID: <OFE9E0899E.22752ABB-ON85257CC8.006E8563-85257CC8.006EEEDA@us.ibm.com>

Hello,

My name is John Langlois and I will be sharing GPFS Product Management 
responsibilities.   Find me on: 

I am very interesting in monitoring this community of GPFS users.  And I 
welcome unsolicited feedback on the problems that you face in your jobs 
every day and how you might use GPFS today or (with a new feature) to 
solve those problems.  What consumes most of your time?  If you had a 
magic wand, how would you use it?   You can write me to help influence the 
future directions of this technology. 

I look forward to collaborating with all of you.

If you are open to a phone interview (again about the jobs you perform), 
please let me know.  I'd love to talk with you directly.


Regards,

John M. Langlois
IBM Software Defined Environment Product Manager

Phone: 1-919-267-6767
E-mail: johnlang at us.ibm.com
Find me on:   and within IBM on:  


-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://gpfsug.org/pipermail/gpfsug-discuss_gpfsug.org/attachments/20140428/976a795d/attachment-0002.htm>
-------------- next part --------------
A non-text attachment was scrubbed...
Name: not available
Type: image/jpeg
Size: 518 bytes
Desc: not available
URL: <http://gpfsug.org/pipermail/gpfsug-discuss_gpfsug.org/attachments/20140428/976a795d/attachment-0008.jpe>
-------------- next part --------------
A non-text attachment was scrubbed...
Name: not available
Type: image/jpeg
Size: 518 bytes
Desc: not available
URL: <http://gpfsug.org/pipermail/gpfsug-discuss_gpfsug.org/attachments/20140428/976a795d/attachment-0009.jpe>
-------------- next part --------------
A non-text attachment was scrubbed...
Name: not available
Type: image/jpeg
Size: 525 bytes
Desc: not available
URL: <http://gpfsug.org/pipermail/gpfsug-discuss_gpfsug.org/attachments/20140428/976a795d/attachment-0010.jpe>
-------------- next part --------------
A non-text attachment was scrubbed...
Name: not available
Type: image/jpeg
Size: 1208 bytes
Desc: not available
URL: <http://gpfsug.org/pipermail/gpfsug-discuss_gpfsug.org/attachments/20140428/976a795d/attachment-0011.jpe>
-------------- next part --------------
A non-text attachment was scrubbed...
Name: not available
Type: image/gif
Size: 1851 bytes
Desc: not available
URL: <http://gpfsug.org/pipermail/gpfsug-discuss_gpfsug.org/attachments/20140428/976a795d/attachment-0002.gif>

From sabujp at gmail.com  Wed Apr  2 22:05:51 2014
From: sabujp at gmail.com (Sabuj Pattanayek)
Date: Wed, 2 Apr 2014 16:05:51 -0500
Subject: [gpfsug-discuss] question about why unix extensions = no is
 recommended when using samba + gpfs?
In-Reply-To: <1394716131.2612.24.camel@buzzard.phy.strath.ac.uk>
References: <CAEeMGHvH84GDv6yEnPgKtNwOhyvXLkbvV2XGtf3vHpJgSuu=Lg@mail.gmail.com>
	<1394705361.16270.9.camel@buzzard.phy.strath.ac.uk>
	<CAEeMGHu4EaiEqa6=qJjHL+4GnkOnQeqh+h5azTHB-1QuqUiTMw@mail.gmail.com>
	<1394716131.2612.24.camel@buzzard.phy.strath.ac.uk>
Message-ID: <CAEeMGHvG4Jf_gZLfKfs8TyERib8L+r42_uWRqP6DQzHvj7_5dg@mail.gmail.com>

So I've been using the recommended gpfs:acl = yes mode for a while on
windows/cifs/smb only shares and today came across a bug where Microsoft
Office (2010, haven't tried other versions) on Windows 7/8 refuses to save
or save as. It can clearly create tmp files (e.g. those ~$... files when it
opens a file) and I can right click -> create a new file, edit files in
notepad/wordpad, drag and drop files between explorer windows but whenever
I try to save a doc/docx or xls/xlsx file it always throws the error dialog
:

There has been a network or file permission error. The network connection
may be lost. (mapped drive:\folder\fileName.docx)

( OK )   ( Help )

Was this information helpful?

If i switch to gpfs:acl = no and then use vfs_acl_xattr instead it works
fine. MS Office on OSX does not have this problem

It's similar to this issue :

https://www.ibm.com/developerworks/community/forums/html/topic?id=77777777-0000-0000-0000-000014299075

Anyone have any ideas without having to use acl_xattr? Again I'm using
sernet samba 4.1.6 and gpfs 3.5.0.11 .

Thanks,
Sabuj



-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://gpfsug.org/pipermail/gpfsug-discuss_gpfsug.org/attachments/20140402/db2df795/attachment-0003.htm>

From sabujp at gmail.com  Wed Apr  2 22:24:14 2014
From: sabujp at gmail.com (Sabuj Pattanayek)
Date: Wed, 2 Apr 2014 16:24:14 -0500
Subject: [gpfsug-discuss] question about why unix extensions = no is
 recommended when using samba + gpfs?
In-Reply-To: <CAEeMGHvG4Jf_gZLfKfs8TyERib8L+r42_uWRqP6DQzHvj7_5dg@mail.gmail.com>
References: <CAEeMGHvH84GDv6yEnPgKtNwOhyvXLkbvV2XGtf3vHpJgSuu=Lg@mail.gmail.com>
	<1394705361.16270.9.camel@buzzard.phy.strath.ac.uk>
	<CAEeMGHu4EaiEqa6=qJjHL+4GnkOnQeqh+h5azTHB-1QuqUiTMw@mail.gmail.com>
	<1394716131.2612.24.camel@buzzard.phy.strath.ac.uk>
	<CAEeMGHvG4Jf_gZLfKfs8TyERib8L+r42_uWRqP6DQzHvj7_5dg@mail.gmail.com>
Message-ID: <CAEeMGHuO5JUNAWAyWv6Oo3rPLvpzKfF0AWdGzgnxyr=nBfVMeQ@mail.gmail.com>

Seems like the workaround for now is to set :

gpfs:sharemodes = no

https://bugzilla.samba.org/show_bug.cgi?id=6762

Could be a regression? Haven't tried 3.5.0.17 yet, but we will be upgrading
to that soon.


On Wed, Apr 2, 2014 at 4:05 PM, Sabuj Pattanayek <sabujp at gmail.com> wrote:

> So I've been using the recommended gpfs:acl = yes mode for a while on
> windows/cifs/smb only shares and today came across a bug where Microsoft
> Office (2010, haven't tried other versions) on Windows 7/8 refuses to save
> or save as. It can clearly create tmp files (e.g. those ~$... files when it
> opens a file) and I can right click -> create a new file, edit files in
> notepad/wordpad, drag and drop files between explorer windows but whenever
> I try to save a doc/docx or xls/xlsx file it always throws the error dialog
> :
>
> There has been a network or file permission error. The network connection
> may be lost. (mapped drive:\folder\fileName.docx)
>
> ( OK )   ( Help )
>
> Was this information helpful?
>
> If i switch to gpfs:acl = no and then use vfs_acl_xattr instead it works
> fine. MS Office on OSX does not have this problem
>
> It's similar to this issue :
>
>
> https://www.ibm.com/developerworks/community/forums/html/topic?id=77777777-0000-0000-0000-000014299075
>
> Anyone have any ideas without having to use acl_xattr? Again I'm using
> sernet samba 4.1.6 and gpfs 3.5.0.11 .
>
> Thanks,
> Sabuj
>
>
>
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://gpfsug.org/pipermail/gpfsug-discuss_gpfsug.org/attachments/20140402/42d9eb85/attachment-0003.htm>

From jonathan at buzzard.me.uk  Wed Apr  2 22:36:28 2014
From: jonathan at buzzard.me.uk (Jonathan Buzzard)
Date: Wed, 02 Apr 2014 22:36:28 +0100
Subject: [gpfsug-discuss] question about why unix extensions = no is
 recommended when using samba + gpfs?
In-Reply-To: <CAEeMGHuO5JUNAWAyWv6Oo3rPLvpzKfF0AWdGzgnxyr=nBfVMeQ@mail.gmail.com>
References: <CAEeMGHvH84GDv6yEnPgKtNwOhyvXLkbvV2XGtf3vHpJgSuu=Lg@mail.gmail.com>
	<1394705361.16270.9.camel@buzzard.phy.strath.ac.uk>
	<CAEeMGHu4EaiEqa6=qJjHL+4GnkOnQeqh+h5azTHB-1QuqUiTMw@mail.gmail.com>
	<1394716131.2612.24.camel@buzzard.phy.strath.ac.uk>
	<CAEeMGHvG4Jf_gZLfKfs8TyERib8L+r42_uWRqP6DQzHvj7_5dg@mail.gmail.com>
	<CAEeMGHuO5JUNAWAyWv6Oo3rPLvpzKfF0AWdGzgnxyr=nBfVMeQ@mail.gmail.com>
Message-ID: <533C82DC.9090402@buzzard.me.uk>

On 02/04/14 22:24, Sabuj Pattanayek wrote:
> Seems like the workaround for now is to set :
>
> gpfs:sharemodes = no
>
> https://bugzilla.samba.org/show_bug.cgi?id=6762

That is doggy ancient ticket, and fixed.


# store DOS attributes in extended attributes (vfs_gpfs then stores them 
in the file system)
	ea support = yes
	store dos attributes = yes
	map readonly = no
	map archive = no
	map system = no
	map hidden = no

Will most likely fix it for you. It is down to Office 2007 onwards 
trying to preserve ACL's on a save. So you should find a save as works, 
no ACL's to preserve but saving an existing file does not.


JAB.

-- 
Jonathan A. Buzzard                 Email: jonathan (at) buzzard.me.uk
Fife, United Kingdom.


From sabujp at gmail.com  Wed Apr  2 22:42:35 2014
From: sabujp at gmail.com (Sabuj Pattanayek)
Date: Wed, 2 Apr 2014 16:42:35 -0500
Subject: [gpfsug-discuss] question about why unix extensions = no is
 recommended when using samba + gpfs?
In-Reply-To: <533C82DC.9090402@buzzard.me.uk>
References: <CAEeMGHvH84GDv6yEnPgKtNwOhyvXLkbvV2XGtf3vHpJgSuu=Lg@mail.gmail.com>
	<1394705361.16270.9.camel@buzzard.phy.strath.ac.uk>
	<CAEeMGHu4EaiEqa6=qJjHL+4GnkOnQeqh+h5azTHB-1QuqUiTMw@mail.gmail.com>
	<1394716131.2612.24.camel@buzzard.phy.strath.ac.uk>
	<CAEeMGHvG4Jf_gZLfKfs8TyERib8L+r42_uWRqP6DQzHvj7_5dg@mail.gmail.com>
	<CAEeMGHuO5JUNAWAyWv6Oo3rPLvpzKfF0AWdGzgnxyr=nBfVMeQ@mail.gmail.com>
	<533C82DC.9090402@buzzard.me.uk>
Message-ID: <CAEeMGHtGDRLQiM4qP62Yuwpp9td+9PCjATNf=S1SS3xhEqw40A@mail.gmail.com>

Yup, I had those settings set already, and neither save as or save worked.


On Wed, Apr 2, 2014 at 4:36 PM, Jonathan Buzzard <jonathan at buzzard.me.uk>wrote:

> On 02/04/14 22:24, Sabuj Pattanayek wrote:
>
>> Seems like the workaround for now is to set :
>>
>> gpfs:sharemodes = no
>>
>> https://bugzilla.samba.org/show_bug.cgi?id=6762
>>
>
> That is doggy ancient ticket, and fixed.
>
>
> # store DOS attributes in extended attributes (vfs_gpfs then stores them
> in the file system)
>         ea support = yes
>         store dos attributes = yes
>         map readonly = no
>         map archive = no
>         map system = no
>         map hidden = no
>
> Will most likely fix it for you. It is down to Office 2007 onwards trying
> to preserve ACL's on a save. So you should find a save as works, no ACL's
> to preserve but saving an existing file does not.
>
>
>
> JAB.
>
> --
> Jonathan A. Buzzard                 Email: jonathan (at) buzzard.me.uk
> Fife, United Kingdom.
> _______________________________________________
> gpfsug-discuss mailing list
> gpfsug-discuss at gpfsug.org
> http://gpfsug.org/mailman/listinfo/gpfsug-discuss
>
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://gpfsug.org/pipermail/gpfsug-discuss_gpfsug.org/attachments/20140402/2827b7c1/attachment-0003.htm>

From jonathan at buzzard.me.uk  Wed Apr  2 23:08:40 2014
From: jonathan at buzzard.me.uk (Jonathan Buzzard)
Date: Wed, 02 Apr 2014 23:08:40 +0100
Subject: [gpfsug-discuss] question about why unix extensions = no is
 recommended when using samba + gpfs?
In-Reply-To: <CAEeMGHtGDRLQiM4qP62Yuwpp9td+9PCjATNf=S1SS3xhEqw40A@mail.gmail.com>
References: <CAEeMGHvH84GDv6yEnPgKtNwOhyvXLkbvV2XGtf3vHpJgSuu=Lg@mail.gmail.com>
	<1394705361.16270.9.camel@buzzard.phy.strath.ac.uk>
	<CAEeMGHu4EaiEqa6=qJjHL+4GnkOnQeqh+h5azTHB-1QuqUiTMw@mail.gmail.com>
	<1394716131.2612.24.camel@buzzard.phy.strath.ac.uk>
	<CAEeMGHvG4Jf_gZLfKfs8TyERib8L+r42_uWRqP6DQzHvj7_5dg@mail.gmail.com>
	<CAEeMGHuO5JUNAWAyWv6Oo3rPLvpzKfF0AWdGzgnxyr=nBfVMeQ@mail.gmail.com>
	<533C82DC.9090402@buzzard.me.uk>
	<CAEeMGHtGDRLQiM4qP62Yuwpp9td+9PCjATNf=S1SS3xhEqw40A@mail.gmail.com>
Message-ID: <533C8A68.7040304@buzzard.me.uk>

On 02/04/14 22:42, Sabuj Pattanayek wrote:
> Yup, I had those settings set already, and neither save as or save worked.
>

You need to provide more information. Much more of your smb.conf, what 
OS, Samba, and GPFS, along with your GPFS config.

Have you tested that the DOS attributes are correctly being stored in 
the GPFS file system?

It explicitly does work. The issues are all around Office trying to 
preserve ACL's which the vast majority of software does not.

Are you running with NFSv4 ACL's *ONLY* on GPFS? Using Posix or Posix 
and NFSv4 together is likely to lead to problems.


JAB.

-- 
Jonathan A. Buzzard                 Email: jonathan (at) buzzard.me.uk
Fife, United Kingdom.


From sabujp at gmail.com  Thu Apr  3 03:08:40 2014
From: sabujp at gmail.com (Sabuj Pattanayek)
Date: Wed, 2 Apr 2014 21:08:40 -0500
Subject: [gpfsug-discuss] question about why unix extensions = no is
 recommended when using samba + gpfs?
In-Reply-To: <533C8A68.7040304@buzzard.me.uk>
References: <CAEeMGHvH84GDv6yEnPgKtNwOhyvXLkbvV2XGtf3vHpJgSuu=Lg@mail.gmail.com>
	<1394705361.16270.9.camel@buzzard.phy.strath.ac.uk>
	<CAEeMGHu4EaiEqa6=qJjHL+4GnkOnQeqh+h5azTHB-1QuqUiTMw@mail.gmail.com>
	<1394716131.2612.24.camel@buzzard.phy.strath.ac.uk>
	<CAEeMGHvG4Jf_gZLfKfs8TyERib8L+r42_uWRqP6DQzHvj7_5dg@mail.gmail.com>
	<CAEeMGHuO5JUNAWAyWv6Oo3rPLvpzKfF0AWdGzgnxyr=nBfVMeQ@mail.gmail.com>
	<533C82DC.9090402@buzzard.me.uk>
	<CAEeMGHtGDRLQiM4qP62Yuwpp9td+9PCjATNf=S1SS3xhEqw40A@mail.gmail.com>
	<533C8A68.7040304@buzzard.me.uk>
Message-ID: <CAEeMGHvFDgP-7i-fy8KnFCoJra13CB5X6RNKacjBWUUq2Zp8HA@mail.gmail.com>

On Wed, Apr 2, 2014 at 5:08 PM, Jonathan Buzzard <jonathan at buzzard.me.uk>wrote:

> On 02/04/14 22:42, Sabuj Pattanayek wrote:
>
>> Yup, I had those settings set already, and neither save as or save worked.
>>
>>
> You need to provide more information. Much more of your smb.conf, what OS,
> Samba, and GPFS, along with your GPFS config.
>

rhel  6.3, 2.6.32-279.31.1.el6.x86_64, sernet samba 4.1.6, ctdb
1.0.114.7-1, gpfs 3.5.0.11, gpfs config farther down :

### smb.conf ###

[global]
workgroup = DOMAIN
netbios name = gpfs-smb-server
password server = dc-1.ds.domain.edu dc-2.ds.domain.edu dc-3.ds.domain.edu
realm = DS.DOMAIN.EDU
security = ads
encrypt passwords = yes
allow trusted domains = No
idmap config *:backend = tdb
idmap config *:range = 4000000 - 5000000
idmap config DOMAIN : backend  = rid
idmap config DOMAIN : range    = 5000001 - 9000000
template shell = /bin/bash
template homedir = /home/%U
winbind offline logon = false
winbind trusted domains only = no
winbind use default domain = yes
# ldap handles users
winbind enum users  = no
winbind enum groups = no
winbind expand groups = 3
server string = SMB
log file = /var/log/samba/log.%m
max log size = 50
passdb backend = tdbsam

clustering = yes
unix extensions = yes

include = /etc/samba/template_shares.conf
include = /etc/samba/test_shares.conf

### template_shares.conf ###

[template_nfs4]
comment = GPFS Cluster on smb using %R protocol
path = /dors/testfs
writeable = yes
vfs objects = shadow_copy2 gpfs fileid
ea support = yes
store dos attributes = yes
access based share enum = yes
map readonly = no
map archive = no
map system = no
mangled names = no
force unknown acl user = yes
locking = yes
notify:inotify = no
shadow:snapdir = .snapshots
shadow:localtime = yes
shadow:format = %Y%m%d_%H:%M
shadow:fixinodes = yes
shadow:snapdirseverywhere = yes
shadow:sort = desc
# vfs_gpfs settings
gpfs:acl = yes
gpfs:winattr = yes
gpfs:dfreequota = yes
nfs4:mode = simple
nfs4:chown = yes
nfs4:acedup = merge
## needed to turn off sharemodes, msoffice on windows couldn't save
# https://bugzilla.samba.org/show_bug.cgi?id=6762
gpfs:sharemodes = no
gpfs:leases = yes
posix locking = yes
kernel oplocks = no
kernel share modes = yes
fileid:algorithm = fsname



>
> Have you tested that the DOS attributes are correctly being stored in the
> GPFS file system?
>

No, but they're all set to no, including map hidden which was missing above
but according to man smb.conf is by default set to no, so wouldn't these
not be mapped/stored in GPFS anyways? What EA file would these be stored in
if these were set to yes?


>
> It explicitly does work. The issues are all around Office trying to
> preserve ACL's which the vast majority of software does not.
>

Understood, but again, with the setup above, I had to turn sharemodes off
to get it to work. Setting it to no was mentioned in a comment in that
samba bug by Volker, i.e. I just didn't think of that myself, so there must
be some correlation.


> Are you running with NFSv4 ACL's *ONLY* on GPFS? Using Posix or Posix and
> NFSv4 together is likely to lead to problems.


posix + nfs4, it can be problematic but we're working around it.

# mmlsfs dors
flag                value                    description
------------------- ------------------------
-----------------------------------
 -f                 2048                     Minimum fragment size in bytes
(system pool)
                    32768                    Minimum fragment size in bytes
(other pools)
 -i                 512                      Inode size in bytes
 -I                 32768                    Indirect block size in bytes
 -m                 1                        Default number of metadata
replicas
 -M                 2                        Maximum number of metadata
replicas
 -r                 1                        Default number of data replicas
 -R                 2                        Maximum number of data replicas
 -j                 scatter                  Block allocation type
 -D                 nfs4                     File locking semantics in
effect
 -k                 all                      ACL semantics in effect
 -n                 2000                     Estimated number of nodes that
will mount file system
 -B                 65536                    Block size (system pool)
                    1048576                  Block size (other pools)
 -Q                 user;group;fileset       Quotas enforced
                    none                     Default quotas enabled
 --filesetdf        Yes                      Fileset df enabled?
 -V                 13.23 (3.5.0.7)          File system version
 --create-time      Thu Nov  7 11:29:46 2013 File system creation time
 -u                 Yes                      Support for large LUNs?
 -z                 No                       Is DMAPI enabled?
 -L                 16777216                 Logfile size
 -E                 Yes                      Exact mtime mount option
 -S                 No                       Suppress atime mount option
 -K                 whenpossible             Strict replica allocation
option
 --fastea           Yes                      Fast external attributes
enabled?
 --inode-limit      524288000                Maximum number of inodes
 -P                 system;capacity;fast     Disk storage pools in file
system
 -d
3T_7K_0;3T_7K_1;3T_7K_2;3T_7K_3;3T_7K_4;3T_7K_5;3T_7K_6;3T_7K_7;3T_7K_8;3T_7K_9;3T_7K_10;3T_7K_11;3T_7K_12;3T_7K_13;900GB_10K_0;900GB_10K_1;900GB_10K_2;900GB_10K_3;
 -d
900GB_10K_4;900GB_10K_5;900GB_10K_6;900GB_10K_7;900GB_10K_8;900GB_10K_9;900GB_10K_10;900GB_10K_11;900GB_10K_12;900GB_10K_13;900GB_10K_14;900GB_10K_15;900GB_10K_16;
 -d
900GB_10K_17;900GB_10K_18;900GB_10K_19;400GB_SSD_0;400GB_SSD_1;400GB_SSD_2;400GB_SSD_3;400GB_SSD_4
 Disks in file system
 --perfileset-quota yes                      Per-fileset quota enforcement
 -A                 yes                      Automatic mount option
 -o                 none                     Additional mount options
 -T                 /dors                    Default mount point
 --mount-priority   0                        Mount priority

A funny thing I noticed was that if I set security settings through the
security properties dialog in windows on a share with gpfs:acl = yes, it
sets posix acl's and doesn't automatically promote the acl's to nfs4. The
top level acl on a share directory has to be set to nfs4 before you set
users loose on it and at least one acl (a user / group on that directory)
has to have DirInherit:FileInherit otherwise files and directories beneath
that directory don't get set with nfs4 acl's which then breaks things like
Windows being able to discern the difference between full and modify
privileges (since posix only provides rwx, samba doesn't seem to care about
the 'c' acl provided by gpfs).

Several other strange behaviors I noticed :

* Turning inheritance off through the windows security -> advanced dialog
doesn't work unless you delete (or add I guess, but didn't try adding an
acl) some acl, either the group/user that you're trying to disable
inheritance for (which then means you have to re-add that group with
inheritance disabled) or some other group / user that you don't care about.
For example to disable inheritance on a directory for a group, you'd add a
dummy user/group acl to that directory, disable inheritance for the
group/user you want to disable inheritance for, then delete that dummy
group, otherwise clicking apply -> ok, backing out and then going back in
doesn't change the inheritance settings in either the advanced security
dialog or FileInherit, DirInherit, or Inherit acls in the output of
mmgetacl.

* robocopy y: z: /mir /COPY:DATSO throws "something is wrong with the
device. Failed to set NTACL ... " error 31 errors if your'e trying to copy
ACLs and data from some other share, but it still ends up copying the ACL's
properly! The problem is that robocopy doesn't complete, it only descends
one directory level at a time per robocopy run when it throws all these
errors. So you have to keep running robocopy in a loop from a .bat script
or manually keep running it until you think it's actually copied over all
the ACL's. This doesn't happen with acl_xattr, but acl_xattr has other
issues as well.

* Does any of the auditing tab stuff work? Samba has auditing via log
files, but this seems to be something that's stored in NTFS?

* I haven't tried anything from the quota tab, can it actually set GPFS
quotas somehow? I guess in windows you can set per directory quotas, the
closest thing would be filesets linked to directories with user/group
quotas within that fileset, but I don't think that tab is going to let you
do that.

Thanks,
Sabuj
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://gpfsug.org/pipermail/gpfsug-discuss_gpfsug.org/attachments/20140402/d5dedd94/attachment-0003.htm>

From sabujp at gmail.com  Thu Apr  3 03:11:43 2014
From: sabujp at gmail.com (Sabuj Pattanayek)
Date: Wed, 2 Apr 2014 21:11:43 -0500
Subject: [gpfsug-discuss] question about why unix extensions = no is
 recommended when using samba + gpfs?
In-Reply-To: <CAEeMGHvFDgP-7i-fy8KnFCoJra13CB5X6RNKacjBWUUq2Zp8HA@mail.gmail.com>
References: <CAEeMGHvH84GDv6yEnPgKtNwOhyvXLkbvV2XGtf3vHpJgSuu=Lg@mail.gmail.com>
	<1394705361.16270.9.camel@buzzard.phy.strath.ac.uk>
	<CAEeMGHu4EaiEqa6=qJjHL+4GnkOnQeqh+h5azTHB-1QuqUiTMw@mail.gmail.com>
	<1394716131.2612.24.camel@buzzard.phy.strath.ac.uk>
	<CAEeMGHvG4Jf_gZLfKfs8TyERib8L+r42_uWRqP6DQzHvj7_5dg@mail.gmail.com>
	<CAEeMGHuO5JUNAWAyWv6Oo3rPLvpzKfF0AWdGzgnxyr=nBfVMeQ@mail.gmail.com>
	<533C82DC.9090402@buzzard.me.uk>
	<CAEeMGHtGDRLQiM4qP62Yuwpp9td+9PCjATNf=S1SS3xhEqw40A@mail.gmail.com>
	<533C8A68.7040304@buzzard.me.uk>
	<CAEeMGHvFDgP-7i-fy8KnFCoJra13CB5X6RNKacjBWUUq2Zp8HA@mail.gmail.com>
Message-ID: <CAEeMGHsaX+3+zEcbCOAM689a_ZFKd5hqkmEGjfHcZ3mxNjG-_Q@mail.gmail.com>

Forgot one,

### test_shares.conf ###

[testfs]
comment = GPFS Cluster on DORS using %R protocol
path = /dors/testfs
copy = template_nfs4
admin users = "DOMAIN\userImLoggingInWith"


It doesn't matter if I login with an "admin user" or a regular user allowed
by NFS4 (NTACLs) set via the security tab. The same problems happen with
save/save as unless gpfs:sharemodes = no .


On Wed, Apr 2, 2014 at 9:08 PM, Sabuj Pattanayek <sabujp at gmail.com> wrote:

>
>
>
> On Wed, Apr 2, 2014 at 5:08 PM, Jonathan Buzzard <jonathan at buzzard.me.uk>wrote:
>
>> On 02/04/14 22:42, Sabuj Pattanayek wrote:
>>
>>> Yup, I had those settings set already, and neither save as or save
>>> worked.
>>>
>>>
>> You need to provide more information. Much more of your smb.conf, what
>> OS, Samba, and GPFS, along with your GPFS config.
>>
>
> rhel  6.3, 2.6.32-279.31.1.el6.x86_64, sernet samba 4.1.6, ctdb
> 1.0.114.7-1, gpfs 3.5.0.11, gpfs config farther down :
>
> ### smb.conf ###
>
> [global]
> workgroup = DOMAIN
> netbios name = gpfs-smb-server
> password server = dc-1.ds.domain.edu dc-2.ds.domain.edu dc-3.ds.domain.edu
> realm = DS.DOMAIN.EDU
> security = ads
> encrypt passwords = yes
> allow trusted domains = No
> idmap config *:backend = tdb
> idmap config *:range = 4000000 - 5000000
> idmap config DOMAIN : backend  = rid
> idmap config DOMAIN : range    = 5000001 - 9000000
> template shell = /bin/bash
> template homedir = /home/%U
> winbind offline logon = false
> winbind trusted domains only = no
> winbind use default domain = yes
> # ldap handles users
> winbind enum users  = no
> winbind enum groups = no
> winbind expand groups = 3
> server string = SMB
> log file = /var/log/samba/log.%m
> max log size = 50
> passdb backend = tdbsam
>
> clustering = yes
> unix extensions = yes
>
> include = /etc/samba/template_shares.conf
> include = /etc/samba/test_shares.conf
>
> ### template_shares.conf ###
>
> [template_nfs4]
> comment = GPFS Cluster on smb using %R protocol
> path = /dors/testfs
> writeable = yes
> vfs objects = shadow_copy2 gpfs fileid
> ea support = yes
> store dos attributes = yes
> access based share enum = yes
> map readonly = no
> map archive = no
> map system = no
> mangled names = no
> force unknown acl user = yes
> locking = yes
> notify:inotify = no
> shadow:snapdir = .snapshots
> shadow:localtime = yes
> shadow:format = %Y%m%d_%H:%M
> shadow:fixinodes = yes
> shadow:snapdirseverywhere = yes
> shadow:sort = desc
> # vfs_gpfs settings
> gpfs:acl = yes
> gpfs:winattr = yes
> gpfs:dfreequota = yes
> nfs4:mode = simple
> nfs4:chown = yes
> nfs4:acedup = merge
> ## needed to turn off sharemodes, msoffice on windows couldn't save
> # https://bugzilla.samba.org/show_bug.cgi?id=6762
> gpfs:sharemodes = no
> gpfs:leases = yes
> posix locking = yes
> kernel oplocks = no
> kernel share modes = yes
> fileid:algorithm = fsname
>
>
>
>>
>> Have you tested that the DOS attributes are correctly being stored in the
>> GPFS file system?
>>
>
> No, but they're all set to no, including map hidden which was missing
> above but according to man smb.conf is by default set to no, so wouldn't
> these not be mapped/stored in GPFS anyways? What EA file would these be
> stored in if these were set to yes?
>
>
>>
>> It explicitly does work. The issues are all around Office trying to
>> preserve ACL's which the vast majority of software does not.
>>
>
> Understood, but again, with the setup above, I had to turn sharemodes off
> to get it to work. Setting it to no was mentioned in a comment in that
> samba bug by Volker, i.e. I just didn't think of that myself, so there must
> be some correlation.
>
>
>> Are you running with NFSv4 ACL's *ONLY* on GPFS? Using Posix or Posix and
>> NFSv4 together is likely to lead to problems.
>
>
> posix + nfs4, it can be problematic but we're working around it.
>
> # mmlsfs dors
> flag                value                    description
> ------------------- ------------------------
> -----------------------------------
>  -f                 2048                     Minimum fragment size in
> bytes (system pool)
>                     32768                    Minimum fragment size in
> bytes (other pools)
>  -i                 512                      Inode size in bytes
>  -I                 32768                    Indirect block size in bytes
>  -m                 1                        Default number of metadata
> replicas
>  -M                 2                        Maximum number of metadata
> replicas
>  -r                 1                        Default number of data
> replicas
>  -R                 2                        Maximum number of data
> replicas
>  -j                 scatter                  Block allocation type
>  -D                 nfs4                     File locking semantics in
> effect
>  -k                 all                      ACL semantics in effect
>  -n                 2000                     Estimated number of nodes
> that will mount file system
>  -B                 65536                    Block size (system pool)
>                     1048576                  Block size (other pools)
>  -Q                 user;group;fileset       Quotas enforced
>                     none                     Default quotas enabled
>  --filesetdf        Yes                      Fileset df enabled?
>  -V                 13.23 (3.5.0.7)          File system version
>  --create-time      Thu Nov  7 11:29:46 2013 File system creation time
>  -u                 Yes                      Support for large LUNs?
>  -z                 No                       Is DMAPI enabled?
>  -L                 16777216                 Logfile size
>  -E                 Yes                      Exact mtime mount option
>  -S                 No                       Suppress atime mount option
>  -K                 whenpossible             Strict replica allocation
> option
>  --fastea           Yes                      Fast external attributes
> enabled?
>  --inode-limit      524288000                Maximum number of inodes
>  -P                 system;capacity;fast     Disk storage pools in file
> system
>  -d
> 3T_7K_0;3T_7K_1;3T_7K_2;3T_7K_3;3T_7K_4;3T_7K_5;3T_7K_6;3T_7K_7;3T_7K_8;3T_7K_9;3T_7K_10;3T_7K_11;3T_7K_12;3T_7K_13;900GB_10K_0;900GB_10K_1;900GB_10K_2;900GB_10K_3;
>  -d
> 900GB_10K_4;900GB_10K_5;900GB_10K_6;900GB_10K_7;900GB_10K_8;900GB_10K_9;900GB_10K_10;900GB_10K_11;900GB_10K_12;900GB_10K_13;900GB_10K_14;900GB_10K_15;900GB_10K_16;
>  -d
> 900GB_10K_17;900GB_10K_18;900GB_10K_19;400GB_SSD_0;400GB_SSD_1;400GB_SSD_2;400GB_SSD_3;400GB_SSD_4
>  Disks in file system
>  --perfileset-quota yes                      Per-fileset quota enforcement
>  -A                 yes                      Automatic mount option
>  -o                 none                     Additional mount options
>  -T                 /dors                    Default mount point
>  --mount-priority   0                        Mount priority
>
> A funny thing I noticed was that if I set security settings through the
> security properties dialog in windows on a share with gpfs:acl = yes, it
> sets posix acl's and doesn't automatically promote the acl's to nfs4. The
> top level acl on a share directory has to be set to nfs4 before you set
> users loose on it and at least one acl (a user / group on that directory)
> has to have DirInherit:FileInherit otherwise files and directories beneath
> that directory don't get set with nfs4 acl's which then breaks things like
> Windows being able to discern the difference between full and modify
> privileges (since posix only provides rwx, samba doesn't seem to care about
> the 'c' acl provided by gpfs).
>
> Several other strange behaviors I noticed :
>
> * Turning inheritance off through the windows security -> advanced dialog
> doesn't work unless you delete (or add I guess, but didn't try adding an
> acl) some acl, either the group/user that you're trying to disable
> inheritance for (which then means you have to re-add that group with
> inheritance disabled) or some other group / user that you don't care about.
> For example to disable inheritance on a directory for a group, you'd add a
> dummy user/group acl to that directory, disable inheritance for the
> group/user you want to disable inheritance for, then delete that dummy
> group, otherwise clicking apply -> ok, backing out and then going back in
> doesn't change the inheritance settings in either the advanced security
> dialog or FileInherit, DirInherit, or Inherit acls in the output of
> mmgetacl.
>
> * robocopy y: z: /mir /COPY:DATSO throws "something is wrong with the
> device. Failed to set NTACL ... " error 31 errors if your'e trying to copy
> ACLs and data from some other share, but it still ends up copying the ACL's
> properly! The problem is that robocopy doesn't complete, it only descends
> one directory level at a time per robocopy run when it throws all these
> errors. So you have to keep running robocopy in a loop from a .bat script
> or manually keep running it until you think it's actually copied over all
> the ACL's. This doesn't happen with acl_xattr, but acl_xattr has other
> issues as well.
>
> * Does any of the auditing tab stuff work? Samba has auditing via log
> files, but this seems to be something that's stored in NTFS?
>
> * I haven't tried anything from the quota tab, can it actually set GPFS
> quotas somehow? I guess in windows you can set per directory quotas, the
> closest thing would be filesets linked to directories with user/group
> quotas within that fileset, but I don't think that tab is going to let you
> do that.
>
> Thanks,
> Sabuj
>
>
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://gpfsug.org/pipermail/gpfsug-discuss_gpfsug.org/attachments/20140402/660ee76b/attachment-0003.htm>

From jonathan at buzzard.me.uk  Thu Apr  3 15:45:29 2014
From: jonathan at buzzard.me.uk (Jonathan Buzzard)
Date: Thu, 03 Apr 2014 15:45:29 +0100
Subject: [gpfsug-discuss] question about why unix extensions = no is
 recommended when using samba + gpfs?
In-Reply-To: <CAEeMGHvFDgP-7i-fy8KnFCoJra13CB5X6RNKacjBWUUq2Zp8HA@mail.gmail.com>
References: <CAEeMGHvH84GDv6yEnPgKtNwOhyvXLkbvV2XGtf3vHpJgSuu=Lg@mail.gmail.com>
	<1394705361.16270.9.camel@buzzard.phy.strath.ac.uk>
	<CAEeMGHu4EaiEqa6=qJjHL+4GnkOnQeqh+h5azTHB-1QuqUiTMw@mail.gmail.com>
	<1394716131.2612.24.camel@buzzard.phy.strath.ac.uk>
	<CAEeMGHvG4Jf_gZLfKfs8TyERib8L+r42_uWRqP6DQzHvj7_5dg@mail.gmail.com>
	<CAEeMGHuO5JUNAWAyWv6Oo3rPLvpzKfF0AWdGzgnxyr=nBfVMeQ@mail.gmail.com>
	<533C82DC.9090402@buzzard.me.uk>
	<CAEeMGHtGDRLQiM4qP62Yuwpp9td+9PCjATNf=S1SS3xhEqw40A@mail.gmail.com>
	<533C8A68.7040304@buzzard.me.uk>
	<CAEeMGHvFDgP-7i-fy8KnFCoJra13CB5X6RNKacjBWUUq2Zp8HA@mail.gmail.com>
Message-ID: <533D7409.3090002@buzzard.me.uk>

On 03/04/14 03:08, Sabuj Pattanayek wrote:

[SNIP]
>
> include = /etc/samba/template_shares.conf
> include = /etc/samba/test_shares.conf

That is stupid, you need to use registry share definitions with CTDB. 
Having them in files is bad bad bad.

>
> ### template_shares.conf ###
>
> [template_nfs4]
> comment = GPFS Cluster on smb using %R protocol
> path = /dors/testfs
> writeable = yes
> vfs objects = shadow_copy2 gpfs fileid

Hum, might have changed in Samba 4.x but in Samba 3.5/3.6 you can only 
have one vfs objects line in the entire smb.conf file and I did not 
thing it was a per share option either. Well you can have more than one, 
but the later ones just override the previous ones.

> ea support = yes
> store dos attributes = yes
> access based share enum = yes
> map readonly = no
> map archive = no
> map system = no
> mangled names = no
> force unknown acl user = yes
> locking = yes
> notify:inotify = no
> shadow:snapdir = .snapshots
> shadow:localtime = yes
> shadow:format = %Y%m%d_%H:%M
> shadow:fixinodes = yes
> shadow:snapdirseverywhere = yes
> shadow:sort = desc
> # vfs_gpfs settings
> gpfs:acl = yes
> gpfs:winattr = yes
> gpfs:dfreequota = yes
> nfs4:mode = simple
> nfs4:chown = yes
> nfs4:acedup = merge
> ## needed to turn off sharemodes, msoffice on windows couldn't save
> # https://bugzilla.samba.org/show_bug.cgi?id=6762
> gpfs:sharemodes = no

I am not well versed with Samba 4.x but a quick check says that share 
modes = yes conflicts with SMB2 and durable handles. Given in Samba 4.1 
max protocol is SMB2 by default ...

I have not seen a definitive answer anywhere about whether SMB2 and CTDB 
can be used in combination and if so what versions of CTDB/Samba one 
should be using however.

> gpfs:leases = yes
> posix locking = yes
> kernel oplocks = no
> kernel share modes = yes
> fileid:algorithm = fsname
>
>
>
>     Have you tested that the DOS attributes are correctly being stored
>     in the GPFS file system?
>
>
> No, but they're all set to no, including map hidden which was missing
> above but according to man smb.conf is by default set to no, so wouldn't
> these not be mapped/stored in GPFS anyways? What EA file would these be
> stored in if these were set to yes?

They are not stored in an extended attribute they are stored in the GPFS 
file system itself. The various settings that I listed are so that Samba 
tells the GPFS VFS module to store them in the extended attributes. 
Howeve the GPFS VFS module then goes and stores/retrieves them directly 
from the file system. It's all part of GPFS being able to run on 
Windows. There are genuine file creation times as well

I suggest that you explicitly test and make sure it is working.

>
>
>     It explicitly does work. The issues are all around Office trying to
>     preserve ACL's which the vast majority of software does not.
>
>
> Understood, but again, with the setup above, I had to turn sharemodes
> off to get it to work. Setting it to no was mentioned in a comment in u
> that samba bug by Volker, i.e. I just didn't think of that myself, so
> there must be some correlation.
>
>
>     Are you running with NFSv4 ACL's *ONLY* on GPFS? Using Posix or
>     Posix and NFSv4 together is likely to lead to problems.
>
>
> posix + nfs4, it can be problematic but we're working around it.
>

Put simply no you are not working around it, it is the cause of your 
issues with Office. More precisely the issue with Office is down to how 
the mapping of NTFS ACLS to GPFS is working, because storing the NTFS 
ACLS in extended attributes works. I am telling you don't mix Posix and 
NFSv4 ACL's in GPFS it won't work. Whether you listen is up to you.

I suggest you use a development/test GPFS cluster to verify it.


JAB.

-- 
Jonathan A. Buzzard                 Email: jonathan (at) buzzard.me.uk
Fife, United Kingdom.


From sabujp at gmail.com  Thu Apr  3 18:23:59 2014
From: sabujp at gmail.com (Sabuj Pattanayek)
Date: Thu, 3 Apr 2014 12:23:59 -0500
Subject: [gpfsug-discuss] question about why unix extensions = no is
 recommended when using samba + gpfs?
In-Reply-To: <533D7409.3090002@buzzard.me.uk>
References: <CAEeMGHvH84GDv6yEnPgKtNwOhyvXLkbvV2XGtf3vHpJgSuu=Lg@mail.gmail.com>
	<1394705361.16270.9.camel@buzzard.phy.strath.ac.uk>
	<CAEeMGHu4EaiEqa6=qJjHL+4GnkOnQeqh+h5azTHB-1QuqUiTMw@mail.gmail.com>
	<1394716131.2612.24.camel@buzzard.phy.strath.ac.uk>
	<CAEeMGHvG4Jf_gZLfKfs8TyERib8L+r42_uWRqP6DQzHvj7_5dg@mail.gmail.com>
	<CAEeMGHuO5JUNAWAyWv6Oo3rPLvpzKfF0AWdGzgnxyr=nBfVMeQ@mail.gmail.com>
	<533C82DC.9090402@buzzard.me.uk>
	<CAEeMGHtGDRLQiM4qP62Yuwpp9td+9PCjATNf=S1SS3xhEqw40A@mail.gmail.com>
	<533C8A68.7040304@buzzard.me.uk>
	<CAEeMGHvFDgP-7i-fy8KnFCoJra13CB5X6RNKacjBWUUq2Zp8HA@mail.gmail.com>
	<533D7409.3090002@buzzard.me.uk>
Message-ID: <CAEeMGHs7UyiFfu6zi5SZHvcUW0aYhQ21dYptVz_CcB5UaPww-A@mail.gmail.com>

> include = /etc/samba/template_shares.conf
>> include = /etc/samba/test_shares.conf
>>
>
> That is stupid, you need to use registry share definitions with CTDB.
> Having them in files is bad bad bad.


Will look into it.


> ### template_shares.conf ###
>
>>
>> [template_nfs4]
>> comment = GPFS Cluster on smb using %R protocol
>> path = /dors/testfs
>> writeable = yes
>> vfs objects = shadow_copy2 gpfs fileid
>>
>
> Hum, might have changed in Samba 4.x but in Samba 3.5/3.6 you can only
> have one vfs objects line in the entire smb.conf file and I did not thing
> it was a per share option either. Well you can have more than one, but the
> later ones just override the previous ones.



Yup, it's definitely per share in 4.1.x and the later ones probably do
override the previous one if the same vfs functions are overloaded, but in
the case above there's no overlap and shadow_copy2 and gpfs do work.



>
> I am not well versed with Samba 4.x but a quick check says that share
> modes = yes conflicts with SMB2 and durable handles. Given in Samba 4.1 max
> protocol is SMB2 by default ...
>

I was able to do SMB2 (at least in terms of performance over SMBv1) with
sharemodes = yes or sharemodes = no. Durable / persistent handles don't
work in that active read/write I/O will not continue if  smb/ctdb is
disabled on one of the samba nodes. The client will not have to
re-map/re-connect but any active I/O other than file deletions and perhaps
metadata operations will continue unaffected.


>
> I have not seen a definitive answer anywhere about whether SMB2 and CTDB
> can be used in combination and if so what versions of CTDB/Samba one should
> be using however.


I'm using ctdb 1.0.114 packaged by sernet along with sernet samba 4.1.6 .
They said they would release re-packaged v2 rpm at some point. Again, SMB2
works in so far as I can tell with its much improved read/write performance
over SMB1.


>>
>> No, but they're all set to no, including map hidden which was missing
>> above but according to man smb.conf is by default set to no, so wouldn't
>> these not be mapped/stored in GPFS anyways? What EA file would these be
>> stored in if these were set to yes?
>>
>
> They are not stored in an extended attribute they are stored in the GPFS
> file system itself. The various settings that I listed are so that Samba
> tells the GPFS VFS module to store them in the extended attributes. Howeve
> the GPFS VFS module then goes and stores/retrieves them directly from the
> file system. It's all part of GPFS being able to run on Windows. There are
> genuine file creation times as well
>
> I suggest that you explicitly test and make sure it is working.
>

Yup, they're working, they're being stored wherever they're supposed to be
stored in GPFS itself. I set a file to hidden and it disappeared from the
explorer window. Went into a command prompt and ran dir/a and it appeared.
Then ran mmlsattr -L on the file and it showed ARCHIVE HIDDEN in the
Windows attributes section.



> Put simply no you are not working around it, it is the cause of your
> issues with Office. More precisely the issue with Office is down to how the
> mapping of NTFS ACLS to GPFS is working, because storing the NTFS ACLS in
> extended attributes works. I am telling you don't mix Posix and NFSv4 ACL's
> in GPFS it won't work. Whether you listen is up to you.
>

It doesn't work if the ACL on the file is POSIX or has been promoted to
NFS4. In any case, we have need for the ACLs support to be both POSIX and
NFS4 where needed for the window shares and we can't/won't split up the
filesystem.


>
> I suggest you use a development/test GPFS cluster to verify it.


Yes, we're going to need a test/dev cluster for testing these for future
upgrades, etc so I will try an FS that's pure nfs4 ACLs only and see if it
behaves any differently.
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://gpfsug.org/pipermail/gpfsug-discuss_gpfsug.org/attachments/20140403/5f38f99f/attachment-0003.htm>

From sabujp at gmail.com  Thu Apr  3 18:26:00 2014
From: sabujp at gmail.com (Sabuj Pattanayek)
Date: Thu, 3 Apr 2014 12:26:00 -0500
Subject: [gpfsug-discuss] question about why unix extensions = no is
 recommended when using samba + gpfs?
In-Reply-To: <CAEeMGHs7UyiFfu6zi5SZHvcUW0aYhQ21dYptVz_CcB5UaPww-A@mail.gmail.com>
References: <CAEeMGHvH84GDv6yEnPgKtNwOhyvXLkbvV2XGtf3vHpJgSuu=Lg@mail.gmail.com>
	<1394705361.16270.9.camel@buzzard.phy.strath.ac.uk>
	<CAEeMGHu4EaiEqa6=qJjHL+4GnkOnQeqh+h5azTHB-1QuqUiTMw@mail.gmail.com>
	<1394716131.2612.24.camel@buzzard.phy.strath.ac.uk>
	<CAEeMGHvG4Jf_gZLfKfs8TyERib8L+r42_uWRqP6DQzHvj7_5dg@mail.gmail.com>
	<CAEeMGHuO5JUNAWAyWv6Oo3rPLvpzKfF0AWdGzgnxyr=nBfVMeQ@mail.gmail.com>
	<533C82DC.9090402@buzzard.me.uk>
	<CAEeMGHtGDRLQiM4qP62Yuwpp9td+9PCjATNf=S1SS3xhEqw40A@mail.gmail.com>
	<533C8A68.7040304@buzzard.me.uk>
	<CAEeMGHvFDgP-7i-fy8KnFCoJra13CB5X6RNKacjBWUUq2Zp8HA@mail.gmail.com>
	<533D7409.3090002@buzzard.me.uk>
	<CAEeMGHs7UyiFfu6zi5SZHvcUW0aYhQ21dYptVz_CcB5UaPww-A@mail.gmail.com>
Message-ID: <CAEeMGHuNe8tWuYZM_XbrV7LNqfrpCC4Um7Vo6FJeeYRiJ4HzSQ@mail.gmail.com>

I was able to do SMB2 (at least in terms of performance over SMBv1) with
> sharemodes = yes or sharemodes = no. Durable / persistent handles don't
> work in that active read/write I/O will not continue if  smb/ctdb is
> disabled on one of the samba nodes. The client will not have to
> re-map/re-connect but any active I/O other than file deletions and perhaps
> metadata operations will continue unaffected.
>

should be "any active I/O other than file deletions and perhaps metadata
operations will be disrupted"
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://gpfsug.org/pipermail/gpfsug-discuss_gpfsug.org/attachments/20140403/9b0bf53a/attachment-0003.htm>

From jonathan at buzzard.me.uk  Thu Apr  3 19:26:08 2014
From: jonathan at buzzard.me.uk (Jonathan Buzzard)
Date: Thu, 03 Apr 2014 19:26:08 +0100
Subject: [gpfsug-discuss] question about why unix extensions = no is
 recommended when using samba + gpfs?
In-Reply-To: <CAEeMGHs7UyiFfu6zi5SZHvcUW0aYhQ21dYptVz_CcB5UaPww-A@mail.gmail.com>
References: <CAEeMGHvH84GDv6yEnPgKtNwOhyvXLkbvV2XGtf3vHpJgSuu=Lg@mail.gmail.com>
	<1394705361.16270.9.camel@buzzard.phy.strath.ac.uk>
	<CAEeMGHu4EaiEqa6=qJjHL+4GnkOnQeqh+h5azTHB-1QuqUiTMw@mail.gmail.com>
	<1394716131.2612.24.camel@buzzard.phy.strath.ac.uk>
	<CAEeMGHvG4Jf_gZLfKfs8TyERib8L+r42_uWRqP6DQzHvj7_5dg@mail.gmail.com>
	<CAEeMGHuO5JUNAWAyWv6Oo3rPLvpzKfF0AWdGzgnxyr=nBfVMeQ@mail.gmail.com>
	<533C82DC.9090402@buzzard.me.uk>
	<CAEeMGHtGDRLQiM4qP62Yuwpp9td+9PCjATNf=S1SS3xhEqw40A@mail.gmail.com>
	<533C8A68.7040304@buzzard.me.uk>
	<CAEeMGHvFDgP-7i-fy8KnFCoJra13CB5X6RNKacjBWUUq2Zp8HA@mail.gmail.com>
	<533D7409.3090002@buzzard.me.uk>
	<CAEeMGHs7UyiFfu6zi5SZHvcUW0aYhQ21dYptVz_CcB5UaPww-A@mail.gmail.com>
Message-ID: <533DA7C0.4050106@buzzard.me.uk>

On 03/04/14 18:23, Sabuj Pattanayek wrote:

[SNIP]

>
> It doesn't work if the ACL on the file is POSIX or has been promoted to
> NFS4. In any case, we have need for the ACLs support to be both POSIX
> and NFS4 where needed for the window shares and we can't/won't split up
> the filesystem.
>

Client side Linux has support NFSv4 or more specifically NFSv4.1 for 
some time. The issue is the fact that the RichACL patches seem to have 
been stuck in limbo for years now.

Not that I have tried it even in development, but there is an 
alternative to the Linux kernel NFS server which sucks anyway as 
visibility into what is going on is near none existent.

It's the NFS-Ganesha server and according to the documentation it 
supports full NFSv4.1 and has GPFS support for a backend file system.

     https://github.com/nfs-ganesha/nfs-ganesha/wiki

That could potentially remove your "requirement" for Posix ACL's. That 
is you could go full NFSv4 ACL's in GPFS and an area could be accessed 
either by NFSv4 or SMB without the ACL's in GPFS getting mucked up. It 
is however not clear if NFSv4 ACL's are supported yet. I note that the 
latest versions of CTDB have support for NFS-Ganesha.

>
>     I suggest you use a development/test GPFS cluster to verify it.
>
> Yes, we're going to need a test/dev cluster for testing these for future
> upgrades, etc so I will try an FS that's pure nfs4 ACLs only and see if
> it behaves any differently.

I never cease to be amazed that people are doing large scale file 
servers with Linux/GPFS/Samba and don't have a test/dev cluster.

JAB.

-- 
Jonathan A. Buzzard                 Email: jonathan (at) buzzard.me.uk
Fife, United Kingdom.


From sabujp at gmail.com  Thu Apr  3 19:50:03 2014
From: sabujp at gmail.com (Sabuj Pattanayek)
Date: Thu, 3 Apr 2014 13:50:03 -0500
Subject: [gpfsug-discuss] question about why unix extensions = no is
 recommended when using samba + gpfs?
In-Reply-To: <533DA7C0.4050106@buzzard.me.uk>
References: <CAEeMGHvH84GDv6yEnPgKtNwOhyvXLkbvV2XGtf3vHpJgSuu=Lg@mail.gmail.com>
	<1394705361.16270.9.camel@buzzard.phy.strath.ac.uk>
	<CAEeMGHu4EaiEqa6=qJjHL+4GnkOnQeqh+h5azTHB-1QuqUiTMw@mail.gmail.com>
	<1394716131.2612.24.camel@buzzard.phy.strath.ac.uk>
	<CAEeMGHvG4Jf_gZLfKfs8TyERib8L+r42_uWRqP6DQzHvj7_5dg@mail.gmail.com>
	<CAEeMGHuO5JUNAWAyWv6Oo3rPLvpzKfF0AWdGzgnxyr=nBfVMeQ@mail.gmail.com>
	<533C82DC.9090402@buzzard.me.uk>
	<CAEeMGHtGDRLQiM4qP62Yuwpp9td+9PCjATNf=S1SS3xhEqw40A@mail.gmail.com>
	<533C8A68.7040304@buzzard.me.uk>
	<CAEeMGHvFDgP-7i-fy8KnFCoJra13CB5X6RNKacjBWUUq2Zp8HA@mail.gmail.com>
	<533D7409.3090002@buzzard.me.uk>
	<CAEeMGHs7UyiFfu6zi5SZHvcUW0aYhQ21dYptVz_CcB5UaPww-A@mail.gmail.com>
	<533DA7C0.4050106@buzzard.me.uk>
Message-ID: <CAEeMGHteKg6DPyiE4igPoCZfjq29MFzyTJe8-Xj-EKFCXVtdkg@mail.gmail.com>

> It's the NFS-Ganesha server and according to the documentation it supports
> full NFSv4.1 and has GPFS support for a backend file system.
>

Yup, that could be a future possibility, but getting everyone who's using
the system to move to non-posix ACLs (whom I have no control over) won't
work. NFSv3 and POSIX + POSIX extended ACLs aren't going anywhere soon
because of their simplicity and availability.


> I never cease to be amazed that people are doing large scale file servers
> with Linux/GPFS/Samba and don't have a test/dev cluster.


We do, using it for testing hasn't been necessary since our production
system was our test system since it wasn't being used in production, the
samba part is still only being used very minimally and we've done as much
testing as we could prior to letting a few users on who discovered some of
these problems that we've worked around.
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://gpfsug.org/pipermail/gpfsug-discuss_gpfsug.org/attachments/20140403/65190ee1/attachment-0003.htm>

From bevans at pixitmedia.com  Thu Apr 17 16:08:23 2014
From: bevans at pixitmedia.com (Barry Evans)
Date: Thu, 17 Apr 2014 16:08:23 +0100
Subject: [gpfsug-discuss] PixStor Launch Party after GPFS User Group meeting
Message-ID: <534FEE67.2080204@pixitmedia.com>

Hello all,

I'd like to invite all attendees of the GPFS User Group Meeting on the 
29th of April to join Pixit Media, ArcaStream and Arrow to the launch 
party of Pixit Media's new unified storage and network architecture for 
media, PixStor (which of course is powered by GPFS). We will also be 
launching our new storage brand for research computing, ArcaStream. But 
most importantly...

FREE DRINKS AND FOOD! (and a few prizes too)

The event will be held at the Mulberry Bush Pub, just a 2 minute walk 
across the road from IBM South Bank, and will start straight after the 
GPFS User Group meeting finishes up and last until the pub close. If 
you'd like to attend, please register at 
http://www.pixitmedia.com/launchparty - hope to see you all there!

Barry Evans
Technical Director/Co-Founder
Pixit Media/ArcaStream



Disclaimer - This party does not form a part of of the actual GPFS user 
group meeting

-- 
This email is confidential in that it is intended for the exclusive 
attention of the addressee(s) indicated. If you are not the intended 
recipient, this email should not be read or disclosed to any other person. 
Please notify the sender immediately and delete this email from your 
computer system. Any opinions expressed are not necessarily those of the 
company from which this email was sent and, whilst to the best of our 
knowledge no viruses or defects exist, no responsibility can be accepted 
for any loss or damage arising from its receipt or subsequent use of this 
email.


From orlando.richards at ed.ac.uk  Fri Apr 18 10:29:15 2014
From: orlando.richards at ed.ac.uk (Orlando Richards)
Date: Fri, 18 Apr 2014 10:29:15 +0100
Subject: [gpfsug-discuss] PixStor Launch Party after GPFS User Group
	meeting
In-Reply-To: <534FEE67.2080204@pixitmedia.com>
References: <534FEE67.2080204@pixitmedia.com>
Message-ID: <5350F06B.4060005@ed.ac.uk>

On 17/04/14 16:08, Barry Evans wrote:
> Hello all,
>
> I'd like to invite all attendees of the GPFS User Group Meeting on the
> 29th of April to join Pixit Media, ArcaStream and Arrow to the launch
> party of Pixit Media's new unified storage and network architecture for
> media, PixStor (which of course is powered by GPFS). We will also be
> launching our new storage brand for research computing, ArcaStream. But
> most importantly...
>
> FREE DRINKS AND FOOD! (and a few prizes too)
>
> The event will be held at the Mulberry Bush Pub, just a 2 minute walk
> across the road from IBM South Bank, and will start straight after the
> GPFS User Group meeting finishes up and last until the pub close. If
> you'd like to attend, please register at
> http://www.pixitmedia.com/launchparty - hope to see you all there!
>
> Barry Evans
> Technical Director/Co-Founder
> Pixit Media/ArcaStream
>
>
>
> Disclaimer - This party does not form a part of of the actual GPFS user
> group meeting
>

Hi Barry,

The link on your web page takes you to a kids toys website ;)

I think you want:
http://www.mulberrybushpub.com/



-- 
             --
    Dr Orlando Richards
   Information Services
IT Infrastructure Division
        Unix Section
     Tel: 0131 650 4994
   skype: orlando.richards

The University of Edinburgh is a charitable body, registered in 
Scotland, with registration number SC005336.


From bevans at pixitmedia.com  Fri Apr 18 16:51:23 2014
From: bevans at pixitmedia.com (Barry Evans)
Date: Fri, 18 Apr 2014 16:51:23 +0100
Subject: [gpfsug-discuss] PixStor Launch Party after GPFS User Group
	meeting
In-Reply-To: <5350F06B.4060005@ed.ac.uk>
References: <534FEE67.2080204@pixitmedia.com> <5350F06B.4060005@ed.ac.uk>
Message-ID: <535149FB.20308@pixitmedia.com>


Well that's embarrassing... ;)

Fixed - Thanks Orlando!


> Orlando Richards <mailto:orlando.richards at ed.ac.uk>
> 18 April 2014 10:29
>
>
> Hi Barry,
>
> The link on your web page takes you to a kids toys website ;)
>
> I think you want:
> http://www.mulberrybushpub.com/
>
>
>
> Barry Evans <mailto:bevans at pixitmedia.com>
> 17 April 2014 16:08
> Hello all,
>
> I'd like to invite all attendees of the GPFS User Group Meeting on the 
> 29th of April to join Pixit Media, ArcaStream and Arrow to the launch 
> party of Pixit Media's new unified storage and network architecture 
> for media, PixStor (which of course is powered by GPFS). We will also 
> be launching our new storage brand for research computing, ArcaStream. 
> But most importantly...
>
> FREE DRINKS AND FOOD! (and a few prizes too)
>
> The event will be held at the Mulberry Bush Pub, just a 2 minute walk 
> across the road from IBM South Bank, and will start straight after the 
> GPFS User Group meeting finishes up and last until the pub close. If 
> you'd like to attend, please register at 
> http://www.pixitmedia.com/launchparty - hope to see you all there!
>
> Barry Evans
> Technical Director/Co-Founder
> Pixit Media/ArcaStream
>
>
>
> Disclaimer - This party does not form a part of of the actual GPFS 
> user group meeting

-- 
This email is confidential in that it is intended for the exclusive 
attention of the addressee(s) indicated. If you are not the intended 
recipient, this email should not be read or disclosed to any other person. 
Please notify the sender immediately and delete this email from your 
computer system. Any opinions expressed are not necessarily those of the 
company from which this email was sent and, whilst to the best of our 
knowledge no viruses or defects exist, no responsibility can be accepted 
for any loss or damage arising from its receipt or subsequent use of this 
email.
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://gpfsug.org/pipermail/gpfsug-discuss_gpfsug.org/attachments/20140418/ba3d6bc6/attachment-0003.htm>
-------------- next part --------------
A non-text attachment was scrubbed...
Name: postbox-contact.jpg
Type: image/jpeg
Size: 1256 bytes
Desc: not available
URL: <http://gpfsug.org/pipermail/gpfsug-discuss_gpfsug.org/attachments/20140418/ba3d6bc6/attachment-0006.jpg>
-------------- next part --------------
A non-text attachment was scrubbed...
Name: compose-unknown-contact.jpg
Type: image/jpeg
Size: 770 bytes
Desc: not available
URL: <http://gpfsug.org/pipermail/gpfsug-discuss_gpfsug.org/attachments/20140418/ba3d6bc6/attachment-0007.jpg>

From orlando.richards at ed.ac.uk  Wed Apr 23 14:22:46 2014
From: orlando.richards at ed.ac.uk (Orlando Richards)
Date: Wed, 23 Apr 2014 14:22:46 +0100
Subject: [gpfsug-discuss] Final details for GPFS User Group Meeting 29/4
In-Reply-To: <CAEKnjWJOoweYnDbQ=q5i=aTFjOkYFaSp7o0Uan_T+t63C=sH=A@mail.gmail.com>
References: <CAEKnjWJOoweYnDbQ=q5i=aTFjOkYFaSp7o0Uan_T+t63C=sH=A@mail.gmail.com>
Message-ID: <5357BEA6.20202@ed.ac.uk>

On 23/04/14 13:03, Secretary GPFS UG wrote:
> Unfortunately there is a tube strike planned from around 21:00 on Monday
> 28 April until the morning of Thursday 1 May which may impact your
> journey so please allow yourself plenty of time to register before the
> first presentation gets underway at 11am.
>

Ugh. Any Londoners have advice on how to get to/from Paddington with 
tube strikes ongoing?

-- 
             --
    Dr Orlando Richards
   Information Services
IT Infrastructure Division
        Unix Section
     Tel: 0131 650 4994
   skype: orlando.richards

The University of Edinburgh is a charitable body, registered in 
Scotland, with registration number SC005336.


From bevans at pixitmedia.com  Wed Apr 23 14:37:40 2014
From: bevans at pixitmedia.com (Barry Evans)
Date: Wed, 23 Apr 2014 14:37:40 +0100
Subject: [gpfsug-discuss] Final details for GPFS User Group Meeting 29/4
In-Reply-To: <5357BEA6.20202@ed.ac.uk>
References: <CAEKnjWJOoweYnDbQ=q5i=aTFjOkYFaSp7o0Uan_T+t63C=sH=A@mail.gmail.com>
	<5357BEA6.20202@ed.ac.uk>
Message-ID: <5357C224.6050800@pixitmedia.com>

Last time I think Bakerloo from Paddington to Waterloo was 'OK' - no 
idea if it will be the same this time around. The bigger stations seemed 
to cope pretty well, Central line excluded.

Cheers,
Barry

Orlando Richards wrote:
>
> On 23/04/14 13:03, Secretary GPFS UG wrote:
>>
>> Unfortunately there is a tube strike planned from around 21:00 on Monday
>> 28 April until the morning of Thursday 1 May which may impact your
>> journey so please allow yourself plenty of time to register before the
>> first presentation gets underway at 11am.
>>
>
>
> Ugh. Any Londoners have advice on how to get to/from Paddington with
> tube strikes ongoing?

-- 
This email is confidential in that it is intended for the exclusive 
attention of the addressee(s) indicated. If you are not the intended 
recipient, this email should not be read or disclosed to any other person. 
Please notify the sender immediately and delete this email from your 
computer system. Any opinions expressed are not necessarily those of the 
company from which this email was sent and, whilst to the best of our 
knowledge no viruses or defects exist, no responsibility can be accepted 
for any loss or damage arising from its receipt or subsequent use of this 
email.
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://gpfsug.org/pipermail/gpfsug-discuss_gpfsug.org/attachments/20140423/0d699dbb/attachment-0003.htm>

From Sandra.McLaughlin at astrazeneca.com  Wed Apr 23 15:02:24 2014
From: Sandra.McLaughlin at astrazeneca.com (McLaughlin, Sandra M)
Date: Wed, 23 Apr 2014 14:02:24 +0000
Subject: [gpfsug-discuss] Final details for GPFS User Group Meeting 29/4
In-Reply-To: <5357C224.6050800@pixitmedia.com>
References: <CAEKnjWJOoweYnDbQ=q5i=aTFjOkYFaSp7o0Uan_T+t63C=sH=A@mail.gmail.com>
	<5357BEA6.20202@ed.ac.uk> <5357C224.6050800@pixitmedia.com>
Message-ID: <117e0d974a314151bfd033002b9e553b@DBXPR04MB031.eurprd04.prod.outlook.com>

I was in London last time as well (can?t believe my luck really, that it?s happening again) and the Victoria and Northern lines were OK, and Euston, Victoria and Waterloo were not too bad. So, it wasn?t nearly as bad as I was expecting.

Sandra.

From: gpfsug-discuss-bounces at gpfsug.org [mailto:gpfsug-discuss-bounces at gpfsug.org] On Behalf Of Barry Evans
Sent: 23 April 2014 14:38
To: gpfsug main discussion list
Subject: Re: [gpfsug-discuss] Final details for GPFS User Group Meeting 29/4

Last time I think Bakerloo from Paddington to Waterloo was 'OK' - no idea if it will be the same this time around. The bigger stations seemed to cope pretty well, Central line excluded.

Cheers,
Barry

Orlando Richards wrote:


On 23/04/14 13:03, Secretary GPFS UG wrote:


Unfortunately there is a tube strike planned from around 21:00 on Monday
28 April until the morning of Thursday 1 May which may impact your
journey so please allow yourself plenty of time to register before the
first presentation gets underway at 11am.


Ugh. Any Londoners have advice on how to get to/from Paddington with
tube strikes ongoing?

[https://ci3.googleusercontent.com/proxy/RHzzP7ozZOO_Rz1yGW5TDRhNOfSN5T0D6OEeEfbCAYlYGEUhlUCQkZ7T74jyNAbZ3QtuhRg-Ma1WcWYTzawl94g=s0-d-e1-ft#http://pixitmedia.com/sig/PixitEmailSig.png]
This email is confidential in that it is intended for the exclusive attention of the addressee(s) indicated. If you are not the intended recipient, this email should not be read or disclosed to any other person. Please notify the sender immediately and delete this email from your computer system. Any opinions expressed are not necessarily those of the company from which this email was sent and, whilst to the best of our knowledge no viruses or defects exist, no responsibility can be accepted for any loss or damage arising from its receipt or subsequent use of this email.

--------------------------------------------------------------------------
AstraZeneca UK Limited is a company incorporated in England and Wales with registered number: 03674842 and a registered office at 2 Kingdom Street, London, W2 6BD.
Confidentiality Notice: This message is private and may contain confidential, proprietary and legally privileged information. If you have received this message in error, please notify us and remove it from your system and note that you must not copy, distribute or take any action in reliance on it. Any unauthorised use or disclosure of the contents of this message is not permitted and may be unlawful.
Disclaimer: Email messages may be subject to delays, interception, non-delivery and unauthorised alterations. Therefore, information expressed in this message is not given or endorsed by AstraZeneca UK Limited unless otherwise notified by an authorised representative independent of this message. No contractual relationship is created by this message by any person unless specifically indicated by agreement in writing other than email.
Monitoring: AstraZeneca UK Limited may monitor email traffic data and content for the purposes of the prevention and detection of crime, ensuring the security of our computer systems and checking Compliance with our Code of Conduct and Policies.
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://gpfsug.org/pipermail/gpfsug-discuss_gpfsug.org/attachments/20140423/e79c7343/attachment-0003.htm>

From orlando.richards at ed.ac.uk  Wed Apr 23 15:07:43 2014
From: orlando.richards at ed.ac.uk (Orlando Richards)
Date: Wed, 23 Apr 2014 15:07:43 +0100
Subject: [gpfsug-discuss] Final details for GPFS User Group Meeting 29/4
In-Reply-To: <117e0d974a314151bfd033002b9e553b@DBXPR04MB031.eurprd04.prod.outlook.com>
References: <CAEKnjWJOoweYnDbQ=q5i=aTFjOkYFaSp7o0Uan_T+t63C=sH=A@mail.gmail.com>	<5357BEA6.20202@ed.ac.uk>
	<5357C224.6050800@pixitmedia.com>
	<117e0d974a314151bfd033002b9e553b@DBXPR04MB031.eurprd04.prod.outlook.com>
Message-ID: <5357C92F.1040407@ed.ac.uk>


Good to hear - thanks both!

On 23/04/14 15:02, McLaughlin, Sandra M wrote:
> I was in London last time as well (can?t believe my luck really, that
> it?s happening again) and the Victoria and Northern lines were OK, and
> Euston, Victoria and Waterloo were not too bad. So, it wasn?t nearly as
> bad as I was expecting.
>
> Sandra.
>
> ------------------------------------------------------------------------
>
> AstraZeneca UK Limited is a company incorporated in England and Wales
> with registered number: 03674842 and a registered office at 2 Kingdom
> Street, London, W2 6BD.
>
> *Confidentiality Notice: *This message is private and may contain
> confidential, proprietary and legally privileged information. If you
> have received this message in error, please notify us and remove it from
> your system and note that you must not copy, distribute or take any
> action in reliance on it. Any unauthorised use or disclosure of the
> contents of this message is not permitted and may be unlawful.
>
> *Disclaimer:* Email messages may be subject to delays, interception,
> non-delivery and unauthorised alterations. Therefore, information
> expressed in this message is not given or endorsed by AstraZeneca UK
> Limited unless otherwise notified by an authorised representative
> independent of this message. No contractual relationship is created by
> this message by any person unless specifically indicated by agreement in
> writing other than email.
>
> *Monitoring: *AstraZeneca UK Limited may monitor email traffic data and
> content for the purposes of the prevention and detection of crime,
> ensuring the security of our computer systems and checking compliance
> with our Code of Conduct and policies.
>
> *From:*gpfsug-discuss-bounces at gpfsug.org
> [mailto:gpfsug-discuss-bounces at gpfsug.org] *On Behalf Of *Barry Evans
> *Sent:* 23 April 2014 14:38
> *To:* gpfsug main discussion list
> *Subject:* Re: [gpfsug-discuss] Final details for GPFS User Group
> Meeting 29/4
>
> Last time I think Bakerloo from Paddington to Waterloo was 'OK' - no
> idea if it will be the same this time around. The bigger stations seemed
> to cope pretty well, Central line excluded.
>
> Cheers,
> Barry
>
> Orlando Richards wrote:
>
>
> On 23/04/14 13:03, Secretary GPFS UG wrote:
>
>
> Unfortunately there is a tube strike planned from around 21:00 on Monday
> 28 April until the morning of Thursday 1 May which may impact your
> journey so please allow yourself plenty of time to register before the
> first presentation gets underway at 11am.
>
>
>
> Ugh. Any Londoners have advice on how to get to/from Paddington with
> tube strikes ongoing?
>
>
> This email is confidential in that it is intended for the exclusive
> attention of the addressee(s) indicated. If you are not the intended
> recipient, this email should not be read or disclosed to any other
> person. Please notify the sender immediately and delete this email from
> your computer system. Any opinions expressed are not necessarily those
> of the company from which this email was sent and, whilst to the best of
> our knowledge no viruses or defects exist, no responsibility can be
> accepted for any loss or damage arising from its receipt or subsequent
> use of this email.
>
>
>
> _______________________________________________
> gpfsug-discuss mailing list
> gpfsug-discuss at gpfsug.org
> http://gpfsug.org/mailman/listinfo/gpfsug-discuss
>


-- 
             --
    Dr Orlando Richards
   Information Services
IT Infrastructure Division
        Unix Section
     Tel: 0131 650 4994
   skype: orlando.richards

The University of Edinburgh is a charitable body, registered in 
Scotland, with registration number SC005336.


From chair at gpfsug.org  Wed Apr 23 15:16:27 2014
From: chair at gpfsug.org (Jez Tucker (Chair))
Date: Wed, 23 Apr 2014 15:16:27 +0100
Subject: [gpfsug-discuss] Final details for GPFS User Group Meeting 29/4
In-Reply-To: <5357BEA6.20202@ed.ac.uk>
References: <CAEKnjWJOoweYnDbQ=q5i=aTFjOkYFaSp7o0Uan_T+t63C=sH=A@mail.gmail.com>
	<5357BEA6.20202@ed.ac.uk>
Message-ID: <5357CB3B.4070200@gpfsug.org>

Indeed.
Best laid plans hey?

As others have said, on the day it's usually not that bad if other lines 
are running some tube trains.
Hopefully, they'll call it off at the last moment alike the previous two 
threatened strikes.

We'll handle the day as it pans out.

Jez


On 23/04/14 14:22, Orlando Richards wrote:
> On 23/04/14 13:03, Secretary GPFS UG wrote:
>> Unfortunately there is a tube strike planned from around 21:00 on Monday
>> 28 April until the morning of Thursday 1 May which may impact your
>> journey so please allow yourself plenty of time to register before the
>> first presentation gets underway at 11am.
>>
>
> Ugh. Any Londoners have advice on how to get to/from Paddington with 
> tube strikes ongoing?
>



From chair at gpfsug.org  Fri Apr 25 11:47:42 2014
From: chair at gpfsug.org (Jez Tucker (Chair))
Date: Fri, 25 Apr 2014 11:47:42 +0100
Subject: [gpfsug-discuss] Most tube lines are running during the strike on
	the 29th April
Message-ID: <535A3D4E.7020108@gpfsug.org>

Hi all,

   If you're attending the GPFS User Group on 29th April, you'll no 
doubt be aware of the RMT strike that will be affecting some Tube lines.

It looks like it's not all that bad.  Most lines will be running, bar 
the Central line, Waterloo & City and inner-London Piccadilly.

For precise information, see the PDF on this page: 
http://www.tfl.gov.uk/modes/tube/services-we-expect-to-run

(However, I'd still leave extra time for the journey if at all possible).

See you there.

Best regards,

Jez

GPFS UG Chair




From johnlang at us.ibm.com  Mon Apr 28 21:10:57 2014
From: johnlang at us.ibm.com (John Langlois)
Date: Mon, 28 Apr 2014 16:10:57 -0400
Subject: [gpfsug-discuss] Hello
Message-ID: <OFE9E0899E.22752ABB-ON85257CC8.006E8563-85257CC8.006EEEDA@us.ibm.com>

Hello,

My name is John Langlois and I will be sharing GPFS Product Management 
responsibilities.   Find me on: 

I am very interesting in monitoring this community of GPFS users.  And I 
welcome unsolicited feedback on the problems that you face in your jobs 
every day and how you might use GPFS today or (with a new feature) to 
solve those problems.  What consumes most of your time?  If you had a 
magic wand, how would you use it?   You can write me to help influence the 
future directions of this technology. 

I look forward to collaborating with all of you.

If you are open to a phone interview (again about the jobs you perform), 
please let me know.  I'd love to talk with you directly.


Regards,

John M. Langlois
IBM Software Defined Environment Product Manager

Phone: 1-919-267-6767
E-mail: johnlang at us.ibm.com
Find me on:   and within IBM on:  


-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://gpfsug.org/pipermail/gpfsug-discuss_gpfsug.org/attachments/20140428/976a795d/attachment-0003.htm>
-------------- next part --------------
A non-text attachment was scrubbed...
Name: not available
Type: image/jpeg
Size: 518 bytes
Desc: not available
URL: <http://gpfsug.org/pipermail/gpfsug-discuss_gpfsug.org/attachments/20140428/976a795d/attachment-0012.jpe>
-------------- next part --------------
A non-text attachment was scrubbed...
Name: not available
Type: image/jpeg
Size: 518 bytes
Desc: not available
URL: <http://gpfsug.org/pipermail/gpfsug-discuss_gpfsug.org/attachments/20140428/976a795d/attachment-0013.jpe>
-------------- next part --------------
A non-text attachment was scrubbed...
Name: not available
Type: image/jpeg
Size: 525 bytes
Desc: not available
URL: <http://gpfsug.org/pipermail/gpfsug-discuss_gpfsug.org/attachments/20140428/976a795d/attachment-0014.jpe>
-------------- next part --------------
A non-text attachment was scrubbed...
Name: not available
Type: image/jpeg
Size: 1208 bytes
Desc: not available
URL: <http://gpfsug.org/pipermail/gpfsug-discuss_gpfsug.org/attachments/20140428/976a795d/attachment-0015.jpe>
-------------- next part --------------
A non-text attachment was scrubbed...
Name: not available
Type: image/gif
Size: 1851 bytes
Desc: not available
URL: <http://gpfsug.org/pipermail/gpfsug-discuss_gpfsug.org/attachments/20140428/976a795d/attachment-0003.gif>