[gpfsug-discuss] EDR and omnipath

Aaron Knister aaron.s.knister at nasa.gov
Mon Sep 19 21:34:53 BST 2016


I must admit, I'm curious as to why one cannot use GPFS with IB and OPA 
both in RDMA mode. Granted, I know very little about OPA but if it just 
presents as another verbs device I wonder why it wouldn't "Just work" as 
long as GPFS is configured correctly.

-Aaron

On 9/19/16 3:11 AM, Vic Cornell wrote:
> Bump
>
> I can see no reason why that wouldn't work. But it would be nice to a
> have an official answer or evidence that it works.
>
> Vic
>
>
>> On 15 Sep 2016, at 5:49 pm, Brian Marshall <mimarsh2 at vt.edu
>> <mailto:mimarsh2 at vt.edu>> wrote:
>>
>> All,
>>
>> I see in the GPFS FAQ A6.3 the statement below.  Is it possible to
>> have GPFS do RDMA over EDR infiniband and non-RDMA communication over
>> omnipath (IP over fabric) when each NSD server has an EDR card and a
>> OPA card installed?
>>
>>
>>
>> RDMA is not supported on a node when both Mellanox HCAs and Intel
>> Omni-Path HFIs are enabled for RDMA.
>>
>> _______________________________________________
>> gpfsug-discuss mailing list
>> gpfsug-discuss at spectrumscale.org <http://spectrumscale.org>
>> http://gpfsug.org/mailman/listinfo/gpfsug-discuss
>
>
>
> _______________________________________________
> gpfsug-discuss mailing list
> gpfsug-discuss at spectrumscale.org
> http://gpfsug.org/mailman/listinfo/gpfsug-discuss
>

-- 
Aaron Knister
NASA Center for Climate Simulation (Code 606.2)
Goddard Space Flight Center
(301) 286-2776



More information about the gpfsug-discuss mailing list