Flame 2011.1 and 10Ge network.. any luck?

[Anonymous]

Hello,
I am wondering whether there is anybody out there who has managed to get the 10Ge network card working on a Flame 2011, ext 1.
Here is the configuration:
HP z800,
Mellanox IB/10Ge card
Extreme Networks 640 10Ge switch
DKU 5.5 and Flame 2011.1
RehHat 5.3

The problem we have is that the card doesn’t provide more than 20MB/s.
I was wondering whether anybody has managed to get good performance in a similar configuration.

Regards,
marina

[Sinan]

Where do you get 20MB/sec speed? Over nfs mount or over wire? Wiretap?
I tested infiniband DDR a few months ago, and I was amazed about its speed. I would like to know, what is going on with 10G interface.

[Shannon Gans]

DDR inifiband should give >800mb/s.

As for 10gbe – I am setting one up as we speak so I should be able to post some results in the next 48hours.

Chris

[Shannon Gans]

@chhym 32429 wrote:

DDR inifiband should give >800mb/s.

As for 10gbe – I am setting one up as we speak so I should be able to post some results in the next 48hours.

Chris

Just seen 600mb/s with 10gbe and sw_ping with a large blocksize.

Using myricom cards and an HP switch.

Chris

[christian]

Would love to know how it goes.
I have a infiniband network but never worked very well.
Was thinking of switching to 10ge. It seems some of the infiniband cards will do 10gige.

[Shannon Gans]

@skulleyb 32434 wrote:

Would love to know how it goes.
I have a infiniband network but never worked very well.
Was thinking of switching to 10ge. It seems some of the infiniband cards will do 10gige.

With IB, it seems to work, or doesn’t and when it doesn’t it can be a pain to troubleshoot as wire transfers are at a very low level (hence performance) and don’t appear in normal IP type diagnostics… remember hippi? – it’s the same!

For my 10gbe setup – it in and working. Performance, it’s better than 1gbe in that I can do a stream of HD.

For IB – you should be able to get 800mb/s assuming the storage can keep up, and with the new cards autodesk sell/supply – this are QDR and 10gbe, so we are in the 2000mbytes/sec + transfer rate area on the QDR side.

Ping me off list if you need help skulley chris at cyberdyne-services dot com if you want help with IB.

Regards

Chris

[Author]

Posts