The SC10 conference and November edition of the
Top500 [1]supercomputer list are just a few days away now. Let’s take a look at the interconnect methods used most frequently by the supercomputers on the list.
Gigabit Ethernet vs. InfiniBand
In the June 2010 edition of the
Top500 list [2] Ethernet (GigE and 10 GigE) took a 48.4 percent share, while InfiniBand (Numalink, SDR, DDR, DDR 4x, and QDR Sun M9 / Mellanox / ParTec) took
over 41 percent [3]. The argument was made in July of this year that InfiniBand is
set to outpace [4] Ethernet. The InfiniBand Trade Association put together a nice
roadmap [5]explaining the acronym soup surrounding InfiniBand technologies, their future, and how each speed lane achieves a particular goal. A
paper [6]from Chelsio Communications seeks to address the myths about Infiniband and claim that 10 Gigabit Ethernet is faster. Throw iWARP into the mix and more debunking of marketing hype and you have
this [7]infoTECH feature by guest author Gilad Shainer from
Mellanox Technologies.
Mellanox, Qlogic and Voltaire
Late last month
Oracle announced [8]that it was making a strategic investment in
Mellanox [9] (MLNX), a supplier of end-to-end connectivity solutions. Last week Mellanox
announced [10] a joint cooperative agreement agreement with the Beijing Computing Center to build a joint cloud computing laboratory. The 40 Gb/s InfiniBand-accelerated Beijing Public Cloud Computing Center will provide China’s academic and commercial researchers with easy access to a high-performance computing cloud for their multiple scientific applications. Mellanox also
announced [11]that its ConnectX-2 adapter card with Virtual Protocol Interconnect (VPI) technology is now available on Dell PowerEdge C6100 ultra-dense rack servers. Mellanox ConnectX-2 VPI adapter cards can connect to either 40Gb/s InfiniBand or 10GigE networks and are suited to a variety of business and clustering applications.
Qlogic (QLGC)
announced [12]last week it has collaborated with
Platform Computing [13] to cross-integrate key components of their respective software management suites, making it easier and more efficient than ever to install, manage and operate high performance computing cluster environments. QLogic’s InfiniBand Fabric Suite FastFabric tools can now be directly installed and executed from Platform Cluster Manager to greatly simplify installation and management of HPC clusters. On Tuesday QLogic
announced [14]that its 7300 Series QDR InfiniBand(R) host channel adapters (HCAs) have established new world records for non-coalesced message rate performance at both host and cluster levels. Tests were run using The Ohio State University message bandwidth benchmark.
Israel-based
Voltaire (VOLT) makes scale-out fabrics for both InfiniBand and Ethernet. Last week Voltaire
announced [15]third quarter 2010 financial results and generated a positive cash flow, for the first time, of $3.6 million. Ronnie Kenneth, Chairman and CEO of Voltaire commented that “time and again, our software proves to be a major differentiator for both our Ethernet and InfiniBand products and enhances our competitive edge. Through effective execution of a well-defined strategy, we are experiencing strong channel development and a growing customer roster.”
The screaming SCinet network
A most impressive network is being setup in New Orleans, where the
Supercomputing Conference SC10 [16] will be held next week. Eric Dube has
begun [17]documenting the SCinet network installation, which will be capable of delivering 260 gigabits per second of aggregate data bandwidth for conference attendees and exhibitors. The network will have an InfiniBand fabric consisting of Quad Data Rate 40, 80, and 120 gigabit per second circuits.
SCinet will be used for a
DICE [18](Data Intensive Computing Environment) program from
Avetec [19] to conduct a live Research Sandbox (System Area Network Demonstration) project utilizing a geographically diverse high-speed wide-area-network architecture (10GBs). The project will demonstrate and test encapsulated and encrypted InfiniBand data movement between high performance computing (HPC) clusters. Each site is connected to the SC10 location by a 10GbE connection and utilizes
Obsidian [20]ES InfiniBand extenders to encapsulate InfiniBand traffic over the links.
John Rath is a veteran IT professional and regular contributor at Data Center Knowledge. He has served many roles in the data center, including support, system administration, web development and facility management.
Article printed from Data Center Knowledge: http://www.datacenterknowledge.com
URL to article: http://www.datacenterknowledge.com/archives/2010/11/11/to-infiniband-and-beyond/
URLs in this post:
[1] Top500 : http://top500.org
[2] Top500 list: http://www.top500.org/stats/list/35/conn
[3] over 41 percent: http://www.datacenterknowledge.com/archives/2010/06/02/top-500-highlights-supercomputing-trends/
[4] set to outpace: http://www.datacenterknowledge.com/archives/2010/07/06/roundup-vegasnap-sgi-infiniband-vs-ethernet/
[5] roadmap : http://www.infinibandta.org/content/pages.php?pg=technology_overview
[6] paper : http://10-gigabit-ethernet.tmcnet.com/topics/10-gigabit-ethernet/articles/115577-why-10-gigabit-ethernet-superior-eight-myths-infiniband.htm
[7] this : http://it.tmcnet.com/topics/it/articles/114501-iwarp-be-faster-than-infiniband.htm
[8] announced : http://www.datacenterknowledge.com/archives/2010/10/29/roundup-oracle-savvis-nimsoft-interxion/
[9] Mellanox: http://www.mellanox.com/
[10] announced: http://www.mellanox.com/content/pages.php?pg=press_release_item&rec_id=478
[11] announced : http://www.mellanox.com/content/pages.php?pg=press_release_item&rec_id=481
[12] announced : http://ir.qlogic.com/phoenix.zhtml?c=85695&p=irol-newsArticle&ID=1491790&highlight=
[13] Platform Computing: http://www.platform.com//
[14] announced : http://ir.qlogic.com/phoenix.zhtml?c=85695&p=irol-newsArticle&ID=1493820&highlight=
[15] announced : http://www.voltaire.com/NewsAndEvents/Press_Releases/press2010/Voltaire_Announces_Continued_Growth_in_Third_Quarter_2010_Results
[16] SC10: http://sc10.supercomputing.org
[17] begun : http://blog.infinibandta.org/2010/11/05/documenting-the-worlds-fastest-network-installation/
[18] DICE : http://www.diceprogram.org/sandbox/
[19] Avetec: http://www.avetec.org/
[20] Obsidian : http://www.obsidianresearch.com/
[21] John Rath: http://www.datacenterknowledge.com/archives/author/johnr/
Click here to print.
