The Njal Supercomputing Cluster
Home | Research | People | Pictures | Hardware | Get an Account | FAQ | Documentation
System Specifications
Njal is based on
Compute-node Hardware

Njal is a heterogeneous cluster based on two classes of compute-nodes.
  • a-nodes - 64bit 2.0GHz + Ethernet
  • b-nodes - 32bit 933MHz + Myrinet
There are 14 a-nodes and 40 b-nodes.

a-node Hardware

Processors
Cores Clock Speed Brand Model
4 2.0GHz Intel Xeon Core2
 
Memory
Capacity Type Speed
4GB DDR 533MHz
 
Network
Type Speed Brand Model
Ethernet 1000Mb/sec Broadcom NetXtreme II BCM5708
 
Storage
Capacity Interface Speed Brand Model
80GB SATA 57MB/sec Western Digital WD800JD-75MS

b-node Hardware

Processors
Cores Clock Speed Brand Model
2 933MHz Intel Pentium III
 
Memory
Capacity Type Speed
1.5GB PC133 133MHz
 
Network
Type Speed Brand Model
Ethernet 100Mb/sec Intel e100
Myrinet 1000Mbit/sec Myricom  
 
Storage
Capacity Interface Speed Brand Model
20GB ATA-100 20MB/sec Western Digital Caviar
Master-node Hardware
Processors
Cores Clock Speed Brand Model
4 1.8GHz Intel Xeon Core2
 
Memory
Capacity Type Speed
2GB DDR 533MHz
 
Network
Type Speed Brand Model
Ethernet 1000Mb/sec Broadcom NetXtreme II BCM5708
 
Storage
Capacity Interface Speed Brand Model
80GB SAS RAID-5 177MB/sec Seagate ST336754SS
160GB SATA RAID-1 74MB/sec Seagate ST3160815AS
Interconnect
Ethernet networking is provided by the HP ProCurve switch with 128 Fast Ethernet ports and 3 Gigabit Ethernet ports. All ports are copper. Switch is tolerant to resets/reboots, usually it does not need any maintenance or configuration. One deficiency - it is not fully non-blocking, the internal banchwidth is less than the sum of the port throughput.

Typical message roundtrip latency is between 100 and 200 microseconds for 64 byte messages. Maximum measured NetPIPE TCP/IP bandwidth is 90 Mbps for Fast Ethernet and 340 Mbps for Gigabit Ethernet.

Supplier: RackSaver

Myrinet connects 40 b-nodes. Each of these nodes has a Myrinet-2000 card (M3F-PCI64B-2) connected by a copper cable to the cross-bar switch. Routing logic is on the cards themselves so the switch is merely an interconnect with an "On/Off" switch.

Typical message roundtrip latency is between 9 and 11 microseconds for 64 byte messages. Maximum measured NetPIPE MPI bandwidth is 460 Mbps.

Supplier: Myricom Inc.
 
Switches
Type Number of ports Latency Bandwidth
HP ProCurve 128 Fast Ethernet ports and 3 Gigabit Ethernet ports 100 and 200 microseconds for 64 byte messages 90 Mbps for Fast Ethernet and 340 Mbps for Gigabit Ethernet
Myrinet   9-11 microseconds for 64 byte messages 460 Mbps
File Server Hardware
Processors
Cores Clock Speed Brand Model
2 1.8GHz AMD Dual-core Opteron
 
Memory
Capacity Type Speed
2GB DDR 533MHz
 
Network
Type Speed Brand Model
Ethernet 1000Mb/sec Broadcom Tigon3
 
Storage
Capacity Interface Speed Brand Model
40GB ATA-133 53MB/sec Seagate ST340014A
1TB SATA RAID-6 69MB/sec Seagate ST3500630NS
Performance

Copyright (C) 2002-2007 Konstantin Likharev and Joseph Spadavecchia.