Princeton University Research Computing

Princeton University Research Computing

An Introduction to Princetons New Computing Resources: IBM Blue Gene, SGI Altix, and Dell Beowulf Cluster PICASso Mini-Course October 18, 2006 Curt Hillegas

Introduction SGI Altix - Hecate IBM Blue Gene/L Orangena Dell Beowulf Cluster Della Storage Other resources TIGRESS High Performance Computing Center

Terascale Infrastructure for Groundbreaking Research in Engineering and Science Partnerships Princeton Institute for Computational

Science and Engineering (PICSciE) Office of Information Technology (OIT) School of Engineering and Applied Science (SEAS) Lewis-Sigler Institute for Integrative Genomics Astrophysical Sciences Princeton Plasma Physics Laboratory (PPPL)

SGI Altix - Hecate 64 1.5 GHz Itanium2 processors 256 GB RAM (4 GB per processor) NUMAlink interconnect 5 TB local disk 360 GFlops

SGI Altix Itanium 2 1.5 GHz 4 MB L3 Cache 256 KB L2 Cache 32 KB L1 Cache SGI Altix - NUMAlink NUMAlink 4 3.2 GB/s per direction

Physical latency 28 ns MPI latency 1 s Up to 256 processors SGI Altix - Software SLES 9 with SGI ProPack

2.6.5-7.252-sn2 kernel Intel Fortran compilers v8.1 Intel C/C++ compilers v8.1 Intel Math Kernel Libraries v7 Intel vtune Torque/Maui OpenMP MPT (SGI mpich libraries)

fftw-2.1.5, fftw-3.1.2 hdf4, hdf5 ncarg petsc IBM Blue Gene/L Orangena 2048 700 MHz Power4 processors 1024 nodes 512 MB RAM (256 MB per

processor) 5 Interconnects including a 3D torus 8 TB local disk 4.713 TFlops IBM Blue Gene/L Full system architecture 1024 nodes

2 PowerPC 440 cpus 512 MB RAM 1 rack

35 kVA 100 kBTU/hr 2 racks of supporting servers and disks

Service node Front end node 8 storage nodes 8 TB GPFS storage 1 Cisco switch IBM Blue Gene/L

IBM Blue Gene/L networks 3D Torus network Collective (tree) network Barrier network Functional network Service network IBM Blue Gene/L Software LoadLeveler (coming soon)

mpich XL Fortran Advanced Edition V9.1 mpxlf, mpf90, mpf95 XL C/C++ Advanced Edition V7.0

Mpcc, mpxlc, mpCC fftw-2.1.5 and fftw-3.0.1 hdf5-1.6.2 netcdf-3.6.0 BLAS, LAPACK, ScaLAPACK IBM Blue Gene/L

More http://orangena.Princeton.EDU http://orangena-sn.Princeton.ED U Dell Beowulf Cluster Della 512 3.2 GHz Xeon processors 256 nodes 2 TB RAM (4 GB per processor)

Gigabit Ethernet 64 nodes connected to Infiniband 3 TB local disk 1.922 TFlops Dell Beowulf Cluster Interconnects All nodes connected with Gigabit Ethernet

1 Gb/s MPI latency ~ 30 s 64 nodes connected with Infiniband 10 Gb/s MPI latency ~5 s Dell Beowulf Cluster Software

Elders RHEL 4 based image 2.6.9-42.0.3.ELsmp kernel Intel compilers Torque/Maui OpenMPI-1.1 fftw-2.1.5, fftw-3.1.2 R-2.1.3 MatlabR2006a

Dell Beowulf Cluster More https://della.Princeton.EDU https://della.Princeton.EDU/gang lia Storage 38 TB delivered

GPFS filesystem At least 200 MB/s Installation at the end of this month Fees to recover half the cost Getting Access 1 3 page proposal Scientific background and merit

Resource requirements # concurrent cpus Total cpu hours Memory per process/total memory

Disk space A few references [email protected] Other resources adrOIT Condor Programming help

Questions

Recently Viewed Presentations

  • Symptom Management Reviews EBM in Hospice and Palliative Care

    Symptom Management Reviews EBM in Hospice and Palliative Care

    Two review authors independently collected data from each appropriate study and entered them into the software Review Manager 5. Two independent review authors assessed the risk of bias using the RevMan 5 'Risk of bias' table following guidance from the...
  • Transforming the Health Care Response to Family Violence

    Transforming the Health Care Response to Family Violence

    Recognizing that victims of domestic violence often seek medical care before calling the police, and that many physicians lack adequate training and guidelines to address domestic violence, AB 890 was introduced to the California legislature in 1993 and passed into...
  • Effective Study Skills Writing based subjects Whats new?

    Effective Study Skills Writing based subjects Whats new?

    Lay out your week in a plan and fill in what you will do and when. This can include other activities. There is an SQA app but there is nothing wrong with a bit of paper and some coloured pens...
  • Transition Working Group - dodccrp

    Transition Working Group - dodccrp

    NEED TO FIND A WAY TO MOVE GOLD NUGGETS INTO ACQUISITION WITHOUT BEING TIED TO THE POM CYCLE Transition Working Group Gerald Douglas Transition Working Group Team Members Gerald Douglas, Lockheed Martin (Chairman) Chris Behre, Old Dominion University Randy Brooks,...
  • Weston-super-Mare "Ever Forward" - Bath and North East ...

    Weston-super-Mare "Ever Forward" - Bath and North East ...

    Achievements since 2000 Youth cafe/services via YMCA Blakehay Theatre Water Adventure Play Park Milton Road Cemetery Love Weston - Tourism Promotion Weston (former North Somerset) Museum Flower Beds and Public Toilets Play areas, bus shelters, allotments, parks etc. Giving Weston...
  • Graywater Treatment - City Tech OpenLab

    Graywater Treatment - City Tech OpenLab

    Greywater also contains substances that can reduce plant growth or crop yield if present at sufficiently high concentrations.The major concerns with regard to soil are salinity and sodicity, both of which are related to the concentration of sodium in greywater.
  • Obálky Knih Zas a Znova

    Obálky Knih Zas a Znova

    Dále se bude po technické stránce jednat o rozšíření vkládacího API mezi aplikací skenovacího klienta a backend vrstvou, o rozšíření datového modelu a o obohacení metadatového kontejneru dotazovacího API o odkaz na dokument se seznamem použité literatury. Úprava se dotkne...
  • Introduction to Packet Scheduling ECE 1545 Packet Switch

    Introduction to Packet Scheduling ECE 1545 Packet Switch

    Introduction to Packet Scheduling ECE 1545 Packet Switch Forwarding Decision Forwarding Decision Forwarding Decision Routing Table Routing Table Routing Table Switch Fabric Output Scheduling Packet Scheduling Packet scheduling algorithm determines the order in which backlogged packets are transmitted on an...