Campus Grids

From Cidays

Jump to: navigation, search

This page is under construction.

Here we list several campuses and national labs that have constructed campus-wide grid infrastructures, and have become part of larger grids. Their paradigms differ, and you may want to research and compare them.

Contents

[edit] Grid Laboratory of Wisconsin (GLOW) at UW Madison

The Grid Laboratory of Wisconsin (GLOW) is a campus-wide computing facility deployed to serve the scientific community, providing more than 30,000 computer hours a day to researchers in areas such as genome mapping, high-energy physics, cancer detection and treatment, and materials science.

There are Condor pools in various departments, made accessible via Condor flocking. The campus grid crosses administrative domains, and interoperates with outside collaborators. Any GLOW member is free to link their resources to other grids.

[edit] The value of campus scale

  • simplicity: software stack is just Linux + Condor
  • fluidity: high common denominator makes sharing easier and provides richer feature-set
  • collective buying power: we speak to vendors with one voice
  • standardized administration: e.g. GLOW uses one centralized cfengine
  • synergy: face-to-face technical meetings, mailing list scales well at campus level
  • the Open Science Grid gives us the opportunity to collaborate outside the bounds of the campus, so we can operate at both scales

[edit] Sites

Six initial GLOW sites:

  • Computational Genomics, Chemistry
  • Amanda, Ice-cube, Physics/Space Science
  • CMS, High Energy Physics
  • Materials by Design, Chemical Engineering
  • Radiation Therapy, Medical Physics
  • Computer Science

Plus new members:

  • ATLAS, High Energy Physics
  • Plasma Physics
  • Multiscalar, Computer Science

These represent diverse users with different deadlines and usage patterns.

[edit] Technical info

  • Users submit jobs to their own private or department scheduler as members of a group (e.g. “CMS” or “MedPhysics”)
    • Jobs are dynamically matched to available machines
    • Jobs run preferentially at the “home” site, but may run anywhere when machines are available
    • Computers at each site give highest priority to jobs from same group (via machine RANK)
  • Crosses multiple administrative domains
    • No common uid-space across campus
    • No cross-campus NFS for file access

Credits: Presentation by Dan Bradley of UWM at SC06


[edit] BoilerGrid (consortium of several Indiana universities)

More than 7,700 computers of all sizes — from desktop machines used by students to do homework and check e-mail, to workstations in researchers' labs, all the way up to large, powerful research computers — are linked together using the open source application Condor.

About BoilerGrid

BoilerGrid delivered more than 10 million hours of computation in 2007, to users in

  • Materials Science
  • Structural Biology
  • Hydrology
  • Astrophysics
  • High Energy Particle Physics
  • Cryptography
  • Bioinformatics

BoilerGrid resources are provided to users on the Open Science Grid and TeraGrid, and to users on the campuses of Purdue University, the University of Notre Dame, Purdue University Calumet, Purdue University - North Central,, Indiana State University, and Indiana University - Purdue University Fort Wayne

[edit] Clemson University Condor Pool of Windows machines

Clemson University in S.C. has created a Condor Pool of Windows machines. The team is still preparing a website under Welcome to the Campus Grids web for OSG.

Some highlights:

  • Windows machines in 27 different locations on Campus.
  • ~1,700 Condor slots, over 1.8M hours served in 6 months
  • Helped get new users from Industrial and Chemical engineering as well as Economics.
  • Made accessible to the OSG through a single gateway.
  • Fast ramp up of usage once the system shown to work.
  • Large Linux Cluster coming up in the Fall (2007)

[edit] FermiGrid (on the Fermi National Accelerator Laboratory campus)

The Computing Division at Fermilab has placed all of its production resources in a Grid "meta-facility" infrastructure called FermiGrid. Fermilab is a national laboratory for high energy physics, 35 miles west of Chicago, IL. Its compute resources are available through Open Science Grid.

The FermiGrid facility is comprised of common grid services, stakeholder bi-lateral interoperability, OSG interfaces, and interfaces to permanent storage. Read FermiGrid's Introduction for details.

Personal tools