Difference: Upgrade64 (3 vs. 4)

Revision 42010-07-27 - WilliamSeligman

Line: 1 to 1
META TOPICPARENT name="Computing"

Upgrading the Nevis Linux cluster to a 64-bit operating system

(This page is being actively updated as I develop the upgrade plan).

What won't be upgraded


Upgrade schedule

Date Systems Mail affected
Tue 17-Aug-2010 morningside, riverside Neutrino group, willis
Thu 19-Aug-2010 shang, han DOE Group, shaevitz, annmarie, jsantini, bishop, capone
Tue 24-Aug-2010 karthur D0/ATLAS, ban, zhang
Wed 25-Aug-2010 kolya ATLAS group
Thu 26-Aug-2010 tehanu VERITAS group

Each upgrade will start at 4PM, and will hopefully take no more than two hours.

Important: While any of the above servers are being upgraded, there is a good chance that the mail server will slow down. It might be necessary to reboot the mail server before and/or after the upgrade.

The batch nodes (hermesXX, kennelXX) and 64-bit-compatible workstations will be upgraded during those two weeks.

Which systems won't be upgraded

  The following systems won't be upgraded to 64-bit; at least, not as part of this co-ordinated effort. Instead, as the systems are replaced, their replacements will receive a 64-bit version of Linux.
    Line: 32 to 47
    yoshi 120 Neutrino workstation
    \ No newline at end of file

    Why the upgrade?

    Here are the reasons:

    • A number of groups are make the move to 64-bit computing:
      • The ATLAS analysis software will run on a 64-bit environment.
      • The Double Chooz group is or will be moving to a 64-bit operating system.
      • The VERITAS group's software functions best in a 64-bit environment.

    • The DOE group already runs their software in a 64-bit environment at BNL, so the change means little to them.

    • In general, a 64-bit operating system can be up to 40% faster than the equivalent 32-bit system running on the same hardware.

    • The last two weeks of August have usually been the time for upgrades to the Nevis computer cluster. In 2009, it was the shift to Scientific Linux 5.

    It boils down to: We would have to make the change someday, and now is as good a time as any.

    Which version of Linux?

    Scientific Linux 5.5

    What about existing software?

    As far as the Scientific Linux packages are concerned, there are 64-bit versions of all existing software. The upgrade will be automatic.

    If you type the command setup on any system on the Nevis Linux cluster, you'll see that I've prepared 64-bit versions of ROOT, Geant4, CLHEP, and the GCC 4.4 compiler. Scientific Linux 5 comes with the GCC 4.1 compiler.

    The 32-bit versions of all software, both Linux- and HEP-related, will remain on the systems for as long as anyone still needs them. In particular, the GCC 3.2 compiler will remain available in a 32-bit version.

    What do I have to change in my scripts?

    If you are moving to 64-bit versions of your programs, and you use /usr/lib explicitly in your scripts, you'll probably have to change it to /usr/lib64.

    If you want to keep using the 32-bit versions of your programs and the software, you'll probably have to add -m32 as a compiler option; e.g., g++ -m32 myprog.cxx -o myprog

    In general, condor will only allow jobs submitted from 32-bit systems to run on 32-bit systems, and the same for 64-bit systems. You probably won't have to change any of your existing condor command files.

    This site is powered by the TWiki collaboration platform Powered by PerlCopyright © 2008-2021 by the contributing authors. All material on this collaboration platform is the property of the contributing authors.
    Ideas, requests, problems regarding TWiki? Send feedback