Configuration changes

•

New configuration:

  • 312 compute nodes
  • 9984 processing elements
  • /work - 175TB
  • /shared - 217TB
  • SLURM scheduler
  • UiB usernames for UiB users
Please find below a short list of changes:

  1. All users (except IMR) have to reaply for access at https://skjemaker.app.uib.no/view.php?id=2901837
  2. SLURM is a new job scheduler
    1. Documentation link https://docs.hpc.uib.no/wiki/Job_execution_(Hexagon)
    2. External Torque/Moab to Slurm reference https://www.glue.umd.edu/hpcc/help/slurm-vs-moab.html
  3. Please use Support for help and support.
  4. The hexagon@hpc.uib.no mailing list will be migrated to a self managed mailing list in a short time. All current mailing list users will be removed soon. If you want to subscribe please get back to our syslog  https://syslog.hpc.uib.no in a week, we will post a link to the new mailing list.

We didn’t manage to replace all HW components we’ve planned during this maintenance. We are planning to have a shorter maintenance somewhere in winter/spring to finish this job. 

All software as modules is still available, we will review and remove old in the coming weeks.

There are some major changes, as the new job scheduler and the HW configuration, maybe some things stopped working for you, some configurations are not finally in place, we will continue on improving this as well as updating documentation during the following weeks, we ask for your patience. And of course all feedback is welcome at support@hpc.uib.no.

The following changes will come in the next months:

  • /shared will be bigger in a few weeks
  • Bigger /home after the next maintenance window

•

We have upgraded the SSH server on hexagon to address some security issues.

If you can not log in anymore using your SSH key, but only password, please check the content of ~/.ssh/authorized_keys file for entries like from="myhost.example.com" and change the hostname to IP address. Starting with this version only IP addresses and not host names may be used in the authorized_keys file.
Edit: authorized_keys file provides fine tuning for client access. If you would like to find out more about it, you may read sshd(8) man pages.

DSA key types are not considered safe anymore and we will phase them out soon. A new syslog entry will be added in the following days with more information about it.

•

Due to several bugs in the queuing  system, affecting mostly OpenMP jobs,  the nodes and the ppn directives are deprecated.

The new way of submitting OpenMP jobs is covered on the HPC docs site, available here: 

https://docs.hpc.uib.no/wiki/Job_execution_(Hexagon)#Parallel.2FOpenMP_jobs.

Have you any question on how to change your script please contact us.

•

Scheduler system on Hexagon is not well working with mppdepth directive.

Due to increased usage of OpenMP on the machine we had to stop supporting mppdepth. 

The new way of running OpenMP is as simple as it was before with mppdepth.

Updated documentation on how to run an OpenMP job you can find here 

https://docs.hpc.uib.no/wiki/Job_execution_(Hexagon)#Parallel.2FOpenMP_jobs
Have you any question on how to change your script please contact us.

•

Work file system on fimm cluster is taken down due to misconfiguration of GPFS file system.

We are working on correction of configuration , will keep you updated.

10/11/2011 Work file system is back online with more space (3.7TB)

Update 11/11/2011

We are balancing data on different disk on work file system since we added new disk to work file system, this is creating load on GPFS file system on fimm, which means the operation related to file system is going to be slow, we are expecting this balancing process will finish during the weekend.