Linux

Due to a GPFS file system hang on the fimm frontend, for a short period of time (hopefully 10-15 minutes), the frontend will not be available, all users need to log in again after this.

Update, 10:12: fimm frontend needs to be rebooted to clear the hang.
Update, 10:26: fimm frontend is now rebooted and up again.

There will be a scheduled downtime on fimm and its filesystems starting Monday January 21st at 0800. This is due to a replacement of the cooler in the machineroom.

We are very sorry for the inconvenience this very short notice may cause you.

The workmen responsible for the replacement have not given us an estimated time for when the cooling will be in place, but the work is expected to take about 2 days. More information will be posted here when we know it.

Update Monday, 1730: The coolers are in place and we are waiting for the plumbers to connect them to the cold-water system.

Update Tuesday, 1115: The plumbers have started the work connecting the coolers. Due to complications in this it is expected to be at least until Thursday afternoon before we can turn on the cooling again.

Update Friday, 1130: Fimm login node will be rebooted and upgraded shortly. This upgrade should take about 30 minuttes.
The plumbers are still working with the cooling, but we hope to be up and running later today.

Update Friday, 1140: Fimm login node has now been upgraded.

Update Friday, 1515: The cooling is now in place and fimm is again operational.

The old cooler (soon to be replaced) has failed.
Therefore the fimm cluster had to shut down to avoid overheating.

Update, 14:45: We now have the fimm frontend with filesystems operational for the moment. The queue will accept jobs, but they will not start since the nodes are not up. See note about scheduled downtime due to cooling system upgrade.

Update, Dec. 13th, 09:10: Due to limited cooling the frontend will be unavailable until the scheduled downtime has been completed.

Update, 19th 16:30: The cooling is now started again (see also updates on the schedule downtime note).

One of the switches has failed on fimm. Because the file-servers were connected to this switch the filesystems went down.
We have now re-routed the fileservers and frontend to one of the other switches and changed the switch-interconnect. Most of fimm is now back up again, including filesystems, but jobs have failed due to missing filesystems.

Due to a necessary re-configuration of the power in the machine room, there will be a downtime of fimm cluster plus filesystems (/migrate, /bcmhsm, /bjerknes*, as well as fimm filesystems /work, /work2, /home).
All running jobs will of course be killed when the nodes are shut down.

The planned downtime is on Monday November 12th from 09:00 to 14:00. It *may* be somewhat shorter if all goes well.

Questions can be sent to support-uib@notur.no

We are sorry for the inconvenience this may cause you.

Update, Mon. 12th 14:50: fimm is now back up again. In addition to the power downtime we did a necessary kernel and gpfs upgrade.