Hexagon will have planned maintenance on 15th August from 08:00.
Currently /work filesystem is running on reduced performance due to broken storage controller.
During the maintenance, we will replace the broken storage controller for the storage system where /work filesystem resides. Due to the high risk of data loss, we urge all /work filesystem users to backup their important, not reproducible data. Please keep it in mind that work is not in backedup and work is scratch filesystem.
After the maintenance we expect /work filesystem will be back on full performance.
We appreciate your understanding.
Update 15.08.2018 11:00
Hexagon maintenance is over, we have successfully replaced the broken, controller. Work file-system is back to it's expected performance.
work file-system crashed Sunday afternoon, we manage to take it online again late Sunday. Jobs that are running on work file-system is crashed and has to be resubmitted.
Work filesystem has crashed again on Hexagon. We are having a severe problem with work filesystem on hexagon and Grunch. We are working on to find out the root cause of the problem, meanwhile work filesystem will be unstable on Hexagon, we will get all users updated about the process.
We are sorry for the inconvenience and appreciate your understanding.
Hexagon work filesystem is down due to crashed lustre mds server. We are working on that issue.
Update 15:00 : hexagon work filesystem is back online. Jobs that are running during the crash probably died. We looking in to the root cause of the problem.