Removing Files from xrootd

On the xenia cluster batch system we have 130TB of space. Please be sure to check how full this if you are starting to upload a large dataset. The easiest way to check is just df -h from the command line on xenia. The system automatically trys to balance the files across the nodes, but it is not always successful. Often one node fills up faster than the others. You can check each node by running the script clusterDF.sh I have attached below. If you see that any of the nodes are >95% full then some datasets need deleted. The first thing to do is to remove your old datasets that you no longer need. This can easily be done (across the cluster) with the script I have attached, xrd_rmrf.sh. You can run it just like

./xrd_rmrf.sh /path/to/your/dataset

where the path leaves out "/data0" or "/xrootdfs" at the front, for example just "/atlas/dq2/..." or "/xrootd/mc11/...".

-- TimothyAndeen - 2013-11-27

Topic attachments
I Attachment History Action Size Date Who Comment
Unix shell scriptsh clusterDF.sh r1 manage 0.3 K 2013-11-27 - 18:40 TimothyAndeen  
Unix shell scriptsh xrd_rmrf.sh r1 manage 0.2 K 2013-11-27 - 18:40 TimothyAndeen  
Edit | Attach | Watch | Print version | History: r2 < r1 | Backlinks | Raw View | Raw edit | More topic actions
Topic revision: r2 - 2013-11-27 - TimothyAndeen
 
This site is powered by the TWiki collaboration platform Powered by PerlCopyright © 2008-2023 by the contributing authors. All material on this collaboration platform is the property of the contributing authors.
Ideas, requests, problems regarding TWiki? Send feedback