Identify 1 or more disk buffers where you can temporarily place data
which should be moved to tape. This should be large enough (>50GB) to accomodate large datasets. It need not be enormous, however, as the files will be removed fairly quickly as they are moved to tape.
For the user who has access to the disk buffer, insert the following line into his or her .k5login file: danielw@FNAL.GOV
Send the location of your disk buffer to Daniel Whiteson as
username:hostmachine:directory
For example, the Top, MC and Exotic group's disk buffers are:
danielw:fcdfdata120.fnal.gov:/export/data6/top/to_dfc/send/
cdfdata:fcdfdata005.fnal.gov:/cdf/scratch/cdfdata/logger/incoming/
exo:fcdfdata116.fnal.gov:/export/data1/beate/lytken/to_tape/
Prepare your files to be stored on tape. Make sure that
- Their file size is ~ 1.5GB
- Their names are ABrrrrrr.ssssGGGN, where
- the dataset DI is AGGGNB
- the run number of the first event is rrrrrr
- the section number of the first event is ssss
Move them to your disk buffer. When the file has arrived in the disk buffer, create a zero-length file with the name ABrrrrrr.ssssGGGN.ok. You will need 1 of these for each file to import, as it is the indicator that the file is ready for importation.
Wait for the files to disappear. You can watch the file buffer.log to monitor the activity. If this file is not created or updated, there may be an error. A successful result will appear like this
o Polling buffer id=danielw host=fcdfdata120.fnal.gov dir=/export/data6/top/to_dfc/send/ at Thu Jun 30 10:28:00 CDT 2005
- File: /export/data6/top/to_dfc/send//aq02b504.0001topa.ok
- Looking for /export/data6/top/to_dfc/send//aq02b504.0001topa on danielw@fcdfdata120.fnal.gov
o File size : 1439447.514 kb
o Disk free : 919713840 kb
o Quota free: 856336188 kb
>> Getting file /export/data6/top/to_dfc/send//aq02b504.0001topa from danielw@fcdfdata120.fnal.gov
>> Local file /cdf/scratch/cdfmc/danielw/data//aq02b504.0001topa has size 1439447.514
>> Creating ok file /cdf/scratch/cdfmc/danielw/data//aq02b504.0001topa.ok
>> Removing remote file danielw@fcdfdata120.fnal.gov:/export/data6/top/to_dfc/send//aq02b504.0001topa
>> Removing remote file danielw@fcdfdata120.fnal.gov:/export/data6/top/to_dfc/send//aq02b504.0001topa.ok
o Polling buffer id=danielw host=fcdfdata120.fnal.gov dir=/export/data6/top/to_dfc/send/ at Thu Jun 30 10:30:18 CDT 2005
- File: /export/data6/top/to_dfc/send//aq02b54d.0001topa.ok
- Looking for /export/data6/top/to_dfc/send//aq02b54d.0001topa on danielw@fcdfdata120.fnal.gov
o File size : 1331252.066 kb
o Disk free : 918306584 kb
o Quota free: 854932928 kb
>> Getting file /export/data6/top/to_dfc/send//aq02b54d.0001topa from danielw@fcdfdata120.fnal.gov
>> Local file /cdf/scratch/cdfmc/danielw/data//aq02b54d.0001topa has size 1331252.066
>> Creating ok file /cdf/scratch/cdfmc/danielw/data//aq02b54d.0001topa.ok
>> Removing remote file danielw@fcdfdata120.fnal.gov:/export/data6/top/to_dfc/send//aq02b54d.0001topa
>> Removing remote file danielw@fcdfdata120.fnal.gov:/export/data6/top/to_dfc/send//aq02b54d.0001topa.ok