User Tools

Site Tools


operations:documentation.ivs.bonnetransfer

This is an old revision of the document!


Transferring Data to Bonn

  • Use a VNC session to run the transfers - the hobart.phys.utas.edu.au:1 session is normally a good option.
  • Open four terminal windows on the Mark5 unit the data will be sent from
  • In the first terminal, make sure that neither fuseMk5 or dimino is running
    ps -ef | grep dim

    and

    ps -ef | grep fuse

    and that another transfer isn't running

    ps -ef | grep tsuna

    .

  • If fuseMk5A is running and the wrong module is mounted, dismount with
    fusermount -u <directory_name>
  • Then use fuseMk5 (or fuseMk5A for unupgraded mark5 units) to mount the module:
    fuseMk5 --bank=0 --verbose --cachesize=128000000 /mnt/diskpack

    This will mount Bank A (set bank=1 for Bank B) at /mnt/diskpack. Wait for a message to say

    .... Registering fuseMk5A to FUSE with: ....

    . It can take a while. Background this process with Ctrl-z and

     bg 

    .

  • In a second terminal, change to the mounted directory and make sure the data are there
    cd /mnt/diskpack
    ls
  • Start the tsunami daemon to send the data:
    tsunamid --port=52100 *
  • In the third terminal window, log on to the computer at Bonn that will receive the data and change to the directory where the data will be sent
    ssh evlbi@<machine.address>
    cd /data3/r1/hobart12/r1485/

    The Bonn web page shows available servers and space.

(194.94.199.166 = sneezy2)

  • Start tsunami and set up for a transfer
tsunami
set rate 300m
connect 131.217.63.175 52100
get *
  • in the fourth terminal window, create an empty file with a name describing the start time of the transfer, rate etc:
    touch 20110525033000_r1485_Hb_Bonn_300m_52100_sneezy2_start

    This puts an entry on the Bonn web page to say there's a transfer under way

  • and send it to the web server
    ncftpput ftp.mpifr-bonn.mpg.de /incoming/geodesy/transfers 0110525033000_r1485hb_Hb177_Bonn_300m_52100_sneezy2_start
  • When the transfer finishes, send a stop message with
    touch 20110525033000_Hb_stop
    ncftpput ftp.mpifr-bonn.mpg.de /incoming/geodesy/transfers 20110525033000_Hb177_stop

It is also possible (and preferable) to export the data onto a RAID first. Currently, there are three RAIDS which can beused for temporary storage at Hobart - Vortex, Cornucopia and 131.217.63.140 (Currently unnamed and contains two separate RAIDS of 6 and 12 TB). These can be NFS mounted on the mk5 machine with

mount vortex.phys.utas.edu.au:/exports/vortex_internal/ /mnt/vortex

(as root). Once mounted the data can be copied with

cp /mnt/diskpack/r1485* /mnt/vortex/r1485hb/

.

Once fully copied, please check the data has not been corrupted in the transfer. ssh into hex0 and NFS mount the RAID if necessary. Then run

directory2filelist /mnt/vortex/r1485hb Mark5B-256-16-1 > /tmp/ok.txt

. The output to the screen will be the list of those scans which show problems. It's not uncommon to see up to ~10% of the scans fail the test - these files should be deleted and retransferred to the RAID.

The same

directory2filelist

procedure should be run after a transfer to Bonn completes to check for errors in transmission.

/home/www/auscope/opswiki/data/attic/operations/documentation.ivs.bonnetransfer.1352849748.txt.gz · Last modified: 2012/11/13 23:35 by Jamie McCallum