Information
Trouble Ticket
Windows
Macintosh
UNIX
Supercomputing
Remote Access
Software
Security
Storage
Site Map & Search
TSRI Home

Introducing the DMF file archiver


What is the DMF File archiver:
The file archiver is a combination of a very high performance disk system coupled with a large high speed tape library:
  • 35 TByte disk cache (approximately 30 day cache).
  • automated robotics to handle tape mounts.
  • The file archiver is designed to be an archival repository for data. Workstation and pc/mac backups are done on a separate system.
  • Only large files (greater than 4096 Bytes) are migrated to tape.
  • Two copies are made of all migrated data and unix dumps are done everyday for the file system.
  • Getting an account: Email wyoung@scripps.edu


    How do you access the archiver:

  • Currently available on UNIX machines (including Mac OSX) and Windows NT/2000/XP (PC usage see the xdmf web page)
  • add /tsri/dmf/bin to your path 
  • use dmf command:

  •  

    beamish% dmf help

    Commands Available
    -------------------------
    cat    - displays the contents of a file.
    cd     - changes directory.
    chgrp  - changes the group associated with a file.
    chmod  - change the protection of a file.
    cp     - copies file on archiver.
    get    - gets a file from archiver.
    echo   - echos arguments. (Useful for wildcards.)
    head   - prints the first few lines of a file.
    help   - prints this message.
    ls     - lists files on archiver.
    local  - executes a command on the local machine.
    mkdir  - makes a directory on archiver.
    more   - display a file in paged mode.
    mv     - renames a file on archiver.
    pwd    - prints current working directory.
    quit   - exits.
    revision - prints the current revision of dmf.
    rm     - deletes a file from archiver.
    rmdir  - deletes an empty directory from archiver.
    store  - stores a file on archiver.
    tail   - prints the last few lines of a file.
    tar   - create a tar file, list or extracts tar file from archiver.

    Creating a directory:

    beamish% dmf mkdir results

    Storing a file:

    To store a tar file with results in your results directory:

    beamish% dmf put GB_RNA.tar results
    storing GB_RNA.tar to dmf:/home/wyoung/results

    Storing a directory:

    atlas% dmf tar c new_results.tar spider
    creating /home/wyoung/new_results.tar from  spider

    Listing contents:

    beamish% dmf ls results
    GB_RNA.tar

    Listing tar files:

    To list the contents of a tar file stored on dmf:

    atlas% dmf tar t new_results.tar
    ...

    Restoring a file:

    beamish% dmf get results/GB_RNA.tar /tmp
    getting dmf:/home/wyoung/results/GB_RNA.tar to /tmp

    Restoring a directory:

    To restore a directory stored as a tar file on dmf to you current directory:

    atlas% dmf tar x new_results.tar
    restoring /home/wyoung/new_results.tar to /scratch/wyoung/99431.atlas
    ....

    Problems:

  • Example 1:
  • pynchon% dmf ls
    Permission denied.
    rsh: connection failed

    Command failed to execute.
    Mon Apr 10 18:20:54 PDT 2000

    by default, access is only granted from a users "home" computer. users must control access to their files. Add the additional hosts to .rhosts on archiver (this must be done from "home" computer).

    beamish% cat > junk
    beamish
    buzz
    pynchon
    ^d
    beamish% dmf put junk .rhosts
    storing junk to dmf:/home/wyoung/.rhosts

  • Example 2:
  • beamish% dmf ls

    Mon Apr 10 18:23:10 PDT 2000 dmf is temporarily unavailable, sleeping for 300 secs.

    The system is temporarily unavailable, please be patient.

    Advanced:

    beamish% dmf ls -l results
    total 664
    -rw-r--r--    1 wyoung   rcgroup   337920 Apr 10 18:17 (MIG) GB_RNA.tar
    beamish% dmf ls -l results
    total 0
    -rw-r--r--    1 wyoung   rcgroup   337920 Apr 10 18:17 (OFL) GB_RNA.tar

    REG indicates file is only on disk (new or small file)
    MIG indicates file is currently being written to tape
    DUL indicates file is both on tape and disk
    OFL indicates file exists only on tape
    UNM indicates file is currently being read from tape

     

    Copyright © 2004 TSRI.