about moredream   moredream toolkit
 
Home > about moredream > GRASP > SRB enabled globus-url-copy
 
 
MoreDream
  GRASP
- Overview
- JRDL
- SRB enabled...
- Publications
  GAIS
  MPICH-GX
 
 

 

 SRB enabled globus-url-copy
 
 Overview
globus-url-copy, which is an application of Globus toolkit, copies a file specified by source URL to a location specified by destination URL, using the GASS transfer API. It is used to stage in/out files from/to storage device for executing jobs. All protocols supported by GASS (local file, http, https, ftp, and gsiftp) are supported. Piping to/from stdin/stdout (setting source/dest argument = '-') is also supported. However, it could not retrieve/save data from/to storage not to be able to use protocol supported by GASS. The Storage Resource Broker (SRB) is client-server middleware that provides a uniform interface for connecting to heterogeneous data resources over a network and accessing replicated data sets. SRB support a lot of interfaces for data resources including HRM, HPSS, DB2, Oracle, Illustra, ObjectStore, ADSM, UniTree, UNIX, NTFS, and HTTP. Therefore, we modify globus-url-copy application to support SRB protocols as well as GASS protocols for accessing various data resources and replicated data sets.
 
 SRB URI
The location of data file should be described with URL format to use globus-url-copy. Thus, the location of data in SRB could be described with URI format as showed Figure 1. Actually, both replica and resource are not included in [1]. replica might be used for accessing replicated data sets. resource might be used to specify the resource name for creating new data to SRB.
 srb:// [username.mdasdomain [.zone] [:password] @] host [:port]
 [?replica=replica_id][?resource=resources_name] [/path]

where square brackets [...] delineate optional components, the characters :, /, @, and . stand for themselves, and spaces should be ignored. If the optional port number is not included, the default port 5544 will be used.
Figure 1. Syntax for SRB URI
 
As above mentioned, the data could be retrieved from SRB server or be saved to SRB server by specified SRB URI format. If there are no attributes except replica and path in specified format, default configuration will be read in ~/.srb/.MdasEnv file. The ~/.srb/.MdasEnv file includes following default configuration information to connect to SRB server.
 
  • mdasCollectionName : default collection name
  • mdasDomainName : default domain name
  • srbUser : default SRB user id
  • srbHost : default host IP of SRB server
  • srbPort : default host port of SRB server
  • defaultResource: default storage resource name
  • AUTH_SCHEME: default authentication mechanism: PASSWD_AUTH, GSI_AUTH, and ENCRYPT1
  • SERVER_DN : server DN of proxy to invoke SRB server in case of GSI authentication
  •  
     SRB Authentication
    SRB server accepts ENCRYPT1 or GSI authentication. If password exists, it authenticates to SRB server via ENCRYPT1 mechanism. Otherwise, by default, it uses GSI authentication. Because the server DN of proxy to invoke SRB server must be specified in case of GSI authentication, the server DN could be read via ?s, -ss, and ?ds among options of globus-url-copy. If the option is not specified, the server DN should be described by SERVER_DN in ~/.srb/.MdasEnv file.
     
     Download
     
     
     
     Installation
     
    $ tar zxvf globus_gass_copy-srb.tar
    $ cd globus_gass_copy-srb
    $ mkdir /usr/local/srb
    $ tar zxvf SRB3_2_1e.tar.gz ?C /usr/local/srb
    $ export SRB_LOCATION=/usr/local/srb/SRB3_2_1e
    $ ./install.sh
     
     Configuration
     
     
     
    Testing
     
    As globus account,
    $ grid-proxy-init
    $ globus-url-copy \
    srb://username.userdomain@IPADDRESS/collectaioname/filename \
    file:////tmp/filename
    $ more /tmp/filename
     
    Reference
     
    [1] SRB URI Ħ°http://www1.ietf.org/proceedings_new/04nov/IDs/draft-gilbert-srb-uri-00.txtĦħ
     
     
     
     
     

    Copyright (c)2002~2006 MoreDream. All rights reserved.
    mailto:mwteam@gridcenter.or.kr