Grid_environment

How to Configure GridWay? Based on DRBL

• 1. Introduction
  
  
  • GridWay? is a Globus project, which provides scheduling functionalities similar to distributed resource management systems. GridWay? interfaces to remote resources through Globus GRAM job manager. GridWay? meta-scheduler integrates with the remote platforms and resource managers (Fork, PBS, SGE, LSF, LoadLeveler? and Condor) compatible with Globus.

• 2. Configure GridWay? on the DRBL server and clients
  
  
  • Building and installing GridWay? based on DRBL is very easy. You only install on the DRBL server by consulting ​GridWay 5.4 System Administrator's Guide and then configure the file:gwd.conf. To uncomment the last three lines and modify the server name.

    #
    # Example MAD Configuration for WS testbeds
    #
    IM_MAD = mds4:gw_im_mad_mds4_thr:-s drbl-srv.nchc.org.tw:gridftp:ws
    EM_MAD = ws:gw_em_mad_ws::rsl2
    TM_MAD = gridftp:gw_tm_mad_ftp:
    

  • IM_MADs is Information Manager Middleware Access Drivers. They are responsible for host discovery and monitoring. You can reference ​GridWay 5.4 System Administrator's Guide 3.4. Information Driver Configuration and ​GT 4.2 Quickstart 3. VO-level services to set up gwd.
    
    
  • Finally, you can start the gwd daemon to perform GridWay? successfully on the DRBL server and clients.
    
    

• 3. Troubleshooting
  
  
  • (1) Could not create remote job directory (gsiftp://pc111.nchc.org.tw/~/.gw_gwuser_3/).
    
    
    • Please check Gridftp. You can reference ​Set up GridFTP.
      
      
  • (2) Copy of file stdout.wrapper failed. Copy of file stderr.wrapper failed. Some output files were not copied, will NOT remove remote directory.
    
    
    • At first, you should check if the GridWay? administrator and all GridWay? users are the same UNIX group. The permission of the job working directory($GW_JOB_HOME) should be written by the GridWay? users. You can try "chmod g+w $GW_JOB_HOME".
      
      
  • (3) Transfer MAD ($nice) not loaded for user gwuser
    
    
    • The setting format of the configuration file (gwd.conf) in older versions and new version are different.
      
      

      older versions:
      IM_MAD = <mad_name>:<path_to_mad>:[args]:[nice]:<tm_mad_name>:<em_mad_name>
      
      nice: Integer value, that will be added to the rank calculated for the hosts managed by this Information Driver. 
            So you can prioritize, at a coarse level, hosts from different Information Drivers (or Grids).
      

      new version (v5.4):
      IM_MAD = <mad_name>:<path_to_mad>:[args]:<tm_mad_name>:<em_mad_name>
      

    • Now GridWay? has remove [nice] field, so you may meet this error(Transfer MAD ($nice) not loaded for user gwuser) if you still set the [nice] field.

References

• ​GridWay 5.4 System Administrator's Guide
• ​GridWay 5.4 User's Guide