J4

• 计算机科学 • 上一篇    下一篇

一个基于CSF4的多集群网格计算平台的设计与实现

魏晓辉1, 丁肇辉1, Li Wilfred W2, Osamu Tatabe3, 姜建华1, 郑金爽1, Arzberger Peter2   

  1. 1. 吉林大学 计算机科学与技术学院, 长春 130012; 2. NBCR, 美国加州大学圣地亚哥分校, CA 92093, 美国; 3. 日本国家工业科技研究所, 筑波 3058568, 日本
  • 收稿日期:2005-11-01 修回日期:1900-01-01 出版日期:2006-07-26 发布日期:2006-07-26
  • 通讯作者: 丁肇辉

Design and Implementing of a Grid Computing System Based on CSF4

WEI Xiaohui1, DING Zhaohui1, Li Wilfred W2, Osamu Tatabe3, JIANG Jianhua1, ZHENG Jinshuang1, Arzberger Peter2   

  1. 1. College of Computer Science and Technology, Jilin University, Changchun 130012, China; 2. National Biomedical Computation Resource, University of California, San Diego, CA 92093, USA;3. National Institute of Advanced Industrial Science and Technology, Tsukuba 3058568, Japan
  • Received:2005-11-01 Revised:1900-01-01 Online:2006-07-26 Published:2006-07-26
  • Contact: DING Zhaohui

摘要: 设计并实现了一个基于WSRF的网格计算平台, 该系统基 于Globus Toolkit 4, 集成了元调度器CSF4, 本地调度器SGE5.3/6.0, LSF6.0和openPBS2.3 .16以及数据网格系统Gfarm. 在功能上, 该系统可协同本地及远程的资源管理器, 支持WS GRAM和PreWSGRAM(GT2 Gatekeeper)的协作, 支持完全地委托用户代理证书; 在任 务管理上, 该系统提供了排队服务, 并支持定制调度策略; 另外, 该系统支持LSF, PBS, SGE, Condor等多种资源管理器类型.

关键词: 网格计算, 元调度器, WSRF, CSF4, 局部调度器

Abstract: The applications in such fields as bioinformatics, etc. increasingly demand more powerful computing environments and huge amounts of distributed data. One single supercomputer or cluster cannot meet the requirements. Using metascheduler can coordinate multiple local clusters so that it is able to provide a scalable grid environment with much more computing resources and disk space. We designed a grid infrastructure based on GT4 (WSRF) and a metascheduler CSF4. The users can take the advantages of the queuing service and cust omized scheduling polices provided by the metascheduler. CSF4 is enhanced to work with different local schedulers, like LSF, PBS, SGE and Condor etc, in remote clusters. The system supports both GT4 WS\|GRAM and GT2 GRAM (Gatekeeper) and is able to delegate client proxy with full delegation. Furthermore, Gfarm is integrated to the system to provide a global file system for dataintensive applications. The system has been deployed on the test\|bed of PRAGMA (Pacific rim applications & grid middleware assembly). A few of bioinformatic applications, like iGap and wublast, have been run successfully on the system.

Key words: grid computing, metascheduler, WSRF, CSF4, localscheduler

中图分类号: 

  • TP31