Economics Paradigm for Resource Management and Scheduling for Service Oriented Peer-to-Peer and Grid Computing


Rajkumar Buyya
School of Computer Science and Software Engineering
Monash University, Melbourne, Australia

Abstract

Peer-to-Peer (P2P) and Grid computing platforms enable the creation of Virtual Enterprises (VEs) for sharing geographically distributed resources, such as computers and data sources, for solving large-scale problems in science, engineering, and commerce. However, resource management, application development and usage models in these environments is a complex undertaking. This is due to the geographic distribution of resources that are owned by different organizations having different usage policies and cost models, and varying loads and availability patterns. To address these resource management challenges, we have proposed and developed computational economy framework for resource allocation and regulation of supply and demand for resources. The new framework offers incentive to resource owners for being part of the Grid and motivates resource users to trade off between time-frame for results delivery and computational cost.

As part of the Economy Grid and Nimrod-G projects, we have developed a Grid Resource Broker called Nimrod/G that supports soft-deadline and budget based scheduling of task framing applications on P2P Grid distributed across the globe. Depending on users' QoS requirements, our resource broker dynamically leases Grid services at runtime depending on their cost, quality, and availability. In addition to deadline and budget constraints in scheduling, our broker supports optimization of either of them.

The presentation covers four topics. First, we briefly review emerging trends in network-based high performance computing and identify resource management challenges. Then, we introduce our framework on Grid Architecture for Computational Economies (GRACE) that leverages existing technologies such as Globus and provides new services that are essential for constructing industrial-strength Grids. We discuss the use of our economic grid infrastructure in scheduling parametric computations containing hundreds of jobs for execution on the World Wide Grid (WWG) testbed resources spanning across five continents (Australia, Asia, Europe, North America, and South America). Finally, we present the usage of our Grid tools in modeling and execution of data-intensive Virtual Drug Design application on the Grid to demonstrate capabilities of our system. For further information on Economics of P2P Grid Computing, see: http://www.csse.monash.edu.au/~rajkumar/ecogrid/

About the Speaker

Rajkumar Buyya is an Australian Government Research Scholar in the School of Computer Science and Software Engineering at Monash University, Melbourne, Australia. He was awarded Dharma Ratnakara Memorial Trust Gold Medal for his academic excellence during 1992 by Mysore/Kuvempu University. He has authored three books Microprocessor x86 Programming, Mastering C++, and Design of PARAS Microkernel. He has edited a popular two volumes book on High Performance Cluster Computing published by Prentice Hall, USA. He also edited proceedings of six international conferences and served as guest editor for major research journals. He has contributed to the development of system software for PARAM supercomputers produced by the Centre for Development of Advanced Computing (C-DAC), Bangalore, India. At Monash University, he is conducting R&D on the use of Economics paradigm for Peer-to-Peer Grid computing. Rajkumar is a speaker in the IEEE Computer Society Chapter Tutorials Program and Co-founder/Chair of the IEEE Computer Society Task Force on Cluster Computing (TFCC). He has organised and chaired IEEE/ACM international conferences in the area of Cluster and Grid Computing. He has lectured on advanced technologies such as Multithreaded Computing, Internet and Java, Cluster Computing, and Grid Computing in many international conferences and institutions. For further information, please browse: http://www.buyya.com