Version 104 (modified by bartek, 13 years ago) (diff)

--

QosCosGrid

The QosCosGrid (QCG) middleware is an integrated e-infrastructure offering advanced job and resource management capabilities to deliver to end-users supercomputer-like performance and structure. By connecting many computing clusters together, QosCosGrid offers easy-to-use mapping, execution and monitoring capabilities for variety of applications, such as parameter sweep, workflows, MPI or hybrid MPI-OpenMP. Thanks to QosCosGrid, large-scale and complex computing models written in Fortran, C, C++ or Java can be automatically distributed over a network of computing resources with guaranteed Quality of Service. Consequently, applications can be run at given periods of time, their execution time and waiting times can be reduced, and thus bigger problem instances can be considered.

News

QosCosGrid in Mapper

April 2011

It was decided to use the QosCosGrid middleware to multi-scale computations in the Mapper project. Installations of the QosCosGrid middleware at production sites in Europe, including EGI and PRACE machines, are currently being discussed.

QCG release 2.0

16 April 2011

We are happy to introduce a next relase of QosCosGrid. This is the first release after finishing the QosCosGrid project and takes a number 2.0.

QosCosGrid middleware deployed in PL-Grid

more

QCG Middleware

QosCosGrid provides:

  • the most efficient remote access to computational resources in a single cluster or many clusters in Poland and Europe,
  • automatic steering of various types of complex computing experiments ranging from multi-parameter sweep studies to cross-cluster executions of parallel applications,
  • fully transparent integration with parallel programming and execution environments like OpenMPI and ProActive located on many computing clusters,
  • support for Quality of Service (e.g. start time) based on advance reservation mechanisms,
  • shorter waiting times and improved resource utilization by hierarchical grid- and local-level job scheduling,
  • management of input and output files in distributed computing clusters,
  • efficient integration between services and queuing systems ensuring high performance and reliability of the overall system,
  • extensible, open and standard based architecture supporting OGF DRMAA, JSDL, BES and HPC Profile with pluggable modules,
  • secure communication channels using transport level (SSL/TLS, X.509) and message level (SAML2.0) mechanisms,
  • delivered together with command-line, graphical, web-based or even mobile phone tools for end users and administrators,
  • fast and reliable installation procedures.

QosCosGrid consists of following components:

Component Main function Home Page
QCG-Computing Basic Execution Service (BES) with Advanced Reservation Support  link
QCG-Notification Notification capabilities based on brokered version of OASIS WS-Notification standard  link
QCG-Broker Resource Management and Brokering service  link
QCG-OpenMPI Extended version of OpenMPI library supporting cross-cluster job execution  link
QCG-Core Common library for QosCosGrid components  link
QCG-Tools Various elements extending the QosCosGrid functionality  link

For more information see Components and Architecture section.

End-user Information

The demanding nature of scientific simulations requires a new e-Infrastructure that is able to simultaneously manage heterogeneous resources, such as computing resources, storage and network to guarantee the level of Quality of Service (QoS) required by end-users for their applications, especially a large number of legacy applications designed to run in parallel. Addressing the need of end-users to run large scale complex simulations we have built a system capable to bring supercomputer-like performance for advanced applications, including sophisticated parameter sweep experiments, workflows, and more importantly cross-cluster parallel computations. For high-level end-users we provide a QCG Science Gateways, the components offering an easy access to concrete applications. If you are interested in using QosCosGrid as a user see End-user Information.

Application Developer Information

QosCosGrid provides a consistent environment for creating and deploying Grid applications. Developers of new software should look at the Application Developer section to get detailed information about QosCosGrid sollutions simplifying Grid application implementation and deployment.

Interoperability & standards supported

The QosCosGrid implementation is based on the open, widely accepted standards. In general, QosCosGrid supports OGF DRMAA, JSDL, BES, HPC Profile and OASIS WS-Notification.

Contacts

The QosCosGrid Infrastructude middleware is developed by the team of Applications Department of  Poznan Supercomputing and Networking Center

General questions please send to:  contact@qoscosgrid.org

Technical questions please send to:  support@lists.qoscosgrid.org