Changes between Version 78 and Version 79 of benchmarks

Show
Ignore:
Timestamp:
11/23/11 16:15:33 (9 years ago)
Author:
bartek
Comment:

--

Legend:

Unmodified
Added
Removed
Modified
  • benchmarks

    v78 v79  
    150150The QCG-Notification performance was compared to the performance of two other services implementing brokered version of WS-Notification specification. These were Apache !ServiceMix (version 3.3.1) and IBM !WebSphere Application Server (version 7.0).  
    151151 
    152 A reliable performance tests of the notification systems are difficult to realise. Note that the proceeding time of a single, small message is very short, difficult to correct measurement and highly depends on many aspects, such us underlying best effort transport protocols, transport protocols or service's configuration.  
     152A reliable performance tests of the notification systems are difficult to realise. Note that the proceeding time of a single, small message is very short, difficult to correct measurement and highly depends on many aspects, such as underlying best effort transport protocols, network protocols or service's configuration.  
    153153 
    154154Taking into account these objectives as well as the fact that the tested notification systems are different: each system provides a set of specific functions that may be unavilable in the another systems (for example, !ServiceMix doesn’t provide support for Full topic dialect), the decision was to test only the most common features and focus on key scenarios. 
     
    160160[[Image(tests-deployment.png, center, width=540px)]] 
    161161 
    162 === Test 1 - Notification Delivery without Active Subscriptions == 
    163 The first test concerned the measurement of the time of sending 1000 notifications while there were no active subscriptions in the tested system. That means the time was counted on a Publisher side and there were any Notification Consumers interested in receiving notifications. 
     162=== Test 1 - Notification Delivery without Active Subscriptions === 
     163The first test concerned the measurement of the time of sending a bunch of notifications while there were no active subscriptions in the tested system. That means that the time was counted on the Publisher side and the notification was not forwarded by the brokers as there were any Notification Consumers interested in receiving notifications. 
     164* filtering based on: topics; 
     165* notification dialect: Simple; 
     166* notification Payload: 320 bytes; 
     167* number of notifications in one bunch: 1000. 
     168 
     169==== Notes ==== 
     170 
     171''Pros:'' 
     172* Possibility to compare : 
     173 * approximately constant number of tasks, 
     174 * "the task flow" (when one task is finished, another begins). 
     175* The program may be used to measure the overall capacity of the system. 
     176 
     177''Cons:'' 
     178* The measured submitting time may be distorted (the response of the service on the submit request does not necessarily imply the submit to the queueing system). 
     179 
    164180=== Test 2 - Notification Delivery with Active Subscriptions === 
    165181