Performance Evaluation of Architectures for Distributed Real-Time Communication (DiRC)



Research project financed by

All your base

Funded period: October 2004 - September 2009

DiRC Project Team

Researchers
Partners
Dieter Hemkemeyer (Siemens AG)
Rainer Zimmermann (Siemens EN GmBH)
Mark Wuwer (Siemens EN GmBH)

Contents:   Summary  |  Publish/Subscribe  |  MoM Frameworks  |  On the Web  |  Publications

Summary

The publish subscribe principle In this project, we focus architectures for distributed real-time communication. In particular, we study eventing sytems that are implemented, e.g., according to the publish/subscribe paradigm. They may be used as a middleware in distributed applications.

The Publish/Subscribe Communication Pattern

In publish/subscribe communications, both information providers -- so-called publishers -- and information consumers -- so-called subscribers -- register at a central server. The publishers send messages to the server that forwards them to all subscribers. Optionally, subscribers can install filters on the server that select only a certain subset of messages for them. Currently we study the following problems.

  • There are no or only insufficient performance evaluation studies about the capacity of JMS servers. We tested several types from different vendors and assessed their capacity in different application scenarios, in particular with and without filters. Our measurement results showed that the capacity of the servers ranges over several orders of magnitude depending on the server type and the application scenario.
  • Eventing systems in large distributed applications must handle an enormous message rate. The applications often have real-time or quasi-real-time requirements, i.e., the delay observed by the messages at the JMS server must be small. As mentioned above, the service time for messages ranges over several orders of magnitude. We considered different application scenarios to assess a reasonable upper bound on the variation of the service time and derived the waiting time distribution for the messages. The results showed that the waiting time is short even at a high server load of 90% if the server capacity is sufficiently large.
  • The capacity of a single server may not suffice to forward the traffic of a large-scale application. Therefore, we look at the performance of server clusters.
  • In case of a failure the subscriptions and their information has to be moved to a backup server. The JMS API itself does not provide any methods by default. So each software implementor has to follow an efficient strategy. In case of ActiveMQ we investigate the Master/Slave and a so-called Network of Brokers mode.

The Request/Reply Communication Pattern

However the publish/subscribe communcation pattern provides an efficient one-way and decoupled message transmission in certain cases an immediate response on a send request might be necessary in software archictecture. This client/server based communication is supported by several protocols available in the Internet. We focus on such, that support an seamless exchangable integration and supporting decoupling as provided by the publish/subscribe principle. Esp. in the field of service oriented architectures already exist implementations of application layer protocols, e.g. SOAP. As a key element of these protocols one may focus their interface frameworks, which might introduce additional overhead. As an ongoing research we evaluate and compare the performance of different implementations of these message oriented middleware frameworks.

  • One aspect of resarch is the maximum achievable throughput depending on the introduced overhead per message transmission.
  • Another performance impact might be introduced by long lasting connections.
  • The characterization and a comparable model of the introduced overhead for the different alternatives will support the design of future applications
  • Links and Literature

    General information on publish/subscribe and JMS

    Software products following the JMS API

    Software products appropriate for request/reply communication

    Publications

    Journal Articles

    Robert Henjes, Michael Menth, and Valentin Himmler
    Throughput Performance of the BEA WebLogic JMS Server.
    International Transactions on Systems Science and Applications, Volume 3, Number 3, 2007.
    [Bibtex]

    Michael Menth, Robert Henjes, Sebastian Gehrsitz, Christian Zepfel
    Throughput Performance of Popular JMS Servers.
    ACM SIGMETRICS Performance Evaluation Review (PER), 34(1), 2006.
    [PDF (52 kB)][Bibtex]

    Conference Articles

    Robert Henjes, Michael Menth, and Valentin Himmler
    Impact of Complex Filters on the Message Throughput of the ActiveMQ JMS Server.
    International Teletraffic Congress (ITC), Ottawa, Canada, June 2007.
    [PDF (288 kB)][Bibtex]

    Robert Henjes, Michael Menth, and Valentin Himmler
    Throughput Performance of the ActiveMQ JMS Server.
    ITG/GI Symposium Communication in Distributed Systems (KiVS), Bern, Switzerland, February 2007.
    [PDF (184 kB)][Bibtex]

    Robert Henjes, Michael Menth, and Christian Zepfel
    Throughput Performance of Java Messaging Services Using WebsphereMQ.
    5th International Workshop on Distributed Event-Based Systems (DEBS), Lisboa, Portugal, July 2006.
    [PDF (153 kB)][Bibtex]

    Michael Menth and Robert Henjes
    Analysis of the Message Waiting Time for the FioranoMQ JMS Server.
    26th International Conference on Distributed Computing Systems (ICDCS), Lisboa, Portugal, July 2006.
    [PDF (350 kB)][Bibtex]

    Michael Menth, Robert Henjes, Sebastian Gehrsitz, and Christian Zepfel
    Throughput Performance of Popular JMS Servers.
    Joint International Conference on Measurement and Modeling of Computer Systems (SIGMETRICS/Performance), Saint-Malo, France, June 2006.
    [PDF (55 kB)][Bibtex]

    Robert Henjes, Michael Menth, and Christian Zepfel
    Throughput Performance of Java Messaging Services Using Sun Java System Message Queue.
    Proceedings 20th European Conference on Modelling and Simulation, Bonn, Germany, May 2006.
    [PDF (266 kB)][Bibtex]

    Robert Henjes and Michael Menth and Sebastian Gehrsitz
    Throughput Performance of Java Messaging Services Using FioranoMQ.
    13th GI/ITG Conference on Measuring, Modelling and Evaluation of Computer and Communication Systems (MMB), Nürnberg, Germany, March 2006.
    [PDF (233 kB)][Bibtex]

    Diploma Thesis

    Matthias Koller
    Performance Evaluation of Failover Mechanisms for the ActiveMQ JMS Server.
    [Leistungsbewertung von Ausfallsicherungsmechanismen für den ActiveMQ JMS Server], March 2009.[Bibtex]

    Valentin Himmler
    Performance Comparison of Popular JMS Servers in Different Application Scenarios.
    [Leistungsvergleich von gängigen JMS Servern in unterschiedlichen Anwendungsszenarien], January 2007.[Bibtex]

    Christian Zepfel
    Performance Comparison of the WebsphereMQ and the SunMQ JMS Server for Real-Time Messaging.
    [Leistungsvergleich der JMS Server WebsphereMQ und SunMQ im Echtzeitkommunikationsumfeld], February 2006.[Bibtex]

    Sebastian Gehrsitz
    Performance Analysis of Messaging Systems for Real-Time Communication.
    [Leistungsanalyse von Messaging Systemen zur Echtzeitkommunikation], October 2005.[Bibtex]


    back to NGN Group