Skip to main content
Version: 8.4

Messages

Process instances can respond to incoming messages. Published messages must be mapped onto a process instance. This step is called message correlation.

Message subscriptions

A message is not sent to a process instance directly. Instead, the message correlation is based on subscriptions that contain the message name and the correlation key (also known as the correlation value).

Message Correlation

A subscription is opened when a process instance awaits a message; for example, when entering a message catch event. The message name is defined either statically in the process (e.g. Money collected) or dynamically as an expression. The correlation key is defined dynamically as an expression (e.g. = orderId). The expressions are evaluated on activating the message catch event. The results of the evaluations are used as message name and as correlation key of the subscription (e.g. "order-123").

When a message is published and the message name and correlation key match to a subscription, the message is correlated to the corresponding process instance. If no proper subscription is opened, the message is discarded.

A subscription is closed when the corresponding element (e.g. the message catch event), or its scope is left. After a subscription is opened, it is not updated (for example, when the referenced process instance variable is changed.)

Publish message via zbctl

zbctl publish message "Money collected" --correlationKey "order-123"

Message buffering

Messages can be buffered for a given time. Buffering can be useful in a situation when it's not guaranteed the subscription is opened before the message is published.

A message has a time-to-live (TTL) which specifies for how long it's buffered. Within this time, the message can be correlated to a process instance.

When a subscription is opened, it polls the buffer for a proper message. If a proper message exists, it is correlated to the corresponding process instance. In case multiple messages match to the subscription, the first published message is correlated (like a FIFO queue).

The buffering of a message is disabled when its TTL is set to zero. If no proper subscription is open, the message is discarded.

Publish message with TTL via zbctl

zbctl publish message "Money collected" --correlationKey "order-123" --ttl 1h

Message cardinality

A message is correlated only once to a process (based on the BPMN process id), across all versions of this process. If multiple subscriptions for the same process are opened (by multiple process instances or within one instance), the message is correlated only to one of the subscriptions.

When subscriptions are opened for different processes, the message is correlated to all the subscriptions.

A message is not correlated to a message start event subscription if an instance of the process is active and was created by a message with the same correlation key. If the message is buffered, it can be correlated after the active instance is ended. Otherwise, it is discarded.

Message uniqueness

A message can have an optional message id — a unique id to ensure the message is published and processed only once (i.e. idempotency). The id can be any string; for example, a request id, a tracking number, or the offset/position in a message queue.

A message is rejected and not correlated if a message with the same name, the same correlation key, and the same id is already buffered. After the message is discarded from the buffer, a message with the same name, correlation key, and id can be published again.

The uniqueness check is disabled when no message id is set.

Publish message with id via zbctl

zbctl publish message "Money collected" --correlationKey "order-123" --messageId "tracking-12345"

Message correlation overview

By combining the principles of message correlation, message uniqueness, and message buffering, very different behaviors can be achieved. Please note that a message name is mandatory, so it is omitted from the table.

Correlation keyMessage IdTime to liveReceiver typeBehavior
setnot setset to 0Start eventA new instance is started if no instance with the correlation key set at start is active, see single instance.
setnot setset to 0Intermediate eventThe message is correlated if a matching subscription is active.
setnot setset > 0Start eventA new instance is started if no instance with the correlation key set at start is active during the lifetime of the message; new equal messages are buffered.
setnot setset > 0Intermediate eventThe message is correlated during the lifetime of the message if a matching subscription is active; new equal messages are buffered.
setsetset to 0Start eventA new instance is started if no instance with the correlation key set at start is active and there is no equal message in the buffer.
setsetset to 0Intermediate eventThe message is correlated if a matching subscription is active and there is no equal message in the buffer.
setsetset > 0Start eventA new instance is started if no instance with the correlation key set at start is active during the lifetime of the message and there is no equal message in the buffer.
setsetset > 0Intermediate eventThe message is correlated during the lifetime of the message if a matching subscription is active and there is no equal message in the buffer.
empty stringnot setset to 0Start eventA new instance is started.
empty stringnot setset to 0Intermediate eventThe message is correlated if a matching subscription to the empty string is active.
empty stringnot setset > 0Start eventA new instance is started.
empty stringnot setset > 0Intermediate eventThe message is correlated during the lifetime of the message if a matching subscription to the empty string is active; new equal messages are buffered.
empty stringsetset to 0Start eventA new instance is started if there is no equal message in the buffer.
empty stringsetset to 0Intermediate eventThe message is correlated if a matching subscription to the empty string is active and there is no equal message in the buffer.
empty stringsetset > 0Start eventA new instance is started if there is no equal message in the buffer.
empty stringsetset > 0Intermediate eventThe message is correlated during the lifetime of the message if a matching subscription to the empty string is active and there is no equal message in the buffer.

Message patterns

The following patterns describe solutions for common problems that can be solved using message correlation.

Message aggregator

Problem: Aggregate/collect multiple messages, map-reduce, batching

Solution:

Message Aggregator

The messages are published with a TTL > 0 and a correlation key that groups the messages per entity.

The first message creates a new process instance. The following messages are correlated to the same process instance if they have the same correlation key.

When the instance ends and messages with the same correlation key are not correlated yet, a new process instance is created.

Single instance

Problem: Create exactly one instance of a process

Solution:

Message Single Instance

The message is published with a TTL = 0 and a correlation key that identifies the entity.

The first message creates a new process instance. The following messages are discarded and do not create a new instance if they have the same correlation key and the created process instance is still active.