Kafka Commit

Commits a Kafka read message without auto-commit. 

Use

This node triggers a confirmation that a consumer has read a message posted in a Kafka consumer group to which that consumer subscribes. With this node you can process a Kafka message further in your flow before you send a commit message. This ensures that only if a message is successfully processed, the confirmation is sent.

Use this node in a flow together with a Kafka consumer node. In the Kafka consumer node, auto-commit must be turned off.

Attributes

AttributeValuesRemarks
Nameany stringEnter a self-explaining name of the node. If you leave this field empty, the generic name displays in the dashboard.

Example

Create asset notification

Kafka Consumer Group

Connects to Kafka and subscribes to a consumer group to receive messages that are published in that group.

Use

Use this node to subscribe to messages from other microservices and create flows that trigger a reaction. For example, subscribe to messages from the asset repository and trigger a message via email or Slack if a new asset is created.

Attributes

AttributeValuesRemarks
Nameany stringEnter a self-explaining name of the node. If you leave this field empty, the generic name displays in the dashboard.
TypeBaseThe value is pre-selected and cannot be changed!
Brokera Kafka broker id (string)The Kafka brokers are configured for all flows. The Kafka brokers can be selected in the node properties, to set the respective id.
Topics 
Nametopic name (string)Enter the name of the topic to subscribe. You can configure multiple topics in one node.
Options
Group IdA Kafka group id (string)Enter name of the Kafka group to which the consumer subscribes.
ProtocolRound Robin|RangeTo avoid session timeouts due to long idle times, select Round Robin.
Encodingutf8Defaults to UTF8. Do not change!
From Offsetlatest|earliest|none
Commit Offsets on first jointrue|false
Out of range offsetlatest|earliest|none

Example

Create asset notification

Kafka Rollback

Sends a rollback message to the Kafka topic defined in the node and closes the associated consumer.

Use

This node works similar to the Kafka commit node, but triggers a rollback message instead of a read message. Use this node in a flow together with a Kafka consumer node. In the Kafka consumer node, auto-commit must be turned off.

Attributes

AttributeValuesRemarks
Nameany stringEnter a self-explaining name of the node. If you leave this field empty, the generic name displays in the dashboard.