Basic Configuration

In this page we list the Camel Kafka Configuration which are not part of the camel-catalog material and are not part of the kafka connect framework. For the specific connector configuration you can have a look at the single documentation pages.

For a Sink connector the basic options are:

Name Description Default Priority

camel.sink.marshal

The camel dataformat name to use to marshal data to the destination

null

HIGH

camel.sink.unmarshal

The camel dataformat name to use to unmarshal data from the topic

null

HIGH

camel.sink.contentLogLevel

Log level for the record’s content. Valid values: TRACE, DEBUG, INFO, WARN, ERROR, OFF.

OFF

HIGH

camel.beans.aggregate

A reference to an aggregate bean, in the form of #class:

null

MEDIUM

camel.aggregation.size

The size of the aggregation, to be used in combination with camel.beans.aggregate

10

MEDIUM

camel.aggregation.timeout

The timeout of the aggregation, to be used in combination with camel.beans.aggregate

500L

MEDIUM

camel.error.handler

The error handler to use: possible value are 'no' or 'default'

default

MEDIUM

camel.error.handler.max.redeliveries

The maximum redeliveries to be use in case of Default Error Handler

0

MEDIUM

camel.error.handler.redelivery.delay

The initial redelivery delay in milliseconds in case of Default Error Handler

1000L

MEDIUM

camel.idempotency.enabled

If idempotency must be enabled or not

false

LOW

camel.idempotency.repository.type

The idempotent repository type to use, possible values are memory and kafka

memory

LOW

camel.idempotency.expression.type

How the idempotency will be evaluated: possible values are body and header

body

LOW

camel.idempotency.expression.header

The header name that will be evaluated in case of camel.idempotency.expression.type equals to header

null

LOW

camel.idempotency.memory.dimension

The Memory dimension of the in memory idempotent Repository

100

LOW

camel.idempotency.kafka.topic

The Kafka topic name to use for the idempotent repository

kafka_idempotent_repository

LOW

camel.idempotency.kafka.bootstrap.servers

A comma-separated list of host and port pairs that are the addresses of the Kafka brokers where the idempotent repository should live

localhost:9092

LOW

For a Source connector the basic options are:

Name Description Default Priority

camel.source.marshal

The camel dataformat name to use to marshal data to the destination

null

HIGH

camel.source.unmarshal

The camel dataformat name to use to unmarshal data from the topic

null

HIGH

camel.source.contentLogLevel

Log level for the record’s content. Valid values: TRACE, DEBUG, INFO, WARN, ERROR, OFF.

OFF

HIGH

camel.source.maxBatchPollSize

The max number of messages retrieved in a single poll()

1000L

MEDIUM

camel.source.maxPollDuration

The maximum time in milliseconds spent in a single call to poll()

1000L

MEDIUM

camel.source.pollingConsumerQueueSize

The queue size for the internal hand-off queue between the polling consumer, and producers sending data into the queue.

1000L

MEDIUM

camel.source.pollingConsumerBlockTimeout

To use a timeout (in milliseconds) when the producer is blocked if the internal queue is full. If the value is 0 or negative then no timeout is in use.

0L

MEDIUM

camel.source.pollingConsumerBlockWhenFull

Whether to block any producer if the internal queue is full.

true

MEDIUM

camel.source.camelMessageHeaderKey

The name of a camel message header containing an unique key that can be used as a Kafka message key. If this is not specified, then the Kafka message will not have a key.

null

MEDIUM

camel.beans.aggregate

A reference to an aggregate bean, in the form of #class:

null

MEDIUM

camel.aggregation.size

The size of the aggregation, to be used in combination with camel.beans.aggregate

10

MEDIUM

camel.aggregation.timeout

The timeout of the aggregation, to be used in combination with camel.beans.aggregate

500L

MEDIUM

camel.error.handler

The error handler to use: possible value are 'no' or 'default'

default

MEDIUM

camel.error.handler.max.redeliveries

The maximum redeliveries to be use in case of Default Error Handler

0

MEDIUM

camel.error.handler.redelivery.delay

The initial redelivery delay in milliseconds in case of Default Error Handler

1000L

MEDIUM

camel.idempotency.enabled

If idempotency must be enabled or not

false

LOW

camel.idempotency.repository.type

The idempotent repository type to use, possible values are memory and kafka

memory

LOW

camel.idempotency.expression.type

How the idempotency will be evaluated: possible values are body and header

body

LOW

camel.idempotency.expression.header

The header name that will be evaluated in case of camel.idempotency.expression.type equals to header

null

LOW

camel.idempotency.memory.dimension

The Memory dimension of the in memory idempotent Repository

100

LOW

camel.idempotency.kafka.topic

The Kafka topic name to use for the idempotent repository

kafka_idempotent_repository

LOW

camel.idempotency.kafka.bootstrap.servers

A comma-separated list of host and port pairs that are the addresses of the Kafka brokers where the idempotent repository should live

localhost:9092

LOW

For more options related to single connector you can have a look at Connectors list.