Kafka Confluent S3 Connector “Failed to find class”

Refresh

December 2018

Views

905 time

3

I'm trying a simple quickstart example and I get:

Caused by: org.apache.kafka.connect.errors.ConnectException: Failed to find any class that implements Connector and which name matches io.confluent.connect.s3.S3SinkConnector, available connectors are: io.confluent.connect.jdbc.JdbcSinkConnector, io.confluent.connect.jdbc.JdbcSourceConnector, org.apache.kafka.connect.tools.MockSinkConnector, org.apache.kafka.connect.file.FileStreamSourceConnector, org.apache.kafka.connect.sink.SinkConnector, io.confluent.connect.elasticsearch.ElasticsearchSinkConnector, org.apache.kafka.connect.tools.MockConnector, io.confluent.connect.hdfs.HdfsSinkConnector, org.apache.kafka.connect.file.FileStreamSinkConnector, org.apache.kafka.connect.tools.VerifiableSourceConnector, org.apache.kafka.connect.tools.VerifiableSinkConnector, org.apache.kafka.connect.tools.SchemaSourceConnector, org.apache.kafka.connect.source.SourceConnector, org.apache.kafka.connect.tools.MockSourceConnector, io.confluent.connect.hdfs.tools.SchemaSourceConnector

This is a brand new VM running the latest Confluent Platform 3.2.0 installed via Debian apt package. I can see that it definitely is running CP 3.2.0. Why wouldn't the S3 connector class be available?

Not sure if this is related, but if I do:

ls -l /etc/ | grep kafka
drwxr-xr-x 2 root root           4096 Apr  5 04:41 kafka
drwxr-xr-x 2 root root           4096 Apr  5 04:39 kafka-connect-elasticsearch
drwxr-xr-x 2 root root           4096 Apr  5 04:39 kafka-connect-hdfs
drwxr-xr-x 2 root root           4096 Apr  5 04:39 kafka-connect-jdbc
drwxr-xr-x 2 root root           4096 Apr  5 04:39 kafka-rest

The docs reference a kafka-connect-s3 directory that clearly doesn't exist in the installation.

I'm using the Open Source variant of the Confluent Platform but according to https://www.confluent.io/product/compare/, the open source version includes the Confluent Amazon S3 Connect connector.

2 answers

1

В качестве обходного пути, вы можете скачать почтовую или деготь версию с http://confluent.io

Оттуда вы найдете kafka-connect-s3в etcи share/javaдиректории.

1

Это была ошибка упаковки в 3.2.0 и фиксируется в последней версии Confluent, которая по состоянию на сегодня (17 мая 2017) является 3.2.1

Существует также исправлена ​​ошибка в S3 Connector в версии 3.2.1, так что лучше использовать эту версию в любом случае.