如何解决无法为 Kafka 启动嵌入式服务器以进行 Junit 测试
我正在尝试锻炼已经从 github 实现的示例,以了解通过 Junit 进行的 Springboot Kafka 单元测试。 我是测试新手。 我正在使用此代码 Github 当我尝试将它作为 Junit 运行时,它给了我下面提到的错误:
2021-06-16 18:14:15.907 INFO 9864 --- [ main] o.a.k.clients.producer.KafkaProducer : [Producer clientId=producer-1] Closing the Kafka producer with timeoutMillis = 0 ms.
2021-06-16 18:14:15.918 INFO 9864 --- [ -C-1] o.a.k.c.c.internals.ConsumerCoordinator : [Consumer clientId=consumer-sender-1,groupId=sender] Revoke prevIoUsly assigned partitions UpdatedBrandEvent-0,UpdatedBrandEvent-1
2021-06-16 18:14:15.918 INFO 9864 --- [ -C-1] o.s.k.l.KafkaMessageListenerContainer : sender: partitions revoked: [UpdatedBrandEvent-0,UpdatedBrandEvent-1]
2021-06-16 18:14:15.918 INFO 9864 --- [ -C-1] o.a.k.c.c.internals.AbstractCoordinator : [Consumer clientId=consumer-sender-1,groupId=sender] Member consumer-sender-1-95af1165-2ad8-4ea4-896b-28fbd9cef316 sending LeaveGroup request to coordinator localhost:60727 (id: 2147483647 rack: null) due to the consumer unsubscribed from all topics
2021-06-16 18:14:15.920 INFO 9864 --- [ -C-1] o.a.k.clients.consumer.KafkaConsumer : [Consumer clientId=consumer-sender-1,groupId=sender] Unsubscribed all topics or patterns and assigned partitions
2021-06-16 18:14:15.920 INFO 9864 --- [ -C-1] o.s.s.c.ThreadPoolTaskScheduler : Shutting down ExecutorService
2021-06-16 18:14:15.924 INFO 9864 --- [quest-handler-0] k.coordinator.group.GroupCoordinator : [GroupCoordinator 0]: Member[group.instance.id None,member.id consumer-sender-1-95af1165-2ad8-4ea4-896b-28fbd9cef316] in group sender has left,removing it from the group
2021-06-16 18:14:15.924 INFO 9864 --- [quest-handler-0] k.coordinator.group.GroupCoordinator : [GroupCoordinator 0]: Preparing to rebalance group sender in state PreparingRebalance with old generation 1 (__consumer_offsets-0) (reason: removing member consumer-sender-1-95af1165-2ad8-4ea4-896b-28fbd9cef316 on LeaveGroup)
2021-06-16 18:14:15.926 INFO 9864 --- [quest-handler-0] k.coordinator.group.GroupCoordinator : [GroupCoordinator 0]: Group sender with generation 2 is Now empty (__consumer_offsets-0)
2021-06-16 18:14:15.936 INFO 9864 --- [ -C-1] essageListenerContainer$ListenerConsumer : sender: Consumer stopped
2021-06-16 18:14:15.964 INFO 9864 --- [ main] kafka.server.KafkaServer : [KafkaServer id=0] shutting down
2021-06-16 18:14:15.965 INFO 9864 --- [ main] kafka.server.KafkaServer : [KafkaServer id=0] Starting controlled shutdown
2021-06-16 18:14:15.982 INFO 9864 --- [er-event-thread] kafka.controller.KafkaController : [Controller id=0] Shutting down broker 0
2021-06-16 18:14:15.988 INFO 9864 --- [er-event-thread] state.change.logger : [Controller id=0 epoch=1] Sending UpdateMetadata request to brokers HashSet() for 0 partitions
2021-06-16 18:14:15.993 INFO 9864 --- [ main] kafka.server.KafkaServer : [KafkaServer id=0] Controlled shutdown succeeded
2021-06-16 18:14:16.002 INFO 9864 --- [ main] icationListener$ChangeEventProcessthread : [/config/changes-event-process-thread]: Shutting down
2021-06-16 18:14:16.003 INFO 9864 --- [-process-thread] icationListener$ChangeEventProcessthread : [/config/changes-event-process-thread]: Stopped
2021-06-16 18:14:16.003 INFO 9864 --- [ main] icationListener$ChangeEventProcessthread : [/config/changes-event-process-thread]: Shutdown completed
2021-06-16 18:14:16.003 INFO 9864 --- [ main] kafka.network.socketServer : [SocketServer brokerId=0] Stopping socket server request processors
2021-06-16 18:14:16.012 INFO 9864 --- [ main] kafka.network.socketServer : [SocketServer brokerId=0] Stopped socket server request processors
2021-06-16 18:14:16.013 INFO 9864 --- [ main] kafka.server.KafkaRequestHandlerPool : [data-plane Kafka Request Handler on broker 0],shutting down
2021-06-16 18:14:16.016 INFO 9864 --- [ main] kafka.server.KafkaRequestHandlerPool : [data-plane Kafka Request Handler on broker 0],shut down completely
2021-06-16 18:14:16.020 INFO 9864 --- [ main] perationPurgatory$ExpiredOperationReaper : [ExpirationReaper-0-Alteracls]: Shutting down
2021-06-16 18:14:16.220 INFO 9864 --- [per-0-Alteracls] perationPurgatory$ExpiredOperationReaper : [ExpirationReaper-0-Alteracls]: Stopped
2021-06-16 18:14:16.220 INFO 9864 --- [ main] perationPurgatory$ExpiredOperationReaper : [ExpirationReaper-0-Alteracls]: Shutdown completed
2021-06-16 18:14:16.221 INFO 9864 --- [ main] kafka.server.KafkaApis : [KafkaApi-0] Shutdown complete.
2021-06-16 18:14:16.222 INFO 9864 --- [ main] perationPurgatory$ExpiredOperationReaper : [ExpirationReaper-0-topic]: Shutting down
2021-06-16 18:14:16.309 INFO 9864 --- [ main] perationPurgatory$ExpiredOperationReaper : [ExpirationReaper-0-topic]: Shutdown completed
2021-06-16 18:14:16.309 INFO 9864 --- [nReaper-0-topic] perationPurgatory$ExpiredOperationReaper : [ExpirationReaper-0-topic]: Stopped
2021-06-16 18:14:16.312 INFO 9864 --- [ main] k.c.transaction.TransactionCoordinator : [TransactionCoordinator id=0] Shutting down.
2021-06-16 18:14:16.313 INFO 9864 --- [ main] k.c.transaction.ProducerIdManager : [ProducerId Manager 0]: Shutdown complete: last producerId assigned 0
2021-06-16 18:14:16.314 INFO 9864 --- [ main] k.c.transaction.TransactionStateManager : [Transaction State Manager 0]: Shutdown complete
2021-06-16 18:14:16.314 INFO 9864 --- [ main] k.c.t.TransactionMarkerChannelManager : [Transaction Marker Channel Manager 0]: Shutting down
2021-06-16 18:14:16.318 INFO 9864 --- [rSenderThread-0] k.c.t.TransactionMarkerChannelManager : [Transaction Marker Channel Manager 0]: Stopped
2021-06-16 18:14:16.318 INFO 9864 --- [ main] k.c.t.TransactionMarkerChannelManager : [Transaction Marker Channel Manager 0]: Shutdown completed
2021-06-16 18:14:16.319 INFO 9864 --- [ main] k.c.transaction.TransactionCoordinator : [TransactionCoordinator id=0] Shutdown complete.
2021-06-16 18:14:16.320 INFO 9864 --- [ main] k.coordinator.group.GroupCoordinator : [GroupCoordinator 0]: Shutting down.
2021-06-16 18:14:16.321 INFO 9864 --- [ main] perationPurgatory$ExpiredOperationReaper : [ExpirationReaper-0-Heartbeat]: Shutting down
2021-06-16 18:14:16.510 INFO 9864 --- [ main] perationPurgatory$ExpiredOperationReaper : [ExpirationReaper-0-Heartbeat]: Shutdown completed
2021-06-16 18:14:16.510 INFO 9864 --- [per-0-Heartbeat] perationPurgatory$ExpiredOperationReaper : [ExpirationReaper-0-Heartbeat]: Stopped
2021-06-16 18:14:16.511 INFO 9864 --- [ main] perationPurgatory$ExpiredOperationReaper : [ExpirationReaper-0-Rebalance]: Shutting down
2021-06-16 18:14:16.544 INFO 9864 --- [ main] perationPurgatory$ExpiredOperationReaper : [ExpirationReaper-0-Rebalance]: Shutdown completed
2021-06-16 18:14:16.544 INFO 9864 --- [per-0-Rebalance] perationPurgatory$ExpiredOperationReaper : [ExpirationReaper-0-Rebalance]: Stopped
2021-06-16 18:14:16.545 INFO 9864 --- [ main] k.coordinator.group.GroupCoordinator : [GroupCoordinator 0]: Shutdown complete.
2021-06-16 18:14:16.545 INFO 9864 --- [ main] kafka.server.ReplicaManager : [ReplicaManager broker=0] Shutting down
2021-06-16 18:14:16.546 INFO 9864 --- [ main] k.s.ReplicaManager$LogDirFailureHandler : [LogDirFailureHandler]: Shutting down
2021-06-16 18:14:16.546 INFO 9864 --- [rFailureHandler] k.s.ReplicaManager$LogDirFailureHandler : [LogDirFailureHandler]: Stopped
2021-06-16 18:14:16.546 INFO 9864 --- [ main] k.s.ReplicaManager$LogDirFailureHandler : [LogDirFailureHandler]: Shutdown completed
2021-06-16 18:14:16.546 INFO 9864 --- [ main] kafka.server.ReplicaFetcherManager : [ReplicaFetcherManager on broker 0] shutting down
2021-06-16 18:14:16.548 INFO 9864 --- [ main] kafka.server.ReplicaFetcherManager : [ReplicaFetcherManager on broker 0] shutdown completed
2021-06-16 18:14:16.548 INFO 9864 --- [ main] kafka.server.ReplicaAlterLogDirsManager : [ReplicaAlterLogDirsManager on broker 0] shutting down
2021-06-16 18:14:16.548 INFO 9864 --- [ main] kafka.server.ReplicaAlterLogDirsManager : [ReplicaAlterLogDirsManager on broker 0] shutdown completed
2021-06-16 18:14:16.548 INFO 9864 --- [ main] perationPurgatory$ExpiredOperationReaper : [ExpirationReaper-0-Fetch]: Shutting down
2021-06-16 18:14:16.618 INFO 9864 --- [ main] perationPurgatory$ExpiredOperationReaper : [ExpirationReaper-0-Fetch]: Shutdown completed
2021-06-16 18:14:16.618 INFO 9864 --- [nReaper-0-Fetch] perationPurgatory$ExpiredOperationReaper : [ExpirationReaper-0-Fetch]: Stopped
2021-06-16 18:14:16.618 INFO 9864 --- [ main] perationPurgatory$ExpiredOperationReaper : [ExpirationReaper-0-Produce]: Shutting down
2021-06-16 18:14:16.726 INFO 9864 --- [ main] perationPurgatory$ExpiredOperationReaper : [ExpirationReaper-0-Produce]: Shutdown completed
2021-06-16 18:14:16.726 INFO 9864 --- [eaper-0-Produce] perationPurgatory$ExpiredOperationReaper : [ExpirationReaper-0-Produce]: Stopped
2021-06-16 18:14:16.726 INFO 9864 --- [ main] perationPurgatory$ExpiredOperationReaper : [ExpirationReaper-0-DeleteRecords]: Shutting down
2021-06-16 18:14:16.744 INFO 9864 --- [ main] perationPurgatory$ExpiredOperationReaper : [ExpirationReaper-0-DeleteRecords]: Shutdown completed
2021-06-16 18:14:16.744 INFO 9864 --- [0-DeleteRecords] perationPurgatory$ExpiredOperationReaper : [ExpirationReaper-0-DeleteRecords]: Stopped
2021-06-16 18:14:16.744 INFO 9864 --- [ main] perationPurgatory$ExpiredOperationReaper : [ExpirationReaper-0-Electleader]: Shutting down
2021-06-16 18:14:16.945 INFO 9864 --- [r-0-Electleader] perationPurgatory$ExpiredOperationReaper : [ExpirationReaper-0-Electleader]: Stopped
2021-06-16 18:14:16.945 INFO 9864 --- [ main] perationPurgatory$ExpiredOperationReaper : [ExpirationReaper-0-Electleader]: Shutdown completed
2021-06-16 18:14:16.956 INFO 9864 --- [ main] kafka.server.ReplicaManager : [ReplicaManager broker=0] Shut down completely
2021-06-16 18:14:16.957 INFO 9864 --- [ main] kafka.log.LogManager : Shutting down.
2021-06-16 18:14:16.959 INFO 9864 --- [ main] kafka.log.LogCleaner : Shutting down the log cleaner.
2021-06-16 18:14:16.960 INFO 9864 --- [ main] kafka.log.LogCleaner : [kafka-log-cleaner-thread-0]: Shutting down
2021-06-16 18:14:16.961 INFO 9864 --- [leaner-thread-0] kafka.log.LogCleaner : [kafka-log-cleaner-thread-0]: Stopped
2021-06-16 18:14:16.961 INFO 9864 --- [ main] kafka.log.LogCleaner : [kafka-log-cleaner-thread-0]: Shutdown completed
2021-06-16 18:14:17.129 INFO 9864 --- [pool-8-thread-1] kafka.log.ProducerStateManager : [ProducerStateManager partition=__consumer_offsets-0] Writing producer snapshot at offset 2
2021-06-16 18:14:17.280 INFO 9864 --- [ main] kafka.log.LogManager : Shutdown complete.
2021-06-16 18:14:17.280 INFO 9864 --- [ main] rollerEventManager$ControllerEventThread : [ControllerEventThread controllerId=0] Shutting down
2021-06-16 18:14:17.281 INFO 9864 --- [ main] rollerEventManager$ControllerEventThread : [ControllerEventThread controllerId=0] Shutdown completed
2021-06-16 18:14:17.281 INFO 9864 --- [er-event-thread] rollerEventManager$ControllerEventThread : [ControllerEventThread controllerId=0] Stopped
2021-06-16 18:14:17.285 INFO 9864 --- [ main] k.controller.ZkPartitionStateMachine : [PartitionStateMachine controllerId=0] Stopped partition state machine
2021-06-16 18:14:17.286 INFO 9864 --- [ main] kafka.controller.ZkReplicaStateMachine : [ReplicaStateMachine controllerId=0] Stopped replica state machine
2021-06-16 18:14:17.287 INFO 9864 --- [ main] kafka.controller.RequestSendThread : [RequestSendThread controllerId=0] Shutting down
2021-06-16 18:14:17.287 INFO 9864 --- [r-0-send-thread] kafka.controller.RequestSendThread : [RequestSendThread controllerId=0] Stopped
2021-06-16 18:14:17.287 INFO 9864 --- [ main] kafka.controller.RequestSendThread : [RequestSendThread controllerId=0] Shutdown completed
2021-06-16 18:14:17.288 INFO 9864 --- [ main] kafka.controller.KafkaController : [Controller id=0] Resigned
2021-06-16 18:14:17.289 INFO 9864 --- [ main] kafka.zookeeper.ZooKeeperClient : [ZooKeeperClient Kafka server] Closing.
2021-06-16 18:14:17.395 INFO 9864 --- [ain-EventThread] org.apache.zookeeper.ClientCnxn : EventThread shut down for session: 0x1000683bf6a0000
2021-06-16 18:14:17.395 INFO 9864 --- [ main] org.apache.zookeeper.ZooKeeper : Session: 0x1000683bf6a0000 closed
2021-06-16 18:14:17.396 INFO 9864 --- [ main] kafka.zookeeper.ZooKeeperClient : [ZooKeeperClient Kafka server] Closed.
2021-06-16 18:14:17.396 INFO 9864 --- [ main] lientQuotaManager$ThrottledChannelReaper : [ThrottledChannelReaper-Fetch]: Shutting down
2021-06-16 18:14:17.447 INFO 9864 --- [ main] lientQuotaManager$ThrottledChannelReaper : [ThrottledChannelReaper-Fetch]: Shutdown completed
2021-06-16 18:14:17.447 INFO 9864 --- [nelReaper-Fetch] lientQuotaManager$ThrottledChannelReaper : [ThrottledChannelReaper-Fetch]: Stopped
2021-06-16 18:14:17.447 INFO 9864 --- [ main] lientQuotaManager$ThrottledChannelReaper : [ThrottledChannelReaper-Produce]: Shutting down
2021-06-16 18:14:18.447 INFO 9864 --- [lReaper-Produce] lientQuotaManager$ThrottledChannelReaper : [ThrottledChannelReaper-Produce]: Stopped
2021-06-16 18:14:18.447 INFO 9864 --- [ main] lientQuotaManager$ThrottledChannelReaper : [ThrottledChannelReaper-Produce]: Shutdown completed
2021-06-16 18:14:18.447 INFO 9864 --- [ main] lientQuotaManager$ThrottledChannelReaper : [ThrottledChannelReaper-Request]: Shutting down
2021-06-16 18:14:18.453 INFO 9864 --- [ main] lientQuotaManager$ThrottledChannelReaper : [ThrottledChannelReaper-Request]: Shutdown completed
2021-06-16 18:14:18.453 INFO 9864 --- [lReaper-Request] lientQuotaManager$ThrottledChannelReaper : [ThrottledChannelReaper-Request]: Stopped
2021-06-16 18:14:18.454 INFO 9864 --- [ main] kafka.network.socketServer : [SocketServer brokerId=0] Shutting down socket server
2021-06-16 18:14:18.482 INFO 9864 --- [ main] kafka.network.socketServer : [SocketServer brokerId=0] Shutdown completed
2021-06-16 18:14:18.485 INFO 9864 --- [ main] kafka.server.KafkaServer : [KafkaServer id=0] shut down completed
2021-06-16 18:14:18.509 INFO 9864 --- [nnectionExpirer] o.a.z.server.NIOServerCnxnFactory : ConnnectionExpirerThread interrupted
2021-06-16 18:14:18.509 INFO 9864 --- [electorThread-1] o.a.z.server.NIOServerCnxnFactory : selector thread exitted run method
2021-06-16 18:14:18.509 INFO 9864 --- [ad:/127.0.0.1:0] o.a.z.server.NIOServerCnxnFactory : accept thread exitted run method
2021-06-16 18:14:18.510 INFO 9864 --- [electorThread-0] o.a.z.server.NIOServerCnxnFactory : selector thread exitted run method
2021-06-16 18:14:18.510 INFO 9864 --- [ main] o.a.zookeeper.server.ZooKeeperServer : shutting down
2021-06-16 18:14:18.511 INFO 9864 --- [ main] o.a.zookeeper.server.SessionTrackerImpl : Shutting down
2021-06-16 18:14:18.511 INFO 9864 --- [ main] o.a.z.server.PrepRequestProcessor : Shutting down
2021-06-16 18:14:18.511 INFO 9864 --- [ main] o.a.z.server.SyncRequestProcessor : Shutting down
2021-06-16 18:14:18.511 INFO 9864 --- [0 cport:60719):] o.a.z.server.PrepRequestProcessor : PrepRequestProcessor exited loop!
2021-06-16 18:14:18.511 INFO 9864 --- [ SyncThread:0] o.a.z.server.SyncRequestProcessor : SyncRequestProcessor exited!
2021-06-16 18:14:18.511 INFO 9864 --- [ main] o.a.z.server.FinalRequestProcessor : shutdown of request processor complete
2021-06-16 18:14:19.207 INFO 9864 --- [ SessionTracker] o.a.zookeeper.server.SessionTrackerImpl : SessionTrackerImpl exited loop!
请在这里帮助我,因为我正在本地运行它。为此我需要修改 bin 中的任何其他配置文件吗。
解决方法
该项目使用的是旧的、不受支持的 Boot 版本。我在 Mac 上使用该版本的 Zookeeper 时遇到了问题。
您还缺少 application.yml 中的 spring:
。
这是我为通过测试所做的工作。
更改 pom 以使用受支持的引导:
...
<parent>
<groupId>org.springframework.boot</groupId>
<artifactId>spring-boot-starter-parent</artifactId>
<version>2.3.12.RELEASE</version>
<relativePath/> <!-- lookup parent from repository -->
</parent>
...
<dependency>
<groupId>org.springframework.kafka</groupId>
<artifactId>spring-kafka</artifactId>
</dependency>
<dependency>
<groupId>org.springframework.kafka</groupId>
<artifactId>spring-kafka-test</artifactId>
<scope>test</scope>
</dependency>
...
修复 Yaml(主要)
spring:
kafka:
bootstrap-servers: localhost:9092
修复 Yaml(测试)
spring:
kafka:
bootstrap-servers: ${spring.embedded.kafka.brokers}
修复 KafkaProducerConfiguration
@Value("${spring.kafka.bootstrap-servers}")
private String bootstrapServers;
如果您使用了启动感知 IDE(例如 Spring Tool Suite 或 IntelliJ,您会看到有关错误 YAML 的警告。
版权声明:本文内容由互联网用户自发贡献,该文观点与技术仅代表作者本人。本站仅提供信息存储空间服务,不拥有所有权,不承担相关法律责任。如发现本站有涉嫌侵权/违法违规的内容, 请发送邮件至 dio@foxmail.com 举报,一经查实,本站将立刻删除。