如何解决凤凰表选择联接返回尝试失败后失败= 11
执行以下语句时出现错误:
SELECT r.*,l.productid,l.prodname,l.projnum,l.projname,l.capitalnumb,l.fundname,l.channelno,l.channelname,l.merchantno,l.merchantname,l.staff_name,l.busipers
FROM lake.lake_retu_record r
LEFT JOIN lake.lake_loan l
ON r.loanacno = l.loanacno
WHERE r.acdate = '20200912000000'
LIMIT 1000
表格信息:
lake.lake_retu_record size:40MB data:44000 pieces of data
lake.lake_loan size:1.5GB data: 1700000 pieces of data
版本:
HBase-Version : 2.1.0
Phoenix-core: 5.0.0-cdh-6.2.0
我正在网上搜索很长时间。但这并不能解决问题。请帮助或尝试提供一些解决方法。
我试图修改这些参数phoenix.query.queueSize phoenix.query.threadPoolSize phoenix.query.targetConcurrency phoenix.query.maxConcurrency
异常:
20/10/18 10:35:50 WARN client.SynccoprocessorRpcChannel: Call Failed on IOException
org.apache.hadoop.hbase.client.RetriesExhaustedException: Failed after attempts=11,exceptions:
Sun Oct 18 10:35:08 CST 2020,RpcretryingCaller{globalStartTime=1602988506012,pause=100,maxAttempts=11},java.io.IOException: Call to CQ-HM-ALIFC-test/10.10.10.10:16020 Failed on local exception: java.io.IOException: Connection reset by peer
Sun Oct 18 10:35:08 CST 2020,org.apache.hadoop.hbase.exceptions.ConnectionClosedException: Call to CQ-HM-ALIFC-test/10.10.10.10:16020 Failed on local exception: org.apache.hadoop.hbase.exceptions.ConnectionClosedException: Connection closed
Sun Oct 18 10:35:09 CST 2020,org.apache.hadoop.hbase.exceptions.ConnectionClosedException: Call to CQ-HM-ALIFC-test/10.10.10.10:16020 Failed on local exception: org.apache.hadoop.hbase.exceptions.ConnectionClosedException: Connection closed
Sun Oct 18 10:35:10 CST 2020,org.apache.hadoop.hbase.exceptions.ConnectionClosedException: Call to CQ-HM-ALIFC-test/10.10.10.10:16020 Failed on local exception: org.apache.hadoop.hbase.exceptions.ConnectionClosedException: Connection closed
Sun Oct 18 10:35:11 CST 2020,org.apache.hadoop.hbase.exceptions.ConnectionClosedException: Call to CQ-HM-ALIFC-test/10.10.10.10:16020 Failed on local exception: org.apache.hadoop.hbase.exceptions.ConnectionClosedException: Connection closed
Sun Oct 18 10:35:12 CST 2020,org.apache.hadoop.hbase.exceptions.ConnectionClosedException: Call to CQ-HM-ALIFC-test/10.10.10.10:16020 Failed on local exception: org.apache.hadoop.hbase.exceptions.ConnectionClosedException: Connection closed
Sun Oct 18 10:35:15 CST 2020,org.apache.hadoop.hbase.exceptions.ConnectionClosedException: Call to CQ-HM-ALIFC-test/10.10.10.10:16020 Failed on local exception: org.apache.hadoop.hbase.exceptions.ConnectionClosedException: Connection closed
Sun Oct 18 10:35:19 CST 2020,org.apache.hadoop.hbase.exceptions.ConnectionClosedException: Call to CQ-HM-ALIFC-test/10.10.10.10:16020 Failed on local exception: org.apache.hadoop.hbase.exceptions.ConnectionClosedException: Connection closed
Sun Oct 18 10:35:29 CST 2020,org.apache.hadoop.hbase.exceptions.ConnectionClosedException: Call to CQ-HM-ALIFC-test/10.10.10.10:16020 Failed on local exception: org.apache.hadoop.hbase.exceptions.ConnectionClosedException: Connection closed
Sun Oct 18 10:35:40 CST 2020,org.apache.hadoop.hbase.exceptions.ConnectionClosedException: Call to CQ-HM-ALIFC-test/10.10.10.10:16020 Failed on local exception: org.apache.hadoop.hbase.exceptions.ConnectionClosedException: Connection closed
Sun Oct 18 10:35:50 CST 2020,org.apache.hadoop.hbase.exceptions.ConnectionClosedException: Call to CQ-HM-ALIFC-test/10.10.10.10:16020 Failed on local exception: org.apache.hadoop.hbase.exceptions.ConnectionClosedException: Connection closed
at org.apache.hadoop.hbase.client.RpcretryingCallerImpl.callWithRetries(RpcretryingCallerImpl.java:145)
at org.apache.hadoop.hbase.client.RegioncoprocessorRpcChannel.callExecService(RegioncoprocessorRpcChannel.java:91)
at org.apache.hadoop.hbase.client.SynccoprocessorRpcChannel.callMethod(SynccoprocessorRpcChannel.java:52)
at org.apache.phoenix.coprocessor.generated.ServerCachingProtos$ServerCachingService$Stub.addServerCache(ServerCachingProtos.java:8484)
at org.apache.phoenix.cache.ServerCacheClient$3.call(ServerCacheClient.java:494)
at org.apache.phoenix.cache.ServerCacheClient$3.call(ServerCacheClient.java:462)
at org.apache.hadoop.hbase.client.HTable$12.call(HTable.java:997)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
Caused by: org.apache.hadoop.hbase.exceptions.ConnectionClosedException: Call to CQ-HM-ALIFC-test/10.10.10.10:16020 Failed on local exception: org.apache.hadoop.hbase.exceptions.ConnectionClosedException: Connection closed
at org.apache.hadoop.hbase.ipc.IPCUtil.wrapException(IPCUtil.java:202)
at org.apache.hadoop.hbase.ipc.AbstractRpcclient.onCallFinished(AbstractRpcclient.java:390)
at org.apache.hadoop.hbase.ipc.AbstractRpcclient.access$100(AbstractRpcclient.java:95)
at org.apache.hadoop.hbase.ipc.AbstractRpcclient$3.run(AbstractRpcclient.java:410)
at org.apache.hadoop.hbase.ipc.AbstractRpcclient$3.run(AbstractRpcclient.java:406)
at org.apache.hadoop.hbase.ipc.Call.callComplete(Call.java:103)
at org.apache.hadoop.hbase.ipc.Call.setException(Call.java:118)
at org.apache.hadoop.hbase.ipc.NettyRpcDuplexHandler.cleanupCalls(NettyRpcDuplexHandler.java:203)
at org.apache.hadoop.hbase.ipc.NettyRpcDuplexHandler.channelInactive(NettyRpcDuplexHandler.java:211)
at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelInactive(AbstractChannelHandlerContext.java:245)
at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelInactive(AbstractChannelHandlerContext.java:231)
at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.fireChannelInactive(AbstractChannelHandlerContext.java:224)
at org.apache.hbase.thirdparty.io.netty.handler.codec.BytetoMessageDecoder.channelInputClosed(BytetoMessageDecoder.java:377)
at org.apache.hbase.thirdparty.io.netty.handler.codec.BytetoMessageDecoder.channelInactive(BytetoMessageDecoder.java:342)
at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelInactive(AbstractChannelHandlerContext.java:245)
at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelInactive(AbstractChannelHandlerContext.java:231)
at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.fireChannelInactive(AbstractChannelHandlerContext.java:224)
at org.apache.hbase.thirdparty.io.netty.channel.ChannelInboundHandlerAdapter.channelInactive(ChannelInboundHandlerAdapter.java:75)
at org.apache.hbase.thirdparty.io.netty.handler.timeout.IdleStateHandler.channelInactive(IdleStateHandler.java:277)
at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelInactive(AbstractChannelHandlerContext.java:245)
at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelInactive(AbstractChannelHandlerContext.java:231)
at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.fireChannelInactive(AbstractChannelHandlerContext.java:224)
at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPipeline$HeadContext.channelInactive(DefaultChannelPipeline.java:1354)
at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelInactive(AbstractChannelHandlerContext.java:245)
at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelInactive(AbstractChannelHandlerContext.java:231)
at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPipeline.fireChannelInactive(DefaultChannelPipeline.java:917)
at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannel$AbstractUnsafe$8.run(AbstractChannel.java:822)
at org.apache.hbase.thirdparty.io.netty.util.concurrent.AbstractEventExecutor.safeExecute(AbstractEventExecutor.java:163)
at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor.runAllTasks(SingleThreadEventExecutor.java:403)
at org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:463)
at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$5.run(SingleThreadEventExecutor.java:858)
at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultThreadFactory$DefaultRunnableDecorator.run(DefaultThreadFactory.java:138)
... 1 more
Caused by: org.apache.hadoop.hbase.exceptions.ConnectionClosedException: Connection closed
... 25 more
有人可以帮我吗..!
解决方法
谢谢大家,我解决了这个问题!
解决方案如下:
我发现了异常的主要原因
org.apache.hadoop.hbase.client.RetriesExhaustedException: Failed after attempts=11,exceptions:
Sun Oct 18 10:35:08 CST 2020,RpcRetryingCaller{globalStartTime=1602988506012,pause=100,maxAttempts=11},java.io.IOException: Call to CQ-HM-ALIFC-test/10.10.10.10:16020 failed on local exception: java.io.IOException: Connection reset by peer
初步判断是RPC有问题,因此在执行SQL语句时,打开报告错误的服务器的RegionServer日志。我发现RegionServer生成以下日志:
>
WARN org.apache.hadoop.hbase.ipc.NettyRpcServer: RPC data length of 353247227 received from 10.10.10.10 is greater than max allowed 268435456. Set "hbase.ipc.max.request.size" on server to override this limit (not recommended)
我增加了参数并解决了问题!
版权声明:本文内容由互联网用户自发贡献,该文观点与技术仅代表作者本人。本站仅提供信息存储空间服务,不拥有所有权,不承担相关法律责任。如发现本站有涉嫌侵权/违法违规的内容, 请发送邮件至 dio@foxmail.com 举报,一经查实,本站将立刻删除。