微信公众号搜"智元新知"关注
微信扫一扫可直接关注哦!

凤凰表选择联接返回尝试失败后失败= 11

如何解决凤凰表选择联接返回尝试失败后失败= 11

执行以下语句时出现错误

SELECT r.*,l.productid,l.prodname,l.projnum,l.projname,l.capitalnumb,l.fundname,l.channelno,l.channelname,l.merchantno,l.merchantname,l.staff_name,l.busipers 
FROM   lake.lake_retu_record r 
       LEFT JOIN lake.lake_loan l 
              ON r.loanacno = l.loanacno 
WHERE  r.acdate = '20200912000000' 
LIMIT  1000 

表格信息:

lake.lake_retu_record size:40MB data:44000 pieces of data
lake.lake_loan size:1.5GB data: 1700000 pieces of data

版本:

HBase-Version : 2.1.0
Phoenix-core: 5.0.0-cdh-6.2.0

我正在网上搜索很长时间。但这并不能解决问题。请帮助或尝试提供一些解决方法
我试图修改这些参数phoenix.query.queueSize phoenix.query.threadPoolSize phoenix.query.targetConcurrency phoenix.query.maxConcurrency

异常:

    20/10/18 10:35:50 WARN client.SynccoprocessorRpcChannel: Call Failed on IOException
    org.apache.hadoop.hbase.client.RetriesExhaustedException: Failed after attempts=11,exceptions:
    Sun Oct 18 10:35:08 CST 2020,RpcretryingCaller{globalStartTime=1602988506012,pause=100,maxAttempts=11},java.io.IOException: Call to CQ-HM-ALIFC-test/10.10.10.10:16020 Failed on local exception: java.io.IOException: Connection reset by peer
    Sun Oct 18 10:35:08 CST 2020,org.apache.hadoop.hbase.exceptions.ConnectionClosedException: Call to CQ-HM-ALIFC-test/10.10.10.10:16020 Failed on local exception: org.apache.hadoop.hbase.exceptions.ConnectionClosedException: Connection closed
    Sun Oct 18 10:35:09 CST 2020,org.apache.hadoop.hbase.exceptions.ConnectionClosedException: Call to CQ-HM-ALIFC-test/10.10.10.10:16020 Failed on local exception: org.apache.hadoop.hbase.exceptions.ConnectionClosedException: Connection closed
    Sun Oct 18 10:35:10 CST 2020,org.apache.hadoop.hbase.exceptions.ConnectionClosedException: Call to CQ-HM-ALIFC-test/10.10.10.10:16020 Failed on local exception: org.apache.hadoop.hbase.exceptions.ConnectionClosedException: Connection closed
    Sun Oct 18 10:35:11 CST 2020,org.apache.hadoop.hbase.exceptions.ConnectionClosedException: Call to CQ-HM-ALIFC-test/10.10.10.10:16020 Failed on local exception: org.apache.hadoop.hbase.exceptions.ConnectionClosedException: Connection closed
    Sun Oct 18 10:35:12 CST 2020,org.apache.hadoop.hbase.exceptions.ConnectionClosedException: Call to CQ-HM-ALIFC-test/10.10.10.10:16020 Failed on local exception: org.apache.hadoop.hbase.exceptions.ConnectionClosedException: Connection closed
    Sun Oct 18 10:35:15 CST 2020,org.apache.hadoop.hbase.exceptions.ConnectionClosedException: Call to CQ-HM-ALIFC-test/10.10.10.10:16020 Failed on local exception: org.apache.hadoop.hbase.exceptions.ConnectionClosedException: Connection closed
    Sun Oct 18 10:35:19 CST 2020,org.apache.hadoop.hbase.exceptions.ConnectionClosedException: Call to CQ-HM-ALIFC-test/10.10.10.10:16020 Failed on local exception: org.apache.hadoop.hbase.exceptions.ConnectionClosedException: Connection closed
    Sun Oct 18 10:35:29 CST 2020,org.apache.hadoop.hbase.exceptions.ConnectionClosedException: Call to CQ-HM-ALIFC-test/10.10.10.10:16020 Failed on local exception: org.apache.hadoop.hbase.exceptions.ConnectionClosedException: Connection closed
    Sun Oct 18 10:35:40 CST 2020,org.apache.hadoop.hbase.exceptions.ConnectionClosedException: Call to CQ-HM-ALIFC-test/10.10.10.10:16020 Failed on local exception: org.apache.hadoop.hbase.exceptions.ConnectionClosedException: Connection closed
    Sun Oct 18 10:35:50 CST 2020,org.apache.hadoop.hbase.exceptions.ConnectionClosedException: Call to CQ-HM-ALIFC-test/10.10.10.10:16020 Failed on local exception: org.apache.hadoop.hbase.exceptions.ConnectionClosedException: Connection closed
    
        at org.apache.hadoop.hbase.client.RpcretryingCallerImpl.callWithRetries(RpcretryingCallerImpl.java:145)
        at org.apache.hadoop.hbase.client.RegioncoprocessorRpcChannel.callExecService(RegioncoprocessorRpcChannel.java:91)
        at org.apache.hadoop.hbase.client.SynccoprocessorRpcChannel.callMethod(SynccoprocessorRpcChannel.java:52)
        at org.apache.phoenix.coprocessor.generated.ServerCachingProtos$ServerCachingService$Stub.addServerCache(ServerCachingProtos.java:8484)
        at org.apache.phoenix.cache.ServerCacheClient$3.call(ServerCacheClient.java:494)
        at org.apache.phoenix.cache.ServerCacheClient$3.call(ServerCacheClient.java:462)
        at org.apache.hadoop.hbase.client.HTable$12.call(HTable.java:997)
        at java.util.concurrent.FutureTask.run(FutureTask.java:266)
        at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
        at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
        at java.lang.Thread.run(Thread.java:748)
    Caused by: org.apache.hadoop.hbase.exceptions.ConnectionClosedException: Call to CQ-HM-ALIFC-test/10.10.10.10:16020 Failed on local exception: org.apache.hadoop.hbase.exceptions.ConnectionClosedException: Connection closed
        at org.apache.hadoop.hbase.ipc.IPCUtil.wrapException(IPCUtil.java:202)
        at org.apache.hadoop.hbase.ipc.AbstractRpcclient.onCallFinished(AbstractRpcclient.java:390)
        at org.apache.hadoop.hbase.ipc.AbstractRpcclient.access$100(AbstractRpcclient.java:95)
        at org.apache.hadoop.hbase.ipc.AbstractRpcclient$3.run(AbstractRpcclient.java:410)
        at org.apache.hadoop.hbase.ipc.AbstractRpcclient$3.run(AbstractRpcclient.java:406)
        at org.apache.hadoop.hbase.ipc.Call.callComplete(Call.java:103)
        at org.apache.hadoop.hbase.ipc.Call.setException(Call.java:118)
        at org.apache.hadoop.hbase.ipc.NettyRpcDuplexHandler.cleanupCalls(NettyRpcDuplexHandler.java:203)
        at org.apache.hadoop.hbase.ipc.NettyRpcDuplexHandler.channelInactive(NettyRpcDuplexHandler.java:211)
        at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelInactive(AbstractChannelHandlerContext.java:245)
        at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelInactive(AbstractChannelHandlerContext.java:231)
        at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.fireChannelInactive(AbstractChannelHandlerContext.java:224)
        at org.apache.hbase.thirdparty.io.netty.handler.codec.BytetoMessageDecoder.channelInputClosed(BytetoMessageDecoder.java:377)
        at org.apache.hbase.thirdparty.io.netty.handler.codec.BytetoMessageDecoder.channelInactive(BytetoMessageDecoder.java:342)
        at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelInactive(AbstractChannelHandlerContext.java:245)
        at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelInactive(AbstractChannelHandlerContext.java:231)
        at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.fireChannelInactive(AbstractChannelHandlerContext.java:224)
        at org.apache.hbase.thirdparty.io.netty.channel.ChannelInboundHandlerAdapter.channelInactive(ChannelInboundHandlerAdapter.java:75)
        at org.apache.hbase.thirdparty.io.netty.handler.timeout.IdleStateHandler.channelInactive(IdleStateHandler.java:277)
        at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelInactive(AbstractChannelHandlerContext.java:245)
        at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelInactive(AbstractChannelHandlerContext.java:231)
        at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.fireChannelInactive(AbstractChannelHandlerContext.java:224)
        at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPipeline$HeadContext.channelInactive(DefaultChannelPipeline.java:1354)
        at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelInactive(AbstractChannelHandlerContext.java:245)
        at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelInactive(AbstractChannelHandlerContext.java:231)
        at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPipeline.fireChannelInactive(DefaultChannelPipeline.java:917)
        at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannel$AbstractUnsafe$8.run(AbstractChannel.java:822)
        at org.apache.hbase.thirdparty.io.netty.util.concurrent.AbstractEventExecutor.safeExecute(AbstractEventExecutor.java:163)
        at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor.runAllTasks(SingleThreadEventExecutor.java:403)
        at org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:463)
        at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$5.run(SingleThreadEventExecutor.java:858)
        at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultThreadFactory$DefaultRunnableDecorator.run(DefaultThreadFactory.java:138)
        ... 1 more
    Caused by: org.apache.hadoop.hbase.exceptions.ConnectionClosedException: Connection closed
        ... 25 more

有人可以帮我吗..!

解决方法

谢谢大家,我解决了这个问题!

解决方案如下:
我发现了异常的主要原因

org.apache.hadoop.hbase.client.RetriesExhaustedException: Failed after attempts=11,exceptions:
Sun Oct 18 10:35:08 CST 2020,RpcRetryingCaller{globalStartTime=1602988506012,pause=100,maxAttempts=11},java.io.IOException: Call to CQ-HM-ALIFC-test/10.10.10.10:16020 failed on local exception: java.io.IOException: Connection reset by peer

初步判断是RPC有问题,因此在执行SQL语句时,打开报告错误的服务器的RegionServer日志。我发现RegionServer生成以下日志:
>

WARN org.apache.hadoop.hbase.ipc.NettyRpcServer: RPC data length of 353247227 received from 10.10.10.10 is greater than max allowed 268435456. Set "hbase.ipc.max.request.size" on server to override this limit (not recommended)

我增加了参数并解决了问题!

版权声明:本文内容由互联网用户自发贡献,该文观点与技术仅代表作者本人。本站仅提供信息存储空间服务,不拥有所有权,不承担相关法律责任。如发现本站有涉嫌侵权/违法违规的内容, 请发送邮件至 dio@foxmail.com 举报,一经查实,本站将立刻删除。

相关推荐


Selenium Web驱动程序和Java。元素在(x,y)点处不可单击。其他元素将获得点击?
Python-如何使用点“。” 访问字典成员?
Java 字符串是不可变的。到底是什么意思?
Java中的“ final”关键字如何工作?(我仍然可以修改对象。)
“loop:”在Java代码中。这是什么,为什么要编译?
java.lang.ClassNotFoundException:sun.jdbc.odbc.JdbcOdbcDriver发生异常。为什么?
这是用Java进行XML解析的最佳库。
Java的PriorityQueue的内置迭代器不会以任何特定顺序遍历数据结构。为什么?
如何在Java中聆听按键时移动图像。
Java“Program to an interface”。这是什么意思?