微信公众号搜"智元新知"关注
微信扫一扫可直接关注哦!

ClickHouse ALTER TABLE DELETE 异常代码 241

如何解决ClickHouse ALTER TABLE DELETE 异常代码 241

我在 ALTER TABLE DELETE 上遇到了问题。我尝试使用各种 ma​​x_block_size(8192、4096、2048、1024)执行 ALTER DELETE。还尝试更改表的 merge_max_block_size(8192、4096、2048、1024)。没运气。 完整的异常文本:

sql 错误 [341]:ClickHouse 异常,代码:341,主机:127.0.0.1,端口:40849;代码:341,e.displayText() = DB::Exception:在执行变异 'mutation_94378.txt' 期间发生异常,部分为 '1_7146_15644_5_94355' 原因:'代码:241,e.displayText() = DB::Exception: Memory超过限制(总计):将使用 14.05 GiB(尝试分配 4425496 字节的块),最大值:14.05 GiB:(avg_value_size_hint = 35.49267578125,avg_chars_size = 32.9912109812,while reading column = 32.9912109375,while reading column = (code):code部分 /mnt/store/clickhouse/store/04d/04d43c3a-9822-4168-a12a-664806ec3b67/1_7146_15644_5_94355/ 从标记 0 开始,max_rows_to_read = 8192)。(build.3).23 官方版本)MergeTree2此错误可能可重试或不可重试。如果出现不可重试的错误,可以使用 KILL MUTATION 查询终止变异(版本 21.1.3.32(官方构建))

clickhouse-server.log:

2021.03.23 08:30:04.621721 [268131] {} AggregatingTransform:聚合 2021.03.23 08:30:04.621756 [268131] {} 聚合器:聚合方法:无键 2021.03.23 08:30:05.077471 [268131] {} AggregatingTransform:聚合。 20 到 1 行(从 0.00 B)在 0.683282494 秒内。 (29.27047037736635 行/秒,0.00 B/秒。) 2021.03.23 08:30:05.077501 [268131] {} 聚合器:合并聚合数据 2021.03.23 08:30:05.077675 [268131] {} test.dt_customer (04d43c3a-9822-4168-a12a-664806ec3b67)(MergerMutator):Mutating part_353_3551_3551_351_35716571716457167759999999999999999999999999999999 2021.03.23 08:30:05.078565 [268131] {} test.dt_customer (04d43c3a-9822-4168-a12a-664806ec3b67) (SelectExecutor):关键条件:未知 2021.03.23 08:30:05.078581 [268131] {} test.dt_customer (04d43c3a-9822-4168-a12a-664806ec3b67)(SelectExecutor):MinMax 索引条件:未知 2021.03.23 08:30:05.078589 [268131] {} test.dt_customer (04d43c3a-9822-4168-a12a-664806ec3b67) (SelectExecutor): 不使用 part_151645_151645_151645_151645_159446 的主索引 2021.03.23 08:30:05.078597 [ 268131 ] {} test.dt_customer (04d43c3a-9822-4168-a12a-664806ec3b67) (SelectExecutor): Selected 1 part by 1 个主键,由 1 个主键分区 144从 1 个范围读取 15147 个标记 2021.03.23 08:30:05.078658 [268131] {} MergeTreeSelectProcessor:读取 1 范围从第 1_7146_15644_5_94355 部分,大约。从 0 开始的 124080000 行 2021.03.23 08:30:05.078722 [268131] {} InterpreterSelectQuery: FetchColumns -> Complete 2021.03.23 08:30:05.162644 [268131] {} MemoryTracker:峰值内存使用量:147.51 MiB。 2021.03.23 08:30:05.162743 [268131] {} auto DB::IBackgroundJobExecutor::jobExecutingTask()::(匿名类)::operator()() const:代码:241,e.displayText() = DB: :例外:超出内存限制(总计):将使用 14.05 GiB(尝试分配 4426357 字节的块),最大值:14.05 GiB:(avg_value_size_hint = 35.49267578125,avg_chars_size = 32.9371921 阅读限制)(市场代码):14.05 GiB: (从部分 /mnt/store/clickhouse/store/04d/04d43c3a-9822-4168-a12a-664806ec3b67/1_7146_15644_5_94355/ 从标记 0 中读取时,max_rows_to_read = 8192,执行跟踪时,堆栈始终复制此消息:包括以下几行):

  1. DB::Exception::Exception,long&,std: :__1::basic_string >(int,std::__1::basic_string const&,char const*&&,std::__1::basic_string&&,std::__1 ::basic_string&&) @ 0x8625620 in /usr/bin/clickhouse
  2. MemoryTracker::alloc(long) @ 0x8624f7d in /usr/bin/clickhouse
  3. MemoryTracker::alloc(long) @ 0x8624ce4 in /usr/bin/clickhouse
  4. MemoryTracker::alloc(long) @ 0x8624ce4 in /usr/bin/clickhouse
  5. DB::DataTypestring::deserializeBinaryBulk(DB::IColumn&,DB::ReadBuffer&,unsigned long,double) const @ 0xea36a74 in /usr/bin/clickhouse
  6. DB::MergeTreeReaderWide::readData(std::__1::basic_string const&,DB::IDataType const&,DB::IColumn&,bool,bool) @ 0xf6f8d19 /usr/bin/clickhouse
  7. DB::MergeTreeReaderWide::readRows(unsigned long,std::__1::vector::immutable_ptr<:icolumn>,std::__1:: allocator::immutable_ptr<:icolumn> > >&) @ 0xf6f8030 in /usr/bin/clickhouse
  8. DB::MergeTreeRangeReader::DelayedStream::finalize(std::__1::vector::immutable_ptr<:icolumn>,std::__1::allocator::immutable_ptr<:icolumn> > >&) @ 0xf700b9a in /usr/bin/clickhouse
  9. DB::MergeTreeRangeReader::startReadingChain(unsigned long,std::__1::deque<:markrange std::__1::allocator> >&) @ 0xf705066 in /usr/bin /clickhouse
  10. DB::MergeTreeRangeReader::read(unsigned long,std::__1::deque<:markrange std::__1::allocator> >&) @ 0xf703c24 in /usr/bin /clickhouse
  11. DB::MergeTreeBaseSelectProcessor::readFromPartImpl() @ 0xf6fe2b3 in /usr/bin/clickhouse
  12. DB::MergeTreeBaseSelectProcessor::readFromPart() @ 0xf6fef0d in /usr/bin/clickhouse
  13. DB::MergeTreeBaseSelectProcessor::generate() @ 0xf6fd7ab in /usr/bin/clickhouse
  14. DB::ISource::tryGenerate() @ 0xf8d8df5 位于 /usr/bin/clickhouse
  15. DB::ISource::work() @ 0xf8d8b1a 在 /usr/bin/clickhouse 中
  16. DB::SourceWithProgress::work() @ 0xfa4045a in /usr/bin/clickhouse
  17. ? @ 0xf9129bc 在 /usr/bin/clickhouse
  18. DB::PipelineExecutor::executeStepImpl(unsigned long,std::__1::atomic*) @ 0xf90f766 in /usr/bin/clickhouse
  19. DB::PipelineExecutor::executeStep(std::__1::atomic*) @ 0xf90e0ec in /usr/bin/clickhouse
  20. DB::PullingPipelineExecutor::pull(DB::Chunk&) @ 0xf91c008 in /usr/bin/clickhouse
  21. DB::PullingPipelineExecutor::pull(DB::Block&) @ 0xf91c250 in /usr/bin/clickhouse
  22. DB::PipelineExecutingBlockInputStream::readImpl() @ 0xf909fd4 in /usr/bin/clickhouse
  23. DB::IBlockInputStream::read() @ 0xe977455 in /usr/bin/clickhouse
  24. DB::CheckSortedBlockInputStream::readImpl() @ 0xf063fc1 in /usr/bin/clickhouse
  25. DB::IBlockInputStream::read() @ 0xe977455 in /usr/bin/clickhouse
  26. DB::ExpressionBlockInputStream::readImpl() @ 0xf64d537 in /usr/bin/clickhouse
  27. DB::IBlockInputStream::read() @ 0xe977455 in /usr/bin/clickhouse
  28. DB::MaterializingBlockInputStream::readImpl() @ 0xee33eed in /usr/bin/clickhouse
  29. DB::IBlockInputStream::read() @ 0xe977455 in /usr/bin/clickhouse
  30. DB::MergeTreeDataMergerMutator::mutateallPartColumns(std::__1::shared_ptr<:imergetreedatapart>,std::__1::shared_ptr<:storageinmemorymetadata const> const&,std::__1::vector,std::__1::allocator<:__1::shared_ptr const> > > const&,std::__1::shared_ptr,long,std::__1::shared_ptr<:icompressioncodec> const&,DB::BackgroundProcessListEntry<:mergelistelement db::mergeinfo>&,bool) const @ 0xf62ff49 in /usr/bin /clickhouse
  31. DB::MergeTreeDataMergerMutator::mutatePartToTemporaryPart(DB::FutureMergedMutatedPart const&,DB::MutationCommands const&,DB::BackgroundProcessListEntry<:mergelistelement db ::mergeinfo>&,DB::Context const&,std::__1::unique_ptr<:ireservation std::__1::default_delete> > const&,std::__1::shared_ptr <:rwlockimpl::lockholderimpl>&) @ 0xf62c06e in /usr/bin/clickhouse
  32. DB::StorageMergeTree::mutateSelectedPart(std::__1::shared_ptr<:storageinmemorymetadata const> const&,DB::StorageMergeTree::MergeMutateSelectedEntry&,std::__1::shared_ptr<:rwlockimpl::lockholderimpl>&) @ 0xf3c6fc7 在 /usr/bin/clickhouse (版本 21.1.3.32(官方版本))

版权声明:本文内容由互联网用户自发贡献,该文观点与技术仅代表作者本人。本站仅提供信息存储空间服务,不拥有所有权,不承担相关法律责任。如发现本站有涉嫌侵权/违法违规的内容, 请发送邮件至 dio@foxmail.com 举报,一经查实,本站将立刻删除。