微信公众号搜"智元新知"关注
微信扫一扫可直接关注哦!

基准测试时 Clickhouse 缓存字典错误

如何解决基准测试时 Clickhouse 缓存字典错误

在具有 2000000 行的缓存字典上运行查询时,出现管道损坏错误。这是查询SELECT dictGet('cacheDictionary','random0',toUInt64(number)) as val FROM numbers(0,100000)) 我的虚拟机有 16Gb 的内存和 256Gb 的存储空间。我正在对缓存字典进行压力测试,所以这是可以预料的,尽管我不完全理解错误的含义。例如,我是否可以更改某些设置以防止发生这种情况,如果可以,费用是多少?此外,对于较小的查询(例如 20 秒),查询时间似乎很慢。

2021.01.16 13:35:15.075765 [ 818 ] {} <Error> ExternalDictionaries: Could not update cache dictionary 'cacheDictionary',next update is scheduled at 2021-01-16 13:35:09: Code: 75,e.displayText() = DB::ErrnoException: Cannot write to file (fd = 39),errno: 32,strerror: broken pipe,Stack trace (when copying this message,always include the lines below):

0. Poco::Exception::Exception(std::__1::basic_string<char,std::__1::char_traits<char>,std::__1::allocator<char> > const&,int) @ 0x13cd24bc in /usr/bin/clickhouse
1. DB::ErrnoException::ErrnoException(std::__1::basic_string<char,int,std::__1::optional<std::__1::basic_string<char,std::__1::allocator<char> > > const&) @ 0xa436167 in /usr/bin/clickhouse
2. DB::throwFromErrNowithPath(std::__1::basic_string<char,std::__1::basic_string<char,int) @ 0x9b55f44 in /usr/bin/clickhouse
3. DB::WriteBufferFromFileDescriptor::nextImpl() @ 0xa42f48b in /usr/bin/clickhouse
4. DB::IoUtputFormat::flush() @ 0x112a460a in /usr/bin/clickhouse
5. DB::formatIDs(std::__1::shared_ptr<DB::IBlockOutputStream>&,std::__1::vector<unsigned long,std::__1::allocator<unsigned long> > const&) @ 0xe53b22a in /usr/bin/clickhouse
6. std::__1::packaged_task<void ()>::operator()() @ 0xe54178b in /usr/bin/clickhouse
7. ? @ 0xe53be76 in /usr/bin/clickhouse
8. ThreadPoolImpl<std::__1::thread>::worker(std::__1::__list_iterator<std::__1::thread,void*>) @ 0xa43cc4d in /usr/bin/clickhouse
9. ? @ 0xa43b3ff in /usr/bin/clickhouse
10. start_thread @ 0x7dd5 in /usr/lib64/libpthread-2.17.so
11. __clone @ 0xfdead in /usr/lib64/libc-2.17.so
 (version 20.8.3.18)
2021.01.16 13:35:15.374415 [ 779 ] {0c6f6eed-a682-4f26-8bdd-f351ad87a47e} <Error> executeQuery: Code: 75,strerror: broken pipe (version 20.8.3.18) (from [::1]:57326) (in query: SELECT dictGet('cacheDictionary',100000)),always include the lines below):

版权声明:本文内容由互联网用户自发贡献,该文观点与技术仅代表作者本人。本站仅提供信息存储空间服务,不拥有所有权,不承担相关法律责任。如发现本站有涉嫌侵权/违法违规的内容, 请发送邮件至 dio@foxmail.com 举报,一经查实,本站将立刻删除。