如何解决我应该使用哪些数据类型将 Jaeger 日志从 Kafka 读取到 Clickhouse?
我是 Clickhouse 的新手。我正在尝试将 Jaeger 日志从 Kafka 读入 Clickhouse 数据库。我有以下 Kafka 消息格式:
{
"traceId": "omFv9AGFHOAfWQ+tJcxDZQ==","spanId": "Lai3jc8v6Pg=","operationName": "GET","startTime": "2021-02-24T09:26:12.771Z","duration": "0.006s","tags": [
{
"key": "component","vStr": "kong"
},{
"key": "http.method","vStr": "GET"
},{
"key": "http.path","vStr": "/static/bootstrap/js/bootstrap.min.js"
},{
"key": "http.status_code","vStr": "304"
},{
"key": "kong.node.id","vStr": "0b2d3a89-67c8-43b2-a56f-450c45689b7d"
},{
"key": "peer.service"
},{
"key": "peer.ipv4","vType": "INT64","vInt64": "2130706433"
},{
"key": "peer.port","vInt64": "44076"
},{
"key": "span.kind","vStr": "server"
},{
"key": "internal.span.format","vStr": "zipkin"
}
],"logs": [
{
"timestamp": "2021-02-24T09:26:12.771Z","fields": [
{
"key": "event","vStr": "krf"
}
]
}
],"process": {
"serviceName": "kong"
}
}
我能够使用下表将 traceID、spanID 和 Operation 输入到 Clickhouse:
CREATE TABLE IF NOT EXISTS db1.jaeger
(
traceId String,spanId String,operationName String
) ENGINE = Kafka()
SETTINGS
kafka_broker_list = 'broker.net:9092',kafka_topic_list = 'jaeger',kafka_group_name = 'sample_group',kafka_format = 'JSONEachRow';
但是我输入标签失败。知道我应该使用哪种 Clickhouse 数据类型吗?
版权声明:本文内容由互联网用户自发贡献,该文观点与技术仅代表作者本人。本站仅提供信息存储空间服务,不拥有所有权,不承担相关法律责任。如发现本站有涉嫌侵权/违法违规的内容, 请发送邮件至 dio@foxmail.com 举报,一经查实,本站将立刻删除。