微信公众号搜"智元新知"关注
微信扫一扫可直接关注哦!

fink+iceberg ,如何更新冰山中的数据

如何解决fink+iceberg ,如何更新冰山中的数据

2021-07-13T11:28:31.187430109+08:00 java.lang.UnsupportedOperationException: 发现覆盖操作,无法支持快照中的增量数据 (6836035541320694960,292593706187078)

2021-07-13T11:28:31.187439398+08:00 在 org.apache.iceberg.IncrementalDataTableScan.snapshotsWithin(IncrementalDataTableScan.java:123) ~[iceberg-flink-runtime-a6a88e6]

>

2021-07-13T11:28:31.187445899+08:00 在 org.apache.iceberg.IncrementalDataTableScan.planFiles(IncrementalDataTableScan.java:73) ~[iceberg-flink-runtime-a6a88e6.jar:?]

2021-07-13T11:28:31.187454652+08:00 在 org.apache.iceberg.BaseTableScan.planTasks(BaseTableScan.java:241) ~[iceberg-flink-runtime-a6a88e6.jar:?]

2021-07-13T11:28:31.187460151+08:00 在 org.apache.iceberg.DataTableScan.planTasks(DataTableScan.java:28) ~[iceberg-flink-runtime-a6a88e6.jar:?]

2021-07-13T11:28:31.187481059+08:00 在 org.apache.iceberg.flink.source.FlinkSplitGenerator.tasks(FlinkSplitGenerator.java:86) ~[iceberg-flink-runtime-a6a88e6.jar:? ]

2021-07-13T11:28:31.187486890+08:00 在 org.apache.iceberg.flink.source.FlinkSplitGenerator.createInputSplits(FlinkSplitGenerator.java:38) ~[iceberg-flink-runtime-a6a88e6.jar: ]

2021-07-13T11:28:31.187493214+08:00 在 org.apache.iceberg.flink.source.StreamingMonitorFunction.monitorAndForwardSplits(StreamingMonitorFunction.java:143) ~[iceberg-flink.jar-8e6a- ]

2021-07-13T11:28:31.187497911+08:00 在 org.apache.iceberg.flink.source.StreamingMonitorFunction.run(StreamingMonitorFunction.java:121) ~[iceberg-flink-runtime-a6a88e6. ]

2021-07-13T11:28:31.187502585+08:00 在 org.apache.flink.streaming.api.operators.StreamSource.run(StreamSource.java:110) ~[flink-dist_2.11-1.12.4 .jar:1.12.4]

2021-07-13T11:28:31.187507397+08:00 在 org.apache.flink.streaming.api.operators.StreamSource.run(StreamSource.java:66) ~[flink-dist_2.11-1.12.4 .jar:1.12.4]

2021-07-13T11:28:31.187512294+08:00 在 org.apache.flink.streaming.runtime.tasks.sourceStreamTask$LegacySourceFunctionThread.run(SourceStreamTask.java:263) ~[flink-dist_2.11-1.1.1.1 .4.jar:1.12.4]

2021-07-13T11:28:31.187545900+08:00 2021-07-13 03:28:31,187 INFO org.apache.flink.runtime.taskmanager.Task [] - 释放任务资源来源:冰山表

版权声明:本文内容由互联网用户自发贡献,该文观点与技术仅代表作者本人。本站仅提供信息存储空间服务,不拥有所有权,不承担相关法律责任。如发现本站有涉嫌侵权/违法违规的内容, 请发送邮件至 dio@foxmail.com 举报,一经查实,本站将立刻删除。