微信公众号搜"智元新知"关注
微信扫一扫可直接关注哦!

是否可以配置 Deequ 指标存储库的架构?

如何解决是否可以配置 Deequ 指标存储库的架构?

这是 [INFO] --- maven-dependency-plugin:3.0.1:tree (default-cli) @ marketing-offers-loader --- [INFO] com.blahblah.blah.sales.offers:sales-offers-loader:jar:01.1.56-SNAPSHOT [INFO] +- org.springframework.boot:spring-boot-starter-web:jar:2.1.4.RELEASE:compile [INFO] | +- org.springframework.boot:spring-boot-starter:jar:2.1.6.RELEASE:compile [INFO] | | +- org.springframework.boot:spring-boot:jar:2.1.6.RELEASE:compile [INFO] | | \- javax.annotation:javax.annotation-api:jar:1.3.2:compile [INFO] | +- org.springframework.boot:spring-boot-starter-json:jar:2.1.6.RELEASE:compile [INFO] | | +- com.fasterxml.jackson.datatype:jackson-datatype-jdk8:jar:2.8.10:compile [INFO] | | +- com.fasterxml.jackson.datatype:jackson-datatype-jsr310:jar:2.10.0:compile [INFO] | | \- com.fasterxml.jackson.module:jackson-module-parameter-names:jar:2.8.10:compile [INFO] | \- org.springframework.boot:spring-boot-starter-tomcat:jar:2.1.6.RELEASE:compile [INFO] | \- org.apache.tomcat.embed:tomcat-embed-el:jar:9.0.21:compile [INFO] +- org.hibernate.validator:hibernate-validator:jar:6.1.5.Final:compile [INFO] | +- jakarta.validation:jakarta.validation-api:jar:2.0.2:compile [INFO] | +- org.jboss.logging:jboss-logging:jar:3.3.2.Final:compile [INFO] | \- com.fasterxml:classmate:jar:1.4.0:compile [INFO] +- org.yaml:snakeyaml:jar:1.26:compile [INFO] +- org.springframework:spring-web:jar:5.1.6.RELEASE:compile [INFO] | \- org.springframework:spring-beans:jar:4.3.12.RELEASE:compile [INFO] +- org.springframework:spring-webmvc:jar:5.1.6.RELEASE:compile [INFO] | \- org.springframework:spring-aop:jar:4.3.12.RELEASE:compile [INFO] +- org.apache.tomcat.embed:tomcat-embed-core:jar:8.5.63:compile [INFO] | \- org.apache.tomcat:tomcat-annotations-api:jar:9.0.21:compile [INFO] +- org.springframework.boot:spring-boot-starter-actuator:jar:2.1.4.RELEASE:compile [INFO] | +- org.springframework.boot:spring-boot-actuator-autoconfigure:jar:2.1.6.RELEASE:compile [INFO] | | \- org.springframework.boot:spring-boot-actuator:jar:2.1.6.RELEASE:compile [INFO] | \- io.micrometer:micrometer-core:jar:1.1.5:compile [INFO] | +- org.hdrhistogram:HdrHistogram:jar:2.1.9:compile [INFO] | \- org.latencyutils:LatencyUtils:jar:2.0.3:compile [INFO] +- org.springframework.boot:spring-boot-configuration-processor:jar:2.1.4.RELEASE:compile (optional) [INFO] +- com.fasterxml.jackson.core:jackson-databind:jar:2.11.0.rc1:compile [INFO] +- com.fasterxml.jackson.core:jackson-core:jar:2.11.0.rc1:compile [INFO] +- org.springframework.boot:spring-boot-starter-batch:jar:2.1.6.RELEASE:compile [INFO] | \- org.springframework.boot:spring-boot-starter-jdbc:jar:2.1.6.RELEASE:compile [INFO] +- org.springframework.boot:spring-boot-starter-test:jar:2.1.4.RELEASE:test [INFO] | +- org.springframework.boot:spring-boot-test:jar:2.1.6.RELEASE:test [INFO] | +- org.springframework.boot:spring-boot-test-autoconfigure:jar:2.1.6.RELEASE:test [INFO] | +- com.jayway.jsonpath:json-path:jar:2.4.0:test [INFO] | | \- net.minidev:json-smart:jar:2.3:test [INFO] | | \- net.minidev:accessors-smart:jar:1.2:test [INFO] | | \- org.ow2.asm:asm:jar:5.0.4:test [INFO] | +- junit:junit:jar:4.12:test [INFO] | +- org.assertj:assertj-core:jar:3.11.1:test [INFO] | +- org.mockito:mockito-core:jar:2.27.0:test [INFO] | | \- net.bytebuddy:byte-buddy-agent:jar:1.9.13:test [INFO] | +- org.hamcrest:hamcrest-core:jar:1.3:test [INFO] | +- org.hamcrest:hamcrest-library:jar:1.3:test [INFO] | +- org.skyscreamer:jsonassert:jar:1.5.0:test [INFO] | | \- com.vaadin.external.google:android-json:jar:0.0.20131108.vaadin1:test [INFO] | +- org.springframework:spring-test:jar:4.3.12.RELEASE:test [INFO] | \- org.xmlunit:xmlunit-core:jar:2.6.2:test [INFO] +- com.blahblah.thedumpster:correlation-id:jar:01.00.38:compile [INFO] +- com.blahblah.thedumpster:common:jar:01.00.38:compile [INFO] +- org.apache.logging.log4j:log4j-api:jar:2.13.2:compile [INFO] +- org.apache.logging.log4j:log4j-core:jar:2.13.2:compile [INFO] +- org.apache.logging.log4j:log4j-slf4j-impl:jar:2.13.2:compile [INFO] | \- org.slf4j:slf4j-api:jar:1.7.26:compile [INFO] +- com.blahblah.observability:metrics-spring-boot-starter-web:jar:0.2.3:compile [INFO] | +- com.blahblah.observability:metrics-spring-boot-starter-core-servlet:jar:0.2.3:compile [INFO] | | \- com.blahblah.observability:metrics-spring-boot-starter-core:jar:0.1.1:compile [INFO] | | +- io.prometheus:simpleclient_hotspot:jar:0.4.0:compile [INFO] | | +- io.prometheus:simpleclient_servlet:jar:0.4.0:compile [INFO] | | | \- io.prometheus:simpleclient_common:jar:0.4.0:compile [INFO] | | +- io.prometheus:simpleclient:jar:0.4.0:compile [INFO] | | \- io.prometheus:simpleclient_hibernate:jar:0.4.0:compile [INFO] | +- com.blahblah.observability:metrics-spring-boot-starter-servlet-filter:jar:0.1.1:compile [INFO] | \- org.slf4j:log4j-over-slf4j:jar:1.7.26:compile [INFO] +- org.springframework.batch:spring-batch-integration:jar:4.2.3.RELEASE:compile [INFO] | +- org.springframework.retry:spring-retry:jar:1.2.4.RELEASE:compile [INFO] | +- org.springframework:spring-context:jar:4.3.12.RELEASE:compile [INFO] | | \- org.springframework:spring-expression:jar:4.3.12.RELEASE:compile [INFO] | \- org.springframework:spring-tx:jar:4.3.12.RELEASE:compile [INFO] +- org.springframework:spring-messaging:jar:5.1.6.RELEASE:compile [INFO] +- org.springframework.batch:spring-batch-core:jar:4.2.3.RELEASE:compile [INFO] | +- javax.batch:javax.batch-api:jar:1.0:compile [INFO] | +- org.codehaus.jettison:jettison:jar:1.2:compile [INFO] | \- org.springframework.batch:spring-batch-infrastructure:jar:4.2.3.RELEASE:compile [INFO] +- com.thoughtworks.xstream:xstream:jar:1.4.16:compile [INFO] | \- io.github.x-stream:mxparser:jar:1.2.1:compile [INFO] +- com.blahblah.blah.batch:ls-batch-common-lib:jar:2.25:compile [INFO] | +- org.springframework.boot:spring-boot-autoconfigure:jar:2.1.6.RELEASE:compile [INFO] | \- commons-io:commons-io:jar:2.4:compile [INFO] +- org.springframework:spring-jms:jar:5.1.6.RELEASE:compile [INFO] +- org.springframework.cloud:spring-cloud-aws-messaging:jar:1.2.1.RELEASE:compile [INFO] | \- com.amazonaws:aws-java-sdk-sns:jar:1.11.125:compile [INFO] +- com.amazonaws:aws-java-sdk-core:jar:1.11.136:compile [INFO] | +- commons-logging:commons-logging:jar:1.1.3:compile [INFO] | +- software.amazon.ion:ion-java:jar:1.0.2:compile [INFO] | \- joda-time:joda-time:jar:2.10.3:compile [INFO] +- com.fasterxml.jackson.dataformat:jackson-dataformat-cbor:jar:2.12.1:compile [INFO] +- org.apache.httpcomponents:httpclient:jar:4.5.13:compile [INFO] | \- org.apache.httpcomponents:httpcore:jar:4.4.11:compile [INFO] +- commons-codec:commons-codec:jar:1.14:compile [INFO] +- com.fasterxml.jackson.core:jackson-annotations:jar:2.9.0:compile [INFO] +- com.amazonaws:aws-java-sdk-sqs:jar:1.11.136:compile [INFO] | \- com.amazonaws:jmespath-java:jar:1.11.136:compile [INFO] +- org.springframework.cloud:spring-cloud-aws-context:jar:1.2.1.RELEASE:compile [INFO] | \- org.springframework.cloud:spring-cloud-aws-core:jar:1.2.1.RELEASE:compile [INFO] | +- com.amazonaws:aws-java-sdk-s3:jar:1.11.598:compile [INFO] | | \- com.amazonaws:aws-java-sdk-kms:jar:1.11.598:compile [INFO] | +- com.amazonaws:aws-java-sdk-ec2:jar:1.11.125:compile [INFO] | \- com.amazonaws:aws-java-sdk-cloudformation:jar:1.11.125:compile [INFO] +- com.blahblah.fs:super-juice:jar:1.0.7:compile [INFO] | \- com.amazonaws:aws-java-sdk-sts:jar:1.11.136:compile [INFO] +- org.apache.commons:commons-lang3:jar:3.6:compile [INFO] +- org.apache.avro:avro:jar:1.9.2:compile [INFO] +- org.apache.avro:avro-compiler:jar:1.9.2:compile [INFO] | \- org.apache.veLocity:veLocity-engine-core:jar:2.2:compile [INFO] +- org.postgresql:postgresql:jar:42.2.13:compile [INFO] | +- com.github.waffle:waffle-jna:jar:1.9.1:runtime [INFO] | | +- net.java.dev.jna:jna:jar:4.5.2:runtime [INFO] | | +- net.java.dev.jna:jna-platform:jar:4.5.2:runtime [INFO] | | \- com.github.ben-manes.caffeine:caffeine:jar:2.6.2:runtime [INFO] | +- org.osgi:org.osgi.core:jar:4.3.1:runtime [INFO] | \- org.osgi:org.osgi.enterprise:jar:4.2.0:runtime [INFO] +- com.blahblah.blah.sales:sales-offers-db:jar:02.00.03-SNAPSHOT:compile [INFO] | +- org.springframework.boot:spring-boot-starter-data-jpa:jar:2.1.6.RELEASE:compile [INFO] | | +- org.springframework.boot:spring-boot-starter-aop:jar:2.1.6.RELEASE:compile [INFO] | | | \- org.aspectj:aspectjweaver:jar:1.9.4:compile [INFO] | | +- javax.transaction:javax.transaction-api:jar:1.3:compile [INFO] | | \- org.springframework:spring-aspects:jar:4.3.12.RELEASE:compile [INFO] | \- com.zaxxer:HikariCP:jar:3.3.1:compile [INFO] +- org.hibernate:hibernate-envers:jar:5.4.24.Final:compile [INFO] +- org.hibernate:hibernate-core:jar:5.4.24.Final:compile [INFO] | +- javax.persistence:javax.persistence-api:jar:2.2:compile [INFO] | +- org.javassist:javassist:jar:3.21.0-GA:compile [INFO] | +- net.bytebuddy:byte-buddy:jar:1.9.13:compile [INFO] | +- antlr:antlr:jar:2.7.7:compile [INFO] | +- org.jboss.spec.javax.transaction:jboss-transaction-api_1.2_spec:jar:1.1.1.Final:compile [INFO] | +- org.jboss:jandex:jar:2.1.3.Final:compile [INFO] | +- javax.activation:javax.activation-api:jar:1.2.0:compile [INFO] | +- org.hibernate.common:hibernate-commons-annotations:jar:5.1.2.Final:compile [INFO] | +- javax.xml.bind:jaxb-api:jar:2.3.1:compile [INFO] | \- org.glassfish.jaxb:jaxb-runtime:jar:2.3.1:compile [INFO] | +- org.glassfish.jaxb:txw2:jar:2.3.1:compile [INFO] | +- com.sun.istack:istack-commons-runtime:jar:3.0.7:compile [INFO] | +- org.jvnet.staxex:stax-ex:jar:1.8:compile [INFO] | \- com.sun.xml.fastinfoset:fastinfoset:jar:1.2.15:compile [INFO] +- org.hibernate:hibernate-entitymanager:jar:5.4.24.Final:compile [INFO] +- org.dom4j:dom4j:jar:2.1.3:compile [INFO] +- org.springframework.data:spring-data-jpa:jar:1.11.20.RELEASE:compile [INFO] | +- org.springframework:spring-orm:jar:4.3.12.RELEASE:compile [INFO] | +- org.aspectj:aspectjrt:jar:1.9.4:compile [INFO] | \- org.slf4j:jcl-over-slf4j:jar:1.7.26:runtime [INFO] +- org.springframework:spring-core:jar:5.1.6.RELEASE:compile [INFO] | \- org.springframework:spring-jcl:jar:5.1.6.RELEASE:compile [INFO] +- org.springframework.data:spring-data-commons:jar:1.13.12.RELEASE:compile [INFO] +- com.github.dozermapper:dozer-core:jar:6.2.0:compile [INFO] | \- org.objenesis:objenesis:jar:2.6:compile [INFO] +- commons-beanutils:commons-beanutils:jar:1.9.4:compile [INFO] | \- commons-collections:commons-collections:jar:3.2.2:compile [INFO] +- com.github.dozermapper:dozer-spring-boot-starter:jar:6.2.0:compile [INFO] | +- com.github.dozermapper:dozer-spring4:jar:6.2.0:compile [INFO] | \- com.github.dozermapper:dozer-spring-boot-autoconfigure:jar:6.2.0:compile [INFO] +- org.spockframework:spock-core:jar:1.1-groovy-2.4:test [INFO] +- org.codehaus.groovy:groovy-all:jar:2.4.16:test [INFO] +- cglib:cglib-nodep:jar:2.2.2:test [INFO] +- org.springframework.batch:spring-batch-test:jar:3.0.6.RELEASE:test [INFO] | +- org.hamcrest:hamcrest-all:jar:1.3:test [INFO] | \- org.springframework:spring-jdbc:jar:5.1.6.RELEASE:compile [INFO] +- org.powermock:powermock-module-junit4:jar:1.6.4:test [INFO] | \- org.powermock:powermock-module-junit4-common:jar:1.6.4:test [INFO] | +- org.powermock:powermock-core:jar:1.6.4:test [INFO] | \- org.powermock:powermock-reflect:jar:1.6.4:test [INFO] \- org.powermock:powermock-api-mockito:jar:1.6.4:test [INFO] \- org.powermock:powermock-api-support:jar:1.6.4:test 提供的 DF:

MetricsRepository

这是直接从 +-----------+--------------------+-------------+------------------+-------------+ | entity| instance| name| value| dataset_date| +-----------+--------------------+-------------+------------------+-------------+ | Column| SEO_title_reco| distinctness| 1.0|1617988041554| | Column|explodedTags cont...| Compliance|0.9944852941176471|1617988041554| | Column| SEO_title_ml| distinctness| 1.0|1617988041554| 提供的 DF:

VerificationResult

是否可以操作我的 MetricsReposity 数据帧来反映第二个 DF 的架构。这将使我的生活更轻松,因为我不必管理两张桌子。

注意:我只使用 MetricsRepository 作为其异常检测工具。

版权声明:本文内容由互联网用户自发贡献,该文观点与技术仅代表作者本人。本站仅提供信息存储空间服务,不拥有所有权,不承担相关法律责任。如发现本站有涉嫌侵权/违法违规的内容, 请发送邮件至 dio@foxmail.com 举报,一经查实,本站将立刻删除。