使用 ngram 分析器获取脏结果以进行高亮搜索

如何解决使用 ngram 分析器获取脏结果以进行高亮搜索

嗨,我正在使用最小长度为 1 和最大长度为 100 的 ngram,我正在获取文档并突出显示文档中的字段。现在,当我从 ES 获得结果时,即使大小为 10,它也有一些随机文档。并且该文档的相关分数也很高。有人可以让我知道如何从我的搜索结果中减少非相关文档。搜索文本,例如“samsung inc”得到“ach”的结果。但是当我在没有任何空间的情况下进行搜索时,我得到了预期的结果。

我使用了这些设置

{
    "settings": {
        "analysis": {
            "filter": {
                "ngram_filter": {
                    "type": "ngram","min_gram": 1,"max_gram": 101
                }
            },"analyzer": {
                "ngram_analyzer": {
                    "type": "custom","tokenizer": "standard","filter": [
                        "lowercase","ngram_filter"
                    ]
                }
            }
        },"max_ngram_diff": 101
    }
}

搜索查询:

    {
    "from": 0,"size": 10,"query": {
        "bool": {
            "must": [
                {
                    "terms": {
                        "documentType.keyword": [
                            "School"
                        ],"boost": 1.0
                    }
                },{
                    "range": {
                        "paidDate": {
                            "from": "2015-05-15T15:29:50","to": "2020-12-15T15:29:50","include_lower": true,"include_upper": true,"boost": 1.0
                        }
                    }
                },{
                    "range": {
                        "updatedDate": {
                            "from": "2015-05-15T15:29:50",{
                    "simple_query_string": {
                        "query": "walmart corp*","fields": [
                            "service^1.0","teacherName^1.0","studentTeacherId^1.0","teacherAccId^1.0","chainName^1.0","paidId^1.0","studentId^1.0","studentName^1.0","teacherId^1.0","studentAccID^1.0","status^1.0"
                        ],"flags": -1,"default_operator": "and","analyze_wildcard": false,"auto_generate_synonyms_phrase_query": true,"fuzzy_prefix_length": 0,"fuzzy_max_expansions": 50,"fuzzy_transpositions": true,"boost": 1.0
                    }
                }
            ],"adjust_pure_negative": true,"boost": 1.0
        }
    },"highlight": {
        "pre_tags": [
            ""
        ],"post_tags": [
            ""
        ],"fields": {
            "paidId": {},"chainName": {},"teacherId": {},"teacherName": {},"status": {},"studentId": {},"studentName": {},"studentAccID": {},"studentTeacherId": {},"service": {}
        }
    }
}

回复:

{
  "took": 213,"timed_out": false,"_shards": {
    "total": 1,"successful": 1,"skipped": 0,"failed": 0
  },"hits": {
    "total": {
      "value": 2702,"relation": "eq"
    },"max_score": 14.807846,"hits": [
      {
        "_index": "scheduler_testing_new","_type": "_doc","_id": "nmvnmvbmnb","_score": 14.807846,"_source": {
          "service": "ACH","teacherAccId": "ASelQvpMBJAY6FJR","chainName": "AMEXB2BTEST","studentId": "OBgEkzyc86C0AbwP","studentAccID": "AB200gR4Pll4sptx","studentTeacherId": "abc68aa1a2adfaay65asd87a6das215","teacherName": "Naga Corporatiasdfaaaon12","paidId": "nmvnmvbmnb","studentName": "Naga Corporatiasdfaaaon12","teacherId": "OSARRRzoDFEKzLMO","status": "MAIL"
        },"highlight": {
          "service": [
            "ACH"
          ],"teacherName": [
            "Naga Corporatiasdfaaaon12"
          ],"studentTeacherId": [
            "abc68aa1a2adfaay65asd87a6das215"
          ],"teacherAccId": [
            "ASelQvpMBJAY6FJR"
          ],"chainName": [
            "AMEXB2BTEST"
          ],"paidId": [
            "PY3PHrQVe9tzZPaF"
          ],"studentId": [
            "OBgEkzyc86C0AbwP"
          ],"studentName": [
            "Naga Corporatiasdfaaaon12"
          ],"teacherId": [
            "OSARRRzoDFEKzLMO"
          ],"studentAccID": [
            "AB200gR4Pll4sptx"
          ],"status": [
            "MAIL"
          ]
        }
      },{
        "_index": "scheduler_testing_new","_id": "PY3g1OcFiSBwQlrU","_score": 14.771165,"teacherAccId": "ASnv9CtYz4ubuusu","studentId": "OBLUaGtLn6YAvepP","studentAccID": "ABpcoMUvQuIAydUA","paidId": "PY3g1OcFiSBwQlrU","teacherId": "OSmPsSrp2CmsFyBG","teacherAccId": [
            "ASnv9CtYz4ubuusu"
          ],"paidId": [
            "PY3g1OcFiSBwQlrU"
          ],"studentId": [
            "OBLUaGtLn6YAvepP"
          ],"teacherId": [
            "OSmPsSrp2CmsFyBG"
          ],"studentAccID": [
            "ABpcoMUvQuIAydUA"
          ],"_id": "PY3gPGf0gUszaoMy","_score": 14.77009,"teacherAccId": "ASxdVOoDIxqdTdkx","studentId": "OBAFhpOkWPWVr2Ze","studentAccID": "AB0Em4lwMRtYsonV","paidId": "PY3gPGf0gUszaoMy","teacherId": "OSrg4RqDTgPxLC1Y","teacherAccId": [
            "ASxdVOoDIxqdTdkx"
          ],"paidId": [
            "PY3gPGf0gUszaoMy"
          ],"studentId": [
            "OBAFhpOkWPWVr2Ze"
          ],"teacherId": [
            "OSrg4RqDTgPxLC1Y"
          ],"studentAccID": [
            "AB0Em4lwMRtYsonV"
          ],"_id": "PYDgkETuAGW6wUDA","_score": 14.735176,"_source": {
          "service": "Card","teacherAccId": "","chainName": "INTACCT","studentId": "OBHPLgTA0h5MbEHO","studentAccID": "AB2hIX9e11py5BwJ","studentTeacherId": "Cardustpay033","teacherName": "APPLECORP","paidId": "PYDgkETuAGW6wUDA","studentName": "APPLECORP","teacherId": "OSgLHayuYOKXJHYd","highlight": {
          "service": [
            "Card"
          ],"teacherName": [
            "APPLECORP"
          ],"studentTeacherId": [
            "Cardustpay033"
          ],"chainName": [
            "INTACCT"
          ],"paidId": [
            "PYDgkETuAGW6wUDA"
          ],"studentId": [
            "OBHPLgTA0h5MbEHO"
          ],"studentName": [
            "APPLECORP"
          ],"teacherId": [
            "OSgLHayuYOKXJHYd"
          ],"studentAccID": [
            "AB2hIX9e11py5BwJ"
          ],"_id": "PYR8DATaXD6udVE4","_score": 14.718508,"studentId": "OBlNai09AyGZ1dn7","studentAccID": "AB2rtgOdosvlIFKg","studentTeacherId": "PCard07","paidId": "PYR8DATaXD6udVE4","teacherId": "OSntdBaqhZLYLR39","studentTeacherId": [
            "PCard07"
          ],"paidId": [
            "PYR8DATaXD6udVE4"
          ],"studentId": [
            "OBlNai09AyGZ1dn7"
          ],"teacherId": [
            "OSntdBaqhZLYLR39"
          ],"studentAccID": [
            "AB2rtgOdosvlIFKg"
          ],"status": [
            "MAIL"
          ]
        }
      }
    ]
  }
}

版权声明:本文内容由互联网用户自发贡献,该文观点与技术仅代表作者本人。本站仅提供信息存储空间服务,不拥有所有权,不承担相关法律责任。如发现本站有涉嫌侵权/违法违规的内容, 请发送邮件至 dio@foxmail.com 举报,一经查实,本站将立刻删除。

相关推荐


使用本地python环境可以成功执行 import pandas as pd import matplotlib.pyplot as plt # 设置字体 plt.rcParams['font.sans-serif'] = ['SimHei'] # 能正确显示负号 p
错误1:Request method ‘DELETE‘ not supported 错误还原:controller层有一个接口,访问该接口时报错:Request method ‘DELETE‘ not supported 错误原因:没有接收到前端传入的参数,修改为如下 参考 错误2:cannot r
错误1:启动docker镜像时报错:Error response from daemon: driver failed programming external connectivity on endpoint quirky_allen 解决方法:重启docker -> systemctl r
错误1:private field ‘xxx‘ is never assigned 按Altʾnter快捷键,选择第2项 参考:https://blog.csdn.net/shi_hong_fei_hei/article/details/88814070 错误2:启动时报错,不能找到主启动类 #
报错如下,通过源不能下载,最后警告pip需升级版本 Requirement already satisfied: pip in c:\users\ychen\appdata\local\programs\python\python310\lib\site-packages (22.0.4) Coll
错误1:maven打包报错 错误还原:使用maven打包项目时报错如下 [ERROR] Failed to execute goal org.apache.maven.plugins:maven-resources-plugin:3.2.0:resources (default-resources)
错误1:服务调用时报错 服务消费者模块assess通过openFeign调用服务提供者模块hires 如下为服务提供者模块hires的控制层接口 @RestController @RequestMapping("/hires") public class FeignControl
错误1:运行项目后报如下错误 解决方案 报错2:Failed to execute goal org.apache.maven.plugins:maven-compiler-plugin:3.8.1:compile (default-compile) on project sb 解决方案:在pom.
参考 错误原因 过滤器或拦截器在生效时,redisTemplate还没有注入 解决方案:在注入容器时就生效 @Component //项目运行时就注入Spring容器 public class RedisBean { @Resource private RedisTemplate<String
使用vite构建项目报错 C:\Users\ychen\work>npm init @vitejs/app @vitejs/create-app is deprecated, use npm init vite instead C:\Users\ychen\AppData\Local\npm-
参考1 参考2 解决方案 # 点击安装源 协议选择 http:// 路径填写 mirrors.aliyun.com/centos/8.3.2011/BaseOS/x86_64/os URL类型 软件库URL 其他路径 # 版本 7 mirrors.aliyun.com/centos/7/os/x86
报错1 [root@slave1 data_mocker]# kafka-console-consumer.sh --bootstrap-server slave1:9092 --topic topic_db [2023-12-19 18:31:12,770] WARN [Consumer clie
错误1 # 重写数据 hive (edu)> insert overwrite table dwd_trade_cart_add_inc > select data.id, > data.user_id, > data.course_id, > date_format(
错误1 hive (edu)> insert into huanhuan values(1,'haoge'); Query ID = root_20240110071417_fe1517ad-3607-41f4-bdcf-d00b98ac443e Total jobs = 1
报错1:执行到如下就不执行了,没有显示Successfully registered new MBean. [root@slave1 bin]# /usr/local/software/flume-1.9.0/bin/flume-ng agent -n a1 -c /usr/local/softwa
虚拟及没有启动任何服务器查看jps会显示jps,如果没有显示任何东西 [root@slave2 ~]# jps 9647 Jps 解决方案 # 进入/tmp查看 [root@slave1 dfs]# cd /tmp [root@slave1 tmp]# ll 总用量 48 drwxr-xr-x. 2
报错1 hive> show databases; OK Failed with exception java.io.IOException:java.lang.RuntimeException: Error in configuring object Time taken: 0.474 se
报错1 [root@localhost ~]# vim -bash: vim: 未找到命令 安装vim yum -y install vim* # 查看是否安装成功 [root@hadoop01 hadoop]# rpm -qa |grep vim vim-X11-7.4.629-8.el7_9.x
修改hadoop配置 vi /usr/local/software/hadoop-2.9.2/etc/hadoop/yarn-site.xml # 添加如下 <configuration> <property> <name>yarn.nodemanager.res