我有一个在Jetty上运行的REST Web服务.我想编写一个
Java客户端,它使用相同的Web连接将大量文档分块到该休息服务.
Sending a stream of documents to a Jersey @POST endpoint
除非您设置clientConfig.property(ClientProperties.REQUEST_ENTITY_PROCESSING,RequestEntityProcessing.CHUNKED),否则这不起作用;因为内容长度未知.
虽然有些工作,但分块转移似乎丢失了一些文件.例如:
num_docs 500000 numFound 499249
也许它发送的块像:
{some:doc},{some:doc},{some:do
所以我每次都在输掉一些?更新:我错了.
我该怎么做呢?还有什么想法可能会发生什么?
ClientConfig clientConfig = new ClientConfig(); clientConfig.property(ClientProperties.CONNECT_TIMEOUT,(int)TimeUnit.SECONDS.toMillis(60)); clientConfig.property(ClientProperties.REQUEST_ENTITY_PROCESSING,RequestEntityProcessing.CHUNKED); clientConfig.property(ClientProperties.ASYNC_THREADPOOL_SIZE,100); clientConfig.property(ApacheClientProperties.CONNECTION_MANAGER,HttpClientFactory.createConnectionManager(name,metricRegistry,configuration)); ApacheConnectorProvider connector = new ApacheConnectorProvider(); clientConfig.connectorProvider(connector); clientConfig.register(new ClientRequestFilter() { @Override public void filter(ClientRequestContext requestContext) throws IOException { List<Object> orig = requestContext.getHeaders().remove(HttpHeaders.CONTENT_LENGTH); if (orig != null && !orig.isEmpty()) { requestContext.getHeaders().addAll("Length",orig); } } }); clientConfig.register(new ClientRequestFilter() { @Override public void filter(ClientRequestContext requestContext) throws IOException { if (requestContext.getMediaType() != null && requestContext.getMediaType().getType() != null && requestContext.getMediaType().getType().equalsIgnoreCase("multipart")) { final MediaType boundaryMediaType = Boundary.addBoundary(requestContext.getMediaType()); if (boundaryMediaType != requestContext.getMediaType()) { requestContext.getHeaders().putSingle(HttpHeaders.CONTENT_TYPE,boundaryMediaType.toString()); } if (!requestContext.getHeaders().containsKey("MIME-Version")) { requestContext.getHeaders().putSingle("MIME-Version","1.0"); } } } });
解决方法
原文地址:https://www.jb51.cc/java/129781.html
版权声明:本文内容由互联网用户自发贡献,该文观点与技术仅代表作者本人。本站仅提供信息存储空间服务,不拥有所有权,不承担相关法律责任。如发现本站有涉嫌侵权/违法违规的内容, 请发送邮件至 dio@foxmail.com 举报,一经查实,本站将立刻删除。