如何解决用Java + Apache Storm处理数据
我的任务是处理进入ApacheMQ Artemis的大型xml文件(
我需要的伪算法是
AnswerXml processIncomingXml(){
currentXmlMessage = getXmlMessageFromApacheMQArtemis();
answerXmlMessage = processCurrentXmlMessageUsingApacheStormFunctionality(currentXml);
saveXmlToApacheMQArtemis(answerXml);
return answerXml;
}
我希望processCurrentXmlMessageUsingApacheStormFunctionality(currentXml)
方法能做到
像这样的东西
AnswerXml processCurrentXmlUsingApacheStormFunctionality(currentXml) {
1. split currentXml message into chunks
2. answerXml + = process chunks in parallel (retrieving necessary data from database
MysqL,calculations,etc. for each chunk independently)
return a stream of answerXml (BufferedWriter or something like that) from all chunks per currentXml;
}
我期望的xml文件结构
<Employees>
<Employee>
<Address>
<street>test street</street>
<houseNr>23</houseNr>
<Country>
<city>test city</city>
</Country>
</Address>
<salary>200</salary>
<maritalstatus>test</maritalstatus>
...
</Employee>
...
</Employees>
我的问题是:“ Apache Storm是适合我的问题的工具,还是我在错误的树上吠叫?”
版权声明:本文内容由互联网用户自发贡献,该文观点与技术仅代表作者本人。本站仅提供信息存储空间服务,不拥有所有权,不承担相关法律责任。如发现本站有涉嫌侵权/违法违规的内容, 请发送邮件至 dio@foxmail.com 举报,一经查实,本站将立刻删除。