微信公众号搜"智元新知"关注
微信扫一扫可直接关注哦!

用Java + Apache Storm处理数据

如何解决用Java + Apache Storm处理数据

我的任务是处理进入ApacheMQ Artemis的大型xml文件

我需要的伪算法是

AnswerXml processIncomingXml(){
  
 currentXmlMessage = getXmlMessageFromApacheMQArtemis();
 answerXmlMessage = processCurrentXmlMessageUsingApacheStormFunctionality(currentXml);
 saveXmlToApacheMQArtemis(answerXml);
return answerXml;
}

我希望processCurrentXmlMessageUsingApacheStormFunctionality(currentXml)方法能做到 像这样的东西

AnswerXml processCurrentXmlUsingApacheStormFunctionality(currentXml) {

1. split currentXml message into chunks
2. answerXml + = process chunks in parallel (retrieving necessary data from database 
                                          MysqL,calculations,etc. for each chunk independently)

return a stream of answerXml (BufferedWriter or something like that) from all chunks per currentXml;
}

我期望的xml文件结构

<Employees>
    <Employee>
        <Address>
            <street>test street</street>
            <houseNr>23</houseNr>
            <Country>
                <city>test city</city>
            </Country>
        </Address>
        <salary>200</salary>
        <maritalstatus>test</maritalstatus>
        ...
    </Employee>
    ...
</Employees>

我的问题是:“ Apache Storm是适合我的问题的工具,还是我在错误的树上吠叫?”

版权声明:本文内容由互联网用户自发贡献,该文观点与技术仅代表作者本人。本站仅提供信息存储空间服务,不拥有所有权,不承担相关法律责任。如发现本站有涉嫌侵权/违法违规的内容, 请发送邮件至 dio@foxmail.com 举报,一经查实,本站将立刻删除。