Our team recently started exploring the async history feature to push data via SQS into MongoDB. Our initial impression was that we can put all of the events into a single collection and run our subsequent pipelines on it. But looking at the structure of the JSON objects, it is apparent that they should not be placed together.
I have searched on the web, as well as on the forums, and I have not seen specific pattern that is established for storing the async data in the NoSQL stores. Are there any considerations that we should take into account. Should the NoSQL collections follow a similar set of collections, like
- ACT_HI_VARINST, etc
Thanks in advance!