This is a continuation of Growing Order Data â€“ Is this really an issue?
Transactional databases grow with order data exponentially over time. â€śData is valuable!â€ť It cannot be purged to trim down a database. The next challenge for solution designers is to implement an approach so that their application can provide a better user experience while business continues to grow with transactions. This blog presents an implementation strategy in IBM Cloud that uses the integration between IBM Order Management (OM) and IBM Universal Behavior Exchange (UBX), a data exchange platform.
Data in OM belongs to three major categories: transactional, configuration and master. A process can be established to push transactional data into an external datastore and to meet the rapidly growing business needs around data retrieval. This data can be pushed in real time using an asynchronous event-based mechanism. The configuration and master data can be pushed through scheduled cron-based processes that can be run at regular intervals. Some common examples are as follows:
A scheduled cron based process can also be used to migrate existing or historical transactional data from a â€śbackup databaseâ€ť into the â€śreadâ€ť datastore. Once the historical data is migrated successfully, another process can be established to trim down the active transactional database periodically.
REST based microservices can be created to access data from the â€śreadâ€ť datastore. Some common use cases can be implemented as shown in the following table:
This pattern can also be used for â€śRestore Orderâ€ť use case if the source needs to restore the data after it is purged.