Data Architecture
Last updated
Last updated
Payment hub follows a headless architecture in which transactional services store data asynchronously into real-time analytics and OLTP datastore. Orchestration (Zeebe) engine's embedded database (RocksDB) stores execution (workflow) variables and states of a transaction.
A Kafka Exporter exports orchestrator's independent event streams to Kafka. This is then streamed by importer services and persisted into both relational database (MySQL) and realtime search / analytical data store (Elasticsearch). This data then can be used for operational and analytical use cases.
Prometheus serves as a store for performance monitoring of the stack (especially for the orchestrator).
The business logic are encapsulated into Zeebe workers and assembled together in use case and implementation flows (configurations dragged and dropped in a modelling tool called Zeebe modeller). These transactional flows are completely separated from the data storage and retrieval mechanisms. Data stored within Elasticsearch is in real-time and is eventually consistent.
The payment hub supports multi-tenant data isolation at the database level
