...
counter
(def) - allows for aggregations assum
,count
,percentage
,min
,max
,avg
,percentile
Future instruments to be implemented -
meter
,gauge
,histogram
.
6. Event Management
All events are stored as CSV files in S3. They can be rerun to repopulate
Datasets
andDimensions
.Time dimensions-based Datasets are rolled up and bucketed using an OLAP extension in PSQL. This provides the best of both worlds - faster inserts (for data with an older timestamp compared to OLAPs) and almost comparable OLAP rolling aggregations on time dimensions.
Moving forward, the current collection service can be deprecated to use Opentelemetry Collector.
Assumptions
Since it’s not a frequent use case, Dimension updates and deletion are not supported. In case this is needed they can just create a new dimension, update the mapping to datasets and refresh the datasets.
Event Sourcing is used throughout the design.