Class OpenSearchMaterializedViewStore
- Namespace
- Excalibur.Data.OpenSearch.MaterializedViews
- Assembly
- Excalibur.Data.OpenSearch.dll
OpenSearch implementation of IMaterializedViewStore.
public sealed class OpenSearchMaterializedViewStore : IMaterializedViewStore, IAsyncDisposable
- Inheritance
-
OpenSearchMaterializedViewStore
- Implements
- Inherited Members
Remarks
Stores materialized views as JSON documents in OpenSearch with the following schema:
- Views index for view data with document ID as viewName:viewId
- Positions index for position tracking with document ID as viewName
Uses upsert operations for thread-safe save operations.
Does not implement IAtomicMaterializedViewStore: a view and its checkpoint live in different indices and there is no cross-index transaction to commit them together, so this store cannot offer exactly-once projection. Wiring it to a projection that requires exactly-once is refused at startup rather than degrading to at-least-once in production.
Views and checkpoints are partitioned by tenant. The tenant term is part of each document's identifier rather than a filter applied over it, so two tenants projecting the same named view hold distinct documents and distinct checkpoints. Keyed on view name and view id alone they shared one document: the later writer's data silently replaced the earlier one's, and a read returned whichever tenant wrote last. The checkpoint was worse -- keyed on view name alone it held ONE position for every tenant, so one tenant's progress advanced another's and that tenant's projector skipped every event in between, permanently.
A document written before this partitioning existed carries the un-prefixed identifier, so a scoped read does not find it. That direction is the safe one and it is chosen deliberately: an unfound checkpoint reads as unset, and an unset checkpoint replays from the beginning, which re-derives the view. The alternative failure -- a tenant inheriting a checkpoint written by another -- would skip the events in between with no error and no way to detect it afterwards. Replay costs time; a skip costs data.
Constructors
OpenSearchMaterializedViewStore(IOptions<OpenSearchMaterializedViewStoreOptions>, ILogger<OpenSearchMaterializedViewStore>, ITenantContext, JsonSerializerOptions?)
Initializes a new instance of the OpenSearchMaterializedViewStore class.
public OpenSearchMaterializedViewStore(IOptions<OpenSearchMaterializedViewStoreOptions> options, ILogger<OpenSearchMaterializedViewStore> logger, ITenantContext tenantContext, JsonSerializerOptions? jsonOptions = null)
Parameters
optionsIOptions<OpenSearchMaterializedViewStoreOptions>The store options.
loggerILogger<OpenSearchMaterializedViewStore>The logger instance.
tenantContextITenantContextThe ambient tenant context. Required: this store partitions documents by tenant, and it resolves that partition from here, so there is no state in which the partition is undecided. A single-tenant host receives the framework default context and operates as the one canonical tenant.
jsonOptionsJsonSerializerOptionsOptional JSON serializer options.
OpenSearchMaterializedViewStore(OpenSearchClient, IOptions<OpenSearchMaterializedViewStoreOptions>, ILogger<OpenSearchMaterializedViewStore>, ITenantContext, JsonSerializerOptions?)
Initializes a new instance of the OpenSearchMaterializedViewStore class with an existing client.
public OpenSearchMaterializedViewStore(OpenSearchClient client, IOptions<OpenSearchMaterializedViewStoreOptions> options, ILogger<OpenSearchMaterializedViewStore> logger, ITenantContext tenantContext, JsonSerializerOptions? jsonOptions = null)
Parameters
clientOpenSearchClientAn existing OpenSearch client.
optionsIOptions<OpenSearchMaterializedViewStoreOptions>The store options.
loggerILogger<OpenSearchMaterializedViewStore>The logger instance.
tenantContextITenantContextThe ambient tenant context. Required: this store partitions documents by tenant, and it resolves that partition from here, so there is no state in which the partition is undecided. A single-tenant host receives the framework default context and operates as the one canonical tenant.
jsonOptionsJsonSerializerOptionsOptional JSON serializer options.
Methods
DeleteAsync(string, string, CancellationToken)
Deletes a materialized view.
public ValueTask DeleteAsync(string viewName, string viewId, CancellationToken cancellationToken)
Parameters
viewNamestringThe view name (typically the view type name).
viewIdstringThe view identifier.
cancellationTokenCancellationTokenCancellation token.
Returns
- ValueTask
A task representing the asynchronous operation.
Remarks
Confined to the ambient tenant, like every other operation on this store: a view stored under
another tenant with the same viewName and viewId is not
deleted, and the call succeeds silently because that view is not visible to this caller. An
implementation that omits the tenant term here deletes another tenant's view -- silent data loss
rather than a disclosure, and the projector that rebuilt it will not notice.
DisposeAsync()
Performs application-defined tasks associated with freeing, releasing, or resetting unmanaged resources asynchronously.
public ValueTask DisposeAsync()
Returns
- ValueTask
A task that represents the asynchronous dispose operation.
GetAsync<TView>(string, string, CancellationToken)
Gets a materialized view by its identifier.
[RequiresUnreferencedCode("JSON deserialization might require types that cannot be statically analyzed.")]
[RequiresDynamicCode("JSON deserialization might require runtime code generation.")]
public ValueTask<TView?> GetAsync<TView>(string viewName, string viewId, CancellationToken cancellationToken) where TView : class
Parameters
viewNamestringThe view name (typically the view type name).
viewIdstringThe view identifier.
cancellationTokenCancellationTokenCancellation token.
Returns
- ValueTask<TView>
The view if found, or null if not found.
Type Parameters
TViewThe view type.
GetPositionAsync(string, CancellationToken)
Gets the last processed position for a view.
public ValueTask<long?> GetPositionAsync(string viewName, CancellationToken cancellationToken)
Parameters
viewNamestringThe view name for position tracking.
cancellationTokenCancellationTokenCancellation token.
Returns
Remarks
The position is used to track which events have been processed for a view, enabling catch-up subscriptions and rebuild scenarios.
ResetPositionAsync(string, CancellationToken)
Clears the recorded position for a view, so the next read reports no checkpoint at all.
public ValueTask ResetPositionAsync(string viewName, CancellationToken cancellationToken)
Parameters
viewNamestringThe view name for position tracking.
cancellationTokenCancellationTokenCancellation token.
Returns
- ValueTask
A task representing the asynchronous operation.
Remarks
Unconditional by contract. This is the operation a rebuild needs, and it is deliberately not subject to the monotonic guard that governs SavePositionAsync(string, long, CancellationToken) — a guard whose whole purpose is to refuse exactly this.
It clears rather than zeroes. GetPositionAsync(string, CancellationToken) already returns null for a view with no checkpoint, so absence is the existing representation of "start from the beginning" and needs no second encoding. Writing zero would also be indistinguishable from a view legitimately checkpointed at position zero.
It returns no outcome because it cannot refuse. Clearing an already-absent checkpoint is success, not a refusal. A store that cannot clear throws.
SaveAsync<TView>(string, string, TView, CancellationToken)
Saves a materialized view.
[RequiresUnreferencedCode("JSON serialization might require types that cannot be statically analyzed.")]
[RequiresDynamicCode("JSON serialization might require runtime code generation.")]
public ValueTask SaveAsync<TView>(string viewName, string viewId, TView view, CancellationToken cancellationToken) where TView : class
Parameters
viewNamestringThe view name (typically the view type name).
viewIdstringThe view identifier.
viewTViewThe view to save.
cancellationTokenCancellationTokenCancellation token.
Returns
- ValueTask
A task representing the asynchronous operation.
Type Parameters
TViewThe view type.
SavePositionAsync(string, long, CancellationToken)
Advances the last processed position for a view, and reports whether the advance was taken.
public ValueTask<ViewPositionSaveOutcome> SavePositionAsync(string viewName, long position, CancellationToken cancellationToken)
Parameters
viewNamestringThe view name for position tracking.
positionlongThe position to advance to.
cancellationTokenCancellationTokenCancellation token.
Returns
- ValueTask<ViewPositionSaveOutcome>
Advanced when the checkpoint moved to
position; RefusedAsStale when the stored checkpoint was already at or beyond it and nothing was written.
Remarks
This advance is MONOTONIC in every implementation, and the refusal is a normal outcome rather than an error. A delayed or retried write carrying an older position must not rewind the checkpoint, because the projection would then replay events it has already applied. Every store enforces that server-side.
The return value exists because the refusal used to be unobservable. This member returned ValueTask — a caller could not tell a taken advance from a refused one, and every implementation logged a successful save either way. That hid a real defect for as long as the monotonic guard existed: a caller that needed the position to go BACKWARDS was silently refused and reported success. An operation that can decline to act must say so in its signature.
To move a checkpoint backwards, use ResetPositionAsync(string, CancellationToken). Lowering a position is a different operation from advancing one, so it is a different member rather than a flag — this method cannot express it and must not be asked to.