Some checks failed
Server CI / Postgres (shard 0) (push) Has been skipped
Server CI / Postgres (shard 3) (push) Has been skipped
BuildEnv Docker Image / build-image (push) Failing after 4s
BuildEnv Docker Image / build-image-fips (push) Failing after 4s
Migration Review & Release Notes / Generate migration review & release notes (push) Failing after 3s
Server CI / Build Environment (push) Failing after 3s
Server CI / Postgres (shard 1) (push) Has been skipped
Tools CI / check-style (mattermost-govet) (push) Failing after 4s
Server CI / Postgres (shard 2) (push) Has been skipped
Tools CI / check-style (mmgotool) (push) Failing after 3s
Server CI / Elasticsearch v8 Compatibility (push) Has been skipped
Server CI / OpenSearch v2 Compatibility (push) Has been skipped
Server CI / Postgres FIPS (shard 0) (push) Has been skipped
Tools CI / Test (mattermost-govet) (push) Failing after 3s
Server CI / Postgres FIPS (shard 1) (push) Has been skipped
Server CI / Postgres FIPS (shard 2) (push) Has been skipped
Tools CI / Test (mmgotool) (push) Failing after 3s
Server CI / Postgres FIPS (shard 3) (push) Has been skipped
Server CI / Run mmctl tests (push) Has been skipped
Server CI / Run mmctl tests (FIPS) (push) Has been skipped
Server CI / Merge Postgres Test Results (push) Has been skipped
Server CI / Merge Postgres FIPS Test Results (push) Has been skipped
Server CI / Check backport migrations (push) Has been skipped
Server CI / Check generated files (push) Has been skipped
Server CI / check-style (push) Has been skipped
Server CI / Vet API (push) Has been skipped
Server CI / Build mattermost server app (push) Has been skipped
Server CI / Server CI Complete (push) Failing after 2s
Server CI / Server CI Artifacts (push) Has been skipped
Server CI / Sentry Upload (push) Has been skipped
Server CI / Server CI Report (push) Failing after 5m1s
Server CI Nightly Race / Race Detector (push) Has been skipped
CodeQL / Analyze (go) (push) Has been cancelled
CodeQL / Analyze (javascript) (push) Has been cancelled
Webapp CI Cache Warm / Warm Webapp node_modules Cache (push) Has been cancelled
E2E CI Cache Warm / Warm E2E npm Registry Cache (push) Has been cancelled
API / build (push) Has been cancelled
Web App CI / check-types (push) Has been cancelled
Web App CI / check-lint (push) Has been cancelled
Web App CI / check-i18n (push) Has been cancelled
Web App CI / check-external-links (push) Has been cancelled
Web App CI / test (platform) (push) Has been cancelled
Web App CI / test (mattermost-redux) (push) Has been cancelled
Web App CI / test (channels shard 1/4) (push) Has been cancelled
Web App CI / test (channels shard 2/4) (push) Has been cancelled
Web App CI / test (channels shard 3/4) (push) Has been cancelled
Web App CI / test (channels shard 4/4) (push) Has been cancelled
Web App CI / upload-coverage (push) Has been cancelled
Web App CI / build (push) Has been cancelled
YAML Lint / yamllint (push) Has been cancelled
Push mirrored docker images / cd/Push mirrored docker images (push) Has been cancelled
docs-cd / Build and deploy docs (push) Has been cancelled
Docs CI / build (push) Has been cancelled
E2E Cache Warm: Cypress deps / Warm Cypress deps cache (push) Has been cancelled
Scorecards supply-chain security / Scorecard analysis (push) Has been cancelled
Server CI Weekly / Postgres FIPS (push) Has been skipped
Server CI Weekly / Run mmctl tests (FIPS) (push) Has been skipped
Server CI Weekly / Postgres with binary parameters (push) Has been skipped
Server CI Weekly / Build Environment (push) Failing after 1s
Server CI Cache Warm / Warm Go Module and Build Cache (push) Failing after 2s
Server CI Nightly Race / Build Environment (push) Failing after 1s
133 lines
3.7 KiB
Go
133 lines
3.7 KiB
Go
// Copyright (c) 2015-present Mattermost, Inc. All Rights Reserved.
|
|
// See LICENSE.txt for license information.
|
|
|
|
/*
|
|
Package store provides the data persistence layer for Mattermost channels.
|
|
|
|
The store package implements a layered architecture that abstracts database operations
|
|
and provides a clean interface for data access. It follows the repository pattern with advanced features
|
|
like caching, search indexing, retry logic, and metrics collection.
|
|
|
|
# Architecture Overview
|
|
|
|
The store package uses a multi-layered architecture where each layer adds specific
|
|
functionality:
|
|
|
|
Application Layer (app/)
|
|
↓
|
|
Store Interface (store.Store)
|
|
↓
|
|
Timer Layer (metrics/timing)
|
|
↓
|
|
Retry Layer (deadlock/error handling)
|
|
↓
|
|
Local Cache Layer (in-memory caching)
|
|
↓
|
|
Search Layer (search indexing)
|
|
↓
|
|
SQL Store (database operations)
|
|
|
|
Each layer wraps the layer below it, following the decorator pattern to add
|
|
cross-cutting concerns without modifying the core business logic.
|
|
|
|
# Store Interface
|
|
|
|
The main Store interface provides access to all domain-specific stores:
|
|
|
|
type Store interface {
|
|
Team() TeamStore
|
|
Channel() ChannelStore
|
|
Post() PostStore
|
|
User() UserStore
|
|
// ... and many more
|
|
}
|
|
|
|
Each domain store interface defines operations for a specific entity type,
|
|
following CRUD patterns and domain-specific operations.
|
|
|
|
# Key Components
|
|
|
|
## SQL Store (sqlstore/)
|
|
The foundation layer that handles direct database operations:
|
|
- Connection management with master/replica support
|
|
- Query building using Squirrel
|
|
- Transaction handling
|
|
- Database migration support
|
|
- Schema management
|
|
|
|
## Local Cache Layer (localcachelayer/)
|
|
Provides in-memory caching for frequently accessed data:
|
|
- LRU cache implementation
|
|
- Cache invalidation strategies
|
|
- Cluster-aware cache invalidation
|
|
- Configurable cache sizes and TTLs
|
|
- Metrics collection for hit/miss ratios
|
|
|
|
## Search Layer (searchlayer/)
|
|
Integrates with search engines for full-text search:
|
|
- Elasticsearch integration
|
|
- Bleve search engine support
|
|
- Automatic indexing of content
|
|
- Search result ranking and filtering
|
|
|
|
## Retry Layer (retrylayer/)
|
|
Handles transient failures and database deadlocks:
|
|
- Automatic retry logic for database deadlocks
|
|
- Configurable retry policies
|
|
- Dead letter queue handling
|
|
|
|
## Timer Layer (timerlayer/)
|
|
Provides performance monitoring and metrics:
|
|
- Method execution timing
|
|
- Database query performance metrics
|
|
- Integration with Prometheus metrics
|
|
- Performance bottleneck identification
|
|
|
|
## Store Test Framework (storetest/)
|
|
Comprehensive testing infrastructure:
|
|
- Mock implementations for all store interfaces
|
|
- Test data factories and builders
|
|
- Database setup and teardown utilities
|
|
- Integration test helpers
|
|
|
|
## Cache Operations
|
|
|
|
The cache layer is transparent to callers but provides significant performance
|
|
benefits for read-heavy operations:
|
|
|
|
// This call may be served from cache
|
|
user, err := store.User().Get(rctx, userID)
|
|
|
|
// Cache is automatically invalidated on updates
|
|
updatedUser, err := store.User().Update(ctx, user, allowRoleUpdate)
|
|
|
|
## Error Handling
|
|
|
|
The store package defines custom error types for common scenarios:
|
|
|
|
// Check for specific error types
|
|
if err != nil {
|
|
var notFoundErr *store.ErrNotFound
|
|
if errors.As(err, ¬FoundErr) {
|
|
// Handle not found case
|
|
}
|
|
|
|
var conflictErr *store.ErrConflict
|
|
if errors.As(err, &conflictErr) {
|
|
// Handle conflict case
|
|
}
|
|
}
|
|
|
|
# Migration and Schema
|
|
|
|
The store package includes a robust migration system:
|
|
- Version-controlled schema migrations
|
|
- Automatic migration execution
|
|
- Rollback support
|
|
- Schema validation
|
|
|
|
For detailed information about specific store implementations, see the
|
|
documentation in the respective subdirectories (sqlstore/, localcachelayer/, etc.).
|
|
*/
|
|
package store
|