Skip to content

Data protection and encryption

This page states where Logstrm encrypts data, where it does not, and which encryption responsibilities belong to the operator. Claims are limited to what the software implements.

Encryption in transit

Outbound to destinations

Destination Transport Certificate validation
Microsoft Sentinel via Data Collection Rule HTTPS to the Data Collection Endpoint Go standard library trust store; no override available
Azure Entra token endpoints (all auth modes) HTTPS Go standard library trust store; no override available
Elasticsearch Operator-configured http:// or https:// Configurable: custom CA, client certificate, or insecure_skip_verify

The Sentinel emitter provides no option to disable certificate validation. The Elasticsearch emitter does: insecure_skip_verify and plain http:// endpoints are accepted. Treat both as prohibited in production and enforce that in configuration review.

Inbound to Logstrm

The Data Plane API and global HTTP ingestion listener can terminate TLS in-process when global.mtls.enabled is configured; the Helm chart enables this by default and the Manager verifies the Data Plane certificate. The Manager presents a client certificate, which the Data Plane verifies when provided. With client_auth: require_and_verify_client_cert, every HTTPS caller must present a trusted client certificate. The Manager API/UI itself still expects TLS termination at a trusted ingress or reverse proxy.

The Syslog listener supports TCP and UDP only; there is no TLS Syslog server, and configuration structure must not be read as evidence that one exists.

Therefore:

  • Terminate TLS at an ingress controller, load balancer or reverse proxy in front of the Manager, and restrict the backend network path.
  • For direct Data Plane deployments, configure global.mtls with certificate/key/CA paths and configure the Manager's trusted CA and client certificate. Production rollouts must use HTTPS; do not register the Data Plane over HTTP.
  • For Syslog, keep the listener on a trusted network segment, or place a TLS-terminating relay in front of it. Do not expose it to untrusted networks.
  • Do not describe Syslog or a Manager deployment without a TLS ingress as encrypted on the inbound path.

For a direct VM/container Data Plane, the listener configuration has this shape (use certificate files mounted from your secret manager, not files committed with the config):

global:
  http:
    listen: ":8080"
  mtls:
    enabled: true
    cert_file: /run/logstrm-tls/server.crt
    key_file: /run/logstrm-tls/server.key
    ca_file: /run/logstrm-tls/client-ca.crt
    client_auth: verify_if_given
api:
  enabled: true
  listen: ":8090"
  auth_token: "${ENV:SLIMSTREAM_API_AUTH_TOKEN}"

Configure the Manager with SLIMSTREAM_DATAPLANE_ENDPOINT=https://<data-plane-host>:8090, SLIMSTREAM_DATAPLANE_CA_FILE, and the paired SLIMSTREAM_DATAPLANE_CLIENT_CERT_FILE / SLIMSTREAM_DATAPLANE_CLIENT_KEY_FILE. Register the node with TLS verification enabled. Manager rollouts reject HTTP or unverified node URLs. When client_auth is require_and_verify_client_cert, every HTTPS client, including HTTP ingestion senders and probes outside Kubernetes, must present a certificate from the configured CA.

Encryption at rest

Logstrm performs no application-level encryption. All at-rest protection is inherited from the storage platform the operator provides.

Data Written by Format Product-level encryption
Dead-letter queue entries Data Plane JSON Lines files in the configured DLQ directory None
JSONL archive output Data Plane JSON Lines file (0600 file mode) None
Configuration version history Manager SQLite table storing the full configuration YAML None
Registered node records, including Data Plane authentication tokens Manager SQLite None
Event Hubs durable outbox, when explicitly enabled Data Plane SQLite/WAL on the operator-provisioned PVC None

On POSIX filesystems, the Manager restricts its SQLite database and audit log files to owner-only permissions (0600), including files that already existed with broader permissions. This limits local file access; it is not encryption. Backups and snapshots still require encrypted storage and appropriate access control.

The Manager rejects literal values in recognized credential fields for new configuration versions, and blocks rollback/rollout of stored versions containing those values. Previous versions are not rewritten or redacted from history/diff read APIs automatically. Rotate any previously stored real credentials and review configuration history, exports, and backups.

Operator responsibilities that follow:

  • Place the DLQ, archive and Manager database on encrypted volumes. On Azure, that is Azure Disk or Azure Files encryption; on Kubernetes, the encryption properties of the StorageClass backing the PersistentVolumeClaim.
  • When the Event Hubs durable outbox is enabled, encrypt its PVC and backups as well. It contains post-pipeline event payloads and per-destination delivery state; Logstrm does not encrypt the SQLite file itself.
  • The Event Hubs outbox uses SQLite WAL. Back up using a SQLite-consistent backup/volume-snapshot procedure or after a clean Data Plane shutdown; copying only the main .sqlite file while the process is active can omit committed WAL pages.
  • Extend encryption and access control to backups and snapshots of those volumes, which contain the same plaintext.
  • Restrict filesystem and volume access: DLQ files and the archive contain raw event payloads, and the Manager database contains configuration and node tokens.
  • Apply retention limits so buffered payloads are not stored longer than the data-classification policy allows.

Customer-managed keys

Logstrm implements no key-management layer, performs no envelope encryption and stores no encryption keys. It therefore cannot independently offer CMK, key rotation or crypto-shredding for data it writes.

What is achievable today:

  • Infrastructure CMK — encrypt the volumes holding the DLQ, archive and Manager database with customer-managed keys through the platform, for example Azure Disk encryption with a key in Azure Key Vault. Key lifecycle, rotation and revocation are managed in the platform, transparently to Logstrm.
  • Destination-side CMK — encryption of data after delivery is a property of the destination, such as a Log Analytics workspace or an Elasticsearch cluster, and is configured there.

What is not available: per-tenant or per-field application-level encryption, customer-held keys for in-flight buffering, and cryptographic erasure of buffered data by key revocation. Revoking a volume key makes the volume unreadable but is a storage-level action, not a Logstrm feature.

Reducing sensitive data at rest

Where payloads must not persist in plaintext buffers, reduce what is written rather than assuming encryption that does not exist:

  • Use the pipeline's masking and redaction transformations to remove sensitive fields before emitters, so DLQ entries and archives contain already-masked events.
  • Drop or project unnecessary fields in the pipeline instead of forwarding whole payloads.
  • Size the DLQ and its retention deliberately; it is a bounded failure buffer, not an archive.

Masking is operator-configured. It applies only to the fields the configuration targets, and it is not a substitute for storage encryption or access control.