Skip to main content

alphaswarm-data-federation

Catalog date: 2026-06-24.

alphaswarm-data-federation is the data-mesh federation gateway for AlphaSwarm. It brokers zero-copy dataset sharing between tenant silos, enabling a decentralized data architecture.

Role​

  • Dataset Sharing: Enables tenants to publish and subscribe to datasets (Iceberg, Hudi, Parquet) across silos.
  • Zero-Copy: Provides signed access to underlying storage (S3/Azure Blob) without copying data between silos.
  • Identity Bridging: Maps subscriber identities to source-silo permission sets using OpenFGA and signed share tokens.
  • Audit Ledger: Maintains a bitemporal ledger of all cross-tenant data access.

Architecture​

The gateway is a read-only reverse-proxy that integrates with the platform's DataCatalog. It uses RS256-signed tokens bound to the source silo's audience and a unique jti to prevent replay.

Repository​