Part of the Æ Aether Ecosystem · Platform Layer

Æ Aether Vault

Organisational knowledge — document indexing, semantic vector search, a Retrieval-Augmented Generation pipeline, and a knowledge graph, scoped per tenant and collection.

Phase 1 — Ingestion & Retrieval Engine ✅ Phase 3 — Freshness & Governance ✅ Phase 4 — Kubernetes + Helm (core) Java 21 Spring Boot 3.3 pgvector Port 8084
Complements
aether-core (personal memory) and aether-memory (shared team memory). Vault owns documents and the knowledge derived from them.

Capability

Five Facets of Knowledge

Aether Vault owns the ecosystem's Knowledge capability exclusively — ingesting enterprise content and turning it into retrievable, structured, always-fresh knowledge.

Indexing

Document Ingestion

Chunk, embed (384-dim), and store documents — from inline text or a source URI, idempotently, so re-indexing never leaves stale chunks.

Connectors

Source Ingestion

Pull from file: (allowed-root confined), http(s):, or s3: sources through a default-deny registry — freshness-aware, so an unchanged source is never re-embedded.

Search

Vector Search

Cosine-distance semantic retrieval over pgvector, scoped strictly to a single collection.

RAG

Retrieval Pipeline

Embed a query, retrieve nearest chunks, assemble a length-bounded context for an agent's prompt.

Graph

Knowledge Graph

Named-entity nodes with mention salience and typed, confidence-weighted relation edges — extracted automatically from documents on ingest.

Freshness & Governance

Re-index Sweep & Erasure

A scheduled sweep flags indexed documents past their (per-collection) re-index interval as stale — marks, never deletes. Collections that opt in are then auto-refreshed by a second sweep that re-fetches stale documents through their source connector. A collection's derived knowledge — documents, chunks, and graph — can be erased on a right-to-erasure request.


Ingest → Retrieve

From Document to Prompt Context

A document is chunked and embedded on ingest; a query is embedded and matched against those chunks, then assembled into a bounded context — retrieval never leaves the collection.

INGEST

Inline text or a source connector; register, compute checksum.

→
CHUNK

Split into overlapping slices.

→
EMBED

384-dim vector per chunk via Ollama.

→
RETRIEVE

Cosine search within the collection.

→
ASSEMBLE

Bounded context for the agent.


Architecture

Four Maven Modules

Strict inward dependency: vault-api → vault-engine → vault-domain. The domain is pure Java 21 — no framework coupling.

vault-domain

Domain & Ports

KnowledgeDocument, DocumentChunk, KnowledgeScope, RagContext, KnowledgeEntity, EntityRelation + port interfaces. No Spring.

vault-engine

Adapters & Services

pgvector chunk store, Ollama embedding, text chunker, ingestion, RAG pipeline, knowledge-graph store, freshness sweep.

vault-api

REST API · Port 8084

Spring Boot app, controllers, Flyway migrations, scheduled freshness, Micrometer metrics.

vault-infra

Infrastructure

Docker Compose, production Helm chart (hardened deployment + HPA + release workflow), standalone migration copies. No Java sources.


API Surface

Key Endpoints

MethodPathDescription
POST/api/v1/tenants/{t}/collections/{c}/documentsIngest a document from inline text
POST/api/v1/tenants/{t}/collections/{c}/documents/from-sourceIngest from a source URI (connector, freshness-aware)
GET/api/v1/tenants/{t}/collections/{c}/documentsList documents in a collection
DEL/api/v1/tenants/{t}/collections/{c}/documents/{id}Delete a document and its chunks
POST/api/v1/rag/queryVector search + bounded context assembly; includeGraph adds a knowledge-graph projection (entity-aware RAG)
POST/api/v1/tenants/{t}/collections/{c}/entitiesCreate / reinforce a graph entity
GET/api/v1/tenants/{t}/collections/{c}/entities/{id}/neighboursTraverse an entity's neighbours
GET PUT/api/v1/tenants/{t}/collections/{c}/freshness-policyPer-collection re-index interval + auto-reingest opt-in
DEL/api/v1/tenants/{t}/collections/{c}Right-to-erasure — erase a collection's documents, chunks, and graph (GDPR Art. 17)

Delivery

Roadmap

P0ScaffoldComplete
P1Ingestion & Retrieval EngineComplete
P2Knowledge Graph Extraction — automatic entity + co-occurrence relation extraction on ingestCore Complete
P3Freshness & Governance — per-collection freshness policy (interval override + auto-reingest opt-in), scheduled auto-reingestion of stale documents via source connectors, and GDPR collection erasure (documents + chunks + graph); checksum-driven re-index already in the connector ingest pathCore Complete
P4Kubernetes + Helm — production Helm chart (hardened deployment, HPA, ingress/Route, ServiceMonitor; vanilla / EKS / OpenShift value sets) and a Helm lint + OCI release workflowCore Complete

Foundation

Technology Stack

LanguageJava 21
FrameworkSpring Boot 3.3.5
DatabasePostgreSQL 16
Vector Storepgvector (384-dim)
Embeddingall-MiniLM-L6-v2 · Ollama
MigrationsFlyway
MetricsMicrometer · Prometheus
BuildMaven multi-module
CI/CDGitHub Actions (OIDC)