garrytan/gbrainmarkdown explorer
garrytan/gbrainmaster
docs / architecture

schema packs

docs/architecture/schema-packs.md

Schema Packs

A schema pack tells gbrain what shape your brain takes — which directories exist, what types live in them, how the agent should infer types from paths, and which link verbs connect what to what. The schema pack is the dynamic, always-consulted artifact every skill reads when filing, querying, or routing experts. It is the single source of truth for "what's in your brain."

This doc is the user-facing reference; for implementation details see docs/designs/V038_SCHEMA_PACKS.md (the original design) and the engine layer in src/core/schema-pack/.

What ships in the box

Seven bundled packs (src/core/schema-pack/base/):

  • gbrain-base-v2 — the 15-type canonical taxonomy. Fresh installs (gbrain init) activate this by default. See type-taxonomy.md for the full type list and the upgrade path from gbrain-base.

  • gbrain-base — the original hardcoded behavior, byte-for-byte (person, company, deal, meeting, project, place, concept, writing, analysis, guide, hardware, architecture, etc. — the original ALL_PAGE_TYPES list). Still the resolution-chain fallback (tier 7) for brains with no pack configured anywhere, so pre-existing brains see zero behavior change until they opt in to something newer.

  • gbrain-recommended — extends gbrain-base with the 13 additional directories described in docs/GBRAIN_RECOMMENDED_SCHEMA.md: deal, meeting, concept, project, source, daily, personal, civic, original, place, trip, conversation, writing. If you like the documented operational-brain pattern, activate this with:

    gbrain schema use gbrain-recommended
    
  • gbrain-creator, gbrain-investor, gbrain-engineer, gbrain-everything — the lens packs, which add cycle phases and calibration domains on top of the base taxonomy. See lens-packs.md.

Plus user-installed packs at ~/.gbrain/schema-packs/<name>/pack.yaml that you author with gbrain schema init or gbrain schema fork.

CLI surface

Inspection verbs:

gbrain schema active     # show resolved pack + which tier set it
gbrain schema list       # list bundled + installed packs
gbrain schema show       # pretty-print the active pack
gbrain schema validate   # validate a manifest's shape
gbrain schema use <pack> # activate a pack (writes ~/.gbrain/config.json)

Authoring + discovery verbs:

gbrain schema detect              # propose types matching brain shape
gbrain schema suggest             # LLM-refined proposals on top of detect
gbrain schema review-candidates   # promote / rename / ignore candidates
gbrain schema review-orphans      # surface pages with no matching type
gbrain schema init <name>         # scaffold a stub pack    (experimental)
gbrain schema fork <a> <b>        # copy + rename a pack    (experimental)
gbrain schema edit <name>         # surface the pack path   (experimental)
gbrain schema diff <a> <b>        # set-diff two packs      (experimental)
gbrain schema graph               # ASCII type listing      (experimental)
gbrain schema lint [--with-db]    # duplicates + missing prefixes; --with-db adds data-plane rules
gbrain schema explain <type>      # plain-English type description (experimental)
gbrain schema downgrade --to <p>  # restore previous pack (recovery)
gbrain schema usage --since 30d   # per-verb invocation counts (telemetry)

The verbs marked experimental are demand-gated: usage is tracked via the schema-events audit (gbrain schema usage), which informs whether rarely-used verbs get deprecated.

With --with-db, schema lint also runs two data-plane rules over the stored corpus: stored_type_is_alias (a page's explicit type is an alias — the canonical type and its filing directory are named) and stored_type_undeclared (the type isn't in the active pack at all). The rule layer accepts a per-source scope (LintOpts.sourceId — multi-source brains can resolve different packs per source), though the CLI currently runs a global scan. The same classification warns once per type per run at sync/import so alias types stop filing into unexpected directories silently; silence the ingest warnings with gbrain config set schema.type_warnings false (the --with-db lint rules are unaffected).

Resolution chain (7 tiers)

When the engine decides "which pack is active for this query?", it walks this chain top-down. First match wins.

TierSourceNotes
1Per-call schema_pack optCLI only (ctx.remote === false); MCP rejected.
2GBRAIN_SCHEMA_PACK envProcess-scope override.
3Per-source DB config key schema_pack:source:<id>
4Brain-wide DB config key schema_pack
5gbrain.yml schema: sectionRepo-checked.
6~/.gbrain/config.json schema_pack fieldWhat gbrain schema use (and gbrain init, which sets gbrain-base-v2) writes.
7Default: gbrain-baseAlways present.

How the agent uses the active pack

Every read + write path consults the active pack at runtime:

  • parseMarkdown infers page type from path prefixes declared in the active pack (page_types[].path_prefixes). Without an active pack threaded, falls back to the legacy hardcoded inferType() so the byte-for-byte parity gate stays green.
  • whoknows / find_experts scopes candidates to expert_routing: true types in the active pack.
  • extract_facts runs only on extractable: true types.
  • enrichment-service routes person/company enrichment based on the pack's primitive declarations.
  • Search hybrid cache (knobsHash) folds in pack name + version. A cache row written under pack A is unreachable when pack B is active. Cross-pack contamination is structurally impossible.

The magical moment

Persona A (Notion refugee) installs gbrain, imports her exports, and the brain looks unfamiliar — the default gbrain-base pack expects people/, companies/, etc., but her files live under Projects/, Reading/, Daily Notes/. The friction signal fires in two places:

  1. Import warn: the end of gbrain import prints [schema] X of Y pages (Z%) have no type matching the active schema pack. Run gbrain schema detect to propose a pack matching your content shape.
  2. gbrain doctor schema_pack_consistency check keeps surfacing the warning persistently after the import session ends.

She runs the magical moment:

gbrain schema detect              # heuristic clustering on her actual shape
gbrain schema suggest             # LLM-refined proposals
gbrain schema review-candidates   # human gate on promotion
gbrain schema review-candidates --apply Projects/   # accept

The agent (via the EIIRP skill, skills/eiirp/SKILL.md) automates phases 1-3 of this for any significant work session. The brain's schema becomes a living artifact the agent maintains, not a hardcoded ceremony the user authors.

Authoring your own pack

gbrain schema init my-pack            # scaffolds ~/.gbrain/schema-packs/my-pack/pack.yaml
$EDITOR ~/.gbrain/schema-packs/my-pack/pack.yaml
gbrain schema validate my-pack        # check shape
gbrain schema use my-pack             # activate
gbrain schema active                  # confirm

A minimal pack:

api_version: gbrain-schema-pack-v1
name: my-pack
version: 0.0.1
gbrain_min_version: 0.39.0
extends: gbrain-base   # inherits base's TYPES (see Merge contract below); add overrides
description: |
  My personal pack.

page_types:
  - name: project-x
    primitive: entity
    path_prefixes:
      - Projects/
    aliases: []
    extractable: false
    expert_routing: false

  # Add more types here. Each maps a path prefix to a primitive +
  # opt-in flags. See src/core/schema-pack/base/gbrain-recommended.yaml
  # for a worked example.

link_types: []
takes_kinds: [fact, take, bet, hunch]
borrow_from: []
frontmatter_links: []
enrichable_types: []
filing_rules: []

Merge contract (extends + borrow_from)

This section is the single home for the merge rules (other docs link here). resolvePack composes a pack against its extends chain (and any borrow_from targets) into the resolved.manifest every consumer reads. The rules:

  • Six fields inherit, child-wins: page_types, link_types, frontmatter_links, enrichable_types, filing_rules, and takes_kinds. A child value with the same key (type name, link name, etc.) overrides the parent's; keys the child doesn't declare come through from the parent.
  • page_types ordering: overrides of a base type keep the base's declared position (base's inferType prefix priority is authoritative); a genuinely new type — from the child, a borrow_from, or a middle pack in the chain — is prepended nearest-first, so a more-derived type's path_prefix wins regardless of how deep the chain is.
  • takes_kinds is UNION, not replace — it carries a Zod default, so an omitted field is indistinguishable from an explicit one. A child can ADD kinds but cannot narrow takes_kinds below base ∪ parent. If you need a smaller set, don't extends a pack that declares the larger one.
  • phases and calibration_domains are NOT inherited (child-only). They gate real cycle execution, so each pack must declare its own participation explicitly — inheriting them would silently make a child run phases it never requested. This is why gbrain-everything re-declares all its phases and calibration domains by hand. See lens-packs.md for the worked example.
  • borrow_from is selective + non-transitive + fail-closed: it pulls only the named types/link_types from the target's OWN declarations (omitting a category borrows none of it); a missing target throws UnknownPackError.

Recovery + revert

A pack activation is config, not code, so reverting code alone doesn't undo it. gbrain schema downgrade restores the active-pack config field:

gbrain schema downgrade --to gbrain-base
# OR auto-detect previous from ~/.gbrain/schema-pack-history.jsonl:
gbrain schema downgrade

Code revert alone is NOT sufficient. The full revert procedure:

  1. git revert <merge-commit> — restores the code.
  2. gbrain schema downgrade --to gbrain-base — restores config.
  3. (Optional) gbrain pages purge-deleted --older-than 0h — hard-deletes soft-deleted pages that no longer have a matching type in the active pack.

The cache + eval rows that pack-aware code wrote are isolated by the knobsHash pack-folding — they become unreachable under the restored pack so no eviction is needed.

Distribution

.gbrain-schema tarballs ride the same distribution pipeline as .gbrain-skillpack tarballs. The discriminator is api_version in the manifest:

  • gbrain-schema-pack-v1 → schemapack
  • gbrain-skillpack-v1 → skillpack

Both install via the same scaffold + copy path; install targets are ~/.gbrain/schema-packs/<name>/ and ~/.gbrain/skillpacks/<name>/ respectively.

Publication to the public registries (garrytan/gbrain-schema-registry, garrytan/gbrain-skillpack-registry) follows the same publish-as-PR workflow as skillpack publishing.

Known limits / deferred work

  • Per-source pack federation across mounts. A query crossing multiple sources rejects with permission_denied when those sources have divergent active packs (src/core/schema-pack/op-trust-gate.ts). A true per-source closure via the existing buildSourceClosureCte engine surface remains future work.
  • Pack version upgrades (e.g. gbrain-basegbrain-base-v2) are handled by the successor-detection + unify-types mechanism — see pack-upgrade-mechanism.md.

The live deferred list is in TODOS.md.

Continue exploring589 Markdown documents in the local repository