Hyphae 3.0.0 · recorded against the released binary · 2026-09-04 → / space: next · ← back · F: fullscreen · R: restart

00 / 10

The released binary

The binary is the one published on crates.io yesterday: 24 crates, signed archives, SBOMs.

$ hyphae version --json

{
  "api_version": "v1",
  "disk_format_version": 2,
  "engine_version": "3.0.0",
  "native_directory_format": 1,
  "product": "hyphae",
  "product_api_version": 1
}

Installed from crates.io: cargo install hyphae-cli --version 3.0.0 --locked

01 / 10

One data directory, one process

Everything that follows lives in this one directory: tables, structures, indexes, one WAL, one commit sequence.

$ hyphae init --data-dir demo/data

  native_directory_format: 1
  status: "initialized"

Everything below lives in this directory: relational tables, keyspace structures, search indexes, one WAL, one commit sequence.

02 / 10

Relational: bounded SQL that fails closed

A bounded relational core. Shapes outside the admitted grammar never scan — they fail closed with a typed error. LIMIT is always mandatory.

$ hyphae sql execute --statement CREATE TABLE orders (id BIGINT PRIMARY KEY, customer TEXT NOT NULL, region TEXT NOT NULL, amount BIGINT NOT NULL)

  commit_csn: 2
  status: "committed"

$ hyphae sql execute --statement INSERT INTO orders ... VALUES (1,'ana','lat',120),(2,'bo','eu',80),(3,'cy','lat',300),(4,'dee','us',45),(5,'eve','eu',210),(6,'fay','lat',60)

  commit_csn: 3
  status: "committed"
  rows_affected: 6

3.0.0 grammar: GROUP BY with HAVING, aliases, grouped ORDER BY. LIMIT is always mandatory.

$ hyphae sql execute --statement SELECT region, COUNT(*) AS n, SUM(amount) AS total FROM orders GROUP BY region HAVING SUM(amount) > 100 ORDER BY total DESC LIMIT 10

  columns: ["region", "n", "total"]
  rows: [["lat", 3, 480], ["eu", 2, 290]]
  visible_csn: 3

A shape outside the admitted grammar never scans — it fails closed with a typed error:

$ hyphae sql execute --statement SELECT * FROM orders WHERE amount IN (SELECT amount FROM orders)

  code: "sql_invalid_syntax"
  message: "native SQL syntax is invalid or unsupported"
  retry: "never"

03 / 10

Keyspace: Valkey-shaped structures in the same directory

Valkey-shaped structures in the same directory. A batch is one transaction: all or nothing, one commit sequence number.

Two catalogued keyspaces (counter, sorted-set). One batch, one commit, all or nothing:

$ hyphae structure batch --mutations-json [counter_add orders:placed +6, create leaderboard, sorted_set_add cy 300, eve 210, ana 120]

  commit_csn: 6
  status: "committed"

$ hyphae structure read --request-json {"operation":"counter_get","keyspace":20,"key":"orders:placed"}

  value: 6
  visible_csn: 6

ZREVRANGEBYSCORE shape (minor 6): top of the leaderboard above 150.

$ hyphae structure read --request-json {"operation":"sorted_set_score_range", lower {"score":150}, upper unbounded, order descending}

  entries: [{"member": "cy", "member_hex": "6379", "score": 300.0}, {"member": "eve", "member_hex": "657665", "score": 210.0}]

04 / 10

Search: lexical index with fuzzy matching, highlights, facets

The lexical engine is Hyphae's own: BM25/BM25F, fuzzy, phrase, prefix, highlights, term and range facets. No external search service.

$ hyphae search provision --collection 13

  commit_csn: 8
  status: "committed"

$ hyphae search ingest --collection 13 --documents-json [5 order notes with doc values category/price/rating and 2-d vectors]

  commit_csn: 9
  documents: 5
  status: "committed"

Typo on purpose: 'notebok'. Fuzzy distance 1, one highlight fragment, a terms facet on category and a range facet on price.

$ hyphae search integrated --collection 13 --lexical notebok --fuzzy 1 --highlight-fragments 1 --facets-json [{"field":"category","limit":5}] --range-facets-json [{"field":"price","ranges":[{"lower":0,"upper":200},{"lower":200,"upper":null}]}] --limit 5

  facets: [{"buckets": [{"count": 1, "value": "eu"}, {"count": 1, "value": "lat"}], "field": "category"}]
  fragments: ["dered a durable notebook, shipped from bogota"]
  object_id: "1001"
  fragments: ["a monitor and a notebook stand"]
  object_id: "1005"
  range_facets: [{"buckets": [{"count": 1, "range_ordinal": 0}, {"count": 1, "range_ordinal": 1}], "field": "price"}]
  visible_csn: 9

05 / 10

One transaction, three engines, one commit

The point of the whole system: SQL insert + keyspace counter + search document, staged together, committed once. Every engine reads the same visible_csn.

Stage an SQL insert, a keyspace counter, and a search document — then commit once.

$ hyphae transaction execute --steps-json [stage_sql INSERT order 7, stage_structure counter_add +1, stage_search index "gus ordered a solar generator", commit]

  status: "active"
  status: "staged"
  status: "staged"
  status: "staged"
  commit_csn: 10
  transaction_id: "311176709636109034757648936092008859055"
  status: "committed"

All three engines read the same commit sequence number (document id 6f726465722d37 = "order-7" in hex):

$ hyphae sql execute --statement SELECT id, customer, amount FROM orders WHERE id = ? --parameter 7

  rows: [[7, "gus", 999]]
  visible_csn: 10

$ hyphae structure read --request-json {"operation":"counter_get",...,"key":"orders:placed"}

  value: 7
  visible_csn: 10

$ hyphae search query --index 23 --query generator --kind term --limit 5

  documents_examined: 6
  document_id_hex: "6f726465722d37"
  score: 1.0

06 / 10

Rollback: nothing leaks

Rollback discards every engine's staged work. Nothing leaks anywhere.

$ hyphae transaction execute --steps-json [stage_sql INSERT order 8, stage_structure counter_add +100, rollback]

  status: "active"
  status: "staged"
  status: "staged"
  status: "rolled_back"
  rows: [[7]]
  value: 7

07 / 10

Proofs: a result anyone can verify offline

A proof and a witness let anyone re-execute the query offline with only a 32-byte anchor. Flip one byte and verification fails closed.

$ hyphae proof generate --operation-json {"operation":"sql","statement":"SELECT region, SUM(amount) AS total FROM orders GROUP BY region ORDER BY total DESC LIMIT 10"} --proof-out report.hynproof --witness-out report.hynwitness

  anchor: "3203030cc201b0453f597cee02161a650aa916cd7888768a7c04fee6ef901929"
  kind: "sql"
  proof_bytes: 700
  witness_bytes: 2229064

The verifier needs only the two files and the 32-byte anchor — no data directory, no network.

$ hyphae proof verify --proof report.hynproof --witness report.hynwitness --anchor 3203030cc201b0453f597cee02161a650aa916cd7888768a7c04fee6ef901929

  scope: "semantic_reexecution"
  semantic_reexecution_performed: true
  status: "verified"

Flip one byte of the proof and verify again:

$ hyphae proof verify --proof tampered.hynproof --witness report.hynwitness --anchor 3203030cc201b0453f597cee02161a650aa916cd7888768a7c04fee6ef901929

  code: "corruption"
  message: "native durable state is invalid"

08 / 10

Crash in the middle of strict-durability writes

A strict-durability writer is killed with SIGKILL mid-flight. Recovery replays the WAL to the last published root: every acknowledged commit, nothing partial.

A writer inserts one row per commit with strict durability; we kill -9 it mid-flight.

Writer killed. Reopen and validate the directory:

$ hyphae doctor --data-dir demo/data

  status: "healthy"

$ hyphae sql execute --statement SELECT COUNT(*) AS bot_rows, MAX(id) AS last_id FROM orders WHERE customer = 'bot'

  columns: ["bot_rows", "last_id"]
  rows: [[91, 190]]

Every acknowledged commit is present and nothing partial: the WAL replays to the last published root.

09 / 10

Status of the whole engine

One status for the whole engine: visible_csn, replayed transactions, root digest.

$ hyphae status --data-dir demo/data

{
  "blob_count": 0,
  "manifest_count": 1,
  "physical": {
    "page_count": 226,
    "physical_page_reads": 1028,
    "process_full_catalog_loads": 2,
    "process_full_state_loads": 2,
    "wal_bytes": 19398656
  },
  "replayed_transactions": 101,
  "retained_wal_bytes": 19398656,
  "snapshot": {
    "catalog_version": 7,
    "directory_lineage": "01a06ce1ca6070779af3b5a81d6edc060100000000000000",
    "logical_time_micros": 1788533135222540,
    "root_digest": "ca01f038df17817896267510bf0b5ed8d4cfd4c86f77fc5a46e92fd6693168c8",
    "visible_csn": 101
  },
  "snapshot_pin_count": 0,
  "status": "ready"
}