FORMAT_SPEC.md

title
Format Specification

Notes:

• The current TileDB format version number is 22 (uint32_t).

• Data written by TileDB and referenced in this document is little-endian with the following exceptions:

  • Dictionary filter
  • RLE filter

History

Format version	TileDB version	Description
1	1.4	Decouple format and library version
2	1.5	Always split coordinate tiles
3	1.6	Parallelize fragment metadata loading
4	1.7	Remove KV storage
5	2.0	Split coordinates into individual files
6	2.1	Implement attribute fill values
7	2.2	Nullable attribute support
8	2.3	Percent encode attribute/dimension file names
9	2.3	Name attribute/dimension files by index
10	2.4	Added array schema evolution
11	2.7	Store integral cells, aka, don't split cells across chunks
12	2.8	New array directory structure
13	2.9	Add dictionary filter
14	2.10	Consolidation with timestamps, add has_timestamps to footer
15	2.11	Remove consolidate with timestamps config
16	2.12	Implement delete strategy
17	2.14	Add dimension labels and data order
18	2.15	Dimension Labels no longer experimental
19	2.16	Vac files now use relative URIs
20	2.17	Enumerations
21	2.19	Tile metadata are now correctly calculated for nullable fixed size strings on dense arrays
22	2.25	Add array current domain

Table of Contents

• Array
  • File hierarchy
  • Array Schema
  • Fragment
  • Array Metadata
  • Tile
  • Generic Tile
• Group
  • File hierarchy
• Other
  • Consolidated Fragment Metadata File
  • Filter Pipeline
  • Timestamped Name
  • Vacuum Pipeline