Expand description
Split Stream file format implementation.
This module implements the Split Stream format for efficiently storing and transferring data with inline content and external object references, supporting compression and content deduplication.
Structsยง
- File
Range ๐ - Split
Stream Builder - Builder for constructing a split stream with parallel object storage.
- Split
Stream Reader - Reader for parsing split stream format files with inline content and external object references.
- Split
Stream Writer - Writer for creating split stream format files with inline content and external object references.
- Splitstream
Header ๐ - Splitstream
Info ๐ - Unique
Vec ๐ - An array of objects with the following properties:
Enumsยง
- Chunk
Type ๐ - Resolved
Entry ๐ - Internal type for resolved entries after awaiting handles.
- Split
Stream Data - Data fragment from a split stream, either inline content or an external object reference.
- Split
Stream Entry - An entry in the split stream being built.
Constantsยง
- LG_
BLOCKSIZE ๐ - SPLITSTREAM_
MAGIC ๐
Functionsยง
- read_
into_ ๐vec - Using the provided
vecas a buffer, read exactly [size] bytes of content from [reader] into it. Any existing content invecwill be discarded; however its capacity will be reused, making this function suitable for use in loops. - read_
range ๐