Module splitstream

Module splitstream 

Source
Expand description

Split Stream file format implementation.

This module implements the Split Stream format for efficiently storing and transferring data with inline content and external object references, supporting compression and content deduplication.

Structsยง

FileRange ๐Ÿ”’
SplitStreamBuilder
Builder for constructing a split stream with parallel object storage.
SplitStreamReader
Reader for parsing split stream format files with inline content and external object references.
SplitStreamWriter
Writer for creating split stream format files with inline content and external object references.
SplitstreamHeader ๐Ÿ”’
SplitstreamInfo ๐Ÿ”’
UniqueVec ๐Ÿ”’
An array of objects with the following properties:

Enumsยง

ChunkType ๐Ÿ”’
ResolvedEntry ๐Ÿ”’
Internal type for resolved entries after awaiting handles.
SplitStreamData
Data fragment from a split stream, either inline content or an external object reference.
SplitStreamEntry
An entry in the split stream being built.

Constantsยง

LG_BLOCKSIZE ๐Ÿ”’
SPLITSTREAM_MAGIC ๐Ÿ”’

Functionsยง

read_into_vec ๐Ÿ”’
Using the provided vec as a buffer, read exactly [size] bytes of content from [reader] into it. Any existing content in vec will be discarded; however its capacity will be reused, making this function suitable for use in loops.
read_range ๐Ÿ”’