Function object_store::coalesce_ranges

source ·

pub async fn coalesce_ranges<F, E, Fut>(
    ranges: &[Range<usize>],
    fetch: F,
    coalesce: usize
) -> Result<Vec<Bytes>, E>where
    F: Send + FnMut(Range<usize>) -> Fut,
    E: Send,
    Fut: Future<Output = Result<Bytes, E>> + Send,

Expand description

Takes a function fetch that can fetch a range of bytes and uses this to fetch the provided byte ranges

To improve performance it will:

Combine ranges less than coalesce bytes apart into a single call to fetch
Make multiple fetch requests in parallel (up to maximum of 10)