Crates.io | deque-loader |
lib.rs | deque-loader |
version | 0.1.0-beta.3 |
source | src |
created_at | 2021-07-06 09:44:00.15823 |
updated_at | 2021-07-31 01:45:08.232753 |
description | Efficient data loading via work stealing and thread local deques |
homepage | |
repository | https://github.com/Bajix/deque-loader-rs/ |
max_upload_size | |
id | 419373 |
size | 30,909 |
A work-stealing data loader designed around optimal load batching and connection utilization. Rather than using yields to collect batches of loads as would other data loaders, loads are enqueued to thread local dequeus and task handlers are spawned to meet capacity. As field resolvers within the same request will already be scheduled, subsequent loads within the same request will be scheduled prior to the load task handler taking a task assignment and upon connection acquisition, all load requests will have been captured and loads by separate requests can be opportunistically batched together without introducing timeout overhead.