# sharded-thread
[](https://github.com/Miaxos/sharded-thread/actions/workflows/release.yml)
[](https://crates.io/crates/sharded-thread)
[](https://deps.rs/repo/github/miaxos/sharded-thread)
[](https://docs.rs/sharded-thread)
[](https://github.com/miaxos/sharded-thread/compare)
"*Application tail latency is critical for services to meet their latency
expectations. We have shown that the thread-per-core approach can reduce
application tail latency of a key-value store by up to 71% compared to baseline
Memcached running on commodity hardware and Linux.*"[^1]
[^1]: [The Impact of Thread-Per-Core Architecture on Application Tail Latency](https://helda.helsinki.fi/server/api/core/bitstreams/3142abaa-16e3-4ad0-beee-e62add589fc4/content)
## Introduction
This library is mainly made for `io-uring` and monoio. There are no dependency
on the runtime, so you should be able to use it with other runtime and also
without `io-uring`.
The purpose of this library is to have a performant way to send data between
thread when threads are following a `thread per core` architecture. Even if the
aim is to be performant remember it's a core to core passing, (or thread to
thread), which is really slow.
Thanks to [Glommio](https://github.com/DataDog/glommio/) for the inspiration.
## Example
Originally, the library was made when you had multiple thread listening to the
same `TcpStream` and depending on what is sent through the `TcpStream` you might
want to change the thread handling the stream.
You can check some examples in the tests.
## Benchmarks
Those benchmarks are only indicative, they are running in GA. You should run
your own on the targeted hardware.
It shows that `sharded-thread` based on `utility.sharded_queue` is faster (~6%) than
if we built the mesh based on `flume`.
## References
- [Glommio example on their sharding](https://github.com/DataDog/glommio/blob/master/examples/sharding.rs)
- [The original monoio issue](https://github.com/bytedance/monoio/issues/213)
- [Sharded Queue - the fastest concurrent collection](https://github.com/ivanivanyuk1993/utility.sharded_queue)
## License
Licensed under either of
- Apache License, Version 2.0, (LICENSE-APACHE or http://www.apache.org/licenses/LICENSE-2.0)
- MIT license (LICENSE-MIT or http://opensource.org/licenses/MIT) at your option.