pipebase
| Crates.io | pipebase |
| lib.rs | pipebase |
| version | 0.2.0 |
| source | src |
| created_at | 2021-08-04 02:24:14.732556 |
| updated_at | 2021-12-26 00:02:56.318578 |
| description | A tokio based runtime library for data integration app |
| homepage | https://github.com/pipebase/pipebase |
| repository | https://github.com/pipebase/pipebase |
| max_upload_size | |
| id | 431300 |
| size | 168,786 |
Li Yu (51yu)
documentation
https://docs.rs/pipebase/
README
pipebase is a tokio based runtime library for data integration app. It provides basic pipes implemented with rust standard library.
Basic Pipes
list of basic pipes built in pipebase
| pipe type | implementation | example |
|---|---|---|
Exporter |
Printer |
printer |
Poller |
Timer |
timer |
Listener |
LocalFilePathVisitor |
file_path |
Streamer |
FileLineReader |
stateless_word_count |
Streamer |
IteratorReader |
stateless_word_count |
Mapper |
FieldVisit |
field_filter |
Mapper |
FilterMap |
field_filter |
Mapper |
StringSplitter |
stateless_word_count |
Mapper |
Projection |
project_file |
Mapper |
FileReader |
project_file |
Mapper |
FileWriter |
convert_csv |
Mapper |
Conversion |
convert_csv |
Selector |
RandomSelector |
ingest_redis_parallel |
Collector |
TextCollector |
ingest_elasticsearch |
Collector |
InMemoryWindowCollector |
moving_average |