whitespace-sifter

Crates.iowhitespace-sifter
lib.rswhitespace-sifter
version2.3.6
created_at2022-12-26 12:53:43.516421+00
updated_at2025-06-01 10:36:17.906871+00
descriptionSift duplicate whitespaces away!
homepage
repositoryhttps://github.com/JumperBot/whitespace-sifter/
max_upload_size
id745757
size96,223
JumperBot_ (JumperBot)

documentation

README

whitespace-sifter

crates.io version github.com forks github.com stars crates.io downloads

use whitespace_sifter::WhitespaceSifter;
// This prints `1.. 2.. 3.. 4.. 5..`.
println!(
    "{}",
    "1.. \n2..  \n\r\n\n3..   \n\n\n4..    \n\n\r\n\n\n5..     \n\n\n\n\n".sift(),
);

// This prints `1..\n2..\n3..\n4..\r\n5..`.
println!(
    "{}",
    "1.. \n2..  \n\r\n3..   \n\n\n4..    \r\n\n\r\n\n5..     \n\n\n\n\n"
        .sift_preserve_newlines(),
);

✨ Sift Duplicate Whitespaces In One Function Call

This crate helps you remove duplicate whitespaces within a UTF-8 encoded string.
It naturally removes the whitespaces at the start and end of the string.

📈 Crate Comparison

Crate Implementation
whitespace-sifter Any AsRef<str> as input, CR-LF compatibility, preserve_newlines
collapse &str input only
fast_whitespace_collapse &str input only, SIMD with fallback for any unsupported rustc target
Crate Whitespace Dictionary Time Complete
whitespace-sifter '\t' | '\n' | '\x0C' | '\r' | ' '| "\r\n" ~170 µs ✅
collapse ' ' | '\x09'..='\x0d' | unicode::White_Space(c) ~270 µs ✅
fast_whitespace_collapse ' ' | '\t' ~160 µs ❌

Disclaimers:

  1. I do not know the crate maintainers nor asked for permission to include their crates here.

  2. As far as I know, there are only three crates dedicated to whitespace sifting/collapse.

  3. fast_whitespace_collapse was not able to collapse cr-lf and line feeds.

⚡️Benchmarks

Performance is a priority; Most updates are performance improvements.
The benchmark uses a transcript of the Bee Movie.

Execute these commands to benchmark:

$ git clone https://github.com/JumperBot/whitespace-sifter.git
$ cd whitespace-sifter/bench
$ cargo bench

You should only look for results that look like the following:

Sift/Sift               time:   [178.69 µs 178.84 µs 179.03 µs]
Sift Preserved/Sift Preserved
                        time:   [179.61 µs 179.75 µs 179.90 µs]

In just 0.0001 seconds; Pretty impressive, no?

Go try it on a better machine, I guess. Benchmark specifications:
  • Processor: Intel(R) Core(TM) i5-8350U CPU @ 1.70GHz 1.90 GHz
  • Memory: RAM 16.0 GB (15.8 GB usable)
  • System: GNU/Linux 5.15.153.1-microsoft-standard-WSL2 x86_64
  • Modified: v2.3.4

➕ Dependency

Add this to your project with:

$ cargo add whitespace-sifter

📦️ Installation

Download the binary with:

$ cargo install whitespace-sifter

Use it as usual:

$ echo "Hello    there!" | whitespace-sifter
$ cat document.txt | whitespace-sifter --preserve-newlines

🔊 Changelog

  • Improved Performance
  • Minimum Supported Rust Version set to v1.79.0 (starting v2.3.3)
  • Crate binary (starting v2.3.6)
  • Stricter Tests (starting v2.3.2)
    • Proper UTF-8/Unicode Encoding
    • Regular Sifting
    • Sifting With Leading Whitespaces
    • Documentation Assertion
    • MSRV Verification
    • Compliance Check for Old Versions
  • Crate Comparison (starting v2.3.4)
  • Benchmark Separation (starting v2.3.5)

📄 Licensing

whitespace-sifter is licensed under the MIT LICENSE; This is the summarization.

Commit count: 28

cargo fmt