hebrew_unicode_script

Hebrew_Unicode_Script

Table of contents

• Description
• Examples
  • Using the function API
  • Using the trait API
• Characteristics
• Install
• Safety
• Panics
• Errors
• Code Coverage
• Notes
  • Points
  • Letters
• References
  • Unicode Script 'Hebrew'
  • Unicode Block 'Hebrew'
  • Unicode Block 'Alphabetic Presentation Forms' (APF)
  • Unicode Problems for Hebrew
• License
  • Contribution
• Questions, requests, bugs

Description

This crate (hebrew_unicode_script) is a low-level library written in Rust and designed to facilitate the identification and validation of Unicode characters (unicode code points) related to the Hebrew script and associated unicode code blocks.

Both a check on individual characters and membership of collections are possible. Examples of collections are vowels, yiddish characters, punctations etc..

More information can be found in the file ARCHITECTURE.

This library provides two types of interfaces:

1. functions

2. trait (the same functions but behind a trait).

Each function in this library returns a boolean value, making it easy to integrate these controls into existing or new applications.

For an overview of released versions see releases.

Examples

Using the function API

Basic usage:

use hebrew_unicode_script::is_hbr_consonant_mem;
use hebrew_unicode_script::is_hbr_consonant_normal;
use hebrew_unicode_script::is_hbr_consonant;
use hebrew_unicode_script::is_script_hbr_consonant;

assert!(is_hbr_consonant_mem('מ'));
assert!(is_hbr_consonant_normal('מ'));
assert!(is_hbr_consonant('מ'));
assert!(is_script_hbr_consonant('מ'));

use hebrew_unicode_script::is_hbr_block;

if is_hbr_block('מ') {
	println!("The character you entered is part of the 'unicode code block Hebrew'");
}

use hebrew_unicode_script::is_hbr_block;

if is_hbr_block('מ') {
	println!("The character you entered is part of the 'unicode code block Hebrew'");
}

use hebrew_unicode_script::{is_hbr_consonant_final, is_hbr_consonant};

let test_str = "ךםןףץ";
for c in test_str.chars() {
    assert!(is_hbr_consonant_final(c));
    assert!(is_hbr_consonant(c));
}

A more complex example:

use hebrew_unicode_script::{is_hbr_accent,is_hbr_mark, is_hbr_point, is_hbr_punctuation};
use hebrew_unicode_script::{is_hbr_consonant_final,is_hbr_yod_triangle,is_hbr_ligature_yiddish};

fn main() {
   // define a strings of characters
   let string_of_chars = "יָ֭דַעְתָּ שִׁבְתִּ֣י abcdefg וְקוּמִ֑י";
   // get a structures that indicates if a type is present or not (bool)
   let chartypes = get_character_types(string_of_chars);
   // print the results
   println!("The following letter types are found in: {}", string_of_chars);
   println!("{:?}",chartypes);
}

#[derive(Debug, Default)]
pub struct HebrewCharacterTypes {
    accent: bool,
    mark: bool,
    point: bool,
    punctuation: bool,
    letter: bool,
    letter_normal: bool,
    letter_final: bool,
    yod_triangle: bool,
    ligature_yiddish: bool,
    whitespace: bool,
    non_hebrew: bool,
}

impl HebrewCharacterTypes {
    fn new() -> Self {
        Default::default()
    }
}

pub fn get_character_types(s: &str) -> HebrewCharacterTypes {
    let mut found_character_types = HebrewCharacterTypes::new();
    for c in s.chars() {
        match c {
            c if is_hbr_accent(c) => found_character_types.accent = true,
            c if is_hbr_mark(c) => found_character_types.mark = true,
            c if is_hbr_point(c) => found_character_types.point = true,
            c if is_hbr_punctuation(c) => found_character_types.punctuation = true,
            c if is_hbr_consonant_final(c) => found_character_types.letter_final = true,
            c if is_hbr_yod_triangle(c) => found_character_types.yod_triangle = true,
            c if is_hbr_ligature_yiddish(c) => found_character_types.ligature_yiddish = true,
            c if c.is_whitespace() => found_character_types.whitespace = true,
            _ => found_character_types.non_hebrew = true,
        }
    }
    found_character_types.letter =
        found_character_types.letter_normal | found_character_types.letter_final;
    found_character_types
}

Output result:

The following character types were found:
HebrewCharacterTypes {
    accent: true,
    mark: false,
    point: true,
    punctuation: false,
    letter: true,
    letter_normal: true,
    letter_final: false,
    yod_triangle: false,
    ligature_yiddish: false,
    whitespace: true,
    non_hebrew: true,
}

Using the trait API

use hebrew_unicode_script::HebrewUnicodeScript;

assert!( 'מ'.is_script_hbr() );
assert!( !'מ'.is_script_hbr_point() );
assert!( 'ױ'.is_script_hbr_ligature_yiddisch() );
assert!( 'מ'.is_hbr_block() );
assert!( !'מ'.is_hbr_point() );

See the crate modules for more examples.

Characteristics

This crate (hebrew_unicode_script) uses the #![no_std] attribute.

It does not depend on any standard library, nor a system allocator.

Install

For installation see the hebrew_unicode_script page at crates.io.

Safety

All functions are written in safe Rust.

Panics

Not that I am aware of.

Errors

All (trait)functions return either true or false.

Code Coverage

Current code coverage is 100% [^code coverage] [^code coverage]: The code coverage figures shown in crates.io are (very) different!

To generate the code coverage, I used grconv (see here how to use it).

Notes

Points

• Hebrew points can be subdivided in:
  • Vowels (code points: U+05B4 .. U+05BB, U+05C7)
  • Semi-Vowels (code points: U+05B0 .. U+05B3)
  • Reading Signs (code points: U+05BC .. U+05BD + U+05BF + U+05C1 .. U+05C2) ¹

Letters

• Hebrew letters (consonants) can be subdivided in:
  • Normal consonants (code points: U+05D0 .. U+05D9, U+05DB, U+05DC, U+05DE, U+05E0 .. U+05E2, U+05E4, U+05E6 .. U+05EA)
  • Final consonants (code points: U+05DA, U+05DD, U+05DF, U+05E3 and U+05E5)
  • Wide consonants (code points: U+FB21 .. U+FB28)
  • Consonants with vowel (code points: U+FB2A .. U+FB36, U+FB38 .. U+FB3C, U+FB3E, U+FB40, U+FB41, U+FB43, U+FB44, U+FB46 .. U+FB4E)
  • Alternative consonants (code points: U+FB20, U+FB29)

References

Unicode Script 'Hebrew'

• Unicode script for the Hebrew language

Unicode Block 'Hebrew'

• See https://www.unicode.org/charts/PDF/U0590.pdf

  • Note: only the following code-point range is applicable: U+0590 .. U+05FF

• See also: https://graphemica.com/blocks/hebrew/

Unicode Block 'Alphabetic Presentation Forms' (APF)

• See https://www.unicode.org/charts/PDF/UFB00.pdf
  • Note: only the following code-point range is applicable: U+FB1D .. U+FB4F
• See also: https://graphemica.com/blocks/alphabetic-presentation-forms

Unicode Problems for Hebrew

There are some issues with unicode and Hebrew. These are described on the following web page: Unicode Problems

To learn more about Unicodesee: Unicode main site, Unicode Scripts and Unicode Blocks

See Hebrew Cantillation Marks And Their Encoding for more specifics on this matter.

License

The hebrew_unicode_script library is distributed under either of

• Apache License, Version 2.0
• MIT license

at your option.

Contribution

Unless you explicitly state otherwise, any contribution intentionally submitted for inclusion in this crate by you, as defined in the Apache-2.0 license, shall be dual licensed as above, without any additional terms or conditions.

Questions, requests, bugs

I invite you to:

• Ask questions
• Make requests for new features or improvements
• Report bugs or suggest enhancements

Any input is welcome. To do this, you can submit a request here.