extract-metadata
| Crates.io | extract-metadata |
| lib.rs | extract-metadata |
| version | 0.1.3 |
| created_at | 2025-02-15 20:23:22.624335+00 |
| updated_at | 2025-02-22 14:02:05.63264+00 |
| description | A tool to extract metadata from .safetensors files in a target directory and its subdirectories. |
| homepage | https://github.com/rakki194/extract-metadata |
| repository | https://github.com/rakki194/extract-metadata |
| max_upload_size | |
| id | 1557069 |
| size | 32,690 |
(rakki194)
documentation
https://docs.rs/extract-metadata
README
extract-metadata
A command-line utility for batch extracting metadata from safetensors files. This tool can process individual files or recursively scan directories to extract metadata from all safetensors files.
Features
- Process single safetensors files or entire directories
- Support for glob patterns to match multiple files
- Recursive directory scanning
- Asynchronous processing for better performance
- Detailed metadata extraction from safetensors files
Installation
Ensure you have Rust installed on your system, then you can install using cargo:
cargo install extract-metadata
Or build from source:
git clone https://github.com/rakki194/extract-metadata
cd extract-metadata
cargo build --release
Usage
The tool supports several usage patterns:
-
Process a single file:
extract-metadata path/to/model.safetensors -
Process all safetensors files in a directory (recursive):
extract-metadata path/to/directory -
Use glob patterns to match specific files:
extract-metadata "models/*.safetensors"
Dependencies
- tokio - Async runtime
- anyhow - Error handling
- glob - File pattern matching
- env_logger - Logging functionality
- dset - Internal safetensors processing
- xio - File system operations
Error Handling
The tool includes robust error handling and will:
- Skip invalid files while continuing to process others
- Provide clear error messages for invalid paths or patterns
- Handle IO errors gracefully
License
MIT License
Contributing
Contributions are welcome! Please feel free to submit a Pull Request.