Robust Downloader

A robust, concurrent file downloader library for Rust with progress tracking and retry capabilities.

English | 中文

Features

• 🚀 Concurrent Downloads: Download multiple files simultaneously with configurable concurrency limits
• 🔄 Automatic Retries: Built-in exponential backoff retry mechanism for failed downloads
• 📊 Progress Tracking: Beautiful progress bars with real-time download statistics and status messages
• ⚡ Performance Optimized: Efficient memory usage with configurable buffer sizes
• 🛡️ Safe File Handling: Uses temporary files for atomic operations
• 🔒 Integrity Verification: Support for file integrity checking with various hash algorithms
• ⚙️ Highly Configurable: Customize timeouts, concurrency, and retry behavior

Quick Start

Add this to your Cargo.toml:

[dependencies]
# Default features (includes SHA2 and SHA3)
robust_downloader = "0.0.6"

# Or with specific hash algorithms
robust_downloader = { version = "0.0.6", features = ["sha2", "blake3"] }

# Or with modern/secure algorithms
robust_downloader = { version = "0.0.6", features = ["modern"] }

# Or with all hash algorithms
robust_downloader = { version = "0.0.6", features = ["all"] }

Example

use robust_downloader::{RobustDownloader, Integrity, DownloadItem};
use std::time::Duration;

#[tokio::main]
async fn main() -> Result<(), Box<dyn std::error::Error>> {
    // Create a downloader with custom configuration
    let downloader = RobustDownloader::builder()
        .max_concurrent(4)                    // Set max concurrent downloads
        .connect_timeout(Duration::from_secs(5))  // Set connection timeout
        .build();

    // Define download tasks with integrity verification
    let downloads = vec![
        DownloadItem::builder()
            .url("https://example.com/file1.zip")
            .target("file1.zip")
            .integrity(Integrity::SHA256("e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855".into()))
            .build(),
        DownloadItem::builder()
            .url("https://example.com/file2.zip")
            .target("file2.zip")
            .integrity(Integrity::Blake3("202020202020202020202020".into()))
            .build(),
    ];

    // Start downloading
    downloader.download(downloads).await?;
    Ok(())
}

Configuration Options

Hash Algorithm Features

Available hash algorithm features:

• md5 - Enable MD5 hash support
• sha1 - Enable SHA1 hash support
• sha2 - Enable SHA256 and SHA512 support (included in default)
• sha3 - Enable SHA3-256 hash support (included in default)
• blake2 - Enable BLAKE2b and BLAKE2s support
• blake3 - Enable BLAKE3 hash support

Feature combinations:

• modern - Enable modern/secure algorithms (sha2, sha3, blake2, blake3)
• legacy - Enable legacy algorithms (md5, sha1)
• all - Enable all hash algorithms

Progress Tracking

The library provides detailed progress tracking with:

• Download progress percentage
• Current file being downloaded
• Status messages for different stages (downloading, verifying integrity, moving file)
• Real-time download speed

Installation

The library requires Rust 1.75 or later.

cargo add robust_downloader

License

This project is licensed under the MIT License - see the LICENSE file for details.