# WARNING Halfway through the development of this crate we learned about [Lender](https://crates.io/crates/lender), which has exactly the same goals of this crate, uses the same ideas, and is much more developed, so we joined the development team. This crate is thus unmaintained and this document is here for historical reasons only. ## A lending iterator trait based on higher-rank trait bounds (HRTBs) A *lending iterator* is an iterator which lends mutable borrows to the items it returns. In particular, this means that the reference to an item is invalidated by the next call to `next()`. The typical example that cannot be written with standard Rust iterators, but is covered by lending iterators, is that of an iterator returning mutable, overlapping windows of a slice. But lending iterators are more general than that, as they might return items that depend on some mutable state stored in the iterator. For example, a lending iterator might return references to the lines of a file reusing an internal buffer; also, starting from an iterator on pairs of integers lexicographically sorted, a lending iterator might return iterators on pairs with the same first coordinate without any copying; clearly, in all these cases any call on `next()` would invalidate the reference returned by the previous call. Similarly to what happens with standard iterators, besides the fundamental [`LendingIterator`] trait there is a [`IntoLendingIterator`] trait and methods such as [`LendingIterator::map`]. Our aim is to have a library as complete as that of standard iterators, but there is still a lot of work to do. The Rust syntax for iterating over types implementing [`IntoIterator`] cannot be extended to lending iterators. The idiomatic way of iterate over a lending iterator is to use a `while let` loop, as in: ```ignore while let Some(item) = iter.next() { // Do something with item } ``` Note that if you have a variable `x` with an `iter` method returning a lending iterator, you cannot use the form `while let Some(item) = x.iter().next()` as you will iterate over the first element forever. To make iteration simpler, we provide a macro [`for_lend!`] that can be used to iterate in a way more similar to a `for` loop. ## An example: reusing line buffers The following code shows how to implement a lending iterator returning lines from a file, reusing a buffer for the line: ```rust use hrtb_lending_iterator::*; use std::fs::File; use std::io::{BufRead, BufReader}; struct Lines { reader: BufReader, buffer: String, } impl<'any> LendingIteratorItem<'any> for Lines { type Type = &'any str; } impl LendingIterator for Lines { fn next(&mut self) -> Option> { self.buffer.clear(); if self.reader.read_line(&mut self.buffer).unwrap() == 0 { return None; } Some(&self.buffer) } } fn main() { let mut iter = Lines { reader: BufReader::new(File::open("Cargo.toml").unwrap()), buffer: String::new(), }; while let Some(line) = iter.next() { // line is a reference to the buffer print!("{}", line); } } ``` Since the library contains several methods analogous to those of Rust iterators, you can enumerate just at most the first ten lines with ```ignore let mut iter = Lines { reader: BufReader::new(File::open("Cargo.toml").unwrap()), buffer: String::new(), }.take(10); ``` Moreover, if at any time you decide that you prefer to handle owned strings, you have just to turn the lending iterator into a standard iterator by making the returned items owned: ```ignore for line in iter.to_owned_item() { // line is a copy of the buffer print!("{}", line); } ``` This is possible every time that the type referenced by the returned item implements [`ToOwned`](std::borrow::ToOwned). ## An example: overlapping windows The following code shows how to implement a lending iterator returning overlapping windows of a slice: ```rust use hrtb_lending_iterator::*; struct WindowsMut<'a, T, const WINDOW_SIZE: usize> { slice: &'a mut [T], curr_pos: usize, } impl<'a, 'any, T, const WINDOW_SIZE: usize> LendingIteratorItem<'any> for WindowsMut<'a, T, WINDOW_SIZE> { type Type = &'any mut [T; WINDOW_SIZE]; } impl<'a, T, const WINDOW_SIZE: usize> LendingIterator for WindowsMut<'a, T, WINDOW_SIZE> { fn next(&mut self) -> Option> { let window = self .slice .get_mut(self.curr_pos..)? .get_mut(..WINDOW_SIZE)?; self.curr_pos += 1; Some(window.try_into().unwrap()) } } fn main() { let mut v = vec![1, 2, 3, 4, 5]; let mut iter = WindowsMut::<'_, _, 3> { slice: &mut v, curr_pos: 0, }; while let Some(window) = iter.next() { // The window is mutable window[0] = window[2] - window[1]; println!("{:?}", window); } } ``` In fact, this is already done for you using an [extension trait](SliceExt::windows_mut), so you can just use it: ```rust use hrtb_lending_iterator::*; fn main() { let mut v = vec![1, 2, 3, 4, 5]; let mut iter = v.windows_mut::<3>(); while let Some(window) = iter.next() { // The window is mutable window[0] = window[2] - window[1]; println!("{:?}", window); } } ``` ## Interacting with standard iterators The library provides several methods that make it possible to move from world of standard iterator to the world of lending iterators and vice versa. - All types implementing [`Iterator`] can be turned into a [`LendingIterator`] by calling the method [`Iterator::into_lend_iter`](IteratorExt::into_lend_iter), and all types implementing [`IntoIterator`] can be turned into a [`IntoLendingIterator`] by calling the method [`IntoIterator::into_into_lend_iter`](IntoIteratorExt::into_into_lend_iter). This is achieved via trait extension, but the methods are also available as free functions [`from_iter`](crate::from_iter) and [`from_into_iter`](crate::from_into_iter). These conversions happen without allocation. - If a lending iterator is actually a standard iterator because there is no actual borrow, the method [`LendingIterator::into_iter`] can be used to turn it into a lending iterator, and the same happens with [`IntoLendingIterator::into_into_iter`](crate::IntoLendingIterator::into_into_iter). These conversions happens without allocation, and are the inverses of the previous two. - The method [`LendingIterator::to_owned_item`] turns a lending iterator into a standard iterator returning owned items. This is possible every time that the type referenced by the returned item implements [`ToOwned`](std::borrow::ToOwned). There will be allocation if the [`ToOwned::to_owned`] method allocates when applied to each item. ## Type-inference problems Due to the complex type dependencies and higher-kind trait bounds involved, the current Rust compiler cannot always infer the correct type of a lending iterator and of the items it returns. In general, when writing methods accepting a [`LendingIterator`] restricting the returned item type with a *type* will work, as in: ```rust use hrtb_lending_iterator::*; struct MockLendingIterator {} impl<'any> LendingIteratorItem<'any> for MockLendingIterator { type Type = &'any str; } impl LendingIterator for MockLendingIterator { fn next(&mut self) -> Option> { None } } fn read_lend_iter(iter: L) where L: LendingIterator + for<'any> LendingIteratorItem<'any, Type = &'any str>, {} fn test_mock_lend_iter(m: MockLendingIterator) { read_lend_iter(m); } ``` However, the following code, which restricts the returned items using a trait bound, does not compile as of Rust 1.73.0: ```ignore use hrtb_lending_iterator::*; struct MockLendingIterator {} impl<'any> LendingIteratorItem<'any> for MockLendingIterator { type Type = &'any str; } impl LendingIterator for MockLendingIterator { fn next(&mut self) -> Option> { None } } fn read_lend_iter(iter: L) where L: LendingIterator, for<'any> >::Type: AsRef, {} fn test_mock_lend_iter(m: MockLendingIterator) { read_lend_iter(&m); } ``` The workaround is to use an explicit type annotation: ```rust use hrtb_lending_iterator::*; struct MockLendingIterator {} impl<'any> LendingIteratorItem<'any> for MockLendingIterator { type Type = &'any str; } impl LendingIterator for MockLendingIterator { fn next(&mut self) -> Option> { None } } fn read_lend_iter(iter: L) where L: LendingIterator, for<'any> >::Type: AsRef, {} fn test_mock_lend_iter(m: MockLendingIterator) { read_lend_iter::(m); } ```