moz_genai

Rust library to perform inference using Candle, exposed through cbindgen for C++ usage.

To build:

make build

To summarize the text from sandman.txt using C++ (see cpp/main.cpp):

make run