tract-metal

Crates.iotract-metal
lib.rstract-metal
version0.21.7
sourcesrc
created_at2024-09-23 12:39:52.821863
updated_at2024-09-23 12:39:52.821863
descriptionTiny, no-nonsense, self contained, TensorFlow and ONNX inference
homepage
repositoryhttps://github.com/snipsco/tract
max_upload_size
id1384011
size533,166
Mathieu Poumeyrol (kali)

documentation

README

tract-metal

Updating Metal Flash Attention library

git clone https://github.com/philipturner/metal-flash-attention.git
cd metal-flash-attention

# for iOS
swift build.swift --platform iOS --xcode-path /Applications/Xcode.app
cp build/lib/libMetalFlashAttention.metallib path/to/tract/metal/src/kernels/libMetalFlashAttention-ios.metallib

# for MacOS
swift build.swift --platform macOS --xcode-path /Applications/Xcode.app
cp build/lib/libMetalFlashAttention.metallib path/to/tract/metal/src/kernels/libMetalFlashAttention-macos.metallib
Commit count: 6528

cargo fmt