Exciting news for llama.cpp users! The introduction of CUDA graph functionality has further enhanced AI inference performance on NVIDIA GPUs. #AI #CUDAGraphs

https://developer.nvidia.com/blog/optimizing-llama-cpp-ai-inference-with-cuda-graphs/