#Nvidia has developed a software update called TensorRT-LLM to improve the performance of its H100 Tensor Core GPUs. With this update, the H100s can now outperform the A100s by 8x, compared to the previous 4x. TensorRT-LLM includes various optimizations and supports popular large language models, and it is available in early access through the Nvidia NeMo framework. #AI #ML #LLM
