NVIDIA TensorRT-LLM Revs Up Inference for Google Gemma

NVIDIA collaborates with Google to deliver Gemma, an optimized family of open models built for high throughput and performance. TensorRT-LLM provides optimizations and kernels that boost Gemma's performance, including FP8, XQA, and INT4 AWQ.