Skip to content


Here are 22 public repositories matching this topic...

This is the official PyTorch implementation of "LLM-QBench: A Benchmark Towards the Best Practice for Post-training Quantization of Large Language Models", and also an efficient LLM compression tool with various advanced compression methods, supporting multiple inference backends.

  • Updated Jun 12, 2024
  • Python

Improve this page

Add a description, image, and links to the internlm topic page so that developers can more easily learn about it.

Curate this topic

Add this topic to your repo

To associate your repository with the internlm topic, visit your repo's landing page and select "manage topics."

Learn more