Sllm

关于

sLLM provides weather forecast functionalities specifically for South Korea via an MCP server. The repository details various experimental environments and configurations, including baseline models with and without fine-tuning and quantization, as well as LoRA and QLoRA setups with different rank (r) and alpha (a) values. It uses techniques like BitsAndBytes for quantization, exploring hyperparameters like load_in_4bit, bnb_4bit_use_double_quant, bnb_4bit_quant_type, and bnb_4bit_compute_dtype.

主要功能

• 0 GitHub stars