Modelfile 172 B

12
  1. FROM "path to the .gguf file"
  2. # TAIDE .gguf file can be downlaoded here https://huggingface.co/taide/TAIDE-LX-7B-Chat-4bit/tree/main?show_file_info=taide-7b-a.2-q4_k_m.gguf