Phi-3-medium-128k-instruct-Q8_0.gguf
Want to test https://huggingface.co/bartowski/Phi-3-medium-128k-instruct-GGUF
The Phi-3-Medium-128K-Instruct is a 14B parameters, lightweight, state-of-the-art open model trained with the Phi-3 datasets that includes both synthetic data and the filtered publicly available websites data with a focus on high-quality and reasoning dense properties. The model belongs to the Phi-3 family with the Medium version in two variants 4k and 128K which is the context length (in tokens) that it can support.
Phi-3-medium-128k-instruct-Q8_0.gguf
Want to test https://huggingface.co/bartowski/Phi-3-medium-128k-instruct-GGUF