llama-2-7b-langchain-chat-gguf
и вы можете перейти по ссылке http://localhost:8000/docs, чтобы увидеть интерфейс Swagger. и вы можете перейти по ссылке http://localhost:8000/docs,...
и вы можете перейти по ссылке http://localhost:8000/docs, чтобы увидеть интерфейс Swagger. и вы можете перейти по ссылке http://localhost:8000/docs,...
Change -t 10 to the number of physical CPU cores you have. For example if your system has...
INVALID LANGUAGE PAIR SPECIFIED. EXAMPLE: LANGPAIR=EN|IT USING 2 LETTER ISO OR RFC3066 LIKE ZH-CN. ALMOST ALL LANGUAGES SUPPORTED...
Model details: — Parameter count: 9B (source checkpoint) — Input support: text — Speculative decoding: no — imatrix:...
Nova builds upon BioMistral-7B-SLERP, adapting a strong open-source language model toward biomedical and medical language. The primary dataset...
Run them directly with llama.cpp, or any other llama.cpp based project Some of these quants (Q3KXL, Q4KL etc)...
Sqweeks-7B-Instruct is based on the Qwen 2.5 7B modality architecture, designed to enhance the reasoning capabilities of 7B-parameter...
Repo: roleplaiapp/DeepSeek-R1-Distill-Qwen-7B-Q4KM-GGUF Original Model: DeepSeek-R1-Distill-Qwen-7B Organization: deepseek-ai Quantized File: deepseek-r1-distill-qwen-7b-q4km.gguf Quantization: GGUF Quantization Method: Q4KM Use Imatrix: False...
Original model: https://huggingface.co/prithivMLmods/Deepthink-Reasoning-7B Some of these quants (Q3KXL, Q4KL etc) are the standard quantization method with the embeddings...
. . | / / | | | || | | / | / \ | | |...