slim-q-gen-phi-3 implements a specialized function-calling question generation from a context passage, with output in the form of a python dictionary, e.g., `{‘question’: [‘What were earnings per share in the most recent quarter?’] } This model is finetuned on top of phi-3-mini-4k-instruct base. For fast inference use, we would recommend the ‘quantized tool’ version, e.g., ‘slim-q-gen-phi-3-tool’. function = «generate» params = «{‘question’, ‘boolean’, or ‘multiple choice’}» prompt = » » + {text} + «n» + » » + {params} + «» + «n:» model = AutoModelForCausalLM.frompretrained(«llmware/slim-q-gen-phi-3») tokenizer = AutoTokenizer.frompretrained(«llmware/slim-q-gen-phi-3») text = «Tesla stock declined yesterday 8% in premarket trading after a poorly-received event in San Francisco yesterda
Модальности:
Генерация текста
Области применения:
Диалог / чат
Задача: Генерация текста
Автор: llmware
Теги: phi3, conversational, custom_code, text-generation-inference
Лайков: 3 | Загрузок: 15
Описание основано на материалах HuggingFace. Перевод выполнен автоматически.