Views
No views yet

transformers library.$ pip install git+https://github.com/huggingface/transformers@v4.49.0-Gemma-3pipeline API1from transformers import pipeline
2import torch
3
4pipe = pipeline(
5 "text-generation",
6 model="OpenGenerativeAI/Bifrost-27B",
7 device="cuda",
8 torch_dtype=torch.bfloat16
9)
10
11messages = [{"role": "user", "content": "Generate a secure API key management system."}]
12output = pipe(text=messages, max_new_tokens=200)
13print(output[0]["generated_text"])