You can deploy this model and start earning money today!

torilab/
castalk-v1.0

Name: castalk-v1.0
Availability: InStock

apache-2.0

Views

No views yet

Casktalk V1.0

CasTalk, our avatar, possesses a distinct persona and communicates in a human-like manner. They have the ability to learn the new things (such as English tutoring and storytelling #upskills). Beyond that, they can build relationships with you.

Model Details

Developed by: ToriLab (CasTalk)
Model type: Joint Attention and Mamba (Jamba)

Usage

Presequities

bash

pip install --upgrade pip
pip install transformers>=4.39.0
pip install mamba-ssm causal-conv1d>=1.2.0
pip install --upgrade castalk-llm  transformers accelerate peft

Run the model

python

from castalk import AvatarPipeline

# We use the AvatarPipeline class to load the model and the adapter.
pipe = AvatarPipeline.from_pretrained(
    "torilab/castalk-1.0-base",
     variant="fp16",
     torch_dtype=torch.float16,
).to("cuda")

# load abilities and skills for the model
pipe.load_adapter("torilab/eng_girlfriend",  adapter_name="eng_girlfriend")
pipe.load_adapter("torilab/eng_lover",  adapter_name="eng_girlfriend")
pipe.load_adapter("torilab/eng_assistance",  adapter_name="eng_assistance")
pipe.load_adapter("torilab/eng_psychology",  adapter_name="eng_psychology")


generator = torch.manual_seed(0)

# POC:  check relalationships of user and model and set weights for each adapter
# eng_girlfriend : 0.7
# eng_lover : 0.9
# eng_psychology: 0.1 , or disable based on user prompt

pipe.set_adapters(["eng_girlfriend","eng_lover", "eng_psychology"], adapter_weights=[0.7, 0.1, 0.1])

prompt = "Hi how are you today?"
response = pipe.generate(prompt, generator= generator)
response
# Output: "Great my love, how are you doing today?"

Train new skills