PlanLLM is a conversational assistant trained to assist users in completing a recipe from beginning to end and be able to answer any related or relevant requests that the user might have. The model was also tested with DIY Tasks and performed similarly.

PlanLLM was trained by fine-tuning a Vicuna model on synthetic dialogue between users and an assistant about a given recipe. The model was first trained using SFT and then using Direct Preference Optimization (DPO).

SFT:

DPO:

PlanLLM was trained on synthetic user-system dialogues where the role of the system is to aid the user in completing a predetermined task. For our case, we used recipes.

These dialogues were generated using the user utterances collected from Alexa users who interacted with TWIZ, our entry in the Alexa Prize Taskbot Challenge 1. Using an intent classifier we mapped each user utterance to a specific intent allowing us to collect intent-specific utterances and a dialogue graph of each dialogue (with intents being the graph nodes). For the system responses, we used a combination of templates, external knowledge sources, and Large Language Models.

Using this we built a pipeline that would navigate a dialogue graph generating user requests and system responses for each turn, creating complete dialogues that follow a similar dialogue pattern used by real users.

SFT:

DPO:

It's the same as Vicuna. A non-commercial Apache 2.0 license.

@InProceedings{planllm_eacl24,
  author="Glória-Silva, Diogo
          and Ferreira, Rafael
          and Tavares, Diogo
          and Semedo, David
          and Magalhães, João",
  title="Plan-Grounded Large Language Models for Dual Goal Conversational Settings",
  booktitle="European Chapter of the Association for Computational Linguistics (EACL 2024)",
  year="2024",
}