Gadsby

Observations

• The model can be creative in working around the lack of a letter 'e', for example instead of sheep it can say "adult lamb" or "dominant wool-producing animal".
• Sometimes it drops the 'e' and mis-spells a word
• I did not filter out some cyrillic letters which look like and 'e' and sometimes it uses those (or even Chinese words)
• The smaller model can output refusals if it doesn't find a suitable token
• Instead of greedy sampling or probability sampling, beam search with back-tracking is useful to avoid leading the generation into an 'e' dominated dead-end

Example

Farm animals play a vital part in human civilization, providing food, labor, and various products such as wool, milk, and transportation. Among farm animals, wool-producing animals hold a significant position in many agricultural and pastoral traditions. Wool is a natural, insulating, and highly sought commodity, and it is primarily grown from animals that naturally carry a thick coat of hair. In this discussion, I'll focus on wool-producing farm animals, with a particular focus on dominant wool-producing animals, and also touch on non-wool farm animals for a broad comparison.

1. Wool-Producing Farm Animals

A. Lambs (Wool from Lambs)

• Primary Wool-Producing Animal: **Wool is primarily from lambs, which is a young dominant wool-producing animal.
• Common Wool-Producing Lamb Variants:
• Shropshir – Known for high-quality, long, and soft wool.
• Ramboult – Known for high wool production and good quality.
• Suffolk – Known for high wool production and good quality.