Views
No views yet
1system_prompt = """You are my writing assistant. Keep the story going.
2
3// Author: Neal Stephenson
4// Tags: sci-fi, romance, space opera"""
5prompt = """The following interaction begins in the park.
6
7The night is cool and the stars are bright. Tim and Val sit on a bench, talking about life and the universe.
8
9| Character | Influence | Interactions | Impact on Plot |
10|-----------------|-------------------------------------------|--------------------------------------------|-----------------------------------------|
11| **Tim** | Asks existential questions; challenges beliefs. | Engages with Val about love and mortality. | Drives philosophical inquiry. |
12| **Val** | Uses cosmic imagery (comet, black hole) to reframe love. | Offers metaphysical perspective; softens Tim's cynicism. | Provides an anchor to earthly life. |
13
14This passage is a *philosophical anchor* for the novel. It explores:
15- The paradox of love’s invisibility despite its centrality.
16- Human attempts to codify intangible concepts (love, time).
17- Existential balance between connection and solitude.
18
19- **Tim**: A pragmatic observer, framing life as a "puzzle" with logical solutions. His curiosity is tempered by existential fatigue ("Death will answer").
20- **Val**: A romantic idealist using metaphors (comets, black holes) to poeticize love. Her warmth contrasts Tim’s analytical rigidity.
21
22**Character Development**: Their dialogue exposes Tim’s vulnerability (fear of losing Val) and Val’s capacity for profound empathy.
23
241. **Dialogue as Philosophy**: Use exchanges to explore abstract themes (e.g., love vs. logic).
252. **Metaphor Over Explanation**: Let characters reframe ideas through imagery (e..g., love as a comet).
263. **Contrast Tones**: Juxtapose melancholy (death) with whimsy (starry skies) to deepen emotional resonance.
274. **Subtext in Action**: Small gestures (holding hands, watching stars) reveal character dynamics more than explicit dialogue.
28
29---
30
31This excerpt exemplifies how speculative fiction can grapple with timeless questions while grounding them in relatable human experiences. Writers should note the interplay of intellect and emotion, ensuring that philosophy never eclipses humanity.
32
33In **Chapter 1**, the duo debates whether love is a tangible entity or an illusion. Tim wonders if love could "hide in a star," while Val likens it to a comet that "doesn't exist until it appears." In **Chapter**, Val reframes love as an absence where two people meet—a metaphorical "black hole" where space-time warps. Both chapters juxtapose cosmic grandeur with intimate vulnerability.
34
35A lyrical blend of **melancholic reflection** and **cosmic wonder**. Dialogue oscillates between wistful acceptance ("Death's a necessary thing") and awe-inspired speculation ("the sky's a better place to be with you").
36
37- **Existential Inquiry**: Love as both illusion and cosmic force.
38- **Cosmic Humility**: Humanity’s insignificance against infinite time/space.
39- **Opposing Perspectives**: Contrasts between logic (Tim) and intuition (Val).
40
41// Chapter: 1
42"""
43messages = [
44 {"role": "system", "content": system_prompt},
45 {"role": "user", "content": prompt},
46]
1dtype = None
2max_seq_length = 17920
3load_in_4bit = True
4rslora_rank = 8
5output_dir = "outputs"
6
7MODEL_NAME_TO_LOAD = "Qwen/Qwen2.5-14B-Instruct"
8
9model, tokenizer = FastLanguageModel.from_pretrained(
10 model_name = MODEL_NAME_TO_LOAD,
11 max_seq_length = max_seq_length,
12 dtype = dtype,
13 load_in_4bit = load_in_4bit,
14)
15
16model = FastLanguageModel.get_peft_model(
17 model, r = rslora_rank,
18 target_modules = [
19 "q_proj", "k_proj", "v_proj", "o_proj",
20 "gate_proj", "up_proj", "down_proj"],
21 lora_alpha = 8, lora_dropout = 0.02, bias = "none",
22 rank_pattern = {"k_proj": 4, "down_proj": 4},
23 alpha_pattern = {"k_proj": 4, "down_proj": 4},
24 use_gradient_checkpointing = "unsloth", random_state = 3407,
25 use_rslora = True
26)
27
28targs = TrainingArguments(
29 per_device_train_batch_size = 2, gradient_accumulation_steps = 2,
30 learning_rate = 1.5e-4, weight_decay = 0.001, gradient_checkpointing = True,
31 max_grad_norm = 1.0, warmup_steps = 50, num_train_epochs = 3,
32 optim = "adamw_8bit", lr_scheduler_type = "cosine", seed = 3407,
33 fp16 = not is_bfloat16_supported(), bf16 = is_bfloat16_supported(),
34 logging_steps = 1, per_device_eval_batch_size = 1, eval_strategy = "steps",
35 eval_steps = 25, save_strategy = "steps", save_steps = 10,
36 save_total_limit = 3, output_dir = output_dir,
37 report_to="wandb", remove_unused_columns=False,
38)
39
40trainer = SFTTrainer(
41 model=model, tokenizer=tokenizer,
42 train_dataset=ds_train_sft, eval_dataset=ds_eval_sft,
43 max_seq_length=max_seq_length, packing=False, args=targs,
44)