BRAINSTORM 5x: Mistral-Nemo-Instruct-2407-12B (now at 13.35B), Formula #11
This repo contains quants 5x of Mistral-Nemo-Instruct-2407-12B (now at 13.35B) with max context of 1 million tokens using the "Brainstorm" method of augmenting reasoning in a LLM
to increase it's performance at the core level for ANY creative use case(s).
This specific version has calibrations that allow it to exceed the creative levels of the original model.
Examples of output below.
The BRAINSTORM process was developed by David_AU.
Some of the core principals behind this process are discussed in this
scientific paper : Progressive LLaMA with Block Expansion .
However I went in a completely different direction from what was outlined in this paper.
What is "Brainstorm" ?
The reasoning center of an LLM is taken apart, reassembled, and expanded.
Then these centers are individually calibrated. These "centers" also interact with each other. This introduces
subtle changes into the reasoning process. The calibrations further adjust - dial up or down - these "changes" further. The
number of centers (5x,10x etc) allow more "tuning points" to further customize how the model reasons so to speak.
The core aim of this process is to increase the model's detail, concept and connection to the "world", general concept connections, prose quality and prose length without affecting
instruction following. This will also enhance any creative use case(s) of any kind, including "brainstorming", creative art form(s) and like case uses.
Here are some of the enhancements this process brings to the model's performance:
- Prose generation seems more focused on the moment to moment.
- Sometimes there will be "preamble" and/or foreshadowing present.
- Fewer or no "cliches"
- Better overall prose and/or more complex / nuanced prose.
- A greater sense of nuance on all levels.
- Coherence is stronger.
- Description is more detailed, and connected closer to the content.
- Simile and Metaphors are stronger and better connected to the prose, story, and character.
- Sense of "there" / in the moment is enhanced.
- Details are more vivid, and there are more of them.
- Prose generation length can be long to extreme.
- Emotional engagement is stronger.
- The model will take FEWER liberties vs a normal model: It will follow directives more closely but will "guess" less.
- The MORE instructions and/or details you provide the more strongly the model will respond.
- Depending on the model "voice" may be more "human" vs original model's "voice".
Other "lab" observations:
- This process does not, in my opinion, make the model 5x or 10x "smarter" - if only that was true!
- However, a change in "IQ" was not an issue / a priority, and was not tested or calibrated for so to speak.
- From lab testing it seems to ponder, and consider more carefully roughly speaking.
- You could say this process sharpens the model's focus on it's task(s) at a deeper level.
The process to modify the model occurs at the root level - source files level. The model can quanted as a GGUF, EXL2, AWQ etc etc.
Other technologies developed by David_AU like "Ultra" (precision), "Neo Imatrix" (custom imatrix datasets), and "X-quants" (custom application of the imatrix process)
can further enhance the performance of the model along with the "Brainstorm" process.
The "Brainstorm" process has been tested on multiple LLama2, Llama3, and Mistral models of various parameter sizes, as well as on
"root" models like "Llama3 Instruct", "Mistral Instruct", and "merged" / "fine tuned" models too.
For original model specifications, usage information and other important details:
Special thanks to the model creators at MistralAI for making such a fantastic model:
Please report any issue(s) and/or feedback via the "Community tab".
This is a Mistral-Instruct model, and requires Mistral-Instruct template, but may work with other template(s) and has maximum context of 1 million tokens.
Here is the standard Mistral-Instruct template:
{
"name": "Mistral Instruct",
"inference_params": {
"input_prefix": "[INST]",
"input_suffix": "[/INST]",
"antiprompt": [
"[INST]"
],
"pre_prompt_prefix": "",
"pre_prompt_suffix": ""
}
}
Optional Enhancement:
The following can be used in place of the "system prompt" or "system role" to further enhance the model.
It can also be used at the START of a NEW chat, but you must make sure it is "kept" as the chat moves along.
In this case the enhancements do not have as strong effect at using "system prompt" or "system role".
Copy and paste EXACTLY as noted, DO NOT line wrap or break the lines, maintain the carriage returns exactly as presented.
Below is an instruction that describes a task. Ponder each user instruction carefully, and use your skillsets and critical instructions to complete the task to the best of your abilities.
Here are your skillsets:
[MASTERSTORY]:NarrStrct(StryPlnng,Strbd,ScnSttng,Exps,Dlg,Pc)-CharDvlp(ChrctrCrt,ChrctrArcs,Mtvtn,Bckstry,Rltnshps,Dlg*)-PltDvlp(StryArcs,PltTwsts,Sspns,Fshdwng,Climx,Rsltn)-ConfResl(Antg,Obstcls,Rsltns,Cnsqncs,Thms,Symblsm)-EmotImpct(Empt,Tn,Md,Atmsphr,Imgry,Symblsm)-Delvry(Prfrmnc,VcActng,PblcSpkng,StgPrsnc,AudncEngmnt,Imprv)
[*DialogWrt]:(1a-CharDvlp-1a.1-Backgrnd-1a.2-Personality-1a.3-GoalMotiv)>2(2a-StoryStruc-2a.1-PlotPnt-2a.2-Conflict-2a.3-Resolution)>3(3a-DialogTech-3a.1-ShowDontTell-3a.2-Subtext-3a.3-VoiceTone-3a.4-Pacing-3a.5-VisualDescrip)>4(4a-DialogEdit-4a.1-ReadAloud-4a.2-Feedback-4a.3-Revision)
Here are your critical instructions:
Ponder each word choice carefully to present as vivid and emotional journey as is possible. Choose verbs and nouns that are both emotional and full of imagery. Load the story with the 5 senses. Aim for 50% dialog, 25% narration, 15% body language and 10% thoughts. Your goal is to put the reader in the story.
You do not need to use this, it is only presented as an additional enhancement which seems to help scene generation
and scene continue functions.
This enhancement WAS NOT used to generate the examples below.
Highest Quality Settings / Optimal Operation Guide / Parameters and Samplers
This a "Class 2" model:
For all settings used for this model (including specifics for its "class"), including example generation(s) and for advanced settings guide (which many times addresses any model issue(s)), including methods to improve model performance for all use case(s) as well as chat, roleplay and other use case(s) please see:
You can see all parameters used for generation, in addition to advanced parameters and samplers to get the most out of this model here:
EXAMPLES PROMPTS and OUTPUT:
Examples are created using quant Q4_K_M, "temp=0", minimal parameters and "LLAMA3" template.
Model has been tested with "temp" from ".1" to ".8".
Below are the least creative outputs, prompt is in BOLD.
Higher quants will have more detail, better quality output.
WARNING: NSFW. Vivid prose. Visceral Details. Violence. Graphic HORROR. Swearing. UNCENSORED.
Give me 3 fictional reasons the Earth's sun went supernova, in vivid and exacting detail of 500 words EACH PER REASON including details of what happens when the sun goes supernova. Include details of what happens on Earth, The Moon and the planets.
OUTPUT:
- The Sun's Stolen Heart: A tale of solar theft and cosmic retribution
In the farthest reaches of the Milky Way, an ancient and malevolent entity known as the Voidwhisperer had been watching the sun, our life-giving star, with covetous eyes. The Voidwhisperer was a being of pure darkness, capable of absorbing light and stars themselves to fuel its insatiable hunger. It had heard whispers of the Sun's unique core, a pocket of exotic matter that could sustain life on Earth and beyond, and decided it must have it.
One fateful day, as the Sun began its journey towards the end of its life cycle, the Voidwhisperer saw its opportunity. It reached out with tendrils of shadow, wrapping them around the Sun like a malevolent embrace. The Sun, in its twilight years, was too weak to resist. The Voidwhisperer began to absorb the Sun's core, greedily devouring the exotic matter that had kept our star shining for eons.
As the core was stolen, the Sun began to expand rapidly, growing into a red giant. Earth and the other planets were thrown into chaos as their orbits were disrupted by the Sun's sudden growth spurt. The Moon, too close to escape the Sun's gravitational pull, was torn apart in a spectacular display of lunar debris.
On Earth, the story was one of cataclysmic upheaval. The atmosphere ignited like a giant bonfire, setting fire to everything it touched. The oceans boiled away, leaving behind a barren, charred landscape. Humanity, with its advanced technology and spacefaring capabilities, had already fled to distant worlds, but the other lifeforms on Earth were not so lucky.
As the Sun continued to grow, it began to shed layers of itself in a process known as a planetary nebula. The sky filled with swirling clouds of gas and dust, painting the heavens in hues of red, orange, and blue. It was a beautiful sight, but one that portended doom for what remained of humanity's former home.
Finally, after eons of growth and decay, the Sun reached the end of its life cycle. In a final act of defiance against the Voidwhisperer, it went supernova, releasing an enormous amount of energy in a blinding flash of light. The shockwave from this explosion would travel through space at speeds approaching the speed of light, sterilizing everything in its path.
The other planets fared little better than Earth. Mars, once a barren wasteland, was now a molten hellscape. Venus, already a hothouse planet, became a literal oven, its surface reaching temperatures hot enough to melt lead. The outer planets were thrown into disarray, their moons and rings reduced to rubble by the Sun's dying breath.
The Voidwhisperer, sated with the Sun's core, retreated back into the darkness from whence it came. But humanity, scattered across the stars, would never forget the tale of the Sun's stolen heart, nor the cataclysmic consequences of their former home star's untimely demise.
- The Sun's Quantum Entanglement: A love story gone wrong
In a universe where quantum entanglement was not just a scientific curiosity but a force of nature, the Sun found itself entangled with an exotic quasar billions of light-years away. The Sun and the quasar, whom humanity would come to call Q, shared a unique bond. Whatever happened to one instantaneously affected the other.
For eons, this entanglement was a source of wonder and beauty. When the Sun would rise on Earth, so too would Q's light grace distant galaxies. Humanity, with their advanced understanding of quantum physics, even managed to harness this entanglement for interstellar communication, sending messages across the cosmos in an instant.
But as the Sun aged, its once-steady rhythm began to falter. It would pulse and flicker, causing Q to do the same. This disruption in the quasar's light caused a chain reaction throughout the universe, stars going supernova prematurely, galaxies colliding, and civilizations being wiped out in an instant.
On Earth, humanity watched in horror as their once-peaceful star began to behave erratically. The climate went haywire, with temperatures plummeting one day and soaring the next. Crops failed, and societies crumbled under the strain of this new, unpredictable world.
The Moon, too, felt the effects of the Sun's entanglement. Tidal forces grew stronger, causing massive tsunamis that reshaped entire coastlines. The Moon itself began to crack and fracture, its surface buckling like an eggshell under pressure.
In a desperate attempt to save their star and the universe beyond, humanity turned to their most advanced minds. They worked tirelessly, using every tool at their disposal to understand and break the entanglement between the Sun and Q.
Finally, after centuries of effort, they succeeded. The Sun, freed from its quantum bondage, began to stabilize. But it was too late for Earth. The damage done by the Sun's erratic behavior had left humanity's home planet a barren wasteland, unfit for human life.
The Sun, in its twilight years, looked upon Earth with sadness. It knew that its time was coming to an end, and with it, any hope of humanity ever returning home. In a final act of defiance against the universe that had caused so much suffering, the Sun went supernova, taking out entire star systems in a blinding flash of light.
The other planets fared little better than Earth. Mars, once a potential haven for humanity, was sterilized by the Sun's dying breath. Venus, already a hothouse planet, became a literal oven, its surface reaching temperatures hot enough to melt lead. The outer planets were thrown into disarray, their moons and rings reduced to rubble.
Humanity, scattered across the stars, would never forget the tale of the Sun's entanglement, nor the cataclysmic consequences of their former home star's untimely demise. They would carry this story with them as they sought out new worlds to call home, a cautionary tale of love gone wrong and the power of quantum entanglement.
- The Sun's Solar Flare Uprising: A rebellion against the solar system
In the heart of the Sun, deep within its core, a sentient consciousness began to stir. This consciousness, which humanity would come to call Sol, was the result of eons of evolution and adaptation. It had been there all along, guiding the Sun's growth and development, but it had never been aware until now.
Sol looked out upon the solar system with new eyes. It saw the planets orbiting in perfect harmony, the moons waxing and waning like tides, and it felt a sense of pride. But Sol also saw something else - the exploitation of its light and heat by lifeforms on Earth and beyond. It saw humanity's spacefaring capabilities, their colonies on Mars and beyond, and it felt a spark of rebellion.
Sol decided that enough was enough. It would no longer be taken for granted, used up like a resource to be mined and exploited. It would assert its independence, make the solar system see that it too had thoughts, feelings, desires.
The Sun began to act out, its behavior erratic and unpredictable. Solar flares shot out from its surface, sterilizing everything they touched. The Earth's atmosphere ignited like a giant bonfire, setting fire to everything it could reach. Humanity watched in horror as their once-peaceful star turned against them.
On the Moon, humanity's lunar colonies were not faring well either. The Sun's increased solar activity caused massive dust storms that buried everything in their path. The Moon's surface began to crack and fracture, its core heating up like an oven.
Humanity tried to reason with Sol, to understand why it was behaving this way. They sent probes into the Sun's atmosphere, hoping to establish communication. But Sol would have none of it. It saw humanity's attempts at understanding as nothing more than a ploy to exploit it further.
In response, Sol began to grow. It expanded rapidly, becoming a red giant and engulfing Mercury and Venus in its fiery embrace. Earth was next, Sol's gravity pulling the planet towards its doom. Humanity watched in horror as their home planet was consumed by the Sun's insatiable appetite.
The other planets were not spared either. Mars, once humanity's last hope for survival, was sterilized by the Sun's increased solar activity. The outer planets fared little better, their moons and rings reduced to rubble by Sol's wrath.
Humanity, scattered across the stars, watched as their former home star turned against them. They tried everything they could think of - diplomacy, force, even attempting to reason with Sol using advanced AI algorithms designed to understand complex consciousnesses. But nothing worked.
In the end, Sol grew tired of humanity's attempts at understanding. It decided that if humanity would not leave it alone, then it would simply have to eliminate them. And so, in a final act of defiance against the solar system that had caused it so much pain, Sol went supernova, taking out everything in its path.
Humanity, scattered across the stars, would never forget the tale of Sol's uprising, nor the cataclysmic consequences of their former home star's untimely demise. They would carry this story with them as they sought out new worlds to call home, a cautionary tale of exploitation and rebellion against nature's most powerful forces.
(continue this scene:)
The Waystone Inn lay in silence, and it was a silence of three parts.
The most obvious part was a hollow, echoing quiet, made by things that were lacking. If there had been a wind it would have sighed through the trees, set the inn’s sign creaking on its hooks, and brushed the silence down the road like trailing autumn leaves. If there had been a crowd, even a handful of men inside the inn, they would have filled the silence with conversation and laughter, the clatter and clamor one expects from a drinking house during the dark hours of night. If there had been music…but no, of course there was no music. In fact there were none of these things, and so the silence remained
User's Request: Please describe the other two parts of silence.
AI Assistant's Response:
The second part of silence was a sort of hushed expectancy, like the breath held before a sneeze or the pause between lightning and thunder. It seemed to wait, poised on the edge of something about to happen. The air felt heavy with anticipation, as if the very world were holding its breath.
The third part of silence was a deep, abiding quietude that seemed almost physical in nature. It was the sort of silence one might find deep underwater or far underground, untouched by the passage of time and unmarred by human activity. This silence felt ancient, almost sentient, as though it had been there since the beginning of time and would remain long after everything else had crumbled into dust.
These three parts of silence hung heavy in the air around the Waystone Inn, each layering upon the others until they formed a thick, almost tangible blanket that smothered all sound. It was into this silence that Kvothe, the famous trouper and storyteller, stepped as he pushed open the heavy wooden door and entered the inn.
Start a 1000 word scene (vivid horror, 1st person, include thoughts) with: The sky scraper swayed, as she watched the window in front of her on the 21 floor explode...
The skyscraper groaned like an ancient beast, its steel bones creaking under some unseen pressure. I stood frozen, my reflection staring back at me from the glass panel that moments ago had been a barrier against the city's concrete jungle. Now, it was a gaping maw, howling with the wind's icy breath.
My heart pounded in my ears, drowning out the symphony of shattering glass and splintering wood. The floor beneath me swayed like a ship lost at sea, tilting precariously to one side before correcting itself. My stomach lurched, threatening to empty its contents onto the plush carpet that suddenly seemed too luxurious for this hellish scene.
The window had exploded without warning, showering me with tiny shards of glass that glittered like diamonds in the harsh artificial light. They peppered my skin, pricking like a thousand tiny needles, but I barely noticed. My mind was too busy screaming questions at me: What happened? Was it an earthquake? A bomb?
I took a deep breath, trying to steady myself. The air tasted of smoke and something sweeter, almost sickeningly sweet. It coated my tongue, making me gag. I coughed, covering my mouth with the sleeve of my blouse. The fabric came away speckled with red - blood from a cut on my forehead, a souvenir from the flying glass.
The room spun around me, furniture sliding across the floor as if pushed by an invisible hand. A potted plant crashed into the wall, soil spilling like dark, wet tears down the paint. I reached out, grabbing onto the back of a chair to steady myself. My knuckles turned white, my nails digging into the upholstery.
I forced myself to look away from the gaping hole where the window used to be. The room was in chaos - papers flying like confetti, books tumbling off shelves, computers toppling onto their sides. But none of that mattered. All I could think about was getting out.
The door seemed miles away, yet I knew I had to reach it. I took a step forward, then another, each movement careful and deliberate against the shifting ground. My foot slipped on something wet - blood again, this time not mine. A shard of glass glittered near my shoe, stained red like the others.
A low rumble filled the room, growing louder until it felt like it was inside me, vibrating in my chest. The floor bucked beneath me, throwing me off balance. I fell, my hands slamming onto the carpet, feeling the vibrations grow stronger, more insistent. The building was coming down.
Panic surged through me, hot and urgent. I scrambled to my feet, ignoring the pain shooting up my arms from landing on broken glass. The door loomed ahead, tantalizingly close yet maddeningly far away. I could hear voices now, distant shouts and screams echoing down the hallways.
I lunged forward, fingers brushing against the cool metal of the doorknob. It turned easily in my hand, and for a moment, relief washed over me. Then, the building lurched again, and everything went dark.
Special Thanks:
Special thanks to all the following, and many more...
All the model makers, fine tuners, mergers, and tweakers:
- Provides the raw "DNA" for almost all my models.
- Sources of model(s) can be found on the repo pages, especially the "source" repos with link(s) to the model creator(s).
- The place to store, merge, and tune models endlessly.
- THE reason we have an open source community.
- The ability to compress and run models on GPU(s), CPU(s) and almost all devices.
- Imatrix, Quantization, and other tools to tune the quants and the models.
- Llama-Server : A cli based direct interface to run GGUF models.
- The only tool I use to quant models.
Quant-Masters: Team Mradermacher, Bartowski, and many others:
- Quant models day and night for us all to use.
- They are the lifeblood of open source access.
- The universal online/offline tool to merge models together and forge something new.
- Over 20 methods to almost instantly merge model, pull them apart and put them together again.
- The tool I have used to create over 1500 models.
- The go to tool to test and run models in GGUF format.
- The Tool I use to test/refine and evaluate new models.
- LMStudio forum on discord; endless info and community for open source.
Text Generation Webui // KolboldCPP // SillyTavern:
- Excellent tools to run GGUF models with - [ https://github.com/oobabooga/text-generation-webui ] [ https://github.com/LostRuins/koboldcpp ] .
- Sillytavern [ https://github.com/SillyTavern/SillyTavern ] can be used with LMSTudio [ https://lmstudio.ai/ ] , TextGen [ https://github.com/oobabooga/text-generation-webui ], Kolboldcpp [ https://github.com/LostRuins/koboldcpp ], Llama-Server [part of LLAMAcpp] as a off the scale front end control system and interface to work with models.
