SentenceTransformer based on unsloth/Qwen3-Embedding-4B

Model Details

Model Description

• Model Type: Sentence Transformer
• Base model: unsloth/Qwen3-Embedding-4B
• Maximum Sequence Length: 512 tokens
• Output Dimensionality: 2560 dimensions
• Similarity Function: Cosine Similarity
• Training Dataset:
  • track_b_task4_dataset

Model Sources

• Documentation: Sentence Transformers Documentation
• Repository: Sentence Transformers on GitHub
• Hugging Face: Sentence Transformers on Hugging Face

Full Model Architecture

SentenceTransformer(
  (0): Transformer({'max_seq_length': 512, 'do_lower_case': False, 'architecture': 'Qwen3Model'})
  (1): Pooling({'word_embedding_dimension': 2560, 'pooling_mode_cls_token': False, 'pooling_mode_mean_tokens': False, 'pooling_mode_max_tokens': False, 'pooling_mode_mean_sqrt_len_tokens': False, 'pooling_mode_weightedmean_tokens': False, 'pooling_mode_lasttoken': True, 'include_prompt': True})
  (2): Normalize()
)

Usage

Direct Usage (Sentence Transformers)

Training Details

Training Dataset

track_b_task4_dataset

• Dataset: track_b_task4_dataset at 11ed557
• Size: 1,897 training samples
• Columns: anchor, positive, and negative
• Approximate statistics based on the first 1000 samples:

  	anchor	positive	negative
  type	string	string	string
  details	min: 61 tokens mean: 178.26 tokens max: 276 tokens	min: 63 tokens mean: 188.56 tokens max: 296 tokens	min: 83 tokens mean: 200.53 tokens max: 306 tokens

• Samples:

  anchor	positive	negative
  A mysterious individual, known only by their alias "The Wanderer", arrives in the small, rural town of Willow Creek, sparking curiosity and intrigue among its residents. The Wanderer, a woman with no discernible past or motivations, settles into a local boarding house and begins to integrate into the community. As the townspeople grow accustomed to her presence, they start to notice a series of subtle yet significant changes: abandoned buildings are repaired, neglected gardens are tended, and long-forgotten traditions are revived. The Wanderer's actions are met with a mix of gratitude and suspicion, with some viewing her as a benevolent force and others as a potential threat. As the weeks pass, the townspeople begin to uncover fragments of The Wanderer's past, hinting at a complex and troubled history. Tensions rise as the truth about her identity and intentions becomes increasingly unclear, leading to a confrontation that will determine the fate of Willow Creek and its enigmatic stran...	In the secluded hamlet of Ravenshire, a mysterious individual known as "The Traveler" emerges, captivating the attention of its residents. The Traveler, a woman shrouded in mystery, takes up residence in a local inn and gradually becomes an integral part of the community. As the townsfolk become accustomed to her presence, they notice a series of incremental improvements: long-deteriorated structures are restored, overgrown orchards are revitalized, and dormant customs are revived. The Traveler's actions elicit a range of reactions, with some perceiving her as a guardian angel and others as a potential danger. As the weeks unfold, the townspeople begin to uncover hints of The Traveler's past, suggesting a multifaceted and troubled history. As tensions escalate, the truth about her identity and intentions becomes increasingly ambiguous, culminating in a climactic confrontation that will decide the fate of Ravenshire and its enigmatic stranger. Ultimately, The Traveler's true purpose and...	In the coastal city of Tidal Cove, a reclusive figure known as "The Architect" emerges, captivating the attention of its residents. The Architect, a man with a talent for urban planning, begins to renovate abandoned waterfront properties and transform neglected public spaces, earning the gratitude of locals and tourists alike. However, as The Architect's projects gain momentum, he faces opposition from a group of powerful developers who seek to exploit the city's resources for their own gain. As tensions rise, The Architect's true identity and motivations are called into question, leading to a dramatic confrontation that exposes a decades-old conspiracy involving corruption, environmental degradation, and hidden agendas. The Architect's actions ultimately prompt the city to reevaluate its relationship with development and the environment, paving the way for a more sustainable future. Despite his successes, The Architect disappears as suddenly as he appeared, leaving behind a legacy and...
  A mysterious drifter arrives in the lawless frontier town of Red Hollow, where tensions between a ruthless land baron and struggling settlers have reached a boiling point. After witnessing the baron's enforcers intimidate locals, the drifter reluctantly intervenes, revealing exceptional gunslinging skills. The townsfolk rally around the drifter, who agrees to help them defend their land in exchange for information about a missing person tied to his past. As the baron escalates his tactics, the drifter trains the settlers in self-defense while uncovering secrets about the baron's rise to power. The conflict culminates in a dramatic shootout, during which the drifter confronts the baron and learns that his missing person was a victim of the baron's greed. With the baron defeated, the drifter declines the townsfolk's pleas to stay, riding off into the horizon to continue his search for redemption.	A lone wanderer arrives in the turbulent mining settlement of Iron Creek, where a greedy tycoon’s stranglehold on resources has left the struggling workers on the brink of revolt. After observing the tycoon’s hired thugs terrorize the community, the wanderer steps in reluctantly, displaying remarkable combat skills. Inspired, the miners plead for the wanderer’s help in resisting the tycoon, and he agrees in exchange for clues about a loved one lost years ago. As the tycoon tightens his grip, the wanderer trains the miners to defend themselves and uncovers the dark history behind the tycoon’s corrupt empire. The tension builds to a climactic confrontation, during which the wanderer faces the tycoon and discovers that his lost loved one fell victim to the tycoon’s ruthless ambition. With the tycoon defeated, the miners beg the wanderer to stay and lead them, but he declines, riding off alone to continue his journey toward closure.	In a sprawling, rain-soaked city, a quiet mechanic named Lena stumbles upon a coded message hidden in the engine of a luxury car belonging to a powerful corporate magnate. The message hints at a secret plan to displace hundreds of residents from a crumbling district in order to construct a high-tech headquarters. Haunted by memories of her own family's eviction years ago, Lena reluctantly teams up with a small group of activists who are desperate to stop the project. Using her engineering expertise, she sabotages construction equipment and leaks incriminating documents to the press. As the magnate retaliates with legal threats and hired enforcers, Lena uncovers evidence that the project’s funding is tied to a shadowy network exploiting vulnerable workers. In a final act of defiance, Lena orchestrates a citywide blackout, crippling the magnate's operations. The activists celebrate their small victory, but Lena quietly walks away, leaving behind the tools she once used to fix machines, n...
  A team of paranormal investigators, led by seasoned medium Claire, is summoned to an abandoned asylum rumored to be haunted by the spirits of its former patients. Upon their arrival, the group sets up equipment to capture evidence of supernatural activity. As night falls, they experience a series of unsettling phenomena, including disembodied whispers and unexplained shadows. Tensions rise when one team member, Mark, becomes possessed by a malevolent spirit, causing chaos among the group. Claire must confront her own traumatic past to save Mark and uncover the asylum's dark history. As they delve deeper, they discover a hidden chamber containing remnants of unethical experiments conducted on the patients. In a climactic confrontation, Claire faces the spirit responsible for the torment, ultimately freeing the trapped souls and restoring peace to the asylum. The film concludes with the team leaving the site, forever changed by their harrowing experience.	A group of spectral researchers, led by experienced clairvoyant Lydia, is called to an abandoned hospital believed to be haunted by the souls of its former inhabitants. Upon their arrival, the team sets up devices to document any supernatural occurrences. As darkness envelops the building, they encounter a series of eerie events, including distant voices and mysterious apparitions. Tensions escalate when one member, Jacob, becomes overtaken by a vengeful entity, creating turmoil within the group. Lydia is compelled to confront her own haunted history to rescue Jacob and unveil the hospital's sinister past. As they investigate further, they uncover a concealed room filled with evidence of inhumane experiments performed on the residents. In a gripping showdown, Lydia confronts the entity behind the suffering, ultimately liberating the anguished spirits and bringing solace to the hospital. The story concludes with the team departing from the site, forever altered by their chilling ordeal.	In a bustling modern city, a group of amateur urban explorers, led by the charismatic Leo, stumbles upon a long-forgotten subway station rumored to hold secrets from a bygone era. As they venture deeper into the dark tunnels, they encounter strange graffiti and remnants of old advertisements, igniting their curiosity. However, the thrill quickly turns to terror when one member, Mia, discovers a series of hidden rooms that seem to echo with whispers of the past. As the group struggles to navigate the labyrinthine passages, tensions mount when Leo, driven by his obsession, becomes increasingly reckless, nearly leading them into danger. To save their friend and escape the underground nightmare, Mia must rely on her knowledge of urban legends and her connection to the city's history. In a final act of courage, she confronts Leo's reckless spirit, grounding him in reality and allowing them to retrace their steps. The explorers emerge into the light, forever bonded by their adventure, having...

• Loss: MultipleNegativesRankingLoss with these parameters:
  json

  1{ 2 "scale": 20.0, 3 "similarity_fct": "cos_sim", 4 "gather_across_devices": false 5}

Training Hyperparameters

Non-Default Hyperparameters

• per_device_train_batch_size: 4
• gradient_accumulation_steps: 4
• learning_rate: 2e-05
• num_train_epochs: 1
• lr_scheduler_type: cosine
• warmup_ratio: 0.1
• bf16: True
• batch_sampler: no_duplicates

All Hyperparameters

Training Logs

Framework Versions

• Python: 3.12.12
• Sentence Transformers: 5.2.3
• Transformers: 4.56.2
• PyTorch: 2.10.0+cu128
• Accelerate: 1.12.0
• Datasets: 4.3.0
• Tokenizers: 0.22.2

Citation

BibTeX

Sentence Transformers

MultipleNegativesRankingLoss