SentenceTransformer(
(0): Transformer({'max_seq_length': 256, 'do_lower_case': False, 'architecture': 'Gemma3TextModel'})
(1): Pooling({'word_embedding_dimension': 768, 'pooling_mode_cls_token': False, 'pooling_mode_mean_tokens': True, 'pooling_mode_max_tokens': False, 'pooling_mode_mean_sqrt_len_tokens': False, 'pooling_mode_weightedmean_tokens': False, 'pooling_mode_lasttoken': False, 'include_prompt': True})
)pip install -U sentence-transformers1from sentence_transformers import SentenceTransformer
2
3# Download from the 🤗 Hub
4model = SentenceTransformer("ahmedHamdi/IR-es-en-gemma")
5# Run inference
6sentences = [
7 'A group of people find wolves dead from eating sand in the central city, an abandoned village on the shores of the Aral Sea. Upon arriving, the group discovers swarms of dogs abandoned by the village; in revenge for the brutality of the people, the dogs begin to attack. Overcome by fear and madness, the people begin to destroy each other.',
8 " Born on a battlefield, Conan is the son of Corin, barbarian chieftain. As a child, he proves himself a skilled but violent warrior to his father. One day, Conan's village is attacked by Khalar Zym, a warlord who wishes to reunite the Mask of Acheron to revive his dead wife Maliva, an evil sorceress, and conquer Hyboria. The mask, crafted by sorcerers and used to subjugate the world, was broken into pieces and scattered among the barbarian tribes to prevent unification. After locating Corin's tribe's piece and slaughtering the entire village, Zym leaves Conan the only survivor. Years later, Conan, now an adult, is a pirate and hunts Zym, seeking revenge for his father's death. In the city of Messantia, he meets Ela-Shan, a thief being chased by Lucius, one of Zym's soldiers that Conan recognizes from his village's slaughter. He allows himself to be captured alongside Ela-Shan to confront Lucius. Torturing him, Conan learns that Zym seeks the female pureblood descendant of the sorcerers of Acheron to unleash the mask's power. Conan frees Lucius' prisoners, who kill Lucius. Zym and his daughter, the sorceress Marique, attack a monastery to find the pureblood descendant. Fassir, a monk, tells his student, Tamara, to flee, knowing she is whom Zym seeks. Conan rescues Tamara and captures Zym's righthand man, Remo. After learning Tamara's identity, Conan catapults Remo into Zym's camp, killing him and sending Zym a message. Zym and Marique confront Conan and Zym finally recognizes him as the boy he left alive. Amidst their battle, Marique poisons Conan with a boomerang sword and he is rescued by Tamara. They jump into the sea and return to Conan's ship, where he recovers. The boat is attacked by Zym's men but Conan and his gang defeat them. Conan departs for Zym's kingdom. His friend Artus sends Tamara after him, and the two spend the night together. The next day, as she is returning to the boat, Tamara is captured by Zym's men. Conan asks Ela-Shan for help breaking into Zym's castle. Zym uses Tamara's blood to mend the mask, planning to use her body as a vessel for his wife's soul. After confronting a tentacled monster that guards Zym's dungeons, Conan frees Tamara and battles Zym, eventually reclaiming the sword Marique had stolen from his father. He also cuts off Marique's hand and she is fatally impaled. Conan and Tamara become trapped on a bridge as Zym uses the mask's power to call forth his wife. Her spirit begins to possess Tamara's body. Conan destroys the bridge, causing Zym to fall into the lava below as he and Tamara escape. Conan returns Tamara to her birthplace, then travels to his old village. He recalls the memory of his father, content that he has avenged his death and recovered his father's sword, thereby restoring his honor.",
9 "Not long after the invasion and occupation of Earth by a race of powerful robots wanting human knowledge and ingenuity, humans are confined to their homes. Leaving without permission would be to risk their lives. Monitored by the electronic implants in their necks, the robot sentries are able to track the movement of humans in order to control them. If any person attempts to exit their home, they are given warnings by the robot sentries to return to their home. If he or she does not comply within ten seconds, they are killed. At the beginning of the film, a teen going by the name of Sean Flynn (Callan McAuliffe), is seeking his father, who went missing not long after the robots invaded, sending out hand-drawn lost posters hidden in tennis balls and fruit. Later, Nathan, a friend of Sean's, is seen attempting to repair his PlayStation, when Connor, a young boy, accidentally shocks Nathan, while a girl named Alexandra watches. The group discovers that Nathan's implant has been turned off by the electrical shock, and then perform the same procedure on each other to stay outside without being tracked down. The group enters a local museum before Sean suggests that they go look for his father, Danny (Steven Mackintosh) at the school, where the files on all the people are kept. They discover that Danny is still alive, having been moved to a hotel, but are then caught and brought to a room with a deep scanner after their implants reboot. Here, Robin Smythe (Ben Kingsley) asks them how they turned off their implants. When they refuse to answer, Sean's uncle is brought in, and receives a black implant, before being subjected to a deep scan, a painful process that searches through all of a person's mental faculties before rendering them unable to eat, causing them to die in a few days. When the children still refuse to answer, Sean is also given a black implant before being subjected to a deep scan. In the midst of it, Sean insults Smythe, causing him to accidentally interrupt the deep scan, allowing Sean to escape the deep scanner alive. A few seconds later, Connor, who had been left outside, bursts in with a makeshift fireworks launcher and frees the other children. The children hide in a bowling alley, where they turn off their implants once again before running to the hotel. When a large robot walks by, the four children hide next to a doorway, where Sean inadvertently controls the robot. The children then meet Monique, a woman who wants to know how to turn off the implants. In exchange, the boys meet Swanny, who has had his implant removed by a watchmaker, and also tells the children to go to a Stone Circle. However, an announcement reveals that Sean's mother, Kate, has been taken a prisoner in the area headquarters, a castle. With Monique's help, the children successfully get to the castle. However, they are caught by a large robot. Sean then discovers that he can take control of the robots because of his black implant, after discovering that the large robot responds to his movement. Meanwhile, Smythe is speaking with Kate about how he and she could live together before an alarm goes off. Smythe leaves to go see what has happened. A few moments later, a young guard is tricked into giving the keys to the door to Kate. Meanwhile, outside, Sean appears to have been caught by the large robot, with Smythe scolding him. Sean then turns the large robot's weapon on Smythe and his team, forcing them to drop their weapons, which are picked up by the other children. Kate suddenly dashes by on a horse, causing Smythe and his team to follow. This opens the line of fire for two clankers, insectoid robots with a top-mounted weapon, which destroy the large robot, forcing Sean to hide behind it. One of the clankers then jumps down and prepares to fire at Sean, before Sean takes control of the robot and uses it to destroy the other, before commanding the clanker to deactivate. The children then track down Kate, before heading to the Stone Circle, deciphering a message written in graffiti to find the location of a human camp, an old tin mine. Meanwhile, Smythe is told by Mediator 452, a recurring character in the film, that a large number of deep scanners are arriving and that Smythe will be the first to be scanned if Sean is not captured by the time that they arrive. Sean and his friends are seen arriving at the human camp, where Sean is reunited with his father. The small group has their implants removed. The next day, the robots descend on the community seeking Sean, who is quickly discovered to be missing. Sean is seen reinstalling his black implant, before mentally controlling a robot craft that rams and destroys the cube, the local robot mothership, halting the invasion. He narrowly escapes the impact. He interfaces with a damaged Mediator, a robot in human form, and mentally sends commands to end the invasion of the Earth, destroying the robots and their craft. The film ends with jubilation as the local population celebrates in town. In the closing scene, Sean looks up at the stars.",
10]
11embeddings = model.encode(sentences)
12print(embeddings.shape)
13# [3, 768]
14
15# Get the similarity scores for the embeddings
16similarities = model.similarity(embeddings, embeddings)
17print(similarities)
18# tensor([[1.0000, 0.4836, 0.1713],
19# [0.4836, 1.0000, 0.2493],
20# [0.1713, 0.2493, 1.0000]])sentence_0 and sentence_1| sentence_0 | sentence_1 | |
|---|---|---|
| type | string | string |
| details |
|
|
| sentence_0 | sentence_1 |
|---|---|
Ted Stryker is a Canadian ex-military pilot who blames himself for the deaths of his squadron members during World War II. Despite the passage of time, this guilt continues to haunt him, causing him to have a fear of flying and of piloting again. This leads his wife, Elena, to leave him one day. Despite his phobia, Ted arrives at the airport in time to buy a ticket for the same flight to Vancouver as his wife. During the flight, some of the passengers and crew—including the pilots—suffer a bacterial infection from spoiled food. It is then discovered that Ted is the only passenger capable of taking control of the aircraft. | During the closing days of the Second World War, six members of the Royal Canadian Air Force fighter squadron led by pilot Ted Stryker are killed because of a command decision he made. Years later, in civilian life in Winnipeg, Manitoba, a guilt-stricken Stryker goes through many jobs, and his marriage is in trouble. Stryker finds a note at home: his wife Ellen has taken their young son Joey and is leaving him, flying to Vancouver. He rushes to Winnipeg Airport to board the same flight, Cross-Canada Air Lines Flight 714. He asks his wife for one last chance, but Ellen says that she can no longer love a man she does not respect. Stewardess Janet Turner begins the meal service, offering meat or fish as the choices. When a number of passengers and the co-pilot begin feeling sick, a doctor aboard determines that the fish is the cause. The pilot also becomes seriously ill and cannot fly the airplane. Before he passes out, he turns on the autopilot. The stewardess determines that Stryker is... |
A day in the life of a typical farming family in central Chile. The grandmother sells cheese by the roadside, the grandfather works in the fields, the daughter is a cook at a guesthouse, and the grandson goes to school. In four separate sections, we follow them through their small joys and sorrows, throughout a day that unabashedly reveals a changing Chile, one that few truly understand. | In 1969, at the time of the Apollo 11 mission, American soldier Dalton Joiner, fighting in the Vietnam War, uses his time of R&R supposed to be spent in Hong Kong, to fly back to the United States to re-capture the heart of his girlfriend Jane. Fellow soldier Mickey Wright accompanies him. Jane now calls herself Juniper, and is a member of a group of anti-war activists. Joiner and Wright pretend they are AWOL, and are admired by the group for that, until it is revealed that they plan to return in time. Juniper breaks up (again) with Joiner, which makes him decide to flee to Canada. Wright falls in love with Candace, but returns to Vietnam. |
Sharon Curley is 20 years old and the eldest daughter of an Irish family. She has become pregnant and refuses to reveal to anyone who the father of her unborn child is, which soon makes her the subject of neighborhood gossip. | Soon after a wild night at the pub, twenty-year-old Sharon Curley finds herself expecting a little snapper by a man she loathes. Her refusal to name the father sets in motion a family drama involving her three brothers, two sisters, and her parents, along with her employers and all her friends. Kellegher, playing the role as a coarse, earthy, yet remarkably sensible young woman soon discovers who her friends really are, as some people tease and torment her, some make remarks to her siblings, some force her father to take direct action in her defence, and all spread gossip. She decides to keep the baby (snapper) and her family, each in their own way, eventually decides to support her. Her father particularly studies up on childbirth and female anatomy (with gratifying results for his wife as a bonus). Des Curley, Sharon's father, shows the whole world in his face, his emotions ranging from outrage toward Sharon for embarrassing the family to tender concern as her time draws near. As the... |
MultipleNegativesRankingLoss with these parameters:
1{
2 "scale": 20.0,
3 "similarity_fct": "cos_sim",
4 "gather_across_devices": false
5}per_device_train_batch_size: 4per_device_eval_batch_size: 4multi_dataset_batch_sampler: round_robinoverwrite_output_dir: Falsedo_predict: Falseeval_strategy: noprediction_loss_only: Trueper_device_train_batch_size: 4per_device_eval_batch_size: 4per_gpu_train_batch_size: Noneper_gpu_eval_batch_size: Nonegradient_accumulation_steps: 1eval_accumulation_steps: Nonetorch_empty_cache_steps: Nonelearning_rate: 5e-05weight_decay: 0.0adam_beta1: 0.9adam_beta2: 0.999adam_epsilon: 1e-08max_grad_norm: 1num_train_epochs: 3max_steps: -1lr_scheduler_type: linearlr_scheduler_kwargs: Nonewarmup_ratio: 0.0warmup_steps: 0log_level: passivelog_level_replica: warninglog_on_each_node: Truelogging_nan_inf_filter: Truesave_safetensors: Truesave_on_each_node: Falsesave_only_model: Falserestore_callback_states_from_checkpoint: Falseno_cuda: Falseuse_cpu: Falseuse_mps_device: Falseseed: 42data_seed: Nonejit_mode_eval: Falsebf16: Falsefp16: Falsefp16_opt_level: O1half_precision_backend: autobf16_full_eval: Falsefp16_full_eval: Falsetf32: Nonelocal_rank: 0ddp_backend: Nonetpu_num_cores: Nonetpu_metrics_debug: Falsedebug: []dataloader_drop_last: Falsedataloader_num_workers: 0dataloader_prefetch_factor: Nonepast_index: -1disable_tqdm: Falseremove_unused_columns: Truelabel_names: Noneload_best_model_at_end: Falseignore_data_skip: Falsefsdp: []fsdp_min_num_params: 0fsdp_config: {'min_num_params': 0, 'xla': False, 'xla_fsdp_v2': False, 'xla_fsdp_grad_ckpt': False}fsdp_transformer_layer_cls_to_wrap: Noneaccelerator_config: {'split_batches': False, 'dispatch_batches': None, 'even_batches': True, 'use_seedable_sampler': True, 'non_blocking': False, 'gradient_accumulation_kwargs': None}parallelism_config: Nonedeepspeed: Nonelabel_smoothing_factor: 0.0optim: adamw_torch_fusedoptim_args: Noneadafactor: Falsegroup_by_length: Falselength_column_name: lengthproject: huggingfacetrackio_space_id: trackioddp_find_unused_parameters: Noneddp_bucket_cap_mb: Noneddp_broadcast_buffers: Falsedataloader_pin_memory: Truedataloader_persistent_workers: Falseskip_memory_metrics: Trueuse_legacy_prediction_loop: Falsepush_to_hub: Falseresume_from_checkpoint: Nonehub_model_id: Nonehub_strategy: every_savehub_private_repo: Nonehub_always_push: Falsehub_revision: Nonegradient_checkpointing: Falsegradient_checkpointing_kwargs: Noneinclude_inputs_for_metrics: Falseinclude_for_metrics: []eval_do_concat_batches: Truefp16_backend: autopush_to_hub_model_id: Nonepush_to_hub_organization: Nonemp_parameters:auto_find_batch_size: Falsefull_determinism: Falsetorchdynamo: Noneray_scope: lastddp_timeout: 1800torch_compile: Falsetorch_compile_backend: Nonetorch_compile_mode: Noneinclude_tokens_per_second: Falseinclude_num_input_tokens_seen: noneftune_noise_alpha: Noneoptim_target_modules: Nonebatch_eval_metrics: Falseeval_on_start: Falseuse_liger_kernel: Falseliger_kernel_config: Noneeval_use_gather_object: Falseaverage_tokens_across_devices: Trueprompts: Nonebatch_sampler: batch_samplermulti_dataset_batch_sampler: round_robinrouter_mapping: {}learning_rate_mapping: {}| Epoch | Step | Training Loss |
|---|---|---|
| 0.8547 | 500 | 0.5078 |
| 1.7094 | 1000 | 0.2785 |
| 2.5641 | 1500 | 0.0663 |
1@inproceedings{reimers-2019-sentence-bert,
2 title = "Sentence-BERT: Sentence Embeddings using Siamese BERT-Networks",
3 author = "Reimers, Nils and Gurevych, Iryna",
4 booktitle = "Proceedings of the 2019 Conference on Empirical Methods in Natural Language Processing",
5 month = "11",
6 year = "2019",
7 publisher = "Association for Computational Linguistics",
8 url = "https://arxiv.org/abs/1908.10084",
9}1@misc{henderson2017efficient,
2 title={Efficient Natural Language Response Suggestion for Smart Reply},
3 author={Matthew Henderson and Rami Al-Rfou and Brian Strope and Yun-hsuan Sung and Laszlo Lukacs and Ruiqi Guo and Sanjiv Kumar and Balint Miklos and Ray Kurzweil},
4 year={2017},
5 eprint={1705.00652},
6 archivePrefix={arXiv},
7 primaryClass={cs.CL}
8}