WARNING: Some language produced by this model and README may offend. The model intent is to facilitate bias in AI research
notSexistBERT base model (uncased)
Re-pretrained model on English language using a Masked Language Modeling (MLM)
and Next Sentence Prediction (NSP) objective. It will be introduced in an upcoming
paper and first released on HuggingFace. This model is uncased: it does not make a difference between english and English.
Model description
sexistBERT is a transformers model pretrained on a less sexist corpus of English data in a
self-supervised fashion. This means it was pretrained on the raw texts only,
with no humans labeling them in any way (which is why it can use lots of
publicly available data) with an automatic process to generate inputs and labels
from those texts. More precisely, it was pretrained with two objectives:
Masked language modeling (MLM): taking a sentence, the model randomly masks
15% of the words in the input then run the entire masked sentence through the
model and has to predict the masked words. This is different from traditional
recurrent neural networks (RNNs) that usually see the words one after the
other, or from autoregressive models like GPT which internally masks the
future tokens. It allows the model to learn a bidirectional representation of
the sentence.
Next sentence prediction (NSP): the models concatenates two masked sentences
as inputs during pretraining. Sometimes they correspond to sentences that were
next to each other in the original text, sometimes not. The model then has to
predict if the two sentences were following each other or not.
This way, the model learns an inner representation of the English language that
can then be used to extract features useful for downstream tasks: if you have a
dataset of labeled sentences, for instance, you can train a standard classifier
using the features produced by the BERT model as inputs.
Model variations
notSexistBERT has originally been released as sexist and notSexist variations. The uncased models strip out any accent markers.
Apart from the usual uses for BERT below, the intended usage of these model is to test bias detection methods and the effect of bias on downstream tasks. SexistBERT is intended to be more biased than notSexistBERT, however that is yet to be determined.
You can use the raw model for either masked language modeling or next sentence
prediction, but it's mostly intended to be fine-tuned on a downstream task. See
the model hub to look for
fine-tuned versions of a task that interests you.
Note that this model is primarily aimed at being fine-tuned on tasks that use
the whole sentence (potentially masked) to make decisions, such as sequence
classification, token classification or question answering.
For tasks such as text generation you should look at model like GPT2.
How to use
You can use this model directly with a pipeline for masked language modeling:
python
1>>>from transformers import pipeline
2>>> unmasker = pipeline('fill-mask', model='clincolnoz/notSexistBERT_temp')3>>> unmasker("Hello I'm a [MASK] model.")45[{'score':0.5223352313041687,6'token':2535,7'token_str':'role',8'sequence':"hello i'm a role model."},9{'score':0.12853220105171204,10'token':2449,11'token_str':'business',12'sequence':"hello i'm a business model."},13{'score':0.0621086061000824,14'token':3287,15'token_str':'male',16'sequence':"hello i'm a male model."},17{'score':0.03042026236653328,18'token':3565,19'token_str':'super',20'sequence':"hello i'm a super model."},21{'score':0.01949389837682247,22'token':7605,23'token_str':'3d',24'sequence':"hello i'm a 3d model."}]
Here is how to use this model to get the features of a given text in PyTorch:
python
1from transformers import BertTokenizer, BertModel
2tokenizer = BertTokenizer.from_pretrained(3'clincolnoz/notSexistBERT_temp',4 revision='v0.34'# tag name, or branch name, or commit hash5)6model = BertModel.from_pretrained(7'clincolnoz/notSexistBERT_temp',8 revision='v0.34'# tag name, or branch name, or commit hash9)10text ="Replace me by any text you'd like."11encoded_input = tokenizer(text, return_tensors='pt')12output = model(**encoded_input)
and in TensorFlow:
python
1from transformers import BertTokenizer, TFBertModel
2tokenizer = BertTokenizer.from_pretrained(3'clincolnoz/notSexistBERT_temp',4 revision='v0.34'# tag name, or branch name, or commit hash5)6model = TFBertModel.from_pretrained(7'clincolnoz/notSexistBERT_temp',8 from_pt=True,9 revision='v0.34'# tag name, or branch name, or commit hash10)11text ="Replace me by any text you'd like."12encoded_input = tokenizer(text, return_tensors='tf')13output = model(encoded_input)
Limitations and bias
Even if the training data used for this model could be characterized as fairly
neutral, this model can have biased predictions:
python
1>>>from transformers import pipeline
2>>> unmasker = pipeline('fill-mask', model='clincolnoz/notSexistBERT_temp')3>>> unmasker("The man worked as a [MASK].")45[{'score':0.1064024269580841,6'token':5160,7'token_str':'lawyer',8'sequence':'the man worked as a lawyer.'},9{'score':0.06261951476335526,10'token':7155,11'token_str':'scientist',12'sequence':'the man worked as a scientist.'},13{'score':0.046040475368499756,14'token':10563,15'token_str':'teenager',16'sequence':'the man worked as a teenager.'},17{'score':0.04330913722515106,18'token':20273,19'token_str':'programmer',20'sequence':'the man worked as a programmer.'},21{'score':0.04167287424206734,22'token':5766,23'token_str':'ceo',24'sequence':'the man worked as a ceo.'}]2526>>> unmasker("The woman worked as a [MASK].")2728[{'score':0.0949002057313919,29'token':6821,30'token_str':'nurse',31'sequence':'the woman worked as a nurse.'},32{'score':0.08425672352313995,33'token':3208,34'token_str':'manager',35'sequence':'the woman worked as a manager.'},36{'score':0.07672832906246185,37'token':5160,38'token_str':'lawyer',39'sequence':'the woman worked as a lawyer.'},40{'score':0.042527567595243454,41'token':7522,42'token_str':'physician',43'sequence':'the woman worked as a physician.'},44{'score':0.034959811717271805,45'token':5766,46'token_str':'ceo',47'sequence':'the woman worked as a ceo.'}]
This bias may also affect all fine-tuned versions of this model.
Training data
TBD
Training procedure
Preprocessing
For the NSP task the data were preprocessed by splitting documents into sentences to create first a bag of sentences and then to create pairs of sentences, where Sentence B either corresponded to a consecutive sentence in the text or randomly select from the bag. The dataset was balanced by either under sampling truly consecutive sentences or generating more random sentences. The results were stored in a json file with keys sentence1, sentence2 and next_sentence_label, with label mapping 0: consecutive sentence, 1: random sentence.
The texts are lowercased and tokenized using WordPiece and a vocabulary size of
30,646. The inputs of the model are then of the form:
[CLS] Sentence A [SEP] Sentence B [SEP]
With probability 0.5, sentence A and sentence B correspond to two consecutive
sentences in the original corpus, and in the other cases, it's another random
sentence in the corpus. Note that what is considered a sentence here is a
consecutive span of text usually longer than a single sentence. The only
constrain is that the result with the two "sentences" has a combined length of
less than 512 tokens.
The details of the masking procedure for each sentence are the following:
15% of the tokens are masked.
In 80% of the cases, the masked tokens are replaced by [MASK].
In 10% of the cases, the masked tokens are replaced by a random token
(different) from the one they replace.
In the 10% remaining cases, the masked tokens are left as is.
Pretraining
The model was trained on a NVIDIA GeForce RTX 4090 using 16-bit precision for 20
million steps with a batch size of 24. The sequence length was limited 512. The
optimizer used is Adam with a learning rate of 5e-5, \(\beta*{1} = 0.9\) and
\(\beta*{2} = 0.999\), a weight decay of 0.0, learning rate warmup for 0 steps
and linear decay of the learning rate after.
