Gender bias in BERT
Visualizations can be used to compare models according to their word embedding spaces. By measuring the similarity between words in the model’s parameter space for specific concepts (e.g., stereotypical words and different gender), we can see associations that the models have learned from the training data.