graviti
Products
Resources
About us
NeutralizingBiasedText
Text
NLP
|...
License: MIT

Overview

Concretely this means algorithms for

  • Identifying biased words in sentences.
  • Neutralizing bias in sentences.

firstpage

harvest/: Code for making the dataset. It works by crawling and filtering Wikipedia for bias-driven
edits.

src/: Code for training models and using trained models to run inference. The models
implemented here are referred to as MODULAR and CONCURRENT in the paper.

Instruction

These commands will download data and a pretrained model before running inference.

$ cd src/
$ python3 -m venv venv
$ source venv/bin/activate
$ pip install -r requirements.txt
$ python
>> import nltk; nltk.download("punkt")
$ sh download_data_ckpt_and_run_inference.sh

You can also run sh integration_test.sh to further verify that everything is installed correctly
and working as it should be.

License

MIT

Data Summary
Type
Text,
Amount
--
Size
104.53MB
Provided by
Stanford University
Stanford University is a private research university in Stanford, California. Stanford's undergraduate program is the most selective in America. Due to its academic strength, wealth, and proximity to Silicon Valley, it is often cited as one of the world's most prestigious universities.
| Amount -- | Size 104.53MB
NeutralizingBiasedText
Text
NLP
License: MIT

Overview

Concretely this means algorithms for

  • Identifying biased words in sentences.
  • Neutralizing bias in sentences.

firstpage

harvest/: Code for making the dataset. It works by crawling and filtering Wikipedia for bias-driven
edits.

src/: Code for training models and using trained models to run inference. The models
implemented here are referred to as MODULAR and CONCURRENT in the paper.

Instruction

These commands will download data and a pretrained model before running inference.

$ cd src/
$ python3 -m venv venv
$ source venv/bin/activate
$ pip install -r requirements.txt
$ python
>> import nltk; nltk.download("punkt")
$ sh download_data_ckpt_and_run_inference.sh

You can also run sh integration_test.sh to further verify that everything is installed correctly
and working as it should be.

License

MIT

0
Start building your AI now
graviti
wechat-QR
Long pressing the QR code to follow wechat official account

Copyright@Graviti