rivenraider/open-instruct-uncensored
rivenraider/open-instruct-uncensored
Watch
1
0
Fork
You've already forked open-instruct-uncensored
 0
mirror of https://huggingface.co/datasets/QuixiAI/open-instruct-uncensored synced 2026-09-11 11:07:35 +02:00
Code Issues Projects Releases Packages Wiki Activity
No description
4 commits 1 branch 0 tags 3.5 GiB
  • Python 100%
Find a file
Exact
Repository files (latest commit first)
Filename Latest commit message Latest commit date
Eric Hartford 7d2c87d9e3 Update README.md
2023-06-22 18:41:10 +00:00
.gitattributes Upload 3 files 2023-06-22 17:13:59 +00:00
open-instruct-uncensored.jsonl Upload 3 files 2023-06-22 17:13:59 +00:00
open-instruct.jsonl Upload 3 files 2023-06-22 17:13:59 +00:00
README.md Update README.md 2023-06-22 18:41:10 +00:00
remove_refusals.py Upload 3 files 2023-06-22 17:13:59 +00:00

README.md

license
apache-2.0

This is Allen AI's open-instruct dataset.

It is used to train the Tulu family of models.

I have done the following:

  1. Download the open-instruct repo
  2. Execute the scripts/prepare_train_data.sh modified to download the "unfiltered" version of sharegpt dataset
  3. Merged data/processed/**/*.jsonl into a single "open-instruct.jsonl"
  4. Executed my "remove_refusals.py" against that "open-instruct.jsonl" to produce a "open-instruct-uncensored.jsonl"

I am currently training this "open-instruct-uncensored.jsonl" to a new model series named ehartford/tulu-uncensored

More info to come.