Skip to content

TrentBrick/tail-sampling

BranchesTags

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

129 Commits
.ipynb_checkpoints
.ipynb_checkpoints
 
 
ImageOutputs
ImageOutputs
 
 
MTurk_Data
MTurk_Data
 
 
Pickles
Pickles
 
 
__pycache__
__pycache__
 
 
gpt-2_output
gpt-2_output
 
 
.DS_Store
.DS_Store
 
 
.gitignore
.gitignore
 
 
.~lock.Trenton_Ranking_WP_Gens.xlsx#
.~lock.Trenton_Ranking_WP_Gens.xlsx#
 
 
AnalyzeLogits-AllSameLogit.ipynb
AnalyzeLogits-AllSameLogit.ipynb
 
 
AnalyzeLogits.ipynb
AnalyzeLogits.ipynb
 
 
AnalyzeMTurk.ipynb
AnalyzeMTurk.ipynb
 
 
BlogPostFigures.ipynb
BlogPostFigures.ipynb
 
 
DeTokenizeWordPrompts.ipynb
DeTokenizeWordPrompts.ipynb
 
 
EvaluateSamples.ipynb
EvaluateSamples.ipynb
 
 
Human_StoryPrompts_Completion.csv
Human_StoryPrompts_Completion.csv
 
 
LookAtGenerationPaths.ipynb
LookAtGenerationPaths.ipynb
 
 
MTURK_QUESTIONS_THREE__backup_of_different_prob_slices.csv
MTURK_QUESTIONS_THREE__backup_of_different_prob_slices.csv
 
 
Min_Max_Disagreement_Coords.csv
Min_Max_Disagreement_Coords.csv
 
 
Min_Max_Disagreement_Coords_TFS90.csv
Min_Max_Disagreement_Coords_TFS90.csv
 
 
ModelLogitCorrelations.ipynb
ModelLogitCorrelations.ipynb
 
 
ProbOfBadSample.ipynb
ProbOfBadSample.ipynb
 
 
ProbabilityLocations-EvaluateSamples.ipynb
ProbabilityLocations-EvaluateSamples.ipynb
 
 
ProbeTheEncoding.ipynb
ProbeTheEncoding.ipynb
 
 
README.md
README.md
 
 
RefineTFSApproach.ipynb
RefineTFSApproach.ipynb
 
 
Scratch.ipynb
Scratch.ipynb
 
 
TailLocationsEvaluateSamples.ipynb
TailLocationsEvaluateSamples.ipynb
 
 
TemperatureAnalysis.ipynb
TemperatureAnalysis.ipynb
 
 
TimeCalculator.ipynb
TimeCalculator.ipynb
 
 
Untitled.ipynb
Untitled.ipynb
 
 
VocabDiversityAnalysis.ipynb
VocabDiversityAnalysis.ipynb
 
 
backup_of_different_tail_slices.csv
backup_of_different_tail_slices.csv
 
 
decodeLogits.py
decodeLogits.py
 
 
encoder.json
encoder.json
 
 
encoder.py
encoder.py
 
 
generate_mech_turk.py
generate_mech_turk.py
 
 
generate_vocab_diversity.py
generate_vocab_diversity.py
 
 
get_perplexities.py
get_perplexities.py
 
 
interactive_conditional_samples.py
interactive_conditional_samples.py
 
 
managing_vocab_diversity.py
managing_vocab_diversity.py
 
 
mech_turk_manager.py
mech_turk_manager.py
 
 
model.py
model.py
 
 
perplexities_calculations.py
perplexities_calculations.py
 
 
sample.py
sample.py
 
 
sample_diff_experiments.py
sample_diff_experiments.py
 
 
sample_mech_turk.py
sample_mech_turk.py
 
 
test_dataframe_500primer.csv
test_dataframe_500primer.csv
 
 
test_dataframe_500primer_only.csv
test_dataframe_500primer_only.csv
 
 
time_diff_experiments.py
time_diff_experiments.py
 
 
utils.py
utils.py
 
 
vocab.bpe
vocab.bpe
 
 

Repository files navigation

Here is all of my analysis for the Tail Free Sampling Blog post: https://trentbrick.github.io/Tail-Free-Sampling/

If you are interested in using Tail Free Sampling, see this repository for an implementation in Tensorflow (tested up to 1.14 but should also work for 2.0). This code should also be trivial to implement in Pytorch.

About

No description, website, or topics provided.

Resources

Readme
Activity

Stars

3 stars

Watchers

1 watching

Forks

0 forks
Report repository

Releases

No releases published

Packages

No packages published

Languages