Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

batch size is creating confusion [ when we compare with Research Paper ] #57

Open
ahmadshabbir2468 opened this issue Aug 19, 2019 · 0 comments

Comments

@ahmadshabbir2468
Copy link

ahmadshabbir2468 commented Aug 19, 2019

Research Paper Says :

Each batch contains a list of sentences which is determined by the parameter of batch size. In our experiments, we use batch size of 100 which means to include sentences whose total length is no greater than 100
(what i understand
Total length is no greater than 100 means : Sentence length including white space should less then 100
i.e this sentence "LSTM CRF" length is 8 as it include 8 character in it ) am i Right?

[](Research Paper links https://arxiv.org/pdf/1508.01991.pdf)

what should we do for long sentence ??

lstm_crf main.py

   params = {
        'dim': 300,
        'dropout': 0.5,
        'num_oov_buckets': 1,
        'epochs': 25,
        'batch_size': 20,
        'buffer': 15000,
        'lstm_size': 100,
        'words': str(Path(DATADIR, 'vocab.words.txt')),
        'chars': str(Path(DATADIR, 'vocab.chars.txt')),
        'tags': str(Path(DATADIR, 'vocab.tags.txt')),
        'glove': str(Path(DATADIR, 'glove.npz'))
    }

@ahmadshabbir2468 ahmadshabbir2468 changed the title batch size is creating confusion ? batch size is creating confusion [ when we compare with Research Paper ] Aug 19, 2019
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant