Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Problems for training #28

Open
xiran2018 opened this issue Jun 17, 2021 · 5 comments
Open

Problems for training #28

xiran2018 opened this issue Jun 17, 2021 · 5 comments

Comments

@xiran2018
Copy link

The environment is：
Python 3.6 and PyTorch 1.5.

when i run the code，it occurs the following problem. I don't know why？

XXX$CUDA_VISIBLE_DEVICES=1 python t2vec.py -vocab_size 18864 -criterion_name "KLDIV" -knearestvocabs "porto-vocab-dist-cell100.h5"

Namespace(batch=128, bidirectional=True, bucketsize=[(20, 30), (30, 30), (30, 50), (50, 50), (50, 70), (70, 70), (70, 100), (100, 100)], checkpoint='/home/ucas/jingquanliang/SimSub/data/checkpoint.pt', criterion_name='KLDIV', cuda=True, data='/home/ucas/jingquanliang/SimSub/data', discriminative_w=0.1, dist_decay_speed=0.8, dropout=0.2, embedding_size=256, epochs=15, generator_batch=32, hidden_size=256, knearestvocabs='porto-vocab-dist-cell100.h5', learning_rate=0.001, max_grad_norm=5.0, max_length=200, max_num_line=20000000, mode=0, num_layers=3, prefix='exp', pretrained_embedding=None, print_freq=50, save_freq=1000, start_iteration=0, t2vec_batch=256, use_discriminative=False, vocab_size=18864)
Reading training data...
Read line 500000
Read line 1000000
Read line 1500000
Read line 2000000
Read line 2500000
Read line 3000000
Read line 3500000
Read line 4000000
Read line 4500000
Read line 5000000
Read line 5500000
Read line 6000000
Read line 6500000
Read line 7000000
Read line 7500000
Read line 8000000
Read line 8500000
Read line 9000000
Read line 9500000
Read line 10000000
Read line 10500000
Read line 11000000
Read line 11500000
Read line 12000000
Read line 12500000
Read line 13000000
Read line 13500000
Read line 14000000
Read line 14500000
Read line 15000000
Read line 15500000
Read line 16000000
Read line 16500000
/home/ucas/jingquanliang/SimSub/ori-t2vec/data_utils.py:155: VisibleDeprecationWarning: Creating an ndarray from ragged nested sequences (which is a list-or-tuple of lists-or-tuples-or ndarrays with different lengths or shapes) is deprecated. If you meant to do this, you must specify 'dtype=object' when creating the ndarray
self.srcdata = list(map(np.array, self.srcdata))
/home/ucas/jingquanliang/SimSub/ori-t2vec/data_utils.py:156: VisibleDeprecationWarning: Creating an ndarray from ragged nested sequences (which is a list-or-tuple of lists-or-tuples-or ndarrays with different lengths or shapes) is deprecated. If you meant to do this, you must specify 'dtype=object' when creating the ndarray
self.trgdata = list(map(np.array, self.trgdata))
Allocation: [5452031, 1661741, 4455989, 2563116, 1595830, 647973, 247370, 87910]
Percent: [0.32623528 0.09943424 0.26663473 0.15337016 0.0954903 0.03877301
0.01480197 0.0052603 ]
Reading validation data...
/home/ucas/jingquanliang/SimSub/ori-t2vec/data_utils.py:148: VisibleDeprecationWarning: Creating an ndarray from ragged nested sequences (which is a list-or-tuple of lists-or-tuples-or ndarrays with different lengths or shapes) is deprecated. If you meant to do this, you must specify 'dtype=object' when creating the ndarray
self.srcdata = np.array(merge(*self.srcdata))
/home/ucas/jingquanliang/SimSub/ori-t2vec/data_utils.py:149: VisibleDeprecationWarning: Creating an ndarray from ragged nested sequences (which is a list-or-tuple of lists-or-tuples-or ndarrays with different lengths or shapes) is deprecated. If you meant to do this, you must specify 'dtype=object' when creating the ndarray
self.trgdata = np.array(merge(*self.trgdata))
Loaded validation data size 167520
Loading vocab distance file /home/ucas/jingquanliang/SimSub/data/porto-vocab-dist-cell100.h5...
=> training with GPU
=> no checkpoint found at '/home/ucas/jingquanliang/SimSub/data/checkpoint.pt'
Iteration starts at 0 and will end at 66999
/home/ucas/jingquanliang/SimSub/ori-t2vec/data_utils.py:46: VisibleDeprecationWarning: Creating an ndarray from ragged nested sequences (which is a list-or-tuple of lists-or-tuples-or ndarrays with different lengths or shapes) is deprecated. If you meant to do this, you must specify 'dtype=object' when creating the ndarray
src = list(np.array(src)[idx])
/home/ucas/jingquanliang/SimSub/ori-t2vec/data_utils.py:47: VisibleDeprecationWarning: Creating an ndarray from ragged nested sequences (which is a list-or-tuple of lists-or-tuples-or ndarrays with different lengths or shapes) is deprecated. If you meant to do this, you must specify 'dtype=object' when creating the ndarray
trg = list(np.array(trg)[idx])
Iteration: 0 Generative Loss: 5.399 Discriminative Cross Loss: 0.000 Discriminative Inner Loss: 0.000
/opt/conda/conda-bld/pytorch_1591914838379/work/aten/src/THC/THCTensorIndex.cu:272: indexSelectLargeIndex: block: [535,0,0], thread: [0,0,0] Assertion srcIndex < srcSelectDimSize failed.
/opt/conda/conda-bld/pytorch_1591914838379/work/aten/src/THC/THCTensorIndex.cu:272: indexSelectLargeIndex: block: [535,0,0], thread: [1,0,0] Assertion srcIndex < srcSelectDimSize failed.
/opt/conda/conda-bld/pytorch_1591914838379/work/aten/src/THC/THCTensorIndex.cu:272: indexSelectLargeIndex: block: [535,0,0], thread: [2,0,0] Assertion srcIndex < srcSelectDimSize failed.
/opt/conda/conda-bld/pytorch_1591914838379/work/aten/src/THC/THCTensorIndex.cu:272: indexSelectLargeIndex: block: [535,0,0], thread: [3,0,0] Assertion srcIndex < srcSelectDimSize failed.
/opt/conda/conda-bld/pytorch_1591914838379/work/aten/src/THC/THCTensorIndex.cu:272: indexSelectLargeIndex: block: [535,0,0], thread: [4,0,0] Assertion srcIndex < srcSelectDimSize failed.
/opt/conda/conda-bld/pytorch_1591914838379/work/aten/src/THC/THCTensorIndex.cu:272: indexSelectLargeIndex: block: [535,0,0], thread: [5,0,0] Assertion srcIndex < srcSelectDimSize failed.
/opt/conda/conda-bld/pytorch_1591914838379/work/aten/src/THC/THCTensorIndex.cu:272: indexSelectLargeIndex: block: [535,0,0], thread: [6,0,0] Assertion srcIndex < srcSelectDimSize failed.
/opt/conda/conda-bld/pytorch_1591914838379/work/aten/src/THC/THCTensorIndex.cu:272: indexSelectLargeIndex: block: [535,0,0], thread: [7,0,0] Assertion srcIndex < srcSelectDimSize failed.
/opt/conda/conda-bld/pytorch_1591914838379/work/aten/src/THC/THCTensorIndex.cu:272: indexSelectLargeIndex: block: [535,0,0], thread: [8,0,0] Assertion srcIndex < srcSelectDimSize failed.
/opt/conda/conda-bld/pytorch_1591914838379/work/aten/src/THC/THCTensorIndex.cu:272: indexSelectLargeIndex: block: [535,0,0], thread: [9,0,0] Assertion srcIndex < srcSelectDimSize failed.
/opt/conda/conda-bld/pytorch_1591914838379/work/aten/src/THC/THCTensorIndex.cu:272: indexSelectLargeIndex: block: [535,0,0], thread: [10,0,0] Assertion srcIndex < srcSelectDimSize failed.
/opt/conda/conda-bld/pytorch_1591914838379/work/aten/src/THC/THCTensorIndex.cu:272: indexSelectLargeIndex: block: [535,0,0], thread: [11,0,0] Assertion srcIndex < srcSelectDimSize failed.
/opt/conda/conda-bld/pytorch_1591914838379/work/aten/src/THC/THCTensorIndex.cu:272: indexSelectLargeIndex: block: [535,0,0], thread: [12,0,0] Assertion srcIndex < srcSelectDimSize failed.
/opt/conda/conda-bld/pytorch_1591914838379/work/aten/src/THC/THCTensorIndex.cu:272: indexSelectLargeIndex: block: [535,0,0], thread: [13,0,0] Assertion srcIndex < srcSelectDimSize failed.
/opt/conda/conda-bld/pytorch_1591914838379/work/aten/src/THC/THCTensorIndex.cu:272: indexSelectLargeIndex: block: [535,0,0], thread: [14,0,0] Assertion srcIndex < srcSelectDimSize failed.
/opt/conda/conda-bld/pytorch_1591914838379/work/aten/src/THC/THCTensorIndex.cu:272: indexSelectLargeIndex: block: [535,0,0], thread: [15,0,0] Assertion srcIndex < srcSelectDimSize failed.
/opt/conda/conda-bld/pytorch_1591914838379/work/aten/src/THC/THCTensorIndex.cu:272: indexSelectLargeIndex: block: [535,0,0], thread: [16,0,0] Assertion srcIndex < srcSelectDimSize failed.
/opt/conda/conda-bld/pytorch_1591914838379/work/aten/src/THC/THCTensorIndex.cu:272: indexSelectLargeIndex: block: [535,0,0], thread: [17,0,0] Assertion srcIndex < srcSelectDimSize failed.
/opt/conda/conda-bld/pytorch_1591914838379/work/aten/src/THC/THCTensorIndex.cu:272: indexSelectLargeIndex: block: [535,0,0], thread: [18,0,0] Assertion srcIndex < srcSelectDimSize failed.
/opt/conda/conda-bld/pytorch_1591914838379/work/aten/src/THC/THCTensorIndex.cu:272: indexSelectLargeIndex: block: [535,0,0], thread: [19,0,0] Assertion srcIndex < srcSelectDimSize failed.
/opt/conda/conda-bld/pytorch_1591914838379/work/aten/src/THC/THCTensorIndex.cu:272: indexSelectLargeIndex: block: [535,0,0], thread: [20,0,0] Assertion srcIndex < srcSelectDimSize failed.
/opt/conda/conda-bld/pytorch_1591914838379/work/aten/src/THC/THCTensorIndex.cu:272: indexSelectLargeIndex: block: [535,0,0], thread: [21,0,0] Assertion srcIndex < srcSelectDimSize failed.
/opt/conda/conda-bld/pytorch_1591914838379/work/aten/src/THC/THCTensorIndex.cu:272: indexSelectLargeIndex: block: [535,0,0], thread: [22,0,0] Assertion srcIndex < srcSelectDimSize failed.
/opt/conda/conda-bld/pytorch_1591914838379/work/aten/src/THC/THCTensorIndex.cu:272: indexSelectLargeIndex: block: [535,0,0], thread: [23,0,0] Assertion srcIndex < srcSelectDimSize failed.
/opt/conda/conda-bld/pytorch_1591914838379/work/aten/src/THC/THCTensorIndex.cu:272: indexSelectLargeIndex: block: [535,0,0], thread: [24,0,0] Assertion srcIndex < srcSelectDimSize failed.
/opt/conda/conda-bld/pytorch_1591914838379/work/aten/src/THC/THCTensorIndex.cu:272: indexSelectLargeIndex: block: [535,0,0], thread: [25,0,0] Assertion srcIndex < srcSelectDimSize failed.
/opt/conda/conda-bld/pytorch_1591914838379/work/aten/src/THC/THCTensorIndex.cu:272: indexSelectLargeIndex: block: [535,0,0], thread: [26,0,0] Assertion srcIndex < srcSelectDimSize failed.
/opt/conda/conda-bld/pytorch_1591914838379/work/aten/src/THC/THCTensorIndex.cu:272: indexSelectLargeIndex: block: [535,0,0], thread: [27,0,0] Assertion srcIndex < srcSelectDimSize failed.
/opt/conda/conda-bld/pytorch_1591914838379/work/aten/src/THC/THCTensorIndex.cu:272: indexSelectLargeIndex: block: [535,0,0], thread: [28,0,0] Assertion srcIndex < srcSelectDimSize failed.
/opt/conda/conda-bld/pytorch_1591914838379/work/aten/src/THC/THCTensorIndex.cu:272: indexSelectLargeIndex: block: [535,0,0], thread: [29,0,0] Assertion srcIndex < srcSelectDimSize failed.
/opt/conda/conda-bld/pytorch_1591914838379/work/aten/src/THC/THCTensorIndex.cu:272: indexSelectLargeIndex: block: [535,0,0], thread: [30,0,0] Assertion srcIndex < srcSelectDimSize failed.
/opt/conda/conda-bld/pytorch_1591914838379/work/aten/src/THC/THCTensorIndex.cu:272: indexSelectLargeIndex: block: [535,0,0], thread: [31,0,0] Assertion srcIndex < srcSelectDimSize failed.
/opt/conda/conda-bld/pytorch_1591914838379/work/aten/src/THC/THCTensorIndex.cu:272: indexSelectLargeIndex: block: [535,0,0], thread: [32,0,0] Assertion srcIndex < srcSelectDimSize failed.
/opt/conda/conda-bld/pytorch_1591914838379/work/aten/src/THC/THCTensorIndex.cu:272: indexSelectLargeIndex: block: [535,0,0], thread: [33,0,0] Assertion srcIndex < srcSelectDimSize failed.
/opt/conda/conda-bld/pytorch_1591914838379/work/aten/src/THC/THCTensorIndex.cu:272: indexSelectLargeIndex: block: [535,0,0], thread: [34,0,0] Assertion srcIndex < srcSelectDimSize failed.
/opt/conda/conda-bld/pytorch_1591914838379/work/aten/src/THC/THCTensorIndex.cu:272: indexSelectLargeIndex: block: [535,0,0], thread: [35,0,0] Assertion srcIndex < srcSelectDimSize failed.
/opt/conda/conda-bld/pytorch_1591914838379/work/aten/src/THC/THCTensorIndex.cu:272: indexSelectLargeIndex: block: [535,0,0], thread: [36,0,0] Assertion srcIndex < srcSelectDimSize failed.
/opt/conda/conda-bld/pytorch_1591914838379/work/aten/src/THC/THCTensorIndex.cu:272: indexSelectLargeIndex: block: [535,0,0], thread: [37,0,0] Assertion srcIndex < srcSelectDimSize failed.
/opt/conda/conda-bld/pytorch_1591914838379/work/aten/src/THC/THCTensorIndex.cu:272: indexSelectLargeIndex: block: [535,0,0], thread: [38,0,0] Assertion srcIndex < srcSelectDimSize failed.
/opt/conda/conda-bld/pytorch_1591914838379/work/aten/src/THC/THCTensorIndex.cu:272: indexSelectLargeIndex: block: [535,0,0], thread: [39,0,0] Assertion srcIndex < srcSelectDimSize failed.
/opt/conda/conda-bld/pytorch_1591914838379/work/aten/src/THC/THCTensorIndex.cu:272: indexSelectLargeIndex: block: [535,0,0], thread: [40,0,0] Assertion srcIndex < srcSelectDimSize failed.
/opt/conda/conda-bld/pytorch_1591914838379/work/aten/src/THC/THCTensorIndex.cu:272: indexSelectLargeIndex: block: [535,0,0], thread: [41,0,0] Assertion srcIndex < srcSelectDimSize failed.
/opt/conda/conda-bld/pytorch_1591914838379/work/aten/src/THC/THCTensorIndex.cu:272: indexSelectLargeIndex: block: [535,0,0], thread: [42,0,0] Assertion srcIndex < srcSelectDimSize failed.
/opt/conda/conda-bld/pytorch_1591914838379/work/aten/src/THC/THCTensorIndex.cu:272: indexSelectLargeIndex: block: [535,0,0], thread: [43,0,0] Assertion srcIndex < srcSelectDimSize failed.
/opt/conda/conda-bld/pytorch_1591914838379/work/aten/src/THC/THCTensorIndex.cu:272: indexSelectLargeIndex: block: [535,0,0], thread: [44,0,0] Assertion srcIndex < srcSelectDimSize failed.
/opt/conda/conda-bld/pytorch_1591914838379/work/aten/src/THC/THCTensorIndex.cu:272: indexSelectLargeIndex: block: [535,0,0], thread: [45,0,0] Assertion srcIndex < srcSelectDimSize failed.
/opt/conda/conda-bld/pytorch_1591914838379/work/aten/src/THC/THCTensorIndex.cu:272: indexSelectLargeIndex: block: [535,0,0], thread: [46,0,0] Assertion srcIndex < srcSelectDimSize failed.
/opt/conda/conda-bld/pytorch_1591914838379/work/aten/src/THC/THCTensorIndex.cu:272: indexSelectLargeIndex: block: [535,0,0], thread: [47,0,0] Assertion srcIndex < srcSelectDimSize failed.
/opt/conda/conda-bld/pytorch_1591914838379/work/aten/src/THC/THCTensorIndex.cu:272: indexSelectLargeIndex: block: [535,0,0], thread: [48,0,0] Assertion srcIndex < srcSelectDimSize failed.
/opt/conda/conda-bld/pytorch_1591914838379/work/aten/src/THC/THCTensorIndex.cu:272: indexSelectLargeIndex: block: [535,0,0], thread: [49,0,0] Assertion srcIndex < srcSelectDimSize failed.
/opt/conda/conda-bld/pytorch_1591914838379/work/aten/src/THC/THCTensorIndex.cu:272: indexSelectLargeIndex: block: [535,0,0], thread: [50,0,0] Assertion srcIndex < srcSelectDimSize failed.
/opt/conda/conda-bld/pytorch_1591914838379/work/aten/src/THC/THCTensorIndex.cu:272: indexSelectLargeIndex: block: [535,0,0], thread: [51,0,0] Assertion srcIndex < srcSelectDimSize failed.
/opt/conda/conda-bld/pytorch_1591914838379/work/aten/src/THC/THCTensorIndex.cu:272: indexSelectLargeIndex: block: [535,0,0], thread: [52,0,0] Assertion srcIndex < srcSelectDimSize failed.
/opt/conda/conda-bld/pytorch_1591914838379/work/aten/src/THC/THCTensorIndex.cu:272: indexSelectLargeIndex: block: [535,0,0], thread: [53,0,0] Assertion srcIndex < srcSelectDimSize failed.
/opt/conda/conda-bld/pytorch_1591914838379/work/aten/src/THC/THCTensorIndex.cu:272: indexSelectLargeIndex: block: [535,0,0], thread: [54,0,0] Assertion srcIndex < srcSelectDimSize failed.
/opt/conda/conda-bld/pytorch_1591914838379/work/aten/src/THC/THCTensorIndex.cu:272: indexSelectLargeIndex: block: [535,0,0], thread: [55,0,0] Assertion srcIndex < srcSelectDimSize failed.
/opt/conda/conda-bld/pytorch_1591914838379/work/aten/src/THC/THCTensorIndex.cu:272: indexSelectLargeIndex: block: [535,0,0], thread: [56,0,0] Assertion srcIndex < srcSelectDimSize failed.
/opt/conda/conda-bld/pytorch_1591914838379/work/aten/src/THC/THCTensorIndex.cu:272: indexSelectLargeIndex: block: [535,0,0], thread: [57,0,0] Assertion srcIndex < srcSelectDimSize failed.
/opt/conda/conda-bld/pytorch_1591914838379/work/aten/src/THC/THCTensorIndex.cu:272: indexSelectLargeIndex: block: [535,0,0], thread: [58,0,0] Assertion srcIndex < srcSelectDimSize failed.
/opt/conda/conda-bld/pytorch_1591914838379/work/aten/src/THC/THCTensorIndex.cu:272: indexSelectLargeIndex: block: [535,0,0], thread: [59,0,0] Assertion srcIndex < srcSelectDimSize failed.
/opt/conda/conda-bld/pytorch_1591914838379/work/aten/src/THC/THCTensorIndex.cu:272: indexSelectLargeIndex: block: [535,0,0], thread: [60,0,0] Assertion srcIndex < srcSelectDimSize failed.
/opt/conda/conda-bld/pytorch_1591914838379/work/aten/src/THC/THCTensorIndex.cu:272: indexSelectLargeIndex: block: [535,0,0], thread: [61,0,0] Assertion srcIndex < srcSelectDimSize failed.
/opt/conda/conda-bld/pytorch_1591914838379/work/aten/src/THC/THCTensorIndex.cu:272: indexSelectLargeIndex: block: [535,0,0], thread: [62,0,0] Assertion srcIndex < srcSelectDimSize failed.
/opt/conda/conda-bld/pytorch_1591914838379/work/aten/src/THC/THCTensorIndex.cu:272: indexSelectLargeIndex: block: [535,0,0], thread: [63,0,0] Assertion srcIndex < srcSelectDimSize failed.
/opt/conda/conda-bld/pytorch_1591914838379/work/aten/src/THC/THCTensorIndex.cu:272: indexSelectLargeIndex: block: [535,0,0], thread: [64,0,0] Assertion srcIndex < srcSelectDimSize failed.
/opt/conda/conda-bld/pytorch_1591914838379/work/aten/src/THC/THCTensorIndex.cu:272: indexSelectLargeIndex: block: [535,0,0], thread: [65,0,0] Assertion srcIndex < srcSelectDimSize failed.
/opt/conda/conda-bld/pytorch_1591914838379/work/aten/src/THC/THCTensorIndex.cu:272: indexSelectLargeIndex: block: [535,0,0], thread: [66,0,0] Assertion srcIndex < srcSelectDimSize failed.
/opt/conda/conda-bld/pytorch_1591914838379/work/aten/src/THC/THCTensorIndex.cu:272: indexSelectLargeIndex: block: [535,0,0], thread: [67,0,0] Assertion srcIndex < srcSelectDimSize failed.
/opt/conda/conda-bld/pytorch_1591914838379/work/aten/src/THC/THCTensorIndex.cu:272: indexSelectLargeIndex: block: [535,0,0], thread: [68,0,0] Assertion srcIndex < srcSelectDimSize failed.
/opt/conda/conda-bld/pytorch_1591914838379/work/aten/src/THC/THCTensorIndex.cu:272: indexSelectLargeIndex: block: [535,0,0], thread: [69,0,0] Assertion srcIndex < srcSelectDimSize failed.
/opt/conda/conda-bld/pytorch_1591914838379/work/aten/src/THC/THCTensorIndex.cu:272: indexSelectLargeIndex: block: [535,0,0], thread: [70,0,0] Assertion srcIndex < srcSelectDimSize failed.
/opt/conda/conda-bld/pytorch_1591914838379/work/aten/src/THC/THCTensorIndex.cu:272: indexSelectLargeIndex: block: [535,0,0], thread: [71,0,0] Assertion srcIndex < srcSelectDimSize failed.
/opt/conda/conda-bld/pytorch_1591914838379/work/aten/src/THC/THCTensorIndex.cu:272: indexSelectLargeIndex: block: [535,0,0], thread: [72,0,0] Assertion srcIndex < srcSelectDimSize failed.
/opt/conda/conda-bld/pytorch_1591914838379/work/aten/src/THC/THCTensorIndex.cu:272: indexSelectLargeIndex: block: [535,0,0], thread: [73,0,0] Assertion srcIndex < srcSelectDimSize failed.
/opt/conda/conda-bld/pytorch_1591914838379/work/aten/src/THC/THCTensorIndex.cu:272: indexSelectLargeIndex: block: [535,0,0], thread: [74,0,0] Assertion srcIndex < srcSelectDimSize failed.
/opt/conda/conda-bld/pytorch_1591914838379/work/aten/src/THC/THCTensorIndex.cu:272: indexSelectLargeIndex: block: [535,0,0], thread: [75,0,0] Assertion srcIndex < srcSelectDimSize failed.
/opt/conda/conda-bld/pytorch_1591914838379/work/aten/src/THC/THCTensorIndex.cu:272: indexSelectLargeIndex: block: [535,0,0], thread: [76,0,0] Assertion srcIndex < srcSelectDimSize failed.
/opt/conda/conda-bld/pytorch_1591914838379/work/aten/src/THC/THCTensorIndex.cu:272: indexSelectLargeIndex: block: [535,0,0], thread: [77,0,0] Assertion srcIndex < srcSelectDimSize failed.
/opt/conda/conda-bld/pytorch_1591914838379/work/aten/src/THC/THCTensorIndex.cu:272: indexSelectLargeIndex: block: [535,0,0], thread: [78,0,0] Assertion srcIndex < srcSelectDimSize failed.
/opt/conda/conda-bld/pytorch_1591914838379/work/aten/src/THC/THCTensorIndex.cu:272: indexSelectLargeIndex: block: [535,0,0], thread: [79,0,0] Assertion srcIndex < srcSelectDimSize failed.
/opt/conda/conda-bld/pytorch_1591914838379/work/aten/src/THC/THCTensorIndex.cu:272: indexSelectLargeIndex: block: [535,0,0], thread: [80,0,0] Assertion srcIndex < srcSelectDimSize failed.
/opt/conda/conda-bld/pytorch_1591914838379/work/aten/src/THC/THCTensorIndex.cu:272: indexSelectLargeIndex: block: [535,0,0], thread: [81,0,0] Assertion srcIndex < srcSelectDimSize failed.
/opt/conda/conda-bld/pytorch_1591914838379/work/aten/src/THC/THCTensorIndex.cu:272: indexSelectLargeIndex: block: [535,0,0], thread: [82,0,0] Assertion srcIndex < srcSelectDimSize failed.
/opt/conda/conda-bld/pytorch_1591914838379/work/aten/src/THC/THCTensorIndex.cu:272: indexSelectLargeIndex: block: [535,0,0], thread: [83,0,0] Assertion srcIndex < srcSelectDimSize failed.
/opt/conda/conda-bld/pytorch_1591914838379/work/aten/src/THC/THCTensorIndex.cu:272: indexSelectLargeIndex: block: [535,0,0], thread: [84,0,0] Assertion srcIndex < srcSelectDimSize failed.
/opt/conda/conda-bld/pytorch_1591914838379/work/aten/src/THC/THCTensorIndex.cu:272: indexSelectLargeIndex: block: [535,0,0], thread: [85,0,0] Assertion srcIndex < srcSelectDimSize failed.
/opt/conda/conda-bld/pytorch_1591914838379/work/aten/src/THC/THCTensorIndex.cu:272: indexSelectLargeIndex: block: [535,0,0], thread: [86,0,0] Assertion srcIndex < srcSelectDimSize failed.
/opt/conda/conda-bld/pytorch_1591914838379/work/aten/src/THC/THCTensorIndex.cu:272: indexSelectLargeIndex: block: [535,0,0], thread: [87,0,0] Assertion srcIndex < srcSelectDimSize failed.
/opt/conda/conda-bld/pytorch_1591914838379/work/aten/src/THC/THCTensorIndex.cu:272: indexSelectLargeIndex: block: [535,0,0], thread: [88,0,0] Assertion srcIndex < srcSelectDimSize failed.
/opt/conda/conda-bld/pytorch_1591914838379/work/aten/src/THC/THCTensorIndex.cu:272: indexSelectLargeIndex: block: [535,0,0], thread: [89,0,0] Assertion srcIndex < srcSelectDimSize failed.
/opt/conda/conda-bld/pytorch_1591914838379/work/aten/src/THC/THCTensorIndex.cu:272: indexSelectLargeIndex: block: [535,0,0], thread: [90,0,0] Assertion srcIndex < srcSelectDimSize failed.
/opt/conda/conda-bld/pytorch_1591914838379/work/aten/src/THC/THCTensorIndex.cu:272: indexSelectLargeIndex: block: [535,0,0], thread: [91,0,0] Assertion srcIndex < srcSelectDimSize failed.
/opt/conda/conda-bld/pytorch_1591914838379/work/aten/src/THC/THCTensorIndex.cu:272: indexSelectLargeIndex: block: [535,0,0], thread: [92,0,0] Assertion srcIndex < srcSelectDimSize failed.
/opt/conda/conda-bld/pytorch_1591914838379/work/aten/src/THC/THCTensorIndex.cu:272: indexSelectLargeIndex: block: [535,0,0], thread: [93,0,0] Assertion srcIndex < srcSelectDimSize failed.
/opt/conda/conda-bld/pytorch_1591914838379/work/aten/src/THC/THCTensorIndex.cu:272: indexSelectLargeIndex: block: [535,0,0], thread: [94,0,0] Assertion srcIndex < srcSelectDimSize failed.
/opt/conda/conda-bld/pytorch_1591914838379/work/aten/src/THC/THCTensorIndex.cu:272: indexSelectLargeIndex: block: [535,0,0], thread: [95,0,0] Assertion srcIndex < srcSelectDimSize failed.
/opt/conda/conda-bld/pytorch_1591914838379/work/aten/src/THC/THCTensorIndex.cu:272: indexSelectLargeIndex: block: [535,0,0], thread: [96,0,0] Assertion srcIndex < srcSelectDimSize failed.
/opt/conda/conda-bld/pytorch_1591914838379/work/aten/src/THC/THCTensorIndex.cu:272: indexSelectLargeIndex: block: [535,0,0], thread: [97,0,0] Assertion srcIndex < srcSelectDimSize failed.
/opt/conda/conda-bld/pytorch_1591914838379/work/aten/src/THC/THCTensorIndex.cu:272: indexSelectLargeIndex: block: [535,0,0], thread: [98,0,0] Assertion srcIndex < srcSelectDimSize failed.
/opt/conda/conda-bld/pytorch_1591914838379/work/aten/src/THC/THCTensorIndex.cu:272: indexSelectLargeIndex: block: [535,0,0], thread: [99,0,0] Assertion srcIndex < srcSelectDimSize failed.
/opt/conda/conda-bld/pytorch_1591914838379/work/aten/src/THC/THCTensorIndex.cu:272: indexSelectLargeIndex: block: [535,0,0], thread: [100,0,0] Assertion srcIndex < srcSelectDimSize failed.
/opt/conda/conda-bld/pytorch_1591914838379/work/aten/src/THC/THCTensorIndex.cu:272: indexSelectLargeIndex: block: [535,0,0], thread: [101,0,0] Assertion srcIndex < srcSelectDimSize failed.
/opt/conda/conda-bld/pytorch_1591914838379/work/aten/src/THC/THCTensorIndex.cu:272: indexSelectLargeIndex: block: [535,0,0], thread: [102,0,0] Assertion srcIndex < srcSelectDimSize failed.
/opt/conda/conda-bld/pytorch_1591914838379/work/aten/src/THC/THCTensorIndex.cu:272: indexSelectLargeIndex: block: [535,0,0], thread: [103,0,0] Assertion srcIndex < srcSelectDimSize failed.
/opt/conda/conda-bld/pytorch_1591914838379/work/aten/src/THC/THCTensorIndex.cu:272: indexSelectLargeIndex: block: [535,0,0], thread: [104,0,0] Assertion srcIndex < srcSelectDimSize failed.
/opt/conda/conda-bld/pytorch_1591914838379/work/aten/src/THC/THCTensorIndex.cu:272: indexSelectLargeIndex: block: [535,0,0], thread: [105,0,0] Assertion srcIndex < srcSelectDimSize failed.
/opt/conda/conda-bld/pytorch_1591914838379/work/aten/src/THC/THCTensorIndex.cu:272: indexSelectLargeIndex: block: [535,0,0], thread: [106,0,0] Assertion srcIndex < srcSelectDimSize failed.
/opt/conda/conda-bld/pytorch_1591914838379/work/aten/src/THC/THCTensorIndex.cu:272: indexSelectLargeIndex: block: [535,0,0], thread: [107,0,0] Assertion srcIndex < srcSelectDimSize failed.
/opt/conda/conda-bld/pytorch_1591914838379/work/aten/src/THC/THCTensorIndex.cu:272: indexSelectLargeIndex: block: [535,0,0], thread: [108,0,0] Assertion srcIndex < srcSelectDimSize failed.
/opt/conda/conda-bld/pytorch_1591914838379/work/aten/src/THC/THCTensorIndex.cu:272: indexSelectLargeIndex: block: [535,0,0], thread: [109,0,0] Assertion srcIndex < srcSelectDimSize failed.
/opt/conda/conda-bld/pytorch_1591914838379/work/aten/src/THC/THCTensorIndex.cu:272: indexSelectLargeIndex: block: [535,0,0], thread: [110,0,0] Assertion srcIndex < srcSelectDimSize failed.
/opt/conda/conda-bld/pytorch_1591914838379/work/aten/src/THC/THCTensorIndex.cu:272: indexSelectLargeIndex: block: [535,0,0], thread: [111,0,0] Assertion srcIndex < srcSelectDimSize failed.
/opt/conda/conda-bld/pytorch_1591914838379/work/aten/src/THC/THCTensorIndex.cu:272: indexSelectLargeIndex: block: [535,0,0], thread: [112,0,0] Assertion srcIndex < srcSelectDimSize failed.
/opt/conda/conda-bld/pytorch_1591914838379/work/aten/src/THC/THCTensorIndex.cu:272: indexSelectLargeIndex: block: [535,0,0], thread: [113,0,0] Assertion srcIndex < srcSelectDimSize failed.
/opt/conda/conda-bld/pytorch_1591914838379/work/aten/src/THC/THCTensorIndex.cu:272: indexSelectLargeIndex: block: [535,0,0], thread: [114,0,0] Assertion srcIndex < srcSelectDimSize failed.
/opt/conda/conda-bld/pytorch_1591914838379/work/aten/src/THC/THCTensorIndex.cu:272: indexSelectLargeIndex: block: [535,0,0], thread: [115,0,0] Assertion srcIndex < srcSelectDimSize failed.
/opt/conda/conda-bld/pytorch_1591914838379/work/aten/src/THC/THCTensorIndex.cu:272: indexSelectLargeIndex: block: [535,0,0], thread: [116,0,0] Assertion srcIndex < srcSelectDimSize failed.
/opt/conda/conda-bld/pytorch_1591914838379/work/aten/src/THC/THCTensorIndex.cu:272: indexSelectLargeIndex: block: [535,0,0], thread: [117,0,0] Assertion srcIndex < srcSelectDimSize failed.
/opt/conda/conda-bld/pytorch_1591914838379/work/aten/src/THC/THCTensorIndex.cu:272: indexSelectLargeIndex: block: [535,0,0], thread: [118,0,0] Assertion srcIndex < srcSelectDimSize failed.
/opt/conda/conda-bld/pytorch_1591914838379/work/aten/src/THC/THCTensorIndex.cu:272: indexSelectLargeIndex: block: [535,0,0], thread: [119,0,0] Assertion srcIndex < srcSelectDimSize failed.
/opt/conda/conda-bld/pytorch_1591914838379/work/aten/src/THC/THCTensorIndex.cu:272: indexSelectLargeIndex: block: [535,0,0], thread: [120,0,0] Assertion srcIndex < srcSelectDimSize failed.
/opt/conda/conda-bld/pytorch_1591914838379/work/aten/src/THC/THCTensorIndex.cu:272: indexSelectLargeIndex: block: [535,0,0], thread: [121,0,0] Assertion srcIndex < srcSelectDimSize failed.
/opt/conda/conda-bld/pytorch_1591914838379/work/aten/src/THC/THCTensorIndex.cu:272: indexSelectLargeIndex: block: [535,0,0], thread: [122,0,0] Assertion srcIndex < srcSelectDimSize failed.
/opt/conda/conda-bld/pytorch_1591914838379/work/aten/src/THC/THCTensorIndex.cu:272: indexSelectLargeIndex: block: [535,0,0], thread: [123,0,0] Assertion srcIndex < srcSelectDimSize failed.
/opt/conda/conda-bld/pytorch_1591914838379/work/aten/src/THC/THCTensorIndex.cu:272: indexSelectLargeIndex: block: [535,0,0], thread: [124,0,0] Assertion srcIndex < srcSelectDimSize failed.
/opt/conda/conda-bld/pytorch_1591914838379/work/aten/src/THC/THCTensorIndex.cu:272: indexSelectLargeIndex: block: [535,0,0], thread: [125,0,0] Assertion srcIndex < srcSelectDimSize failed.
/opt/conda/conda-bld/pytorch_1591914838379/work/aten/src/THC/THCTensorIndex.cu:272: indexSelectLargeIndex: block: [535,0,0], thread: [126,0,0] Assertion srcIndex < srcSelectDimSize failed.
/opt/conda/conda-bld/pytorch_1591914838379/work/aten/src/THC/THCTensorIndex.cu:272: indexSelectLargeIndex: block: [535,0,0], thread: [127,0,0] Assertion srcIndex < srcSelectDimSize failed.
/opt/conda/conda-bld/pytorch_1591914838379/work/aten/src/THC/THCTensorIndex.cu:272: indexSelectLargeIndex: block: [534,0,0], thread: [0,0,0] Assertion srcIndex < srcSelectDimSize failed.
/opt/conda/conda-bld/pytorch_1591914838379/work/aten/src/THC/THCTensorIndex.cu:272: indexSelectLargeIndex: block: [534,0,0], thread: [1,0,0] Assertion srcIndex < srcSelectDimSize failed.
/opt/conda/conda-bld/pytorch_1591914838379/work/aten/src/THC/THCTensorIndex.cu:272: indexSelectLargeIndex: block: [534,0,0], thread: [2,0,0] Assertion srcIndex < srcSelectDimSize failed.
/opt/conda/conda-bld/pytorch_1591914838379/work/aten/src/THC/THCTensorIndex.cu:272: indexSelectLargeIndex: block: [534,0,0], thread: [3,0,0] Assertion srcIndex < srcSelectDimSize failed.
/opt/conda/conda-bld/pytorch_1591914838379/work/aten/src/THC/THCTensorIndex.cu:272: indexSelectLargeIndex: block: [534,0,0], thread: [4,0,0] Assertion srcIndex < srcSelectDimSize failed.
/opt/conda/conda-bld/pytorch_1591914838379/work/aten/src/THC/THCTensorIndex.cu:272: indexSelectLargeIndex: block: [534,0,0], thread: [5,0,0] Assertion srcIndex < srcSelectDimSize failed.
/opt/conda/conda-bld/pytorch_1591914838379/work/aten/src/THC/THCTensorIndex.cu:272: indexSelectLargeIndex: block: [534,0,0], thread: [6,0,0] Assertion srcIndex < srcSelectDimSize failed.
/opt/conda/conda-bld/pytorch_1591914838379/work/aten/src/THC/THCTensorIndex.cu:272: indexSelectLargeIndex: block: [534,0,0], thread: [7,0,0] Assertion srcIndex < srcSelectDimSize failed.
/opt/conda/conda-bld/pytorch_1591914838379/work/aten/src/THC/THCTensorIndex.cu:272: indexSelectLargeIndex: block: [534,0,0], thread: [8,0,0] Assertion srcIndex < srcSelectDimSize failed.
/opt/conda/conda-bld/pytorch_1591914838379/work/aten/src/THC/THCTensorIndex.cu:272: indexSelectLargeIndex: block: [534,0,0], thread: [9,0,0] Assertion srcIndex < srcSelectDimSize failed.
/opt/conda/conda-bld/pytorch_1591914838379/work/aten/src/THC/THCTensorIndex.cu:272: indexSelectLargeIndex: block: [534,0,0], thread: [10,0,0] Assertion srcIndex < srcSelectDimSize failed.
/opt/conda/conda-bld/pytorch_1591914838379/work/aten/src/THC/THCTensorIndex.cu:272: indexSelectLargeIndex: block: [534,0,0], thread: [11,0,0] Assertion srcIndex < srcSelectDimSize failed.
/opt/conda/conda-bld/pytorch_1591914838379/work/aten/src/THC/THCTensorIndex.cu:272: indexSelectLargeIndex: block: [534,0,0], thread: [12,0,0] Assertion srcIndex < srcSelectDimSize failed.
/opt/conda/conda-bld/pytorch_1591914838379/work/aten/src/THC/THCTensorIndex.cu:272: indexSelectLargeIndex: block: [534,0,0], thread: [13,0,0] Assertion srcIndex < srcSelectDimSize failed.
/opt/conda/conda-bld/pytorch_1591914838379/work/aten/src/THC/THCTensorIndex.cu:272: indexSelectLargeIndex: block: [534,0,0], thread: [14,0,0] Assertion srcIndex < srcSelectDimSize failed.
/opt/conda/conda-bld/pytorch_1591914838379/work/aten/src/THC/THCTensorIndex.cu:272: indexSelectLargeIndex: block: [534,0,0], thread: [15,0,0] Assertion srcIndex < srcSelectDimSize failed.
/opt/conda/conda-bld/pytorch_1591914838379/work/aten/src/THC/THCTensorIndex.cu:272: indexSelectLargeIndex: block: [534,0,0], thread: [16,0,0] Assertion srcIndex < srcSelectDimSize failed.
/opt/conda/conda-bld/pytorch_1591914838379/work/aten/src/THC/THCTensorIndex.cu:272: indexSelectLargeIndex: block: [534,0,0], thread: [17,0,0] Assertion srcIndex < srcSelectDimSize failed.
/opt/conda/conda-bld/pytorch_1591914838379/work/aten/src/THC/THCTensorIndex.cu:272: indexSelectLargeIndex: block: [534,0,0], thread: [18,0,0] Assertion srcIndex < srcSelectDimSize failed.
/opt/conda/conda-bld/pytorch_1591914838379/work/aten/src/THC/THCTensorIndex.cu:272: indexSelectLargeIndex: block: [534,0,0], thread: [19,0,0] Assertion srcIndex < srcSelectDimSize failed.
/opt/conda/conda-bld/pytorch_1591914838379/work/aten/src/THC/THCTensorIndex.cu:272: indexSelectLargeIndex: block: [534,0,0], thread: [20,0,0] Assertion srcIndex < srcSelectDimSize failed.
/opt/conda/conda-bld/pytorch_1591914838379/work/aten/src/THC/THCTensorIndex.cu:272: indexSelectLargeIndex: block: [534,0,0], thread: [21,0,0] Assertion srcIndex < srcSelectDimSize failed.
/opt/conda/conda-bld/pytorch_1591914838379/work/aten/src/THC/THCTensorIndex.cu:272: indexSelectLargeIndex: block: [534,0,0], thread: [22,0,0] Assertion srcIndex < srcSelectDimSize failed.
/opt/conda/conda-bld/pytorch_1591914838379/work/aten/src/THC/THCTensorIndex.cu:272: indexSelectLargeIndex: block: [534,0,0], thread: [23,0,0] Assertion srcIndex < srcSelectDimSize failed.
/opt/conda/conda-bld/pytorch_1591914838379/work/aten/src/THC/THCTensorIndex.cu:272: indexSelectLargeIndex: block: [534,0,0], thread: [24,0,0] Assertion srcIndex < srcSelectDimSize failed.
/opt/conda/conda-bld/pytorch_1591914838379/work/aten/src/THC/THCTensorIndex.cu:272: indexSelectLargeIndex: block: [534,0,0], thread: [25,0,0] Assertion srcIndex < srcSelectDimSize failed.
/opt/conda/conda-bld/pytorch_1591914838379/work/aten/src/THC/THCTensorIndex.cu:272: indexSelectLargeIndex: block: [534,0,0], thread: [26,0,0] Assertion srcIndex < srcSelectDimSize failed.
/opt/conda/conda-bld/pytorch_1591914838379/work/aten/src/THC/THCTensorIndex.cu:272: indexSelectLargeIndex: block: [534,0,0], thread: [27,0,0] Assertion srcIndex < srcSelectDimSize failed.
/opt/conda/conda-bld/pytorch_1591914838379/work/aten/src/THC/THCTensorIndex.cu:272: indexSelectLargeIndex: block: [534,0,0], thread: [28,0,0] Assertion srcIndex < srcSelectDimSize failed.
/opt/conda/conda-bld/pytorch_1591914838379/work/aten/src/THC/THCTensorIndex.cu:272: indexSelectLargeIndex: block: [534,0,0], thread: [29,0,0] Assertion srcIndex < srcSelectDimSize failed.
/opt/conda/conda-bld/pytorch_1591914838379/work/aten/src/THC/THCTensorIndex.cu:272: indexSelectLargeIndex: block: [534,0,0], thread: [30,0,0] Assertion srcIndex < srcSelectDimSize failed.
/opt/conda/conda-bld/pytorch_1591914838379/work/aten/src/THC/THCTensorIndex.cu:272: indexSelectLargeIndex: block: [534,0,0], thread: [31,0,0] Assertion srcIndex < srcSelectDimSize failed.
/opt/conda/conda-bld/pytorch_1591914838379/work/aten/src/THC/THCTensorIndex.cu:272: indexSelectLargeIndex: block: [534,0,0], thread: [32,0,0] Assertion srcIndex < srcSelectDimSize failed.
/opt/conda/conda-bld/pytorch_1591914838379/work/aten/src/THC/THCTensorIndex.cu:272: indexSelectLargeIndex: block: [534,0,0], thread: [33,0,0] Assertion srcIndex < srcSelectDimSize failed.
/opt/conda/conda-bld/pytorch_1591914838379/work/aten/src/THC/THCTensorIndex.cu:272: indexSelectLargeIndex: block: [534,0,0], thread: [34,0,0] Assertion srcIndex < srcSelectDimSize failed.
/opt/conda/conda-bld/pytorch_1591914838379/work/aten/src/THC/THCTensorIndex.cu:272: indexSelectLargeIndex: block: [534,0,0], thread: [35,0,0] Assertion srcIndex < srcSelectDimSize failed.
/opt/conda/conda-bld/pytorch_1591914838379/work/aten/src/THC/THCTensorIndex.cu:272: indexSelectLargeIndex: block: [534,0,0], thread: [36,0,0] Assertion srcIndex < srcSelectDimSize failed.
/opt/conda/conda-bld/pytorch_1591914838379/work/aten/src/THC/THCTensorIndex.cu:272: indexSelectLargeIndex: block: [534,0,0], thread: [37,0,0] Assertion srcIndex < srcSelectDimSize failed.
/opt/conda/conda-bld/pytorch_1591914838379/work/aten/src/THC/THCTensorIndex.cu:272: indexSelectLargeIndex: block: [534,0,0], thread: [38,0,0] Assertion srcIndex < srcSelectDimSize failed.
/opt/conda/conda-bld/pytorch_1591914838379/work/aten/src/THC/THCTensorIndex.cu:272: indexSelectLargeIndex: block: [534,0,0], thread: [39,0,0] Assertion srcIndex < srcSelectDimSize failed.
/opt/conda/conda-bld/pytorch_1591914838379/work/aten/src/THC/THCTensorIndex.cu:272: indexSelectLargeIndex: block: [534,0,0], thread: [40,0,0] Assertion srcIndex < srcSelectDimSize failed.
/opt/conda/conda-bld/pytorch_1591914838379/work/aten/src/THC/THCTensorIndex.cu:272: indexSelectLargeIndex: block: [534,0,0], thread: [41,0,0] Assertion srcIndex < srcSelectDimSize failed.
/opt/conda/conda-bld/pytorch_1591914838379/work/aten/src/THC/THCTensorIndex.cu:272: indexSelectLargeIndex: block: [534,0,0], thread: [42,0,0] Assertion srcIndex < srcSelectDimSize failed.
/opt/conda/conda-bld/pytorch_1591914838379/work/aten/src/THC/THCTensorIndex.cu:272: indexSelectLargeIndex: block: [534,0,0], thread: [43,0,0] Assertion srcIndex < srcSelectDimSize failed.
/opt/conda/conda-bld/pytorch_1591914838379/work/aten/src/THC/THCTensorIndex.cu:272: indexSelectLargeIndex: block: [534,0,0], thread: [44,0,0] Assertion srcIndex < srcSelectDimSize failed.
/opt/conda/conda-bld/pytorch_1591914838379/work/aten/src/THC/THCTensorIndex.cu:272: indexSelectLargeIndex: block: [534,0,0], thread: [45,0,0] Assertion srcIndex < srcSelectDimSize failed.
/opt/conda/conda-bld/pytorch_1591914838379/work/aten/src/THC/THCTensorIndex.cu:272: indexSelectLargeIndex: block: [534,0,0], thread: [46,0,0] Assertion srcIndex < srcSelectDimSize failed.
/opt/conda/conda-bld/pytorch_1591914838379/work/aten/src/THC/THCTensorIndex.cu:272: indexSelectLargeIndex: block: [534,0,0], thread: [47,0,0] Assertion srcIndex < srcSelectDimSize failed.
/opt/conda/conda-bld/pytorch_1591914838379/work/aten/src/THC/THCTensorIndex.cu:272: indexSelectLargeIndex: block: [534,0,0], thread: [48,0,0] Assertion srcIndex < srcSelectDimSize failed.
/opt/conda/conda-bld/pytorch_1591914838379/work/aten/src/THC/THCTensorIndex.cu:272: indexSelectLargeIndex: block: [534,0,0], thread: [49,0,0] Assertion srcIndex < srcSelectDimSize failed.
/opt/conda/conda-bld/pytorch_1591914838379/work/aten/src/THC/THCTensorIndex.cu:272: indexSelectLargeIndex: block: [534,0,0], thread: [50,0,0] Assertion srcIndex < srcSelectDimSize failed.
/opt/conda/conda-bld/pytorch_1591914838379/work/aten/src/THC/THCTensorIndex.cu:272: indexSelectLargeIndex: block: [534,0,0], thread: [51,0,0] Assertion srcIndex < srcSelectDimSize failed.
/opt/conda/conda-bld/pytorch_1591914838379/work/aten/src/THC/THCTensorIndex.cu:272: indexSelectLargeIndex: block: [534,0,0], thread: [52,0,0] Assertion srcIndex < srcSelectDimSize failed.
/opt/conda/conda-bld/pytorch_1591914838379/work/aten/src/THC/THCTensorIndex.cu:272: indexSelectLargeIndex: block: [534,0,0], thread: [53,0,0] Assertion srcIndex < srcSelectDimSize failed.
/opt/conda/conda-bld/pytorch_1591914838379/work/aten/src/THC/THCTensorIndex.cu:272: indexSelectLargeIndex: block: [534,0,0], thread: [54,0,0] Assertion srcIndex < srcSelectDimSize failed.
/opt/conda/conda-bld/pytorch_1591914838379/work/aten/src/THC/THCTensorIndex.cu:272: indexSelectLargeIndex: block: [534,0,0], thread: [55,0,0] Assertion srcIndex < srcSelectDimSize failed.
/opt/conda/conda-bld/pytorch_1591914838379/work/aten/src/THC/THCTensorIndex.cu:272: indexSelectLargeIndex: block: [534,0,0], thread: [56,0,0] Assertion srcIndex < srcSelectDimSize failed.
/opt/conda/conda-bld/pytorch_1591914838379/work/aten/src/THC/THCTensorIndex.cu:272: indexSelectLargeIndex: block: [534,0,0], thread: [57,0,0] Assertion srcIndex < srcSelectDimSize failed.
/opt/conda/conda-bld/pytorch_1591914838379/work/aten/src/THC/THCTensorIndex.cu:272: indexSelectLargeIndex: block: [534,0,0], thread: [58,0,0] Assertion srcIndex < srcSelectDimSize failed.
/opt/conda/conda-bld/pytorch_1591914838379/work/aten/src/THC/THCTensorIndex.cu:272: indexSelectLargeIndex: block: [534,0,0], thread: [59,0,0] Assertion srcIndex < srcSelectDimSize failed.
/opt/conda/conda-bld/pytorch_1591914838379/work/aten/src/THC/THCTensorIndex.cu:272: indexSelectLargeIndex: block: [534,0,0], thread: [60,0,0] Assertion srcIndex < srcSelectDimSize failed.
/opt/conda/conda-bld/pytorch_1591914838379/work/aten/src/THC/THCTensorIndex.cu:272: indexSelectLargeIndex: block: [534,0,0], thread: [61,0,0] Assertion srcIndex < srcSelectDimSize failed.
/opt/conda/conda-bld/pytorch_1591914838379/work/aten/src/THC/THCTensorIndex.cu:272: indexSelectLargeIndex: block: [534,0,0], thread: [62,0,0] Assertion srcIndex < srcSelectDimSize failed.
/opt/conda/conda-bld/pytorch_1591914838379/work/aten/src/THC/THCTensorIndex.cu:272: indexSelectLargeIndex: block: [534,0,0], thread: [63,0,0] Assertion srcIndex < srcSelectDimSize failed.
/opt/conda/conda-bld/pytorch_1591914838379/work/aten/src/THC/THCTensorIndex.cu:272: indexSelectLargeIndex: block: [534,0,0], thread: [64,0,0] Assertion srcIndex < srcSelectDimSize failed.
/opt/conda/conda-bld/pytorch_1591914838379/work/aten/src/THC/THCTensorIndex.cu:272: indexSelectLargeIndex: block: [534,0,0], thread: [65,0,0] Assertion srcIndex < srcSelectDimSize failed.
/opt/conda/conda-bld/pytorch_1591914838379/work/aten/src/THC/THCTensorIndex.cu:272: indexSelectLargeIndex: block: [534,0,0], thread: [66,0,0] Assertion srcIndex < srcSelectDimSize failed.
/opt/conda/conda-bld/pytorch_1591914838379/work/aten/src/THC/THCTensorIndex.cu:272: indexSelectLargeIndex: block: [534,0,0], thread: [67,0,0] Assertion srcIndex < srcSelectDimSize failed.
/opt/conda/conda-bld/pytorch_1591914838379/work/aten/src/THC/THCTensorIndex.cu:272: indexSelectLargeIndex: block: [534,0,0], thread: [68,0,0] Assertion srcIndex < srcSelectDimSize failed.
/opt/conda/conda-bld/pytorch_1591914838379/work/aten/src/THC/THCTensorIndex.cu:272: indexSelectLargeIndex: block: [534,0,0], thread: [69,0,0] Assertion srcIndex < srcSelectDimSize failed.
/opt/conda/conda-bld/pytorch_1591914838379/work/aten/src/THC/THCTensorIndex.cu:272: indexSelectLargeIndex: block: [534,0,0], thread: [70,0,0] Assertion srcIndex < srcSelectDimSize failed.
/opt/conda/conda-bld/pytorch_1591914838379/work/aten/src/THC/THCTensorIndex.cu:272: indexSelectLargeIndex: block: [534,0,0], thread: [71,0,0] Assertion srcIndex < srcSelectDimSize failed.
/opt/conda/conda-bld/pytorch_1591914838379/work/aten/src/THC/THCTensorIndex.cu:272: indexSelectLargeIndex: block: [534,0,0], thread: [72,0,0] Assertion srcIndex < srcSelectDimSize failed.
/opt/conda/conda-bld/pytorch_1591914838379/work/aten/src/THC/THCTensorIndex.cu:272: indexSelectLargeIndex: block: [534,0,0], thread: [73,0,0] Assertion srcIndex < srcSelectDimSize failed.
/opt/conda/conda-bld/pytorch_1591914838379/work/aten/src/THC/THCTensorIndex.cu:272: indexSelectLargeIndex: block: [534,0,0], thread: [74,0,0] Assertion srcIndex < srcSelectDimSize failed.
/opt/conda/conda-bld/pytorch_1591914838379/work/aten/src/THC/THCTensorIndex.cu:272: indexSelectLargeIndex: block: [534,0,0], thread: [75,0,0] Assertion srcIndex < srcSelectDimSize failed.
/opt/conda/conda-bld/pytorch_1591914838379/work/aten/src/THC/THCTensorIndex.cu:272: indexSelectLargeIndex: block: [534,0,0], thread: [76,0,0] Assertion srcIndex < srcSelectDimSize failed.
/opt/conda/conda-bld/pytorch_1591914838379/work/aten/src/THC/THCTensorIndex.cu:272: indexSelectLargeIndex: block: [534,0,0], thread: [77,0,0] Assertion srcIndex < srcSelectDimSize failed.
/opt/conda/conda-bld/pytorch_1591914838379/work/aten/src/THC/THCTensorIndex.cu:272: indexSelectLargeIndex: block: [534,0,0], thread: [78,0,0] Assertion srcIndex < srcSelectDimSize failed.
/opt/conda/conda-bld/pytorch_1591914838379/work/aten/src/THC/THCTensorIndex.cu:272: indexSelectLargeIndex: block: [534,0,0], thread: [79,0,0] Assertion srcIndex < srcSelectDimSize failed.
/opt/conda/conda-bld/pytorch_1591914838379/work/aten/src/THC/THCTensorIndex.cu:272: indexSelectLargeIndex: block: [534,0,0], thread: [80,0,0] Assertion srcIndex < srcSelectDimSize failed.
/opt/conda/conda-bld/pytorch_1591914838379/work/aten/src/THC/THCTensorIndex.cu:272: indexSelectLargeIndex: block: [534,0,0], thread: [81,0,0] Assertion srcIndex < srcSelectDimSize failed.
/opt/conda/conda-bld/pytorch_1591914838379/work/aten/src/THC/THCTensorIndex.cu:272: indexSelectLargeIndex: block: [534,0,0], thread: [82,0,0] Assertion srcIndex < srcSelectDimSize failed.
/opt/conda/conda-bld/pytorch_1591914838379/work/aten/src/THC/THCTensorIndex.cu:272: indexSelectLargeIndex: block: [534,0,0], thread: [83,0,0] Assertion srcIndex < srcSelectDimSize failed.
/opt/conda/conda-bld/pytorch_1591914838379/work/aten/src/THC/THCTensorIndex.cu:272: indexSelectLargeIndex: block: [534,0,0], thread: [84,0,0] Assertion srcIndex < srcSelectDimSize failed.
/opt/conda/conda-bld/pytorch_1591914838379/work/aten/src/THC/THCTensorIndex.cu:272: indexSelectLargeIndex: block: [534,0,0], thread: [85,0,0] Assertion srcIndex < srcSelectDimSize failed.
/opt/conda/conda-bld/pytorch_1591914838379/work/aten/src/THC/THCTensorIndex.cu:272: indexSelectLargeIndex: block: [534,0,0], thread: [86,0,0] Assertion srcIndex < srcSelectDimSize failed.
/opt/conda/conda-bld/pytorch_1591914838379/work/aten/src/THC/THCTensorIndex.cu:272: indexSelectLargeIndex: block: [534,0,0], thread: [87,0,0] Assertion srcIndex < srcSelectDimSize failed.
/opt/conda/conda-bld/pytorch_1591914838379/work/aten/src/THC/THCTensorIndex.cu:272: indexSelectLargeIndex: block: [534,0,0], thread: [88,0,0] Assertion srcIndex < srcSelectDimSize failed.
/opt/conda/conda-bld/pytorch_1591914838379/work/aten/src/THC/THCTensorIndex.cu:272: indexSelectLargeIndex: block: [534,0,0], thread: [89,0,0] Assertion srcIndex < srcSelectDimSize failed.
/opt/conda/conda-bld/pytorch_1591914838379/work/aten/src/THC/THCTensorIndex.cu:272: indexSelectLargeIndex: block: [534,0,0], thread: [90,0,0] Assertion srcIndex < srcSelectDimSize failed.
/opt/conda/conda-bld/pytorch_1591914838379/work/aten/src/THC/THCTensorIndex.cu:272: indexSelectLargeIndex: block: [534,0,0], thread: [91,0,0] Assertion srcIndex < srcSelectDimSize failed.
/opt/conda/conda-bld/pytorch_1591914838379/work/aten/src/THC/THCTensorIndex.cu:272: indexSelectLargeIndex: block: [534,0,0], thread: [92,0,0] Assertion srcIndex < srcSelectDimSize failed.
/opt/conda/conda-bld/pytorch_1591914838379/work/aten/src/THC/THCTensorIndex.cu:272: indexSelectLargeIndex: block: [534,0,0], thread: [93,0,0] Assertion srcIndex < srcSelectDimSize failed.
/opt/conda/conda-bld/pytorch_1591914838379/work/aten/src/THC/THCTensorIndex.cu:272: indexSelectLargeIndex: block: [534,0,0], thread: [94,0,0] Assertion srcIndex < srcSelectDimSize failed.
/opt/conda/conda-bld/pytorch_1591914838379/work/aten/src/THC/THCTensorIndex.cu:272: indexSelectLargeIndex: block: [534,0,0], thread: [95,0,0] Assertion srcIndex < srcSelectDimSize failed.
/opt/conda/conda-bld/pytorch_1591914838379/work/aten/src/THC/THCTensorIndex.cu:272: indexSelectLargeIndex: block: [534,0,0], thread: [96,0,0] Assertion srcIndex < srcSelectDimSize failed.
/opt/conda/conda-bld/pytorch_1591914838379/work/aten/src/THC/THCTensorIndex.cu:272: indexSelectLargeIndex: block: [534,0,0], thread: [97,0,0] Assertion srcIndex < srcSelectDimSize failed.
/opt/conda/conda-bld/pytorch_1591914838379/work/aten/src/THC/THCTensorIndex.cu:272: indexSelectLargeIndex: block: [534,0,0], thread: [98,0,0] Assertion srcIndex < srcSelectDimSize failed.
/opt/conda/conda-bld/pytorch_1591914838379/work/aten/src/THC/THCTensorIndex.cu:272: indexSelectLargeIndex: block: [534,0,0], thread: [99,0,0] Assertion srcIndex < srcSelectDimSize failed.
/opt/conda/conda-bld/pytorch_1591914838379/work/aten/src/THC/THCTensorIndex.cu:272: indexSelectLargeIndex: block: [534,0,0], thread: [100,0,0] Assertion srcIndex < srcSelectDimSize failed.
/opt/conda/conda-bld/pytorch_1591914838379/work/aten/src/THC/THCTensorIndex.cu:272: indexSelectLargeIndex: block: [534,0,0], thread: [101,0,0] Assertion srcIndex < srcSelectDimSize failed.
/opt/conda/conda-bld/pytorch_1591914838379/work/aten/src/THC/THCTensorIndex.cu:272: indexSelectLargeIndex: block: [534,0,0], thread: [102,0,0] Assertion srcIndex < srcSelectDimSize failed.
/opt/conda/conda-bld/pytorch_1591914838379/work/aten/src/THC/THCTensorIndex.cu:272: indexSelectLargeIndex: block: [534,0,0], thread: [103,0,0] Assertion srcIndex < srcSelectDimSize failed.
/opt/conda/conda-bld/pytorch_1591914838379/work/aten/src/THC/THCTensorIndex.cu:272: indexSelectLargeIndex: block: [534,0,0], thread: [104,0,0] Assertion srcIndex < srcSelectDimSize failed.
/opt/conda/conda-bld/pytorch_1591914838379/work/aten/src/THC/THCTensorIndex.cu:272: indexSelectLargeIndex: block: [534,0,0], thread: [105,0,0] Assertion srcIndex < srcSelectDimSize failed.
/opt/conda/conda-bld/pytorch_1591914838379/work/aten/src/THC/THCTensorIndex.cu:272: indexSelectLargeIndex: block: [534,0,0], thread: [106,0,0] Assertion srcIndex < srcSelectDimSize failed.
/opt/conda/conda-bld/pytorch_1591914838379/work/aten/src/THC/THCTensorIndex.cu:272: indexSelectLargeIndex: block: [534,0,0], thread: [107,0,0] Assertion srcIndex < srcSelectDimSize failed.
/opt/conda/conda-bld/pytorch_1591914838379/work/aten/src/THC/THCTensorIndex.cu:272: indexSelectLargeIndex: block: [534,0,0], thread: [108,0,0] Assertion srcIndex < srcSelectDimSize failed.
/opt/conda/conda-bld/pytorch_1591914838379/work/aten/src/THC/THCTensorIndex.cu:272: indexSelectLargeIndex: block: [534,0,0], thread: [109,0,0] Assertion srcIndex < srcSelectDimSize failed.
/opt/conda/conda-bld/pytorch_1591914838379/work/aten/src/THC/THCTensorIndex.cu:272: indexSelectLargeIndex: block: [534,0,0], thread: [110,0,0] Assertion srcIndex < srcSelectDimSize failed.
/opt/conda/conda-bld/pytorch_1591914838379/work/aten/src/THC/THCTensorIndex.cu:272: indexSelectLargeIndex: block: [534,0,0], thread: [111,0,0] Assertion srcIndex < srcSelectDimSize failed.
/opt/conda/conda-bld/pytorch_1591914838379/work/aten/src/THC/THCTensorIndex.cu:272: indexSelectLargeIndex: block: [534,0,0], thread: [112,0,0] Assertion srcIndex < srcSelectDimSize failed.
/opt/conda/conda-bld/pytorch_1591914838379/work/aten/src/THC/THCTensorIndex.cu:272: indexSelectLargeIndex: block: [534,0,0], thread: [113,0,0] Assertion srcIndex < srcSelectDimSize failed.
/opt/conda/conda-bld/pytorch_1591914838379/work/aten/src/THC/THCTensorIndex.cu:272: indexSelectLargeIndex: block: [534,0,0], thread: [114,0,0] Assertion srcIndex < srcSelectDimSize failed.
/opt/conda/conda-bld/pytorch_1591914838379/work/aten/src/THC/THCTensorIndex.cu:272: indexSelectLargeIndex: block: [534,0,0], thread: [115,0,0] Assertion srcIndex < srcSelectDimSize failed.
/opt/conda/conda-bld/pytorch_1591914838379/work/aten/src/THC/THCTensorIndex.cu:272: indexSelectLargeIndex: block: [534,0,0], thread: [116,0,0] Assertion srcIndex < srcSelectDimSize failed.
/opt/conda/conda-bld/pytorch_1591914838379/work/aten/src/THC/THCTensorIndex.cu:272: indexSelectLargeIndex: block: [534,0,0], thread: [117,0,0] Assertion srcIndex < srcSelectDimSize failed.
/opt/conda/conda-bld/pytorch_1591914838379/work/aten/src/THC/THCTensorIndex.cu:272: indexSelectLargeIndex: block: [534,0,0], thread: [118,0,0] Assertion srcIndex < srcSelectDimSize failed.
/opt/conda/conda-bld/pytorch_1591914838379/work/aten/src/THC/THCTensorIndex.cu:272: indexSelectLargeIndex: block: [534,0,0], thread: [119,0,0] Assertion srcIndex < srcSelectDimSize failed.
/opt/conda/conda-bld/pytorch_1591914838379/work/aten/src/THC/THCTensorIndex.cu:272: indexSelectLargeIndex: block: [534,0,0], thread: [120,0,0] Assertion srcIndex < srcSelectDimSize failed.
/opt/conda/conda-bld/pytorch_1591914838379/work/aten/src/THC/THCTensorIndex.cu:272: indexSelectLargeIndex: block: [534,0,0], thread: [121,0,0] Assertion srcIndex < srcSelectDimSize failed.
/opt/conda/conda-bld/pytorch_1591914838379/work/aten/src/THC/THCTensorIndex.cu:272: indexSelectLargeIndex: block: [534,0,0], thread: [122,0,0] Assertion srcIndex < srcSelectDimSize failed.
/opt/conda/conda-bld/pytorch_1591914838379/work/aten/src/THC/THCTensorIndex.cu:272: indexSelectLargeIndex: block: [534,0,0], thread: [123,0,0] Assertion srcIndex < srcSelectDimSize failed.
/opt/conda/conda-bld/pytorch_1591914838379/work/aten/src/THC/THCTensorIndex.cu:272: indexSelectLargeIndex: block: [534,0,0], thread: [124,0,0] Assertion srcIndex < srcSelectDimSize failed.
/opt/conda/conda-bld/pytorch_1591914838379/work/aten/src/THC/THCTensorIndex.cu:272: indexSelectLargeIndex: block: [534,0,0], thread: [125,0,0] Assertion srcIndex < srcSelectDimSize failed.
/opt/conda/conda-bld/pytorch_1591914838379/work/aten/src/THC/THCTensorIndex.cu:272: indexSelectLargeIndex: block: [534,0,0], thread: [126,0,0] Assertion srcIndex < srcSelectDimSize failed.
/opt/conda/conda-bld/pytorch_1591914838379/work/aten/src/THC/THCTensorIndex.cu:272: indexSelectLargeIndex: block: [534,0,0], thread: [127,0,0] Assertion srcIndex < srcSelectDimSize failed.
Traceback (most recent call last):
File "t2vec.py", line 121, in
train(args)
File "/home/ucas/jingquanliang/SimSub/ori-t2vec/train.py", line 262, in train
genloss = genLoss(gendata, m0, m1, lossF, args)
File "/home/ucas/jingquanliang/SimSub/ori-t2vec/train.py", line 90, in genLoss
output = m0(input, lengths, target)
File "/home/ucas/anaconda3/envs/jqlsim/lib/python3.6/site-packages/torch/nn/modules/module.py", line 550, in call
result = self.forward(*input, **kwargs)
File "/home/ucas/jingquanliang/SimSub/ori-t2vec/models.py", line 207, in forward
encoder_hn, H = self.encoder(src, lengths)
File "/home/ucas/anaconda3/envs/jqlsim/lib/python3.6/site-packages/torch/nn/modules/module.py", line 550, in call
result = self.forward(*input, **kwargs)
File "/home/ucas/jingquanliang/SimSub/ori-t2vec/models.py", line 111, in forward
lengths = lengths.data.view(-1).tolist()
RuntimeError: CUDA error: device-side assert triggered
@LannDiane
Copy link

Hi xiran,
I met the same problem as you, I would like to know if you have solved this.
Thank you so much!

@Gshaoo
Copy link

Gshaoo commented Mar 24, 2023

Hi xiran,
I met the same problem as you, I would like to know if you have solved this.
Thank you so much!

2 similar comments
@Gshaoo
Copy link

Gshaoo commented Apr 19, 2023

Hi xiran,
I met the same problem as you, I would like to know if you have solved this.
Thank you so much!

@FanC27
Copy link

FanC27 commented May 25, 2023

Hi xiran,
I met the same problem as you, I would like to know if you have solved this.
Thank you so much!

@liuwj2000
Copy link

I change -vocab_size to 20000, it is OK now

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
None yet
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
5 participants
@xiran2018 @liuwj2000 @LannDiane @FanC27 @Gshaoo