Cannot pickle dataset?

[252057052]

Can't pickle local object 'load_mosi..MOSI'

[frallisland]

you maybe download dataset firdt.

[Justin1904]

Can you provide more context? Like the full stack trace and where you download and put the data?

[Junge718]

like this:
Traceback (most recent call last):
File "train_mosi.py", line 264, in
main(PARAMS)
File "train_mosi.py", line 131, in main
for batch in train_iterator:
File "D:\Anaconda3\lib\site-packages\torch\utils\data\dataloader.py", line 352, in iter
return self._get_iterator()
File "D:\Anaconda3\lib\site-packages\torch\utils\data\dataloader.py", line 294, in _get_iterator
return _MultiProcessingDataLoaderIter(self)
File "D:\Anaconda3\lib\site-packages\torch\utils\data\dataloader.py", line 801, in init
w.start()
File "D:\Anaconda3\lib\multiprocessing\process.py", line 105, in start
self._popen = self._Popen(self)
File "D:\Anaconda3\lib\multiprocessing\context.py", line 223, in _Popen
return _default_context.get_context().Process._Popen(process_obj)
File "D:\Anaconda3\lib\multiprocessing\context.py", line 322, in _Popen
return Popen(process_obj)
File "D:\Anaconda3\lib\multiprocessing\popen_spawn_win32.py", line 65, in init
reduction.dump(process_obj, to_child)
File "D:\Anaconda3\lib\multiprocessing\reduction.py", line 60, in dump
ForkingPickler(file, protocol).dump(obj)
AttributeError: Can't pickle local object 'load_mosi..MOSI'

[Justin1904]

This looks weird, seems like the error is coming from inside the torch dataloader? Which version of pytorch is this

[Junge718]

This looks weird, seems like the error is coming from inside the torch dataloader? Which version of pytorch is this

It's 1.7.1. Maybe it's just because my OS is Windows.

[elmliu]

train_iterator = DataLoader(train_set, batch_size=batch_sz, num_workers=0, shuffle=True)
Works for me on Windows after changing num_workers=4 to 0. This is probably because multiprocessing lib doesn’t have it implemented on Windows.

[Weiyinyin11]

This looks weird, seems like the error is coming from inside the torch dataloader? Which version of pytorch is this

It's 1.7.1. Maybe it's just because my OS is Windows.

Has your problem been solved?

[Junge718]

Thank you very much for your attention to my problem. I have tried on Linux and there are no problems on Linux. But I still can't run the code on Windows. 

…

------------------ 原始邮件 ------------------ 发件人: "Justin1904/Low-rank-Multimodal-Fusion" ***@***.***>; 发送时间: 2021年12月1日(星期三) 晚上9:12 ***@***.***>; ***@***.******@***.***>; 主题: Re: [Justin1904/Low-rank-Multimodal-Fusion] Cannot pickle dataset? (#15) This looks weird, seems like the error is coming from inside the torch dataloader? Which version of pytorch is this It's 1.7.1. Maybe it's just because my OS is Windows. Has your problem been solved? — You are receiving this because you commented. Reply to this email directly, view it on GitHub, or unsubscribe. Triage notifications on the go with GitHub Mobile for iOS or Android.

[Weiyinyin11]

非常感谢您对我的问题的关注。我在 Linux 上试过，在 Linux 上没有问题。但是我仍然无法在 Windows 上运行代码。 
…
------------------ 原始邮件 ------------------ 发件人: "Justin1904/Low-rank-Multimodal-Fusion" @.>; 发送时间: 2021年12月1日(星期三) 晚上9:12 @.>; @.@.>; 主题: Re: [Justin1904/Low-rank-Multimodal-Fusion] Cannot pickle dataset? (#15) This looks weird, seems like the error is coming from inside the torch dataloader? Which version of pytorch is this It's 1.7.1. Maybe it's just because my OS is Windows. Has your problem been solved? — You are receiving this because you commented. Reply to this email directly, view it on GitHub, or unsubscribe. Triage notifications on the go with GitHub Mobile for iOS or Android.

Thank you for your reply. Is it convenient to leave a contact information?May I ask you some questions?