Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Curiositystream - Collection URL problem #26326

Closed
6 tasks done
NaufalAriqS21 opened this issue Aug 14, 2020 · 0 comments
Closed
6 tasks done

Curiositystream - Collection URL problem #26326

NaufalAriqS21 opened this issue Aug 14, 2020 · 0 comments

Comments

@NaufalAriqS21
Copy link

Checklist

  • I'm reporting a broken site support issue
  • I've verified that I'm running youtube-dl version 2020.07.28
  • I've checked that all provided URLs are alive and playable in a browser
  • I've checked that all URLs and arguments with special characters are properly quoted or escaped
  • I've searched the bugtracker for similar bug reports including closed ones
  • I've read bugs section in FAQ

Verbose log

C:\Windows\system32>youtube-dl --version
2020.07.28

C:\Windows\system32>youtube-dl -v -F https://app.curiositystream.com/collection/2
[debug] System config: []
[debug] User config: []
[debug] Custom config: []
[debug] Command-line args: ['-v', '-F', 'https://app.curiositystream.com/collection/2']
[debug] Encodings: locale cp1252, fs utf-8, out utf-8, pref cp1252
[debug] youtube-dl version 2020.07.28
[debug] Python version 3.6.8 (CPython) - Windows-10-10.0.14393-SP0
[debug] exe versions: ffmpeg git-2020-08-07-fab00b0, ffprobe git-2020-08-07-fab00b0
[debug] Proxy map: {}
[curiositystream:collection] 2: Downloading JSON metadata
[download] Downloading playlist: Curious Minds: The Internet
[curiositystream:collection] playlist Curious Minds: The Internet: Collected 17 video ids (downloading 17 of them)
[download] Downloading video 1 of 17
[curiositystream] 2: Downloading JSON metadata
[curiositystream] 2: Downloading m3u8 information
[info] Available formats for 2:
format code  extension  resolution note
hls-696      mp4        640x360     696k , avc1.66.30, mp4a.40.2
hls-896      mp4        640x360     896k , avc1.77.30, mp4a.40.2
hls-1328     mp4        1280x720   1328k , avc1.64001f, mp4a.40.2
rtmp         flv        1280x720   1628k , Mp4 container, H264@1500k, Aac  @128k, 22.60MiB
http         mp4        1280x720   1628k , Mp4 container, H264@1500k, Aac  @128k, 22.60MiB
hls-1928     mp4        1920x1080  1928k , avc1.64001f, mp4a.40.2
hls-2328     mp4        1920x1080  2328k , avc1.64001f, mp4a.40.2
hls-3628     mp4        1920x1080  3628k , avc1.64001f, mp4a.40.2
hls-6128     mp4        1920x1080  6128k , avc1.64001f, mp4a.40.2 (best)
[download] Downloading video 2 of 17
[curiositystream] 143: Downloading JSON metadata
[info] Available formats for 143:
format code  extension  resolution note
rtmp         flv        1280x720   1692k , Mp4 container, H264@1500k, Aac  @192k, 24.10MiB
http         mp4        1280x720   1692k , Mp4 container, H264@1500k, Aac  @192k, 24.10MiB (best)
[download] Downloading video 3 of 17
[curiositystream] 147: Downloading JSON metadata
[info] Available formats for 147:
format code  extension  resolution note
rtmp         flv        1280x720   1692k , Mp4 container, H264@1500k, Aac  @192k, 20.66MiB
http         mp4        1280x720   1692k , Mp4 container, H264@1500k, Aac  @192k, 20.66MiB (best)
[download] Downloading video 4 of 17
[curiositystream] 90: Downloading JSON metadata
[curiositystream] 90: Downloading m3u8 information
[info] Available formats for 90:
format code  extension  resolution note
hls-696      mp4        640x360     696k , avc1.66.30, mp4a.40.2
hls-896      mp4        640x360     896k , avc1.77.30, mp4a.40.2
hls-1328     mp4        1280x720   1328k , avc1.64001f, mp4a.40.2
rtmp         flv        1280x720   1628k , Mp4 container, H264@1500k, Aac  @128k, 18.01MiB
http         mp4        1280x720   1628k , Mp4 container, H264@1500k, Aac  @128k, 18.01MiB
hls-1928     mp4        1920x1080  1928k , avc1.64001f, mp4a.40.2
hls-2328     mp4        1920x1080  2328k , avc1.64001f, mp4a.40.2
hls-3628     mp4        1920x1080  3628k , avc1.64001f, mp4a.40.2
hls-6128     mp4        1920x1080  6128k , avc1.64001f, mp4a.40.2 (best)
[download] Downloading video 5 of 17
[curiositystream] 4: Downloading JSON metadata
[curiositystream] 4: Downloading m3u8 information
[info] Available formats for 4:
format code  extension  resolution note
hls-696      mp4        640x360     696k , avc1.66.30, mp4a.40.2
hls-896      mp4        640x360     896k , avc1.77.30, mp4a.40.2
hls-1328     mp4        1280x720   1328k , avc1.64001f, mp4a.40.2
rtmp         flv        1280x720   1628k , Mp4 container, H264@1500k, Aac  @128k, 17.42MiB
http         mp4        1280x720   1628k , Mp4 container, H264@1500k, Aac  @128k, 17.42MiB
hls-1928     mp4        1920x1080  1928k , avc1.64001f, mp4a.40.2
hls-2328     mp4        1920x1080  2328k , avc1.64001f, mp4a.40.2
hls-3628     mp4        1920x1080  3628k , avc1.64001f, mp4a.40.2
hls-6128     mp4        1920x1080  6128k , avc1.64001f, mp4a.40.2 (best)
[download] Downloading video 6 of 17
[curiositystream] 651: Downloading JSON metadata
[curiositystream] 651: Downloading m3u8 information
[info] Available formats for 651:
format code  extension  resolution note
hls-696      mp4        640x360     696k , avc1.66.30, mp4a.40.2
hls-896      mp4        640x360     896k , avc1.77.30, mp4a.40.2
hls-1328     mp4        1280x720   1328k , avc1.64001f, mp4a.40.2
hls-1928     mp4        1920x1080  1928k , avc1.64001f, mp4a.40.2
hls-2328     mp4        1920x1080  2328k , avc1.64001f, mp4a.40.2
hls-3628     mp4        1920x1080  3628k , avc1.64001f, mp4a.40.2
hls-6128     mp4        1920x1080  6128k , avc1.64001f, mp4a.40.2 (best)
[download] Downloading video 7 of 17
[curiositystream] 142: Downloading JSON metadata
[info] Available formats for 142:
format code  extension  resolution note
rtmp         flv        1280x720   1692k , Mp4 container, H264@1500k, Aac  @192k, 24.16MiB
http         mp4        1280x720   1692k , Mp4 container, H264@1500k, Aac  @192k, 24.16MiB (best)
[download] Downloading video 8 of 17
[curiositystream] 9: Downloading JSON metadata
[curiositystream] 9: Downloading m3u8 information
[info] Available formats for 9:
format code  extension  resolution note
hls-696      mp4        640x360     696k , avc1.66.30, mp4a.40.2
hls-896      mp4        640x360     896k , avc1.77.30, mp4a.40.2
hls-1328     mp4        1280x720   1328k , avc1.64001f, mp4a.40.2
rtmp         flv        1280x720   1628k , Mp4 container, H264@1500k, Aac  @128k, 23.32MiB
http         mp4        1280x720   1628k , Mp4 container, H264@1500k, Aac  @128k, 23.32MiB
hls-1928     mp4        1920x1080  1928k , avc1.64001f, mp4a.40.2
hls-2328     mp4        1920x1080  2328k , avc1.64001f, mp4a.40.2
hls-3628     mp4        1920x1080  3628k , avc1.64001f, mp4a.40.2
hls-6128     mp4        1920x1080  6128k , avc1.64001f, mp4a.40.2 (best)
[download] Downloading video 9 of 17
[curiositystream] 141: Downloading JSON metadata
[curiositystream] 141: Downloading m3u8 information
[info] Available formats for 141:
format code  extension  resolution note
hls-728      mp4        640x360     728k , avc1.66.30, mp4a.40.2
hls-928      mp4        640x360     928k , avc1.77.30, mp4a.40.2
hls-1392     mp4        1280x720   1392k , avc1.64001f, mp4a.40.2
rtmp         flv        1280x720   1692k , Mp4 container, H264@1500k, Aac  @192k, 16.67MiB
http         mp4        1280x720   1692k , Mp4 container, H264@1500k, Aac  @192k, 16.67MiB
hls-1992     mp4        1920x1080  1992k , avc1.64001f, mp4a.40.2
hls-2392     mp4        1920x1080  2392k , avc1.64001f, mp4a.40.2
hls-3692     mp4        1920x1080  3692k , avc1.64001f, mp4a.40.2
hls-6192     mp4        1920x1080  6192k , avc1.64001f, mp4a.40.2 (best)
[download] Downloading video 10 of 17
[curiositystream] 144: Downloading JSON metadata
[info] Available formats for 144:
format code  extension  resolution note
rtmp         flv        1280x720   1692k , Mp4 container, H264@1500k, Aac  @192k, 15.57MiB
http         mp4        1280x720   1692k , Mp4 container, H264@1500k, Aac  @192k, 15.57MiB (best)
[download] Downloading video 11 of 17
[curiositystream] 146: Downloading JSON metadata
[info] Available formats for 146:
format code  extension  resolution note
rtmp         flv        1280x720   1692k , Mp4 container, H264@1500k, Aac  @192k, 13.96MiB
http         mp4        1280x720   1692k , Mp4 container, H264@1500k, Aac  @192k, 13.96MiB (best)
[download] Downloading video 12 of 17
[curiositystream] 6: Downloading JSON metadata
[curiositystream] 6: Downloading m3u8 information
[info] Available formats for 6:
format code  extension  resolution note
hls-696      mp4        640x360     696k , avc1.66.30, mp4a.40.2
hls-896      mp4        640x360     896k , avc1.77.30, mp4a.40.2
hls-1328     mp4        1280x720   1328k , avc1.64001f, mp4a.40.2
rtmp         flv        1280x720   1628k , Mp4 container, H264@1500k, Aac  @128k, 23.22MiB
http         mp4        1280x720   1628k , Mp4 container, H264@1500k, Aac  @128k, 23.22MiB
hls-1928     mp4        1920x1080  1928k , avc1.64001f, mp4a.40.2
hls-2328     mp4        1920x1080  2328k , avc1.64001f, mp4a.40.2
hls-3628     mp4        1920x1080  3628k , avc1.64001f, mp4a.40.2
hls-6128     mp4        1920x1080  6128k , avc1.64001f, mp4a.40.2 (best)
[download] Downloading video 13 of 17
[curiositystream] 97: Downloading JSON metadata
[curiositystream] 97: Downloading m3u8 information
[info] Available formats for 97:
format code  extension  resolution note
hls-696      mp4        640x360     696k , avc1.66.30, mp4a.40.2
hls-896      mp4        640x360     896k , avc1.77.30, mp4a.40.2
hls-1328     mp4        1280x720   1328k , avc1.64001f, mp4a.40.2
rtmp         flv        1280x720   1628k , Mp4 container, H264@1500k, Aac  @128k, 14.01MiB
http         mp4        1280x720   1628k , Mp4 container, H264@1500k, Aac  @128k, 14.01MiB
hls-1928     mp4        1920x1080  1928k , avc1.64001f, mp4a.40.2
hls-2328     mp4        1920x1080  2328k , avc1.64001f, mp4a.40.2
hls-3628     mp4        1920x1080  3628k , avc1.64001f, mp4a.40.2
hls-6128     mp4        1920x1080  6128k , avc1.64001f, mp4a.40.2 (best)
[download] Downloading video 14 of 17
[curiositystream] 7: Downloading JSON metadata
[curiositystream] 7: Downloading m3u8 information
[info] Available formats for 7:
format code  extension  resolution note
hls-696      mp4        640x360     696k , avc1.66.30, mp4a.40.2
hls-896      mp4        640x360     896k , avc1.77.30, mp4a.40.2
hls-1328     mp4        1280x720   1328k , avc1.64001f, mp4a.40.2
rtmp         flv        1280x720   1628k , Mp4 container, H264@1500k, Aac  @128k, 23.16MiB
http         mp4        1280x720   1628k , Mp4 container, H264@1500k, Aac  @128k, 23.16MiB
hls-1928     mp4        1920x1080  1928k , avc1.64001f, mp4a.40.2
hls-2328     mp4        1920x1080  2328k , avc1.64001f, mp4a.40.2
hls-3628     mp4        1920x1080  3628k , avc1.64001f, mp4a.40.2
hls-6128     mp4        1920x1080  6128k , avc1.64001f, mp4a.40.2 (best)
[download] Downloading video 15 of 17
[curiositystream] 145: Downloading JSON metadata
[curiositystream] 145: Downloading m3u8 information
[info] Available formats for 145:
format code  extension  resolution note
hls-728      mp4        640x360     728k , avc1.66.30, mp4a.40.2
hls-928      mp4        640x360     928k , avc1.77.30, mp4a.40.2
hls-1392     mp4        1280x720   1392k , avc1.64001f, mp4a.40.2
rtmp         flv        1280x720   1692k , Mp4 container, H264@1500k, Aac  @192k, 22.12MiB
http         mp4        1280x720   1692k , Mp4 container, H264@1500k, Aac  @192k, 22.12MiB
hls-1992     mp4        1920x1080  1992k , avc1.64001f, mp4a.40.2
hls-2392     mp4        1920x1080  2392k , avc1.64001f, mp4a.40.2
hls-3692     mp4        1920x1080  3692k , avc1.64001f, mp4a.40.2
hls-6192     mp4        1920x1080  6192k , avc1.64001f, mp4a.40.2 (best)
[download] Downloading video 16 of 17
[curiositystream] 8: Downloading JSON metadata
[curiositystream] 8: Downloading m3u8 information
[info] Available formats for 8:
format code  extension  resolution note
hls-696      mp4        640x360     696k , avc1.66.30, mp4a.40.2
hls-896      mp4        640x360     896k , avc1.77.30, mp4a.40.2
hls-1328     mp4        1280x720   1328k , avc1.64001f, mp4a.40.2
rtmp         flv        1280x720   1628k , Mp4 container, H264@1500k, Aac  @128k, 17.72MiB
http         mp4        1280x720   1628k , Mp4 container, H264@1500k, Aac  @128k, 17.72MiB
hls-1928     mp4        1920x1080  1928k , avc1.64001f, mp4a.40.2
hls-2328     mp4        1920x1080  2328k , avc1.64001f, mp4a.40.2
hls-3628     mp4        1920x1080  3628k , avc1.64001f, mp4a.40.2
hls-6128     mp4        1920x1080  6128k , avc1.64001f, mp4a.40.2 (best)
[download] Downloading video 17 of 17
[curiositystream] 662: Downloading JSON metadata
[curiositystream] 662: Downloading m3u8 information
[info] Available formats for 662:
format code  extension  resolution note
hls-696      mp4        640x360     696k , avc1.66.30, mp4a.40.2
hls-896      mp4        640x360     896k , avc1.77.30, mp4a.40.2
hls-1328     mp4        1280x720   1328k , avc1.64001f, mp4a.40.2
hls-1928     mp4        1920x1080  1928k , avc1.64001f, mp4a.40.2
hls-2328     mp4        1920x1080  2328k , avc1.64001f, mp4a.40.2
hls-3628     mp4        1920x1080  3628k , avc1.64001f, mp4a.40.2
hls-6128     mp4        1920x1080  6128k , avc1.64001f, mp4a.40.2 (best)
[download] Finished downloading playlist: Curious Minds: The Internet

C:\Windows\system32>youtube-dl -v -F https://curiositystream.com/collections/36
[debug] System config: []
[debug] User config: []
[debug] Custom config: []
[debug] Command-line args: ['-v', '-F', 'https://curiositystream.com/collections/36']
[debug] Encodings: locale cp1252, fs utf-8, out utf-8, pref cp1252
[debug] youtube-dl version 2020.07.28
[debug] Python version 3.6.8 (CPython) - Windows-10-10.0.14393-SP0
[debug] exe versions: ffmpeg git-2020-08-07-fab00b0, ffprobe git-2020-08-07-fab00b0
[debug] Proxy map: {}
[generic] 36: Requesting header
WARNING: Falling back on generic information extractor.
[generic] 36: Downloading webpage
[generic] 36: Extracting information
ERROR: Unsupported URL: https://curiositystream.com/collections/36
Traceback (most recent call last):
  File "c:\program files\python36\lib\site-packages\youtube_dl\YoutubeDL.py", line 797, in extract_info
    ie_result = ie.extract(url)
  File "c:\program files\python36\lib\site-packages\youtube_dl\extractor\common.py", line 530, in extract
    ie_result = self._real_extract(url)
  File "c:\program files\python36\lib\site-packages\youtube_dl\extractor\generic.py", line 3382, in _real_extract
    raise UnsupportedError(url)
youtube_dl.utils.UnsupportedError: Unsupported URL: https://curiositystream.com/collections/36

Description

It seems curiositystream has another collection url format
Collection url format 1: https://app.curiositystream.com/collection/2
Collection url format 2: https://curiositystream.com/collections/36
With this regex https?://(?:app\.)?curiositystream\.com/(?:collection|series)/(?P<id>\d+) , format number 2 is not detected.
The difference is just word s in collection and collections.
@NaufalAriqS21 NaufalAriqS21 changed the title Curiositystream Collection URL not Downloading Curiositystream - Collection URL problem Aug 14, 2020
@tsia tsia mentioned this issue May 23, 2021
Closed
11 tasks
@dstftw dstftw closed this as completed in 2ccee8d Jun 20, 2021
gaming-hacker added a commit to gaming-hacker/youtube-dl that referenced this issue Sep 3, 2021
@gaming-hacker
Merge commit '188b7b108e1cd287580bee5dba8075e669c29a10' into v1
d8c3589 
* commit '188b7b108e1cd287580bee5dba8075e669c29a10': (192 commits)
  Avoid skipping ID when unlisted_hash is numeric
  [peertube] only call description endpoint if necessary (ytdl-org#29383)
  [periscope] pass referer to HLS requests(closes ytdl-org#29419)
  [liveleak] Remove extractor (closes ytdl-org#17625, closes ytdl-org#24222) (ytdl-org#29331)
  [pornhub] Add support for pornhubthbh7ap3u.onion
  [pornhub] Detect geo restriction
  [pornhub] Dismiss tbr extracted from download URLs (closes ytdl-org#28927)
  [curiositystream:collection] Extend _VALID_URL (closes ytdl-org#26326, closes ytdl-org#29117)
  [youtube] Make get_video_info processing more robust (closes ytdl-org#29333)
  [youtube] Workaround for get_video_info request (refs ytdl-org#29333)
  [bilibili] Strip uploader name (ytdl-org#29202)
  [youtube] Update invidious instance list (ytdl-org#29281)
  [umg:de] Update GraphQL API URL (ytdl-org#29304)
  [nrk] Switch psapi URL to https (closes ytdl-org#29344)
  [postprocessor/ffmpeg] Show ffmpeg output on error (refs ytdl-org#22680) (ytdl-org#29336)
  [egghead] Add support for app.egghead.io (closes ytdl-org#28404) (ytdl-org#29303)
  [appleconnect] Fix extraction (ytdl-org#29208)
  [orf:tvthek] Add support for MPD formats (closes ytdl-org#28672) (ytdl-org#29236)
  [README.md] Update MSVC 2010 redist URL (closes ytdl-org#29222)
  release 2021.06.06
  ...

# Conflicts:
#	youtube_dl/extractor/generic.py
@Lesmiscore Lesmiscore mentioned this issue Feb 20, 2022
Open
14 tasks
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
None yet
Projects
None yet
Milestone
No milestone
Development

Successfully merging a pull request may close this issue.

Update curiositystream.py
1 participant
@NaufalAriqS21