aboutsummaryrefslogtreecommitdiffstats
path: root/yt_dlp/extractor/common.py
Commit message (Collapse)AuthorAgeFilesLines
* [cleanup] Miscpukkandan2023-07-301-1/+1
|
* [ie] Extract subtitles from SMIL manifests (#7667)bashonly2023-07-241-20/+26
| | | Authored by: bashonly, pukkandan
* [extractor] Fix `--load-pages`pukkandan2023-07-221-1/+1
|
* [compat, networking] Deprecate old functions (#2861)coletdjnz2023-07-151-17/+24
| | | | Authored by: coletdjnz, pukkandan
* [networking] Rewrite architecture (#2861)coletdjnz2023-07-151-17/+15
| | | | | | | | | | | | | | | | New networking interface consists of a `RequestDirector` that directs each `Request` to appropriate `RequestHandler` and returns the `Response` or raises `RequestError`. The handlers define adapters to transform its internal Request/Response/Errors to our interfaces. User-facing changes: - Fix issues with per request proxies on redirects for urllib - Support for `ALL_PROXY` environment variable for proxy setting - Support for `socks5h` proxy - Closes https://github.com/yt-dlp/yt-dlp/issues/6325, https://github.com/ytdl-org/youtube-dl/issues/22618, https://github.com/ytdl-org/youtube-dl/pull/28093 - Raise error when using `https` proxy instead of silently converting it to `http` Authored by: coletdjnz
* [core] Allow extractors to mark formats as potentially DRM (#7396)pukkandan2023-07-061-6/+4
| | | | | | | | This is useful for HLS where detecting whether the format is actually DRM requires the child manifest to be downloaded. Makes the error message when using `--test` inconsistent, but doesn't really matter.
* [extractor] Support multiple `_VALID_URL`s (#5812)pukkandan2023-06-221-4/+4
| | | | Authored by: nixxo
* Fix bug in db3ad8a67661d7b234a6954d9c6a4a9b1749f5ebpukkandan2023-06-211-1/+2
| | | | Closes #7367
* [cleanup] Miscpukkandan2023-06-211-1/+2
| | | | | Closes #6288, Closes #7197, Closes #7265, Closes #7353, Closes #5773 Authored by: mikf, freezboltz, pukkandan
* Add option `--netrc-cmd` (#6682)Nicolai Dagestad2023-06-211-24/+29
| | | | Authored by: NDagestad, pukkandan Closes #1706
* [extractor/youtube] Extract `channel_is_verified` (#7213)coletdjnz2023-06-081-0/+1
| | | | Authored by: coletdjnz
* [extractor/youtube] Extract more metadata for comments (#7179)coletdjnz2023-06-011-2/+7
| | | | | | | | | | Adds new comment fields: * `author_url` - The url to the comment author's page * `author_is_verified` - Whether the author is verified on the platform * `is_pinned` - Whether the comment is pinned to the top of the comments Closes https://github.com/yt-dlp/yt-dlp/issues/5411 Authored by: coletdjnz
* [cookies] Move `YoutubeDLCookieJar` to cookies module (#7091)coletdjnz2023-05-271-1/+1
| | | Authored by: coletdjnz
* [extractor/youtube] Extract `heatmap` data (#7100)Audrey2023-05-261-0/+4
| | | | Closes #3888 Authored by: tntmod54321
* [extractor] Do not warn for invalid chapter data in descriptionpukkandan2023-04-161-4/+8
| | | | Fixes https://github.com/yt-dlp/yt-dlp/issues/6811#issuecomment-1509876209
* [extractor] Extract more metadata from ISMpukkandan2023-03-251-0/+2
| | | | Fixes https://github.com/yt-dlp/yt-dlp/commit/81b6102d2099eec78a2db9ae3d101a8503dd4f25#r105892531
* [extractor] Do not exit early for unsuitable `url_result`pukkandan2023-03-251-2/+2
|
* [extractor/rutube] Extract chapters from description (#6345)mushbite2023-03-041-0/+32
| | | Authored by: mushbite
* [cleanup] Miscpukkandan2023-02-281-1/+1
|
* [extractor/youtube] Fix 5038f6d713303e0967d002216e7a88652401c22apukkandan2023-02-281-0/+1
| | | | | | | * [fragment] Fix `request_data` * [youtube] Don't use POST for now. It may be easier to break in future Authored by: bashonly, coletdjnz
* [extractor] Fix DRM detection in m3u8pukkandan2023-02-261-0/+2
| | | | Fixes https://github.com/ytdl-org/youtube-dl/issues/31693#issuecomment-1445202857
* Update to ytdl-commit-2dd6c6epukkandan2023-02-171-1/+1
| | | | | | | | | | [YouTube] Avoid crash if uploader_id extraction fails https://github.com/ytdl-org/youtube-dl/commit/2dd6c6edd8e0fc5e45865b8e6d865e35147de772 Except: * 295736c9cba714fb5de7d1c3dd31d86e50091cf8 [jsinterp] Improve parsing * 384f632e8a9b61e864a26678d85b2b39933b9bae [ITV] Overhaul ITV extractor * 33db85c571304bbd6863e3407ad8d08764c9e53b [feat]: Add support to external downloader aria2p
* [extractor/common] Fix `_search_nuxt_data` (#6062)LowSuggestion9122023-02-121-5/+2
| | | Authored by: LowSuggestion912
* [downloader/hls] Allow extractors to provide AES key (#6158)bashonly2023-02-081-1/+12
| | | | | | | | and related cleanup Authored by: bashonly, Grub4K Co-authored-by: Simon Sawicki <contact@grub4k.xyz>
* [extractor/slideslive] Fix slides and chapters/duration (#6024)bashonly2023-01-141-1/+11
| | | | | | | * Fix slides/thumbnails extraction * Extract duration to fix issues w/ `--embed-chapters`, `--split-chapters` * Add `InfoExtractor._extract_mpd_vod_duration` method * Expand applicability of `InfoExtractor._parse_m3u8_vod_duration` method Authored by: bashonly
* [extractor/nbc] Fix `NBC` and `NBCStations` extractors (#6033)bashonly2023-01-141-1/+4
| | | | | Improve `InfoExtractor._parse_smil_formats` extension detection Closes #6019 Authored by: bashonly
* [cleanup] Miscpukkandan2023-01-071-5/+2
|
* [cleanup] Miscpukkandan2023-01-021-2/+4
| | | | Closes #5576, closes #5887
* Update to ytdl-commit-195f22f6Simon Sawicki2023-01-021-21/+35
| | | | | | | [generic] Improve KVS (etc) extraction https://github.com/ytdl-org/youtube-dl/commit/195f22f679330549882a8234e7234942893a4902 Closes #3716 Authored by: Grub4k, pukkandan
* Improve handling for overriding extractors with plugins (#5916)Matthew2023-01-021-2/+11
| | | | | | * Extractors replaced with plugin extractors now show in debug output * Better testcase handling * Added documentation Authored by: coletdjnz, pukkandan
* [extractor] Let `_extract_format` functions obey `--ignore-no-formats`pukkandan2022-12-231-0/+16
|
* [cleanup] Miscpukkandan2022-12-031-1/+11
|
* [utils] Make `ExtractorError` mutablepukkandan2022-11-301-10/+4
|
* [extractor] Deprecate `_sort_formats`pukkandan2022-11-171-3/+8
|
* Implement universal format sortingpukkandan2022-11-171-3/+3
| | | | Closes #5566
* [utils] Move format sorting code into `utils`pukkandan2022-11-171-286/+12
|
* Add new field `aspect_ratio`pukkandan2022-11-161-0/+3
| | | | Closes #5402
* [cleanup] Miscpukkandan2022-11-161-4/+5
| | | | Closes #5541
* [extractor] Add a way to distinguish IEs that returns only videospukkandan2022-11-131-0/+19
|
* [extractor] Fix `fatal=False` for `_search_nuxt_data`pukkandan2022-11-111-1/+4
| | | | Closes #5423
* [extractor/youtube] Differentiate between no and disabled comments (#5491)Matthew2022-11-101-0/+5
| | | | | | | | `comments` and `comment_count` will be set to None, as opposed to an empty list and 0, respectively. Fixes https://github.com/yt-dlp/yt-dlp/issues/5068 Authored by: coletdjnz, pukkandan
* [cleanup] Lint and misc cleanuppukkandan2022-11-071-1/+2
|
* [extractor] Improve `_generic_title`pukkandan2022-10-311-3/+5
|
* [extractor/zeenews] Add extractor (#5289)m4tu4g2022-10-201-1/+1
| | | | Closes #4967 Authored by: m4tu4g, pukkandan
* [cleanup Miscpukkandan2022-10-181-1/+3
| | | | Closes #5162
* [extractor/youtube:tab] Let `approximate_date` return timestamppukkandan2022-10-131-2/+2
|
* [extractor/generic] Separate embed extraction into own function (#5176)pukkandan2022-10-091-0/+7
|
* [extractor/common] Fix `json_ld` type checks (#5145)Simon Sawicki2022-10-091-7/+5
| | | | Closes #5144, #5143 Authored by: Grub4K
* [extractor/youtube] Extract concurrent view count for livestreams (#5152)Matthew2022-10-071-0/+1
| | | | | | Adds new field `concurrent_view_count` Closes https://github.com/yt-dlp/yt-dlp/issues/4843 Authored by: coletdjnz
* [cleanup] Minor fixespukkandan2022-10-041-1/+1
| | | | Closes #5129, Closes #4982