aboutsummaryrefslogtreecommitdiffstats
path: root/yt_dlp/downloader/fragment.py
Commit message (Collapse)AuthorAgeFilesLines
* [downloader/fragment] HLS download can continue without first fragmentpukkandan2022-10-181-24/+25
| | | | Closes #5274
* [utils] Add `deprecation_warning`pukkandan2022-08-301-2/+2
| | | | See https://github.com/yt-dlp/yt-dlp/pull/2173#issuecomment-1097021515
* Standardize retry mechanism (#1649)pukkandan2022-08-021-29/+22
| | | | | | | * [utils] Create `RetryManager` * Migrate all retries to use the manager * [extractor] Add wrapper methods for convenience * Standardize console messages for retries * Add `--retry-sleep` for extractors
* [compat] Remove more functionspukkandan2022-06-251-3/+5
| | | | Removing any more will require changes to a large number of extractors
* [cleanup] Misc fixespukkandan2022-06-221-1/+1
|
* [dash] Show fragment count with `--live-from-start` (#3493)MMM2022-06-071-0/+4
| | | Authored by: flashdagger
* [cleanup] Misc fixespukkandan2022-06-031-6/+14
| | | | | | Cherry-picks from: #3498, #3947 Related: #3949, https://github.com/yt-dlp/yt-dlp/issues/1839#issuecomment-1140313836 Authored by: pukkandan, flashdagger, gamer191
* Bugfix for 23326151c45b632c3d5948bd018e80abb370e676pukkandan2022-05-201-12/+5
|
* Add option --retry-sleep (#3059)pukkandan2022-05-191-4/+1
| | | | Closes #2852
* [cleanup] Misc fixes (see desc)pukkandan2022-05-011-1/+1
| | | | | | | | * Do not warn when fixup is skipped for existing file * [fragment] Fix `--skip-unavailable-fragments` for HTTP Errors * [utils] write_string: Fix bug in 59f943cd5097e9bdbc3cb3e6b5675e43d369341a * [utils] parse_codecs: Subtitle codec is generally referred to as `scodec`. https://github.com/yt-dlp/yt-dlp/pull/2174#discussion_r790156048 * [docs] Remove note about permissions. Closes #3597
* [cleanup] Misc fixespukkandan2022-04-291-8/+4
| | | | Closes #3565, https://github.com/yt-dlp/yt-dlp/issues/3514#issuecomment-1105944364
* [cleanup] Misc cleanup and refactor (#2173)pukkandan2022-04-181-4/+4
|
* [downloader/fragment] Make single thread download work for --live-from-start ↵Lesmiscore (Naoya Ozaki)2022-04-161-2/+7
| | | | | (#3446) Authored by: Lesmiscore
* Fix `--skip-unavailable-fragments`pukkandan2022-04-151-0/+2
| | | | | Bug in d71fd412495af9ebccef807379859a0baa97ddee Closes #3437
* Do not change fragment chunk-size when `--test`pukkandan2022-04-151-1/+1
| | | | Closes #3434
* [cleanup] Sort importspukkandan2022-04-121-6/+2
| | | | | | Using https://github.com/PyCQA/isort isort -m VERTICAL_HANGING_INDENT --py 36 -l 80 --rr -n --tc .
* [cleanup] Upgrade syntaxpukkandan2022-04-121-6/+2
| | | | | | | | | | Using https://github.com/asottile/pyupgrade 1. `__future__` imports and `coding: utf-8` were removed 2. Files were rewritten with `pyupgrade --py36-plus --keep-percent-format` 3. f-strings were cherry-picked from `pyupgrade --py36-plus` Extractors are left untouched (except removing header) to avoid unnecessary merge conflicts
* [cleanup] Misc fixespukkandan2022-04-051-13/+11
| | | | | | Closes https://github.com/yt-dlp/yt-dlp/pull/3213, Closes https://github.com/yt-dlp/yt-dlp/pull/3117 Related: https://github.com/yt-dlp/yt-dlp/issues/3146#issuecomment-1077323114, https://github.com/yt-dlp/yt-dlp/pull/3277#discussion_r841019671, https://github.com/yt-dlp/yt-dlp/commit/a825ffbffa0bea322e3ccb44c6f8e01d8d9572fb#commitcomment-68538986, https://github.com/yt-dlp/yt-dlp/issues/2360, https://github.com/yt-dlp/yt-dlp/commit/5fa3c9a88f597625296981a4a26be723e65d4842#r70393519, https://github.com/yt-dlp/yt-dlp/commit/5fa3c9a88f597625296981a4a26be723e65d4842#r70393254
* [fragment] Read downloaded fragments only when needed (#3069)Lesmiscore (Naoya Ozaki)2022-03-151-26/+20
| | | Authored by: Lesmiscore
* [downloader] Obey `--file-access-retries` when deleting/renaming (#2224)Emanuel Hoogeveen2022-03-031-2/+2
| | | Authored by: ehoogeveen-medweb
* [downloader/fragment] Fix bugs around resuming with Range (#2901)Lesmiscore (Naoya Ozaki)2022-02-281-1/+1
| | | Authored by: Lesmiscore
* [downloader/fragment] Ignore `FileNotFoundError` when downloading livestreamsLesmiscore2022-02-261-1/+6
| | | | | | when `--live-from-start` is used for YouTube and the live ends, request for the last segment prematurely ends (or 404, 403). this is causing lack of the file and `FileNotFoundError` lacking segment doesn't have any data, so it's safe to ignore
* [downloader/fragment] Fix problem where multiple threads can share one iteratorLesmiscore2022-02-251-8/+7
| | | | | | which causes "ValueError: generator already executing" error Closes #2881
* [downloader/fragment] Improve `--live-from-start` for YouTube livestreams ↵Lesmiscore (Naoya Ozaki)2022-02-251-10/+30
| | | | (#2870)
* [aes] Add unpad_pkcs7pukkandan2022-02-011-3/+2
|
* [youtube] End `live-from-start` properly when stream ends with 403pukkandan2021-12-261-0/+2
| | | | Closes #2089
* Add option `--file-access-retries` (#2066)Emanuel Hoogeveen2021-12-231-5/+4
| | | | Closes #517 Authored by: ehoogeveen-medweb
* [dash,youtube] Download live from start to end (#888)The Hatsune Daishi2021-12-201-10/+37
| | | | | | | | | | | | | | | * Add option `--live-from-start` to enable downloading live videos from start * Add key `is_from_start` in formats to identify formats (of live videos) that downloads from start * [dash] Create protocol `http_dash_segments_generator` that allows a function to be passed instead of fragments * [fragment] Allow multiple live dash formats to download simultaneously * [youtube] Implement fragment re-fetching for the live dash formats * [youtube] Re-extract dash manifest every 5 hours (manifest expires in 6hrs) * [postprocessor/ffmpeg] Add `FFmpegFixupDuplicateMoovPP` to fixup duplicated moov atoms Known issue: Ctrl+C doesn't work on Windows when downloading multiple formats Closes #1521 Authored by: nao20010128nao, pukkandan
* [docs] Minor documentation improvementspukkandan2021-11-101-0/+1
| | | | Closes #1583, #1599
* [fragment] Fix progress display in fragmented downloadspukkandan2021-11-031-3/+11
| | | | Closes #1517
* [cleanup] miscpukkandan2021-10-231-1/+2
|
* [fragment] Print error message when skipping fragmentpukkandan2021-10-191-3/+4
|
* Revert "[fragments] Pad fragments before decrypting (#1298)"pukkandan2021-10-191-2/+1
| | | | This reverts commit 373475f03553a7fff2d20df878755bfad2fab8e5.
* [fragments] Pad fragments before decrypting (#1298)shirt2021-10-181-1/+2
| | | | Closes #197, #1297, #1007 Authored by: shirt-dev
* Improved progress reporting (See desc) (#1125)pukkandan2021-10-091-3/+1
| | | | | | | | | | | * Separate `--console-title` and `--no-progress` * Add option `--progress` to show progress-bar even in quiet mode * Fix and refactor `minicurses` * Use `minicurses` for all progress reporting * Standardize use of terminal sequences and enable color support for windows 10 * Add option `--progress-template` to customize progress-bar and console-title * Add postprocessor hooks and progress reporting Closes: #906, #901, #1085, #1170
* [HLS] Fix decryption issues (#1117)shirt2021-09-291-1/+2
| | | | | | | * Unpad HLS fragments with PKCS#7 according to datatracker.ietf.org/doc/html/rfc8216 * media_sequence should only be incremented in for media fragments * The native decryption should only be used if ffmpeg is unavailable since it is significantly slower. Closes #1086 Authored by: shirt-dev, pukkandan
* Basic framework for simultaneous download of multiple formats (#1036)The Hatsune Daishi2021-09-221-2/+51
| | | Authored by: nao20010128nao
* [fragment,aria2c] Generalize and refactor some codepukkandan2021-09-221-20/+25
|
* [fragment] Fix range header when using `-N` and media sequence (#1048)pukkandan2021-09-221-1/+1
| | | | Authored by: shirt
* [fragment] Avoid repeated request for AES keypukkandan2021-09-221-2/+8
|
* [hls,aes] Fallback to native implementation for AES-CBCpukkandan2021-09-181-7/+2
| | | | | | | and detect `Cryptodome` in addition to `Crypto` Closes #935 Related: #938
* [webvtt] Merge daisy-chained duplicate cues (#638)Felix S2021-08-101-1/+4
| | | | | | | | | | | | | | | | | Fixes: https://github.com/yt-dlp/yt-dlp/issues/631#issuecomment-893338552 Previous deduplication algorithm only removed duplicate cues with identical text, styles and timestamps. This change also merges cues that come in ‘daisy chains’, where sequences of cues with identical text and styles appear in which the ending timestamp of one equals the starting timestamp of the next. This deduplication algorithm has the somewhat unfortunate side effect that NOTE blocks between cues, if found, will be emitted in a different order relative to their original cues. This may be unwanted if perfect fidelity is desired, but then so is daisy-chain deduplication itself. NOTE blocks ought to be ignored by WebVTT players in any case. Authored by: fstirlitz
* Misc fixes - See descpukkandan2021-08-101-11/+13
| | | | | | | * Remove unnecessary uses of _list_from_options_callback * Fix download tests - Bug from 6e84b21559f586ee4d6affb61688d5c6a0c21221 * Rename ExecAfterDownloadPP to ExecPP and refactor its tests * Ensure _write_ytdl_file closes file handle on error - Potential fix for #517
* [downloader] Pass `info_dict` to `progress_hook`spukkandan2021-07-221-7/+8
|
* [fragment] Handle errors in threads correctlypukkandan2021-07-071-7/+3
|
* [cleanup] Minor refactoring of `fragment`pukkandan2021-06-241-6/+4
|
* [fragment] Return status of download correctlypukkandan2021-06-241-0/+1
|
* [fragment] Merge during download for `-N`, and refactor `hls`/`dash` (#364)pukkandan2021-06-221-3/+127
|
* Add experimental option `--check-formats` to test the URLs before format ↵pukkandan2021-05-061-3/+3
| | | | selection
* [downloader/fragment] Allow persisting extra state when a download is ↵Felix S2021-04-281-1/+6
| | | | interrupted