| Commit message (Collapse) | Author | Age | Files | Lines |
|---|
| |
|
|
| |
Also change superfluous use of multi_get to item.get nearby
|
| |
|
|
|
| |
By checking first if it's in item_types rather than checking if it can be dug into first.
For example: this allows extracting things like sectionListRenderer
|
| |
|
|
|
|
| |
independently
extract_items_from_renderer will extract given just a renderer rather than a response
|
| |
|
|
|
|
|
| |
Change usage of multi_deep_get to multi_get where possible
Remove checking of type from calls to get functions (because it's very unlikely Youtube suddenly changes the type without changing the name of the variable or anything, and it takes up unnecessary space)
Remove all default=None arguments from get functions, since those are superflous.
Remove list_types constant since it's no longer in use.
|
| | |
|
| | |
|
| |
|
|
| |
Philosophically, a channel doesn't create itself.
|
| |
|
|
|
|
|
|
| |
more robust
For example, "354 subscribers" wasn't being extracted correctly be extract_approx_int.
Make extract_approx_int and extract_int only extract integers that are words.
So e.g. 342 will not be extracted from internetuser342
|
| | |
|
| |
|
|
|
|
| |
items.
Examples: Empty channels, no search results
|
| |
|
|
| |
Because youtube doesn't give the number of search results, so previous behavior would give an error if a page number out of range was selected.
|
| |
|
|
| |
Don't display a nasty traceback in that case.
|
| | |
|
| |
|
|
|
|
|
|
|
|
|
|
|
| |
than just channel id.
It was set to a fake value of 1000 previously in order to ensure there would be enough page buttons.
This was because two sequential requests are necessary (one to get the channel id corresponding to the custom url, another to get the number of videos from the "all uploaded videos" playlist, the url for which can be generated from the channel id).
Since Tor has a high latency, I thought at the time that this would be too slow, but in practice it's not too big of a deal.
Introduces cachetools dependency in order to cache the function which gets the number of videos.
The get_channel_id function has also been fixed since the ajax api seems to have been removed.
|
| |
|
|
|
| |
Deduplicates the code. channel_id logic was previously separate because of the need to get the number of videos and different page numbers
Also makes search work for general urls, not just channel_id urls
|
| |
|
|
|
|
| |
names. Extract subscriber_count correctly.
Don't just shove english strings into info['stats']. Actually give semantic names for the stats.
|
| |
|
|
| |
It wasn't working because decimals such as 15.1M weren't considered, so it was extracting "1M"
|
| | |
|
| | |
|
| |
|
|
|
| |
- Correctly handle /embed, /watch with no video ids
- Correctly report error for this and for too short video ids
|
| |
|
|
|
|
| |
page in general.
Also add a link to github for reporting the exception.
|
| | |
|
| | |
|
| |
|
|
| |
Especially for the light theme
|
| |
|
|
| |
yt_data_extract
|
| |
|
|
| |
Otherwise, it wasn't clear enough that a tag was selected.
|
| |\
| |
| |
| |
| |
| |
| |
| |
| |
| |
| | |
Commits in this branch are prefixed with "Extraction:"
This branch refactors data extraction. All such functionality has been moved to the yt_data_extract module.
Responses from requests are given to the module and it parses them into a consistent, more useful format.
The dependency on youtube-dl has also been dropped and this functionality has been built from scratch for these reasons:
(1) I've noticed youtube-dl breaks more often than invidious (which uses watch page extraction built from scratch) in response to changes from Youtube, so I'm hoping what I wrote will also be less brittle.
(2) Such breakage is inconvenient because I have to manually merge the fixes since I had to make changes to youtube-dl to make it do things such as extracting related videos.
(3) I have no control over error handling and request pooling with youtube-dl, since it does all the requests (these would require intrusive changes I don't want to maintain).
(4) I will now be able to finally display the number of comments and whether comments are disabled without making additional requests.
|
| | |
| |
| |
| | |
yt_data_extract
|
| | |
| |
| |
| |
| |
| | |
internal helper function names
Move get_captions_url in watch_extraction to bottom next to other exported, public functions
|
| | | |
|
| | | |
|
| | |
| |
| |
| |
| |
| |
| |
| |
| | |
author_channel_id to that, fix bug in extract_items
author_id (an internal sql-like integer previously required for deleting and editing comments) has been removed by Youtube and is no longer required.
Remove it for simplicity.
Rename author_channel_id to author_id for consistency with other extraction attributes.
extract_items returned None for items instead of [] for empty continuation responses. Fixes that.
|
| | |
| |
| |
| |
| |
| | |
time_published will be put to the right of the view_count in related videos
Author will now always be above the other stats, since it doesn't make a difference in the big search result boxes since the description snippet is always very short
(However, it's important the author isn't inline with the other stats in related video boxes since those are so narrow and the author name can be very long)
|
| | |
| |
| |
| | |
recommended videos
|
| | | |
|
| | |
| |
| |
| | |
readability, rename extracted names for more consistency
|
| | | |
|
| | | |
|
| | | |
|
| | | |
|
| | |
| |
| |
| | |
videos, and as a fallback. Shorten some function names
|
| | | |
|
| | |
| |
| |
| | |
foreign language captions
|
| | |
| |
| |
| | |
parameters in the captions url
|
| | | |
|
| | | |
|
| | | |
|
| | | |
|
| | | |
|
| | | |
|
