PaperTowel/NewPipeExtractor
1
0
Fork 0
Code Issues Pull Requests Packages Projects Releases Wiki Activity
2,277 Commits 1 Branch 0 Tags
c1040bccacd871ea4c7cf603554d4fd5feee9366
Commit Graph

1662 Commits

Author SHA1 Message Date
Stypox
c1040bccac Merge pull request #794 from FireMasterK/comments-count 
[YouTube] Add support to extract total comment count
 2023-01-11 15:32:19 +01:00
TobiGr
56aab4d971 [YouTube] Fix escaping links in YouTubeParsingHelper.getTextFromObject 2023-01-05 00:28:12 +01:00
Kavin
22a47da8c7 Fix requested change and remove outdated comment. 2023-01-02 20:42:32 +00:00
Kavin
98a90fd9c8 Don't cache comments count and return early on page fetch if no token. 2023-01-02 20:40:48 +00:00
Kavin
2974dfaa48 Only store ajaxJson for initial page and eager fetch the initial continuation. 2023-01-02 20:40:48 +00:00
Kavin
64d24aa09e Fix request changes. 2023-01-02 20:40:48 +00:00
Kavin
67ef4f4c30 Cleanup and remove optional. 2023-01-02 20:40:48 +00:00
FireMasterK
22f71b010c Fix for requested changes. 2023-01-02 20:40:48 +00:00
FireMasterK
656b7c1cd9 Improve method documentation. 2023-01-02 20:40:48 +00:00
FireMasterK
981aee4092 Add support to extract total comment count. 2023-01-02 20:40:48 +00:00
Stypox
45636b0d00 Merge pull request #986 from Isira-Seneviratne/Static_maps 
Use immutable Map factory methods.
 2023-01-02 18:11:14 +01:00
Stypox
219c5c5be5 Update extractor/src/main/java/org/schabi/newpipe/extractor/services/youtube/YoutubeParsingHelper.java 2023-01-02 18:11:03 +01:00
Stypox
259de3cba6 Merge pull request #995 from TeamNewPipe/feat/soundcloud-playlistinfoitemextractor 
[SoundCloud] Implement getUploaderUrl() and isUploaderVerified() for PlaylistInfoItemExtractor
 2023-01-02 15:10:40 +01:00
Stypox
991394b53a Merge pull request #1005 from FireMasterK/fix-escaping-xss 
Fix for potential XSS attacks and formatting issues
 2023-01-02 15:06:17 +01:00
Isira Seneviratne
d8ce08d969 Use immutable Map factory methods. 2023-01-02 07:50:31 +05:30
Kavin
01acf79436 Fix for potential XSS attacks. 2022-12-31 20:05:32 +00:00
TobiGr
292e0d8ce7 [SoundCloud] Implement getUploaderUrl() and isUploaderVerified() for PlaylistInfoItemExtractor 2022-12-31 18:46:39 +01:00
TobiGr
2a8729aeb2 Apply suggestions 
Co-authored-by: Stypox <stypox@pm.me>
 2022-12-31 18:24:33 +01:00
TobiGr
d75a997611 [PeerTube] Support searching for channels 2022-12-31 18:24:33 +01:00
TobiGr
dea6d8ce4c [PeerTube] Support searching for playlists 2022-12-31 18:24:33 +01:00
Stypox
95cc6aefbb Merge pull request #994 from TeamNewPipe/fix/peertube-subtitles-exception 
[PeerTube] Report Exceptions thrown while getting a stream's subtitles
 2022-12-31 15:01:39 +01:00
Stypox
7b54457789 Merge pull request #941 from TeamNewPipe/feat/peertube-comment-replies 
[PeerTube]  Support comment replies
 2022-12-31 14:57:51 +01:00
AudricV
f45966d449 Merge pull request #910 from Isira-Seneviratne/Locale_forLanguageTag 
Add compat Locale.forLanguageTag() implementation.
 2022-12-24 23:53:30 +01:00
AudricV
d5437e0bc5 Merge pull request #863 from AudricV/add-content-type-and-content-length-headers-to-post-requests 
Add Content-Type header to all POST requests without an empty body
 2022-12-16 19:32:56 +01:00
AudricV
0766b1d211 [YouTube] Improve YoutubeStreamInfoItemExtractor 
- Return duration of video premieres;
- Add another non-localized method to determine whether a stream is a running
livestream;
- Return view count and upload date of videos in playlists;
- Store isPremiere result;
- Remove shorts workaround code, as it was only useful on channels and shorts
have been moved into a separated channel tab;
- Improve some other code.
 2022-12-08 13:59:12 +01:00
Tobi
896d7e09eb Merge pull request #978 from Theta-Dev/fix/search-channel-handles 
[YouTube] Fix search subscriber count extraction with channel handles
 2022-12-05 17:52:05 +01:00
TobiGr
cd3262745d [PeerTube] Report Exceptions thrown while getting a stream's subtitles 2022-12-03 16:11:21 +01:00
TobiGr
4e66b2287e [PeerTube] Add support for comment replies 2022-12-01 14:05:18 +01:00
Tobi
41c8dce452 Merge pull request #992 from Isira-Seneviratne/String_isBlank 
Use String.isBlank().
 2022-11-30 17:48:54 +01:00
Isira Seneviratne
2bca56f0df Use String.isBlank(). 2022-11-30 08:26:21 +05:30
Isira Seneviratne
3b80547976 Add code review suggestions. 2022-11-30 07:57:45 +05:30
ThetaDev
016623131e docs: update comment in YoutubeChannelInfoItemExtractor 2022-11-29 19:06:03 +01:00
Kavin
2e08eaad96 Fix complication error in comment test. 2022-11-29 16:07:48 +00:00
Kavin
abf08e1496 Merge pull request #990 from FireMasterK/bold-italic-strikethrough 
[YouTube] Implement bold/italic/strike-through support
 2022-11-29 15:59:38 +00:00
Kavin
57e7a6fb7c Add mocks test. 2022-11-28 20:27:55 +00:00
Kavin
1d3d7fa5c3 Add test for formatting. 2022-11-28 20:26:37 +00:00
Kavin
52fda37915 Implement bold/italic/strike-through support. 2022-11-28 19:06:18 +00:00
Kavin
b566084cac Use Description object for comments text. 2022-11-28 17:02:19 +00:00
Tobi
1da0190056 Merge pull request #980 from TeamNewPipe/fix/yt/unavailable 
[YouTube] Fix extracting the detailed error message for unavailable streams
 2022-11-28 10:07:34 +01:00
Stypox
60fb30f835 Merge pull request #928 from FireMasterK/comment-urls 
Parse YouTube comments as HTML
 2022-11-27 19:16:34 +01:00
Kavin
5abea22225 Fix throwing correct reason. 2022-11-26 21:09:08 +00:00
Kavin
c043597255 Update supported countries list. 2022-11-26 19:01:33 +00:00
TobiGr
4680df0bdf Fix throwing correct reason 2022-11-23 17:03:22 +01:00
TobiGr
9de8405c9f [YouTube] Fix extracting the detailed error message of streams which are unavailable 2022-11-23 08:33:06 +01:00
Stypox
34d79bd267 [YouTube] Update mocks 2022-11-22 17:10:04 +01:00
AudricV
2ec296e674 Fix YoutubeSearchExtractorTest.MetaInfoTest 
Not all the "learn more" button is uppercase anymore, that's only the case for
the first letter.
 2022-11-22 16:34:54 +01:00
AudricV
3891542ca1 Use Downloader's postWithContentType and postWithContentTypeJson methods in services and extractors 2022-11-22 11:37:18 +01:00
AudricV
b2862f3cd1 Add postWithContentType and postWithContentTypeJson utility methods in Downloader 
Co-authored-by: Stypox <stypox@pm.me>
 2022-11-22 11:37:17 +01:00
AudricV
e9a0d3bd95 [YouTube] Send Content-Type header in all POST requests 
This header was not sent partially before and was added and guessed by OkHttp. This can create issues when using other HTTP clients than OkHttp, such as Cronet.

Some code in the modified classes has been improved and / or deduplicated, and usages of the UTF_8 constant of the Utils class has been replaced by StandardCharsets.UTF_8 where possible.

Note that this header has been not added in except in YoutubeDashManifestCreatorsUtils, as an empty body is sent in the POST requests made by this class.
 2022-11-22 11:37:16 +01:00
AudricV
b9e463de49 [Bandcamp] Send Content-Type header in POST requests 
This header was not sent before and was added and guessed by OkHttp. This can create issues when using other HTTP clients than OkHttp, such as Cronet.

Also make use of StandardCharsets.UTF_8 when getting bytes of bodies instead of the platform default's charset, to make sure to prevent some encoding issues on some JVMs.
 2022-11-22 11:35:46 +01:00