Mirrors/cobalt
1
0
Fork 0
mirror of https://github.com/wukko/cobalt.git synced 2025-02-12 13:46:22 +01:00
Code Issues Projects Releases Packages Wiki Activity
969 commits 4 branches 0 tags 72 MiB
Commit graph

249 commits

Author SHA1 Message Date
wukko
ca04acc468 tumblr: fix at.tumblr link handling 2023-12-25 22:45:04 +06:00
wukko
0dcd36c16f tumblr: formatting 2023-12-25 22:40:02 +06:00
wukko
197198ad79 soundcloud: fall back to mp3 when no opus found 
also made match action decider readable
 2023-12-25 22:21:06 +06:00
wukko
ddc87ca42b
api: clean url upon entry, not down the road 2023-12-25 12:34:20 +00:00
wukko
d6e4b5ac20
servicesConfig: www is unnecessary here too 2023-12-25 12:34:20 +00:00
wukko
88666eeeaa
servicesConfig: www was unnecessary... 2023-12-25 12:34:20 +00:00
wukko
509d24fd87
servicesConfig: add subdomains for twitter and youtube 2023-12-25 12:34:20 +00:00
wukko
aaa61cfee9
processing url: alt domains for services and fixvx support 2023-12-25 12:34:20 +00:00
dumbmoron
5928b21fee
tumblr: fix priority of subdomain/segment for username 2023-12-25 12:34:20 +00:00
dumbmoron
18a3c06a9e
url: always strip username, password, port, fragment 2023-12-25 12:34:20 +00:00
dumbmoron
3a00bc7f8d
url: remove tumblr aliasing 
not quite sure what its purpose is/was anyways (tracking id removal? it's not used anyways)
 2023-12-25 12:34:20 +00:00
dumbmoron
ba35ec923e
url: re-parse hostname after validating 2023-12-25 12:34:20 +00:00
dumbmoron
34d8333d72
tumblr: render error template for broken links 2023-12-25 12:34:20 +00:00
dumbmoron
81e68c37f5
processing: pass URL object instead of string 2023-12-25 12:34:20 +00:00
dumbmoron
30c9652b6e
url: typo 2023-12-25 12:34:20 +00:00
dumbmoron
662360509c
url: return host instead of bool for success 2023-12-25 12:34:20 +00:00
dumbmoron
3056624b3d
servicesConfig: set up subdomains 2023-12-25 12:34:20 +00:00
dumbmoron
c458423e03
match: light cleanup 2023-12-25 12:34:20 +00:00
dumbmoron
f9feaa41ce
tumblr: stricter subdomain parsing 2023-12-25 12:34:20 +00:00
dumbmoron
149c16abbb
url: make youtu.be alias rule more lax 2023-12-25 12:34:20 +00:00
dumbmoron
2e1eb1b864
api: rename hostOverrides to 'url' 
it does a bit more than it did before now
 2023-12-25 12:34:20 +00:00
dumbmoron
dd563eb752
api: rework url parsing 
- tlds are now parsed and validated correctly (e.g. ".co.uk" works now)
- url patterns are pre-compiled instead of being compiled for every request
- aliases are computed in a safe manner using the URL object where possible
 2023-12-25 12:34:20 +00:00
wukko
a4349b4c41 throw a critical error when youtube api returns a stub 2023-12-25 12:59:00 +06:00
wukko
e27c02c55e twitter & stream: formatting 2023-12-17 23:50:04 +06:00
wukko
4834f21554 twitter: use original media timestamp for fix check 2023-12-17 23:45:15 +06:00
wukko
8556a5fe2c twitter: fix videos only within affected time range 2023-12-17 23:05:43 +06:00
wukko
3e8c059a3a vimeo: fix parsing and resolution in filename 
- all videos/audios should now be downloadable
- proper resolution is now displayed in basic and pretty filename styles
 2023-12-02 21:52:38 +06:00
wukko
5bd50fd55f twitter: remux all videos 
- increased stream link lifespan to 90 seconds
- decreased max video duration back to 3 hours
 2023-12-02 20:44:19 +06:00
wukko
24870c5dd7 pattern tester: less yapping 2023-11-23 22:18:49 +06:00
wukko
5d1d25a6dd
twitch: add filename attributes to twitch clips 
merge pull request #233 from Snazzah/feat/twitch-pretty
 2023-11-23 21:49:22 +06:00
wukko
19ba117838 twitch (oops): actually import cleanString 2023-11-23 21:45:23 +06:00
wukko
158361c95e twitch: sanitise video title 2023-11-23 21:43:35 +06:00
wukko
88b8a69f9c
fix handling of URLs containing utf-8 characters 
Merge pull request #253 from dumbmoron/fix-utf8-urls
 2023-11-23 21:40:24 +06:00
wukko
3ca65e0daf reddit: remove the rest of references to title 2023-11-23 21:35:02 +06:00
dumbmoron
7468b803fb
reddit: don't include title in API request path 2023-11-23 14:52:30 +00:00
dumbmoron
c26800ca2e
reddit: fix expiry check 2023-11-17 12:00:04 +00:00
wukko
463ece02c7 7.6.6: refined twitter module, removed spaces 2023-11-07 22:37:47 +06:00
Snazzah
d2e124c7cd
chore: small fix to ext 2023-10-30 12:41:53 -05:00
Snazzah
5d87b68f5b
chore: twitch cleanup 2023-10-30 12:40:15 -05:00
Snazzah
e2bcad79aa
feat: add filename attributes to twitch clips 2023-10-30 12:14:28 -05:00
wukko
31a2136c90 updated docs 2023-10-28 18:51:20 +06:00
dumbmoron
946bec68c1
youtube: slight cleanup & deduplication 2023-10-21 22:07:06 +00:00
dumbmoron
a4c7cc0d35
youtube: unify quality matching 2023-10-17 16:58:12 +00:00
wukko
73d84c09d3 fix for youtube dubs rare error 2023-10-15 22:13:01 +06:00
wukko
dfdf8580be fixed slash handling in file names 2023-10-15 15:11:39 +06:00
wukko
b093bf33bd 7.6.1: fixed numbers in metadata and file names 
also replaced the 7.6 banner with webp version
 2023-10-15 14:39:17 +06:00
wukko
68d65dc0b9
7.6: file name customization 2023-10-15 11:06:48 +06:00
wukko
33daaaf936 Update reddit.js 2023-10-15 11:03:22 +06:00
dumbmoron
a45d500c3b
reddit: add support for authenticated requests 2023-10-14 22:49:28 +00:00
dumbmoron
035f5a7839
cookie: allow updating cookie values directly 2023-10-14 22:49:12 +00:00
wukko
f1152f4862
instagram: add stories support 
merge pull request #194 from dumbmoron/instagram-stories
 2023-10-14 23:49:43 +06:00
wukko
866792c8d5 spacing 
no need for closest quality btw
 2023-10-14 23:48:06 +06:00
wukko
1504a8bae9 Update instagram.js 2023-10-14 23:24:19 +06:00
wukko
81d37e9987 final file name style picker 2023-10-14 22:51:53 +06:00
wukko
d10a404f1f vk: added support for rich filenames 2023-10-13 21:52:15 +06:00
wukko
ff13ef7217 fix quality label for 720p yt videos 2023-10-12 23:19:36 +06:00
wukko
16f74094b9 filename pattern customization 
- added metadata for rutube and vimeo.
- added a picker for preferred filename pattern.
- fixed content disposition header.
- mute and audio dub tags don't appear together in a file name anymore.
- youtube: dub file name tag doesn't appear anymore if audio track is default.
 2023-10-12 23:14:54 +06:00
wukko
6c314a1a62 well that's just embarrassing 2023-10-08 18:31:04 +06:00
dumbmoron
f7e0871a8a
Merge branch 'current' into instagram-stories 2023-09-16 23:34:23 +02:00
dumbmoron
0bb84f0e98 fix soundcloud downloads when requested format is best 2023-09-16 21:25:36 +00:00
wukko
e721cf9878 support for rutube, fixes, accommodations for multi lang 2023-09-16 23:38:07 +06:00
wukko
ad8a9c454d remove vods 
there's no point in downloading entire streams. people can clip what they need and download that instead!
 2023-09-16 17:58:43 +06:00
wukko
f7247b87f0 fix wording 2023-09-16 16:31:02 +06:00
wukko
ad9b6ebdd3 twitch clean up 2023-09-16 16:27:53 +06:00
wukko
ff9d48740d
Merge branch 'current' into feat/twitch 2023-09-16 15:40:09 +06:00
wukko
572dc20e41 7.4 
- updated more files to be up-to-date with domain change.
- 7.4 changelog.
- updated docker compose example with watchtower and cobalt image.
 2023-09-09 22:31:24 +06:00
wukko
bfde9aab39
Merge branch 'current' into disable-metadata 2023-09-06 20:05:16 +06:00
dumbmoron
395a59a8b1 add instagram stories support 
+ some code cleanup and deduplication
 2023-08-26 16:06:46 +00:00
dumbmoron
b54efb968f clean up posts/reels code 2023-08-26 06:35:13 +00:00
wukko
8dcb6d8ea7
a typo just broke everything 2023-08-26 00:53:05 +06:00
wukko
be21c86d89 youtube: added support for live links 2023-08-26 00:03:24 +06:00
dumbmoron
93aa1f4db4 add option to disable file metadata 
closes #142
 2023-08-25 17:57:03 +00:00
wukko
fc89cb566b clean up 2023-08-23 01:03:31 +06:00
wukko
749c00a691 soundcloud: got rid of html parsing 2023-08-23 00:49:02 +06:00
wukko
0ef2c70c66 add support for more vimeo links 
closes #184
 2023-08-22 12:46:13 +06:00
wukko
a1e08c0692 Update instagram.js 2023-08-21 22:03:18 +06:00
dumbmoron
40f8b3ee0c update cookies that have no expiration 2023-08-20 22:33:33 +00:00
dumbmoron
9eb6700399 set instagram specific headers 2023-08-20 22:33:30 +00:00
dumbmoron
ba7137ef62 send cookies as-is 2023-08-20 22:21:00 +00:00
wukko
0a5fff32ae 7.1 release 
added changelog and update notice
 2023-08-20 23:25:02 +06:00
wukko
877148159d
use else-if instead of if for evaluating action 
merge pull request #183 from dumbmoron/decider-elif
 2023-08-20 22:46:13 +06:00
wukko
9d590a64dc fix the order 2023-08-20 22:30:26 +06:00
dumbmoron
a59ecd14e7 use else-if instead of if for evaluating action 
sets a fixed order of actions
 2023-08-20 16:20:18 +00:00
wukko
b441b494ef fix vk downloads 2023-08-20 22:12:09 +06:00
wukko
a6134c58d2 remove unused stuff 2023-08-20 21:02:20 +06:00
wukko
244357820d update readme and services config 2023-08-20 19:59:34 +06:00
wukko
6be2c7344e
do not attempt to update nonexistent cookie 
merge pull request #181 from dumbmoron/fix-cookie-update
 2023-08-20 19:38:11 +06:00
wukko
cbb519d73e fix + test 2023-08-20 19:36:56 +06:00
dumbmoron
411938b460 do not attempt to update nonexistent cookie 2023-08-20 13:27:49 +00:00
dumbmoron
1f6c7c8ead instagram: add downloading of single image 2023-08-20 13:26:35 +00:00
wukko
dfdda06099 added support for instagram images 
also improved various picker
 2023-08-20 19:14:31 +06:00
wukko
a15558bc3f oh 2023-08-20 18:16:00 +06:00
wukko
2929b9535f added file metadata to videos & fixed youtube dubs 2023-08-20 18:14:15 +06:00
wukko
609bf26dd4
#177: add cookie support 
merge pull request #177 from dumbmoron/cookie
 2023-08-20 16:58:49 +06:00
wukko
c72d9b0ed1 change cookie path capitalization for consistency with other env stuff 2023-08-20 16:58:04 +06:00
wukko
fd0357e52d move cookies to processing 
slight clean up and better example
 2023-08-20 16:51:39 +06:00
wukko
a8cbebd240 vxtwitter support 
- moved out host overrides to its own file
- added mastodon verification
 2023-08-20 16:11:16 +06:00
wukko
8304499ce7 fixed streamable (the service) metadata 2023-08-20 15:45:03 +06:00
wukko
890b7c8924 streamable: clean up + more patterns 2023-08-20 15:18:21 +06:00
Blobadoodle
9af60e1e6b === 2023-08-19 18:58:01 +01:00
Blobadoodle
df894864ce useless comments 2023-08-19 18:34:43 +01:00
Blobadoodle
cd1d699886 feat: streamable support 2023-08-19 17:42:10 +01:00
dumbmoron
a2216510b7 add cookie support 
usage:
 - create cookies.json file somewhere, preferrably outside cobalt directory
 - in docker, you can bind mount it (`volumes` in composefile)
   - if you don't want cobalt to update the cookies, set it to `:ro` (cobalt will print a warning about this, ignore it)
 - set COOKIE_PATH to the absolute path of this file
 - enjoy?

usage in services: probably the simplest api ever
 - import { getCookie, updateCookie } from '../../cookie/manager.js';
 - const cookie = getCookie('<service_name>');
   - add this to headers - `headers: { cookie }`
 - after fetch is done, save potential cookie updates: updateCookie(cookie, fetch.headers)
 - see instagram.js for example usage
 2023-08-16 19:59:33 +00:00
wukko
2302c1dbe4
7.0 release 2023-08-15 16:15:11 +06:00
wukko
a1637e249f
fix soundcloud pattern test 
merge pull request #167 from dumbmoron/fix-soundcloud-pattern-test
 2023-08-15 16:10:39 +06:00
wukko
27d872363d graphql twitter api & soundcloud fix 
closes #127
 2023-08-15 14:37:59 +06:00
wukko
5955594e48 even more cleansing 
- added support for x.com urls
- removed del shortcut for clearing url input area because it was causing regular typing issues
- added info about no liability
- fixed donate button glow and text backdrop padding
- updated donation and privacy policy texts for more clarity in both english and russian
- made cors question in setup script to take yes as answer, not just 'y'
- text-to-copy now has proper rounding when highlighted
- home screen now smoothly fades in instead of popping in
 2023-08-14 00:09:50 +06:00
dumbmoron
5e17144cb7 fix instagram downloads 2023-08-11 12:24:31 +00:00
dumbmoron
c3071b54c2 fix soundcloud pattern test 
username can actually be up to 25 characters long, song url can actually be up to 255 characters long
 2023-08-07 14:50:15 +00:00
wukko
43a3ebf475 7.0: ui refresh and more 2023-08-05 00:43:12 +06:00
wukko
fafd2c8ccc small fix for instagram reels 
- now all reels should be possible to download
- also added support for youtube embed links
 2023-07-04 17:57:58 +06:00
wukko
db5d62ae58 6.2.2: fixes related to twitter screwing everything up 
(also fixes an issue with some instagram links)
 2023-06-30 16:29:21 +06:00
wukko
65161107fa 6.2: no more ip verification 
- removed ip verification and updated privacy policy to reflect this change.
- streamable links now last for 20 seconds instead of 2 minutes.
- cleaned up stream verification algorithm. now the same function isn't run 4 times in a row.
- removed deprecated way of hosting a cobalt instance.
 2023-06-27 19:56:15 +06:00
wukko
7f28dbf2e7
feat: add pinterest support (by Snazzah) 
merge pull request #134 from Snazzah/feat/pinterest
 2023-06-05 12:50:31 +06:00
wukko
55f1e4b704 tumblr audio, youtube vr, updated setup script, further mitosis accommodations 2023-06-05 12:43:04 +06:00
wukko
f68edb51c7 4 spaces!! four!! 2023-06-05 11:27:43 +06:00
Snazzah
40291c4d24
feat: add pinterest support 2023-05-24 12:32:41 -05:00
Snazzah
8551243207
Merge branch 'current' into feat/twitch 2023-05-23 12:24:54 -05:00
wukko
a2e7212285 fixed the overlapping issue with short soundcloud links 
ids of some of new links overlap with old ones, so i decided to remove support for old shareable links. keeping support for soundcloud.app.goo.gl links makes no sense, you can't even get them from any of the apps anymore.
 2023-05-16 21:20:00 +06:00
wukko
71cc5305b4 5.5.1 
- updated readme: added info about new services, sorted the list alphabetically, replaced emoji with checkmarks, added info about ncsd (#101), and more.
- fixed typos in vk and setup modules.
- removed unused variables from css.
 2023-05-08 14:40:38 +06:00
Snazzah
fa7af1bf44
feat: add twitch vod/clip support 2023-04-29 14:33:36 -05:00
wukko
a25615982c 5.5: vine support and bug fixes 
- added support for vine archives
- fixed ability to download muted videos from tumblr
- removed extra instagram id testing which i left by mistake
 2023-04-29 22:26:49 +06:00
wukko
6e097de2db 5.4.7: added support for ancient vk videos & salt improvements 
- now you can download 240p hardbass videos from 2008!
- implemented updated stream salt and ip salt properly
 2023-04-29 21:30:59 +06:00
wukko
8f27876aee bumped version up to 5.4.5 2023-04-29 17:11:09 +06:00
wukko
ce6aa0e1ce bump youtubei.js to 5.0.0 and remove unnecessary twitter cookies 2023-04-29 17:05:32 +06:00
wukko
8f93232e81 5.4.4: moved to twitter api v2 2023-04-27 09:26:19 +06:00
wukko
0dca373237 5.4: instagram support 2023-04-25 01:01:25 +06:00
wukko
b4eddd06fe there's a better way to do it oops 2023-04-10 18:32:14 +06:00
wukko
b0e6dc7528 fixed a lil oversight in youtube module 2023-04-10 18:28:41 +06:00
wukko
7f533b3485 retweet links, new clipboard icon, mobile layout and loc improvements 
- added support for retweet links
- updated spaces endpoint
- bumped up the user agent version
- new clipboard icon
- new clipboard + auto mode layout on mobile, less wasted space
- fixed button press animations for safari on mobile
- tons of localization improvements for english and russian
- bumped up youtubei.js to 4.1.0
 2023-03-24 23:16:10 +06:00
wukko
6e9f9efa28 vimeo support revamp and bug fixes 
- completely reworked vimeo module.
- added support for audio downloads from vimeo.
- added support for chop type of dash for vimeo.
- added ability to choose between progressive and dash vimeo downloads. both to api and settings on frontend.
- added support for single m3u8 playlists. will be useful for future additions and is currently used for vimeo.
- proper error is now shown if there are no matching vimeo videos found
- temporarily disabled douyin support because bytedance killed off old endpoint.
- fixed the issue related to periods in tiktok usernames. (closes #96)
- fixed error text value patching in match module.
- fixed video stream removal for audio only option, wouldn't work in some edge cases.
- minor clean up.
 2023-03-15 22:18:31 +06:00
wukko
daa2856d92 5.1.2 
- added women's day celebration emoji
- fixed vk user id extraction
 2023-03-08 13:17:33 +06:00
wukko
2884bd9081 5.1.1 
- bigger video/audio duration limit (3 hours instead of 2 hours and 5 minutes).
- no more unexpected errors when downloading audio from youtube.
 2023-03-01 08:37:26 +06:00
wukko
6465ac8d6f 5.1 
closes #62, #66, #75
 2023-02-26 22:49:25 +06:00
wukko
c57d16b615 added 5.0 changelog 2023-02-13 21:56:52 +06:00
wukko
a1fea0a5f1 fixes 2023-02-13 20:30:57 +06:00
wukko
3c578d6d49 cleaning up what i missed 2023-02-13 20:02:52 +06:00
wukko
75a85972aa 5.0 
- finished writing tests for all services
- fixed douyin support
- fixed tiktok picker that was broken by previous commit
- temporarily removed douyin photos from list of supported services
- fixed support for "user view" vk clip links
- slightly improved the testing script
 2023-02-13 19:44:58 +06:00
wukko
0e7a281366 accidentally left error logging 2023-02-12 13:41:28 +06:00
wukko
dacaaf5b27 5.0-dev1 
- rewrote and/or optimized all service modules
- rewrote matching and processing modules to optimize readability and performance
- added support for reddit gifs
- fixed various issues with twitter error explanations
- code optimizations and enhancements (such as finally getting rid of ==, prettier and more readable formatting, etc)
- added branch information
- all functions in currentCommit submodule run only once and cache received data
- added a test script. only twitter and soundcloud are 100% covered and tested atm, will add tests (and probably fixes) for the rest of services in next commits
- changed some localization strings for russian
- added more clarity to rate limit message
- moved services folder into processing folder
 2023-02-12 13:40:49 +06:00
wukko
6b87c7babd 4.8: new about popup and other visual improvements 2023-01-30 00:17:33 +06:00
wukko
3b5bf51ba7 4.7 
fixes #63, #67, #68, and #71, among other issues
 2023-01-14 00:34:48 +06:00
wukko
7f1ba6b36b 4.6.0: video muting and soundcloud client_id 2022-12-17 17:09:49 +06:00
wukko
f13a82e152 4.5 2022-12-07 01:21:07 +06:00
wukko
5bfdce252a fixed support for twitter direct video links 2022-11-15 21:49:50 +06:00
wukko
316e6423f4 4.3: open api + post method for main endpoint 2022-11-12 22:40:11 +06:00
wukko
02529c0b54 4.1: better tiktok image downloads and celebrations 2022-10-27 22:27:20 +06:00
wukko
c532062aa2 twitter spaces and a ton of improvements 2022-10-24 19:03:11 +06:00
wukko
2c79ae3807 multi media tweets support 2022-10-09 23:44:00 +06:00