Youtube Ripper: Collector’s Edition
Unfortunately, this script is broken now. Youtube changed things internally and the script broke. For a working script, see this post
Today I had an interesting conversation with my fellow blogger themak and he asked if it would be possible to download a bunch of videos that he knew followed a regular naming scheme and that were uploaded by two different users. After some coding I came up with a script that will download all videos uploaded by a specific Youtube user where the title matches a pattern (regexp compatible). The final output is flash videos named after the unique video ID.
$ sh youtube-user.sh rpoland "Andy Mckee"
Would download all videos with Andy Mckee in the title listed on the user rpoland’s profile page.
Update: Mike wrote a PHP port!
Update again: Regarding the Digg comments, the script now works with all profile pages and I re-wrote it to feature functions instead of one big one-liner.
Hopefully last update: Fixed the last regexp flaws and removed a flag to xargs that stopped it from running on OS X. Also added a dry-run mode.
April 8th, 2007 at 6:00 pm
[…] It doesn’t have a progress bar (since it’s not using wget), but it gets the job done.read more | digg story Save This […]
April 8th, 2007 at 7:39 pm
W000t! You’ve been dugg! Front page!
April 8th, 2007 at 8:18 pm
how can .ph be used on web ?
thanks… great post…
April 8th, 2007 at 8:20 pm
Hehe, great work on the script–and congrats on the Digg frontpager :D
April 8th, 2007 at 8:34 pm
check out this ripper
http://www.tubularapp.com/blog/
good luck
April 8th, 2007 at 9:07 pm
there is no -r option for xargs in Intel Mac Book. I removed it and also tried replacing it with -t but I get a http 303 See Other. error. I am using the same example as give above for test case.
April 8th, 2007 at 9:18 pm
tubesock is a better ripper
April 8th, 2007 at 9:18 pm
@Jay: The -r option is a GNU extension and it only adds some character checking.
The 303 is caused by the script at http://youtube.com/get_video which handles load balancing and redirects you to the actual content on a sub-server like http://sjc-v88.sjc.youtube.com/.
April 8th, 2007 at 9:27 pm
@Ryan: You are aware about the fact that you’re comparing a *SCRIPT* to a full-scale application?
Thousands of lines of code in a proper programming language compared to 39 lines of text-processing commands put together to parse some links.
Hours of planned development and testing compared to a few minutes of script writing.
Very mature comparisons I must say…
April 8th, 2007 at 9:29 pm
[…] Video Ripper Filed under: Uncategorized — recar @ 8:28 pm YouTube Video Ripper A script that will download all the videos uploaded by a specific YouTube user where the title […]
April 8th, 2007 at 10:42 pm
Thanks for the script. Props for the frontpage of digg. :D
April 8th, 2007 at 11:35 pm
[…] After an interesting chat with Niklas regarding my desire to learn the guitar he coded my a nice shell script to download me some youtube videos. […]
April 9th, 2007 at 1:08 am
[…] few hours ago one of my posts made the Digg front page (didn’t see that coming). Here is a diagram showing how the visits […]
April 9th, 2007 at 3:17 am
[…] The final output is flash videos named in the back of the unique video ID. … After some coding I dawned up with a script that will download the whole thing videos uploaded by a specific Youtube user where the title matches a pattern (regexp well suited). read more… […]
April 9th, 2007 at 3:29 am
[…] The final output is flash videos named in the back of the unique video ID. … After some coding I dawned up with a script that will download the whole thing videos uploaded by a specific Youtube user where the title matches a pattern (regexp well suited). read on… […]
April 9th, 2007 at 3:33 am
[…] The final output is flash videos named in the back of the unique video ID. … After some coding I dawned up with a script that will download the whole thing videos uploaded by a specific Youtube user where the title matches a pattern (regexp well suited). continue here… […]
April 9th, 2007 at 3:39 am
[…] persist reading Rooney, Carvey plus Lane - VIDEO … The final output is flash videos named subsequent to the unique video ID. In this, the second of two how-to galleries, you’ll learn how to open your overlay in QuickTime Pro also merge it with your video to fashion a translucent worm in the spot of your movie. After some coding I arrived up with a script that will download the whole lot videos uploaded by a specific Youtube user where the title matches a pattern (regexp similar temperament). troth aware: you do need to upgrade QuickTime to … … college-occasion grandson (played by Dana Carvey) also his roommate, played by Nathan Lane. Meg Ryan similarly starred in the series, which, per IMDb, ran for a whopping eight episodes. … more… […]
April 9th, 2007 at 3:40 am
[…] videos uploaded by a specific Youtube user where the title matches a pattern (regexp well suited). read rest of article… […]
April 9th, 2007 at 3:54 am
[…] persist reading Rooney, Carvey plus Lane - VIDEO … The final output is flash videos named subsequent to the unique video ID. In this, the second of two how-to galleries, you’ll learn how to open your overlay in QuickTime Pro also merge it with your video to fashion a translucent worm in the spot of your movie. After some coding I arrived up with a script that will download the whole lot videos uploaded by a specific Youtube user where the title matches a pattern (regexp similar temperament). troth aware: you do need to upgrade QuickTime to … … college-occasion grandson (played by Dana Carvey) also his roommate, played by Nathan Lane. Meg Ryan similarly starred in the series, which, per IMDb, ran for a whopping eight episodes. … more… […]
April 9th, 2007 at 4:01 am
[…] persist reading Rooney, Carvey plus Lane - VIDEO … The final output is flash videos named subsequent to the unique video ID. In this, the second of two how-to galleries, you’ll learn how to open your overlay in QuickTime Pro also merge it with your video to fashion a translucent worm in the spot of your movie. After some coding I arrived up with a script that will download the whole lot videos uploaded by a specific Youtube user where the title matches a pattern (regexp similar temperament). troth aware: you do need to upgrade QuickTime to … … college-occasion grandson (played by Dana Carvey) also his roommate, played by Nathan Lane. Meg Ryan similarly starred in the series, which, per IMDb, ran for a whopping eight episodes. … continue… […]
April 9th, 2007 at 5:31 am
CastCluster does this and has a UI and makes RSS feeds from the results… and converts the videos to H.264
http://castcluster.blogspot.com/index.html
April 9th, 2007 at 1:45 pm
quite nice!
April 9th, 2007 at 2:49 pm
[…] Check it out […]
April 9th, 2007 at 3:11 pm
Why use a ripper? Just go to the Internet Temporary Files folder, find the YouTube file there (you can guess by the size and date, although there will be no extension), copy it and paste it to another location on your hard drive and rename it to something meaningful with .avi extension.
April 9th, 2007 at 4:06 pm
Can you make the script rename the file with the string contained in the page’s title? I mean, the video is on a page. The page has a title. Make the video been named after the page it is in, or we will end with lots of videos like kj1234ku2.flv, 123kjhj1234h.flv, etc.
April 9th, 2007 at 4:14 pm
The initial version featured some code that extracted the title as well.
I updated the previous script.
Thanks for the suggestion.
April 9th, 2007 at 8:18 pm
YESSSSSSSSSSSSSSS!!!! NOW IT IS PERFECT!
the only thing I had to do is to remove the “-r” option on my Mac OS X.
it does not work with this option.
thanks!!!!!!
April 9th, 2007 at 8:52 pm
Hi, I don’t know if it is a problem in the script or on you tube. I’m using a Mac and I have removed the “-r” option.
this guy named melah65 has 5 videos that I want to grab from youtube.
the videos are named
UFO Files: Black Box UFO Secrets Revealed ( part 1 of 5 )
UFO Files: Black Box UFO Secrets Revealed ( part 2 of 5 )
UFO Files: Black Box UFO Secrets Revealed ( part 3 of 5 )
UFO Files: Black Box UFO Secrets Revealed ( part 4 of 5 )
UFO Files: Black Box UFO Secrets Revealed ( part 5 of 5 )
I tried the following command
$ sh youtube-user.sh melah65 “UFO Files: Black Box”
after grabing part 1, 2 and 3, the script stopped.
I have tried with other videos from other guys, the problem is the same. Not all videos are grabbed. After some videos, the script stop and no error is shown.
April 9th, 2007 at 9:05 pm
I discover part of the problem. The guy named parts 1, 2 and 3 using “:” after the word “Files” and parts 4 and 5 using a dash after the word “Files”… anyway as the script uses regex it should not be a problem…
April 9th, 2007 at 10:51 pm
@Josh: I’ve done some serious re-writing with the regexp in the crawl() function.
April 10th, 2007 at 2:21 am
Niklas, now it is working fine!!!!!!!!! You’re the man!
April 10th, 2007 at 5:08 am
I just use the plugin that you can get for Firefox.
Neat concept though. If I ever find the need to copy a users complete video collection.
Shudders at the thought of a Numa collection.
April 11th, 2007 at 4:21 am
Sorry, but I will have to say that the script is not working 100%. I would say that it is working 99%.
Using the test command as in
$ sh youtube-user.sh HeadUnit420 “BBC” test
I see this guy has the following videos
* C4cXGJFGeJ0 as BBC Space - E2P1 HD.flv
* Jn_sPcXYSVY as BBC - Space E1/P2 HD.flv
* aV4ADdHz1no as BBC - Space E1/P1 HD.flv
* iyftv9IGBCo as BBC - Space E2P2 HD.flv
* nN4wUbR-ujI as BBC Space - E1P3 HD.flv
* uGyIUwK-H7M as BBC - Space E2P3.flv
“BBC” is the string all videos have in common. Use this and those videos with “/” in the name will not be grabbed.
Anyway, thanks for your efforts.
April 11th, 2007 at 1:57 pm
@MonkeyMan: For a very good reason. It would not be convenient with a filename containing ‘/’ on a UNIX system . :)
To fix this problem the filename that gets based on the video title should be properly escaped using another regexp replacing or removing things like slashes and other special characters.
Thanks for letting me know about this issue that I hadn’t considered before.
April 18th, 2007 at 3:08 pm
HOW do this actually work? WHAT do I need to use this script thing?
April 18th, 2007 at 5:05 pm
@PJ: It uses regular expressions on the Youtube pages. You need Bash and wget, which means it will work perfect on most Linux distributions, *BSD and OS X if you install wget.
Possibly might work with Cygwin as well.
April 19th, 2007 at 10:10 pm
[…] Si sois unos fanáticos de YouTube seguro que ya habéis utilizado las múltiples opciones existentes para descargar vídeos de este servicio. Sin embargo si vuestra afición llega al punto de tener vuestros usuarios favoritos, tal vez sea interesante pertrecharse de una herramienta que nos permita descargar sus trabajos de una manera automatizada. Eso es precisamente lo que hace el script youtube-user. […]
April 21st, 2007 at 3:09 pm
[…] Check it out […]
April 22nd, 2007 at 11:38 pm
Yeah do the above. Nothing big in my eyes.
May 5th, 2007 at 9:16 pm
[…] nlindblad.org/2007/04/08/youtube-ripper-collectors-edition/ […]
May 5th, 2007 at 9:21 pm
[…] nlindblad.org/2007/04/08/youtube-ripper-collectors-edition/ […]
May 6th, 2007 at 6:45 am
[…] 20. Youtube-dl 21. YouTube Ripper […]
May 6th, 2007 at 8:47 am
[…] Video Downloader 16. KeepV 17. VideoGet 18. TubeSucker OS X 19. Get Tube Linux 20. Youtube-dl 21. YouTube Ripper Plugins 22. Vidtaker 23. Ook? Video Ook! (Yes, that’s what it’s called. We’re all […]
May 6th, 2007 at 8:54 am
[…] http://nlindblad.org/2007/04/08/youtube-ripper-collectors-edition/ […]
May 6th, 2007 at 11:15 am
[…] nlindblad.org/2007/04/08/youtube-ripper-collectors-edition/ […]
May 6th, 2007 at 1:09 pm
[…] nlindblad.org/2007/04/08/youtube-ripper-collectors-edition/ […]
May 6th, 2007 at 1:11 pm
[…] nlindblad.org/2007/04/08/youtube-ripper-collectors-edition/ […]
May 6th, 2007 at 1:52 pm
[…] YouTube Ripper […]
May 6th, 2007 at 4:17 pm
[…] YouTube Ripper. […]
May 7th, 2007 at 1:34 am
[…] nlindblad.org/2007/04/08/youtube-ripper-collectors-edition/ […]
May 7th, 2007 at 2:48 am
[…] nlindblad.org/2007/04/08/youtube-ripper-collectors-edition/ […]
May 7th, 2007 at 6:21 am
[…] YouTube Ripper -not actually an application;it’s a simple script that rips all videos that match a keyword, […]
May 7th, 2007 at 6:28 am
[…] YouTube Ripper – это не совсем программа, на самом деле это скрипт, […]
May 7th, 2007 at 12:16 pm
[…] YouTube Ripper, um script para pegar vídeos e baixar de um usuário específico. […]
May 7th, 2007 at 3:25 pm
[…] Youtube-dl 下载原始的.flv格式,Linux下的mplayer和VLC都可以播放。21. YouTube Ripper […]
May 7th, 2007 at 10:10 pm
[…] 21. YouTube Ripper ist kein Programm im eigentlichen Sinne. Es handelt sich um ein einfaches Script das alle Videos nach einem vorgegebenen Keyword eiens bestimmten Users runterlädt. Es gibt davon auch eine ortierug in PHP. nlindblad.org/2007/04/08/youtube-ripper-collectors-edition/ […]
May 8th, 2007 at 2:54 am
[…] nlindblad.org/2007/04/08/youtube-ripper-collectors-edition/ […]
May 8th, 2007 at 6:59 am
[…] 20.Youtube-dl 下载原始的.flv格式,Linux下的mplayer和VLC都可以播放。 21.YouTube Ripper […]
May 8th, 2007 at 10:10 am
[…] nlindblad.org/2007/04/08/youtube-ripper-collectors-edition/ […]
May 8th, 2007 at 11:32 pm
[…] nlindblad.org/2007/04/08/youtube-ripper-collectors-edition/ […]
May 9th, 2007 at 6:37 am
[…] 21.YouTube Ripper 实际上这都不是一个软件,而只是一个简单的脚本,功能是rip所有满足某个关键字或者由某个YouTube用户上传的所有文件。同时还有PHP版。 […]
May 10th, 2007 at 4:42 am
[…] 21.YouTube Ripper 实际上这都不是一个软件,而只是一个简单的脚本,功能是rip所有满足某个关键字或者由某个YouTube用户上传的所有文件。同时还有PHP版。 […]
May 10th, 2007 at 3:03 pm
[…] YouTube Ripper всъщност не е приложение, а скрипт, който даунлодва […]
May 11th, 2007 at 1:21 am
Unfortunately, this script is broken now. Youtube changed things internally and the script broke.
May 11th, 2007 at 4:34 pm
[…] 21. 严格地讲,YouTube Ripper并不能够算作一款真正意义上的应用程序;它只是一段简单的脚本代码,能够抓取符合某一个关键词,或是由某个特定YouTube网站用户所上传的所有视频文件。事实上,我们并不真正知道拿它来有什么用,不过也许你对此有更好的主意!它同时也提供了现成的PHP端口。 […]
May 11th, 2007 at 7:23 pm
[…] nlindblad.org/2007/04/08/youtube-ripper-collectors-edition/ […]
May 13th, 2007 at 1:49 pm
What does Naevius YouTube Converter do for me?
Naevius YouTube Converter is a convenient tool to download and convert your favorite videos from YouTube website into the standard AVI DivX video format.
http://www.naevius.com/youtube_converter.htm
May 13th, 2007 at 8:08 pm
[…] initial versionof the Youtube command-line ripper appeared on Digg without ever reaching any sort of maturity. […]
May 14th, 2007 at 4:29 pm
[…] 21.YouTube Ripper 实际上这都不是一个软件,而只是一个简单的脚本,功能是rip所有满足某个关键字或者由某个YouTube用户上传的所有文件。同时还有PHP版。 […]
May 20th, 2007 at 1:49 pm
[…] nlindblad.org/2007/04/08/youtube-ripper-collectors-edition/ […]
May 22nd, 2007 at 9:16 pm
[…] Youtube-dl YouTube Ripper […]
May 30th, 2007 at 1:28 pm
[…] nlindblad.org/2007/04/08/youtube-ripper-collectors-edition/ […]
June 1st, 2007 at 6:59 am
[…] http://nlindblad.org/2007/04/08/youtube-ripper-collectors-edition/ […]
June 8th, 2007 at 2:11 am
[…] YouTube Ripper , , , […]
July 1st, 2007 at 5:58 am
[…] nlindblad.org/2007/04/08/youtube-ripper-collectors-edition/ […]
July 2nd, 2007 at 12:51 am
http://boomvid.com
You can also download YouTube Video, Google Video, Dailymotion, ifilm, Break, putFile, grouper, MySpace, That Video Site, Grinvi,…all in one page in one click. Check out this site: http://boomvid.com
Enjoy!!!
Boomvid.com
July 5th, 2007 at 2:05 pm
[…] nlindblad.org/2007/04/08/youtube-ripper-collectors-edition/ […]
July 6th, 2007 at 6:19 pm
nice thanx
July 25th, 2007 at 10:59 am
[…] YouTube Ripper. […]
August 15th, 2007 at 2:29 am
I couldn’t understand some parts of this article las Lindblad Organisation, but I guess I just need to check some more resources regarding this, because it sounds interesting.
August 19th, 2007 at 1:48 pm
[…] nlindblad.org/2007/04/08/youtube-ripper-collectors-edition/ […]
August 24th, 2007 at 3:07 pm
[…] 21.YouTube Ripper 实际上这都不是一个软件,而只是一个简单的脚本,功能是rip所有满足某个关键字或者由某个YouTube用户上传的所有文件。同时还有PHP版。 […]
August 29th, 2007 at 2:08 am
[…] Mac OS X 软件 Get Tube Linux 软件 Youtube-dl YouTube Ripper […]
August 30th, 2007 at 7:32 am
YouTube Robot enables you to download videos from YouTube and automatically convert them to be viewed on your Video iPod, Zune, PSP or other portable …
You can download YouTube Robot from following link
http://www.youtuberobot.com/download/utuberobot.exe
http://www.youtuberobot.com/
\\192.168.0.99
September 18th, 2007 at 7:43 am
[…] 22. YouTube Ripper […]
September 18th, 2007 at 9:43 am
[…] 22. YouTube Ripper […]
October 5th, 2007 at 12:46 pm
[…] read more | digg story […]
October 12th, 2007 at 5:25 pm
[…] nlindblad.org/2007/04/08/youtube-ripper-collectors-edition/ […]
October 22nd, 2007 at 10:59 am
[…] YouTube Ripper (Linux) […]
October 24th, 2007 at 6:48 pm
[…] read more | digg story […]
October 26th, 2007 at 6:48 pm
[…] YouTube Ripper […]
November 4th, 2007 at 4:03 pm
[…] YouTube Ripper […]
November 5th, 2007 at 4:11 am
[…] 8. Vixy9. Hey! Watch10. Media Converter11. KcoolOnline12. FLV DownloaderWindows 软件13. VDownloader14. YouTube Grabber15. Orbit Downloader16. My Video Downloader17. KeepV18. VideoGet19. TubeSuckerMac OS X 软件20. Get TubeLinux 软件21. Youtube-dl22. YouTube Ripper […]
November 5th, 2007 at 4:15 pm
[…] 8. Vixy9. Hey! Watch10. Media Converter11. KcoolOnline12. FLV DownloaderWindows软件13. VDownloader14.YouTubeGrabber15. OrbitDownloader16. My VideoDownloader17. KeepV18. VideoGet19. TubeSuckerMac OS X软件20. GetTubeLinux 软件21. Youtube-dl22.YouTubeRipper […]
November 5th, 2007 at 6:27 pm
[…] 8. Vixy 9. Hey! Watch 10. Media Converter 11. KcoolOnline 12. FLV Downloader Windows 软件 13. VDownloader 14. YouTube Grabber 15. Orbit Downloader 16. My Video Downloader 17. KeepV 18. VideoGet 19. TubeSucker Mac OS X 软件 20. Get Tube Linux 软件 21. Youtube-dl 22. YouTube Ripper […]
November 5th, 2007 at 8:17 pm
[…] 8. Vixy 9. Hey! Watch 10. Media Converter 11. KcoolOnline 12. FLV Downloader Windows 软件 13. VDownloader 14. YouTube Grabber 15. Orbit Downloader 16. My Video Downloader 17. KeepV 18. VideoGet 19. TubeSucker Mac OS X 软件 20. Get Tube Linux 软件 21. Youtube-dl 22. YouTube Ripper […]
November 5th, 2007 at 9:54 pm
[…] 8. Vixy 9. Hey! Watch 10. Media Converter 11. KcoolOnline 12. FLV Downloader Windows 软件 13. VDownloader 14. YouTube Grabber 15. Orbit Downloader 16. My Video Downloader 17. KeepV 18. VideoGet 19. TubeSucker Mac OS X 软件 20. Get Tube Linux 软件 21. Youtube-dl 22. YouTube Ripper […]
November 5th, 2007 at 9:55 pm
[…] 8. Vixy 9. Hey! Watch 10. Media Converter 11. KcoolOnline 12. FLV Downloader Windows 软件 13. VDownloader 14. YouTube Grabber 15. Orbit Downloader 16. My Video Downloader 17. KeepV 18. VideoGet 19. TubeSucker Mac OS X 软件 20. Get Tube Linux 软件 21. Youtube-dl 22. YouTube Ripper […]
November 6th, 2007 at 2:08 am
[…] 8. Vixy 9. Hey! Watch 10. Media Converter 11. KcoolOnline 12. FLV Downloader Windows 软件 13. VDownloader 14. YouTube Grabber 15. Orbit Downloader 16. My Video Downloader 17. KeepV 18. VideoGet 19. TubeSucker Mac OS X 软件 20. Get Tube Linux 软件 21. Youtube-dl 22. YouTube Ripper […]
November 9th, 2007 at 7:05 pm
nice script
November 9th, 2007 at 7:06 pm
very very nice script
November 10th, 2007 at 8:28 am
[…] nlindblad.org/2007/04/08/youtube-ripper-collectors-edition/ […]
November 11th, 2007 at 2:53 am
[…] YouTube Ripper, um script para pegar vídeos e baixar de um usuário específico. […]
November 11th, 2007 at 5:11 pm
Hi Guys…
I found a website that help you to search and download youtube videos directly from one place. Check this out : http://video.bizuniversal.com/
November 12th, 2007 at 10:21 am
[…] YouTube Ripper 严格意义上不能算是一个程序,它不过是一个简单的script代码. […]
November 14th, 2007 at 2:19 pm
[…] read more | digg story […]
November 15th, 2007 at 6:16 pm
[…] YouTube Ripper […]
November 18th, 2007 at 7:30 pm
[…] YouTube Ripper. […]
November 20th, 2007 at 2:53 pm
[…] YouTube Ripper – это не совсем программа, на самом деле это скрипт, […]
November 23rd, 2007 at 12:44 am
[…] YouTube Ripper […]
November 23rd, 2007 at 5:44 am
[…] YouTube Ripper […]
November 26th, 2007 at 3:07 pm
[…] nlindblad.org/2007/04/08/youtube-ripper-collectors-edition/ […]
December 9th, 2007 at 8:45 am
[…] YouTube Ripper […]
December 14th, 2007 at 11:09 am
[…] http://nlindblad.org/2007/04/08/yout…ctors-edition/ […]
December 17th, 2007 at 9:20 am
[…] Tube 支持来自YouTube, DailyMotion 和 Kewego的音视频下载. Linux平台20. Youtube-dl. 21. YouTube Ripper 严格意义上不能算是一个程序,它不过是一个简单的script代码. 插件推荐22. […]
December 17th, 2007 at 8:11 pm
Nice Code
December 28th, 2007 at 1:07 pm
Thanks for the code.
January 1st, 2008 at 2:41 am
[…] nlindblad.org/2007/04/08/youtube-ripper-collectors-edition/ […]
February 2nd, 2008 at 12:11 am
naevius youtube converter…
Thanks. I gave a link of this letter in my blog….
February 11th, 2008 at 8:03 am
[…] on YouTube, CNN, AOL, Yahoo! Video, Daily Motion, etc. Youtube-dl: Download videos in FLV format. YouTube Ripper: Script that downloads videos using […]
February 12th, 2008 at 11:15 am
[…] YouTube Ripper […]
February 12th, 2008 at 2:10 pm
s