In 2010, YouTube introduced a new option of unlisted videos. Unlisted videos are like the ordinary public videos but won’t appear in YouTube’s search results (except in playlists). Unlisted videos differ from private videos in that anyone can watch the video if they know the URL, or know of a webpage that links to or embeds that video.
There are various reasons for unlisting a video. Some official accounts of celebrities, bands, brands and organisations, might decide to unlist to allow their subscribers the first view of a new video, to declutter their channel, or provide a relatively hard to find ‘Easter egg’ or treat for their subscribers.
Some video uploaders might have their videos unlisted because they think the videos would be of little interest to those likely to stumble upon them through a search e.g. software tutorials, video game footage, animations etc. Some may decide to unlist for privacy reasons if the video is aimed solely at an individual, family, or organisation (such videos are not permitted on Unlisted Videos)
Scrape unlisted youtube videos
Scraping https://unlistedvideos.com/ Youtube is removing all unlisted videos made before Jan 1st 2017 in 1 month, we are trying to archive many of them. Here is a script to get about 600,000.
How to scrape unlisted videos ?
- Open index.js and edit the COOKIE header, you can find this by pressing F12, going to the network tab, refresh, click the first request, find the request headers and copy
node index.js - Please note you may have to repeat step 1 a few times depending on how suspicious you are to cloudflare. If you get a 403 error, do the cloudflare captcha then copy the last number sent in console and change
let start = 653501. The program will continue downloading the rest of the pages.
GitHub : github.com/moom0o/UnlistedVideosScraper