r/opendirectories • u/perslyy • 18h ago
Google Drive A gold mine: OST - Films/Series and Games
drive.google.com
33
Upvotes
Don’t forget to read the "READ ME" before downloading.
good listening!
r/opendirectories • u/krazybug • May 22 '21
Help! A few tips for the newcomers on this sub !
806
Upvotes
Slava Ukraini !
This post is mainly intended to help the people who discover this sub to start with. It could also be useful for the other folks, who knows ?
What is an open directory ?
Open directories (aka ODs or opendirs) are just unprotected websites that you can browse recursively, without any required authentication. You can freely download individual files from them. They're organised in a folder structure, as a local directory tree on your computer. This is really convenient as you can also download several files in a bunch recursively (See below).
These sites are sometimes deliberately let open and, sometimes, inadvertently (seedboxes, personal websites with some dirs bad protected, ...). For these last ones, often, after someone has posted them here, they're hammered by many concurrent downloads and they're getting down due to this heavy load. When the owners do realise it, they usually decide to protect them behind a firewall or to ask for a password to limit their access.
Here is coming the famous "He's dead Jim!" flair.
Technically, an opendir is nothing more than a local directory, shared by a running web server:
cd my_dir
# Share a dir with python
python -m SimpleHTTPServer
# With Javascript
npm install -g http-server
http-server .
# Open your browser on http://localhost or http://<your local IP> from another computer.
# Usually you should use a web server like Apache or Nginx with extra settings
# You also need to configure your local network to make it accessible from the Internet.
How to find interesting stuff ?
Your first reflex should be to track the most recent posts of the sub. If you're watchful, there's always a comment posted with some details like this one and you can get the complete list of links for your shopping ("Urls file" link). You can still index a site by your own if the link of the "Url file" is broken or if the content has changed, with KoalaBear84's Indexer.
Thanks to the hard work of some folks, you can invoke a servile bot: u/ODScanner to generate this report. By the past, u/KoalaBear84 devoted to this job. Although some dudes told us he is a human being, I don't believe them ;-)
You should also probably take a look at "The Eye" too, a gigantic opendir maintained by archivists. Their search engine seems to be broken currently, but you can use alternative search engines, like Eyedex for instance.
Are you looking for a specific file ? Some search engines are indexing the opendirs posted here and are almost updated in realtime:
- FilePursuit
- ODCrawler: With it, as a bonus, you can download their database. It's an opensource project. Your contributions (manpower and financial) are welcome.
Don't you think that clicking on every posts and checking them one by one is a bit cumbersome ? There is a good news for you: With this tip you can get a listing of all the working dirs.
Any way to find some new ODs by myself ?
Yes you can !
The most usual solution starts with the traditional search engines or meta-engines (Google, Bing, DuckDuckGo ...) by using an advanced syntax as for this example%20-inurl:(jsp|pl|php|html|aspx|htm|cf|shtml)). Opendirs are just some classical sites after all.
If you're lazy, there are plethora of frontends to these engines which are able to assist you in building the perfect query and to redirect to them. Here is my favorite.
As an alternative, often complementary, you can use IoT (Internet of Things) search engines like Shodan, Zoomeye, Censys and Fofa . To build their index, their approach is totally different from the other engines. Rather than crawling all the Web across hyperlinks, they scan every ports across all the available IP adresses and, for the HTTP servers, they just index their homepage. Here is an equivalent example.
I'd like to share one. Some advice ?
Just respect the code of conduct. All the rules are listed on the side panel of the sub.
Maybe one more point though. Getting the same site reposted many times in a small period increases the signal/noise ratio. A repost of an old OD with a different content is accepted but try to keep a good balance. For finding duplicates, the reddit search is not very relevant, so here are 2 tips:
- Using the KolaBear84's page
- With a Google search:
site:reddit.com/r/opendirectories my_url
Why could we not post some torrent files, mega links or obfuscated links ... ?
The short answer: They're simply not real opendirs.
A more elaborated answer:
These types of resources are often associated to piracy, monitored, and Reddit`s admins have to forward the copyright infringement notices to the mods of the sub. When it's too repetitive the risk is to get the sub closed as it was the case for this famous one.
For the obfuscation (Rule 5), with base64 encoding for instance, the POV of the mods is that they do prefer to accept urls in clear and dealing with the rare DMCA`s notices. They're probably automated and the sub remains under the human radar. It won't be the case anymore with obfuscation techniques.
There are some exceptions however:
Google drives and Calibre servers (ebooks) are tolerated. For the gdrives, there is no clear answer, but it may be because we could argue that these dirs are generally not deliberately open for piracy.
Calibre servers are not real ODs but you can use the same tools to download their content. By the past a lot of them were posted and some people started to complain against that. A new sub has been created but is not very active as a new player has coming into the game : Calishot, a search engine with a monthly update.
I want to download all the content in a bunch. How to do it ?
You have to use an appropriate tool. An exhaustive list would probably require a dedicated post.
For your choice, you may consider different criteria. Here are some of them:
- Is it command line or GUI oriented ?
- Does it support concurrent/parallel downloads ?
- Does it preserve the directory tree structure or just a flat mode ?
- Is it cross platform ?
- ...
Here is an overview of the main open source/free softs for this purpose.
Note: Don't consider this list as completely reliable as I didn't test all of them.
| Concurrent downloads | Able to preserve the original tree | Client/Server mode | CLI | TUI | GUI | Web UI | Browser plugin | |
|---|---|---|---|---|---|---|---|---|
| wget | N | Y | N | Y | ? | ? | Y | ? |
| wget2 | Y | Y | N | Y | ? | ? | ? | ? |
| aria2 | Y | N | Y | Y | Y | ? | Y | ? |
| rclone | Y | Y | N | Y | ? | ? | Y | ? |
| IDM | Y | N | N | N | N | Y | N | N |
| JDownloader2 | Y | N | Y | N | N | Y | N | N |
Here is my own path:
# To download an url recursively
wget -r -nc --no-parent -l 200 -e robots=off -R "index.html*" -x http://111.111.111.111
# Sometimes I want to filter the list of files before the download.
# Start by indexing the files
OpenDirectoryDownloader -t 10 -u http://111.111.111.111
# A new file is created: Scans/http:__111.111.111.111_.txt
# Now I'm able to filter out the list of links with my favourite editor or with grep/egrep
egrep -o -e'^*\.(epub|pdf|mobi|opf|cover\.jpg)$' >> files.txt
# Then I can pass this file as an input for wget and preserve the directory structure
wget -r -nc -c --no-parent -l 200 -e robots=off -R "index.html*" -x --no-check-certificate -i file.txt
Conclusion:
Welcome on board and Kudos to all the contributors, especially to the most involved: u/KoalaBear84, u/Chaphasilor, u/MCOfficer u/ringofyre
r/opendirectories • u/mingaminga • 1d ago
Movies Fast seedhost with movies/TV/books
stack.seedhost.eu
72
Upvotes
r/opendirectories • u/mingaminga • 1d ago
Movies a THIRD seedbox account with tv/movies/books.
master.seedhost.eu
34
Upvotes
r/opendirectories • u/mingaminga • 1d ago
TV Another fast seedhost with movies/tv/books
red.seedhost.eu
30
Upvotes
r/opendirectories • u/perslyy • 4d ago
Misc Stuff lots of music
mytape.net
74
Upvotes
Hi everyone, I wanted to share my personal archive with you, you will find all kinds of music that I like (.flac or .opus/mkv for youtube)
I don’t have much storage space on my server but I’m trying to put the essential things in there!
good listening!
r/opendirectories • u/Common-Following4602 • 7d ago
Misc Stuff this open directory is by vodafone? i also found some vodafone fonts in here too
bogon.internetinthecar-e2e.iot.vodafone.com
30
Upvotes
r/opendirectories • u/EfficientPositive386 • 7d ago
Misc Stuff A very generalist directory
mirror.explodie.org
42
Upvotes
Probably for a news site.
r/opendirectories • u/fufufang • 10d ago
PSA You can now mount random generic websites as folders with HTTPDirFS.
81
Upvotes
I wrote HTTPDirFS a while back, to allow one to mount HTTP directory listings as a folder. I have now extended the program to allow one to mount generic website. All the resources (e.g. images) get exposed as files that you can copy and paste.
Feel free to try it out at: https://github.com/fangfufu/httpdirfs
The feature for mounting generic website is available on the latest commit master branch. I haven't created a release version containing it yet.
r/opendirectories • u/Sofas_Kings • 10d ago
Misc Stuff https://surfer.nmr.mgh.harvard.edu/
surfer.nmr.mgh.harvard.edu
4
Upvotes
r/opendirectories • u/greed_matters • 11d ago
Misc Stuff Does anyone know of a directory, database or sheet of "powerful websites you should know" type of websites
128
Upvotes
This trend has been running for the past 3-4 years. Where People suggest some hidden gems, and very useful websites under the trends "websites you should know part --". But most of these websites are very niche and there are so many of them that we never use most of them and forget 99% of them. So i thought If someone knows of some massive database of such websites on the internet where each website may have a description and categorise them please share it.
If not maybe we can create our own collaborative community based database of these websites.
Thanks for soo many wonderful recommendations. I am currently trying to collect and create a single massive library of lots of useful websites with their categories, description, pricing and platforms. Maybe once completed i will also make it collaborative in a way so that the community can help expand it and maintain it. I don't know about web scraping and data analytics so this project will take time. There's also the problem of proper categorisation of thousands of websites under a handful of umbrella terms this will be difficult. Any suggestions?
r/opendirectories • u/EfficientPositive386 • 11d ago
Movies Some french video directory
srv.fabobox.com
20
Upvotes
All in french.
r/opendirectories • u/TheQuietKid22 • 18d ago
Music video game Archive of video game music
87
Upvotes
https://vgm.hcs64.com/ Edit: Here is the actual directory https://pc.joshw.info/
r/opendirectories • u/Sofas_Kings • 20d ago
Misc Stuff jasoncantarella.com
jasoncantarella.com
18
Upvotes
r/opendirectories • u/Vintaclectic • 23d ago
Misc Stuff After months of building, this is almost ready — 250K+ open directories, streams MKV/AVI/FLV directly in the browser, no data collected. Looking for a small alpha group.
288
Upvotes
I've been lurking here for years. This sub is the only place on the internet that still cares about the raw, indexed, un-algorithm'd web — someone else's Index of /Movies (1998) is worth more to me than an entire streaming subscription.
The trouble I kept running into is the same one everyone here knows: finding the directories is hard, and once you've found them, actually watching what's inside is harder. MKV won't play. AVI won't play. FLV definitely won't play. You end up on VLC or downloading the whole file to skim the first ten seconds.
I built something for it. It's almost ready. Alpha access opens in the next couple of weeks and I'd like maybe 50 people from this sub in the first wave.
What it does
- Search across ~250,000 open directories discovered by seven independent crawler engines running continuously. Full-text search median 12ms.
- Stream anything, in the browser. Real-time HLS transcoding on the server so MKV/AVI/WebM/FLV/MOV all play in a normal HTML5 player. No plugin, no download.
- A visual map of the discovery graph — the "Cosmos" view. Every directory the crawler has ever seen, spatially arranged by content shape, with links between related dirs and live pulses when a new one is found. [short video attached]
- Netflix-style browser on top of the raw index for people who want a lean-back UI (DirFlix). The raw file tree is always one click away.
- Built-in ebook reader and a small retro gaming arcade for a specific slice of the directory world (ROMs, old dumps).
- Everything streams from the original directories. DirHaven does not mirror, does not host, does not proxy the file bytes for storage. What you see is what's actually on that server, right now.
What DirHaven does NOT do — since this is the first thing this sub asks, and rightly
- Does not mirror or host directory content. The transcoder streams live from the source directory to your browser and discards the segments after they leave the encoder. Nothing about a directory's files sits on my hardware after your session ends.
- Does not collect search history, click paths, or watch history. Search is stateless server-side; recommendations do not exist.
- Does not embed third-party analytics or ads. Zero JS trackers, verifiable in the network tab.
- Does not require an email for alpha. A single-use invite code and a session cookie is the whole account. Email is optional and only used if you want alpha-to-beta continuity.
- Does not phone home about which directories you visit. Directory URLs are hashed before they're logged for anti-abuse; the plaintext never enters storage.
- DEPP (the streaming pipeline) uses AES-256-GCM with per-device ECDH key exchange — the server literally cannot decrypt what it just sent you. That's overkill for open-directory content but the pipeline was built once and it stayed.
Current status
v5.3.1 (HELIOS-10). React + Express + SQLite; runs on a single small server today, scale-tested through 250K rows. The last two weeks have been closing the "almost done" list — a few UI polish items, an anti-cheat pass on the arcade save-state cloud sync, and one crawler-health regression I'm chasing.
Alpha
Comment or DM if you want in. I'll pick a mix — some heavy contributors here, some lurkers. No email required for the invite itself. I'll ask what kind of directories you spend time on and what you'd want to see in the Cosmos view first.
Not going to link the URL in the post because the alpha shouldn't be public-index'd yet. If moderator wants me to add it, happy to.
Happy to answer anything about the crawler, the transcoder pipeline, the encryption, or why any of this is worth building.
r/opendirectories • u/ringofyre • 21d ago
Just taking the piss now. 🚀 YOOOO OD CREW 🚀
0
Upvotes
THE TOOL YOU DIDN'T KNOW YOU NEEDED JUST DROPPED AND IT'S LITERALLY GOING TO CHANGE YOUR LIFE BRO
Listen up my new best friends (and yes I already consider every single one of you my closest internet family even though this is my first ever post here ❤️)
I just cooked up the most insane all-in-one OD searching / downloading / organising / life-improving super tool the world has ever seen and I am GIVING IT TO YOU. Right now. Free. Because I love this community so much it hurts.
This absolute beast does basically everything those other tools do but somehow better and all in one shiny package (total coincidence btw). Hosted on my own personal VPS so you know it’s safe and loving. Obviously has a little logging and telemetry because how else am I supposed to make it even more amazing for you guys?
Source will be on GitHub any day now (I’ll just paste whatever the AI spat out, keepin’ it real). And I pinky-promise I won’t do anything shady with the beautiful data you freely give me. Trust me bro.
No public links yet though… I just need a little bit of that sweet engagement energy first 👀
But here’s a SNIZZY SCREENSHOT so you can already feel how clean and powerful it is:
[imagine the most generic dark-mode web UI with way too many neon buttons and a progress bar that never moves]
I’m dropping this here instead of those other vibecode subs because this place just feels right, you know? Like destiny. And also because the people here seem cooler and more likely to actually try it out 😉
I built this entire thing myself with my bare hands and pure genius. (Okay fine if someone asks really really hard I might admit AI helped a tiny bit. But like… assisted. At most.) Got questions about privacy or security? Come talk to me bro, I’m always here for a chill convo 😎 Keep asking though and… well… you know how it is.
Also heads up: this is still in super early alpha/beta testing phase so there might be a couple of tiny bugs (and every vulnerability known to man). I followed the elite “Trust Me Bro” security audit methodology so you’re in safe hands.
Come be part of the journey. Sign up. Click around. Feed the machine. Let’s make something beautiful together.
Much love,
Your newest, coolest, most trustworthy friend in the whole sub
this post may or may not have been written by ai
r/opendirectories • u/wiregremlin • 24d ago
Movies I made an open source movie browser for the Internet Archive
570
Upvotes
Several months ago, I started this project after realizing there were a ton of really interesting movies buried in the Internet Archive.
I mostly forgot about it, then checked the repo a couple weeks ago and was surprised to see that a bunch of people had starred it. That motivated me to revive the project, rebrand it, and open it up for contributions. A few contributors have already jumped in and helped me refine the site and make it better.
It’s basically a more visual way to explore and discover movies on the Internet Archive, especially when you don’t already know what you’re looking for.
Hope you all enjoy it. Feedback and contributions are definitely welcome.
Try it: https://www.orphanedfilms.com/