Woogle
h
AdCharity (1322)

Preface: the only links in there are google, some bing stuff, repl, and stack overflow

Stuff

Need I say more? The fake search engine is here. It's pretty much missing the most critical parts of an engine (like pagination, mobile support, and indexing) but I think it captures the essence of finding link matches.

Fork

You can fork the project and take a look at config.js so you can input your own types of links (the crawler will crawl all links and then crawl those links etc.) It's fairly unstable since I used request and cheerio for images and the crawler crashes but oh well.

Updates

  • Featured right now: image and link search
  • Coming: pagination, indexing, mobile support (if I don't abandon the project)
  • Update 1: images that don't work are removed
  • Update 2: Scraping slightly better (still bad)
  • Update 3: Matches partial matches (like spaces in between)
You are viewing a single comment. View All
JordanDixon1 (178)

How do you add websites to this?

AdCharity (1322)

@JordanDixon1 fork it and go to config.js and type in the links you want (it crawls every link it finds as well, so one is fine)

JordanDixon1 (178)

@AdCharity I see https://google.com and thats the only link on there. Whenever I search something nothing shows up though. I can look up repl.it though.

AdCharity (1322)

@JordanDixon1 bruh ok so config.js sets the crawler settings and adds more links. The testing.js in the database file has all the links you could search (which is stack overflow, google, repl, etc.)