Share your repls and programming experiences

← Back to all posts
Search The World - The Best Search Engine
h
hg0428 (195)

Search The World

This search engine is one of my biggest coding projects ever. After a lot of code, and a lot of time, I have finally finished. I planned to submit this last month, but the language jam delayed it.

I hope you enjoy!

Comments
hotnewtop
hg0428 (195)

Yes, but not many people saw [email protected]
I have some things I make that are much better than the things you see at the top of the top section, but I never get more than a few upvotes.

zplusfour (914)

@hg0428 yes! add:

  • Some cool CSS
  • nothing it's cool
hg0428 (195)

I am not the best at css, that was the best I could [email protected]

hg0428 (195)

Also, you need to check your [email protected]

hg0428 (195)

Ok, if you want to. But, I ended this project months ago. I will not be working on [email protected]

zplusfour (914)

@hg0428 I dunno why.. I can't login into discord ;-;

CodeLongAndPros (1630)

Uh does this crawl anything?

hg0428 (195)

Yes, every indexed website. And [email protected]

CodeLongAndPros (1630)

@hg0428 Because I'm just getting Bing links and SO bangs.

hg0428 (195)

Give an example, and what your query [email protected]

hg0428 (195)

Ok, that is supposed to happen, those are links to websites that have good results for your query.
It searches through 1000s of websites and shows all the ones that have any result. @CodeLongAndPros

CodeLongAndPros (1630)

@hg0428 But stackoverflow did not! And you also appear to link to other search engines...

hg0428 (195)

I have no idea why it gave one without results, it should check first. It must have found those words somewhere in the text on the page, maybe in the search itself? @CodeLongAndPros

hg0428 (195)

Yes, it does do that in case no results are [email protected]

hg0428 (195)

Oh, maybe. It says: "No results for plan nine from bell labs". That could lead it to thin k that it is an actual result. @CodeLongAndPros

CodeLongAndPros (1630)

@hg0428 Yes, that's what I surmised. The real fix is to crawl the websites.

hg0428 (195)

Ok, it should give you the wikipedia result [email protected]

hg0428 (195)

It does, and it indexes all websites it finds. Last time, I left the crawler on too long and it added 8,000 new site, I had to delete some because of problem in loading the [email protected]

CodeLongAndPros (1630)

@hg0428 I did, now it changed the order.

CodeLongAndPros (1630)

@hg0428

It does, and it indexes all websites it finds

It does not appear to, please correct me if I am wrong, but crawling should give a deep link into the website, not point to the search function, right?

hg0428 (195)

Crawling is used to index new sites, it looks through the text and finds all links, indexes them and continues the process.
@CodeLongAndPros

CodeLongAndPros (1630)

@hg0428 Well yes, but you don't appear to do that, you appear to have a static list of websites and use their search functions.

hg0428 (195)

No, actually not, I have thousands, I would not be able to add that many without a web crawler. It's just not active all the time. There is a shortcut to activate it, go to index my site and type in "full crawl()" to activate it. Also when you add sites, it crawls them.
@CodeLongAndPros

CodeLongAndPros (1630)

@hg0428 9 results for 1000s of websites? It appears to activate for certain queries, not sure why it's not default though.

hg0428 (195)

Yea, I guess, try searching for nothing
@CodeLongAndPros . I activated the crawler by the way.

CodeLongAndPros (1630)

@hg0428 Ok, that's looking more like a search engine.

hg0428 (195)

Yes, smaller searches have more [email protected]