Search The World - The Best Search Engine
h
hg0428

Search The World

This search engine is one of my biggest coding projects ever. After a lot of code, and a lot of time, I have finally finished. I planned to submit this last month, but the language jam delayed it.

I hope you enjoy!

You are viewing a single comment. View All
CodeLongAndPros

Uh does this crawl anything?

hg0428

Yes, every indexed website. And [email protected]

CodeLongAndPros

@hg0428 Because I'm just getting Bing links and SO bangs.

hg0428
CodeLongAndPros

@hg0428 Not actual websites.

CodeLongAndPros
hg0428

Give an example, and what your query [email protected]

hg0428

Ok, that is supposed to happen, those are links to websites that have good results for your query.
It searches through 1000s of websites and shows all the ones that have any result. @CodeLongAndPros

CodeLongAndPros
CodeLongAndPros

@hg0428 But stackoverflow did not! And you also appear to link to other search engines...

hg0428

I have no idea why it gave one without results, it should check first. It must have found those words somewhere in the text on the page, maybe in the search itself? @CodeLongAndPros

hg0428

Yes, it does do that in case no results are [email protected]

hg0428

It is being fixed right [email protected]

CodeLongAndPros

@hg0428 Perhaps this is why?

hg0428

Oh, maybe. It says: "No results for plan nine from bell labs". That could lead it to thin k that it is an actual result. @CodeLongAndPros

CodeLongAndPros

@hg0428 Yes, that's what I surmised. The real fix is to crawl the websites.

hg0428

Ok, it should give you the wikipedia result [email protected]

CodeLongAndPros
hg0428

It does, and it indexes all websites it finds. Last time, I left the crawler on too long and it added 8,000 new site, I had to delete some because of problem in loading the [email protected]

hg0428

Try reloading now.
@CodeLongAndPros

CodeLongAndPros

@hg0428 I did, now it changed the order.

hg0428
CodeLongAndPros

@hg0428

It does, and it indexes all websites it finds

It does not appear to, please correct me if I am wrong, but crawling should give a deep link into the website, not point to the search function, right?

hg0428

Crawling is used to index new sites, it looks through the text and finds all links, indexes them and continues the process.
@CodeLongAndPros

CodeLongAndPros

@hg0428 Well yes, but you don't appear to do that, you appear to have a static list of websites and use their search functions.

hg0428

No, actually not, I have thousands, I would not be able to add that many without a web crawler. It's just not active all the time. There is a shortcut to activate it, go to index my site and type in "full crawl()" to activate it. Also when you add sites, it crawls them.
@CodeLongAndPros

CodeLongAndPros

@hg0428 9 results for 1000s of websites? It appears to activate for certain queries, not sure why it's not default though.

hg0428

Yea, I guess, try searching for nothing
@CodeLongAndPros . I activated the crawler by the way.

CodeLongAndPros

@hg0428 Ok, that's looking more like a search engine.

hg0428

Yes, smaller searches have more [email protected]