Ask coding questions

← Back to all posts
Websites to index for my search engine?
h
hg0428

Please give me ideas for websites to index for my search engine. I need all the ideas you can give me.

Voters
angrydoge
hg0428
Comments
hotnewtop
coderash

I have a site with a bunch of coding-related stuff you should put in:
https://web-i-wiki--motherqube.repl.co/

hg0428

Indexed! Do you have any [email protected]

coderash

uhh, i setup a web crawler with python a few weeks ago and it crawled google for like 3 hours, ill try to pull up the results for you

hg0428

I am making a new search engine, so it is not added to [email protected]

coderash

I mean it looks at one websites, indexes it, finds any links and indexes them and repeats on them.

hg0428

Thats a good idea!
@coderash

coderash

i think its what google do aswell, so its good enough for a search engine :D