Skip to content
← Back to Community
Web Scraper
Profile icon
h
has Hacker Plan
HackermonDev

I created this basic web scraper with nodejs and wanted to share it. You have to fork it then change the variable url to the url you want. I'm still adding more features to it. Upvote this post and star the repo if you like it.

Voters
Profile icon
meowsquared
Profile icon
SimerLol
Profile icon
SBCKing
Profile icon
RomeroSchwarz
Profile icon
Kai_Justice
Profile icon
AgastyaSandhuja
Profile icon
CodeSalvageON
Profile icon
Commodore95
Profile icon
HackermonDev
Comments
hotnewtop
Profile icon
CodingEpic
Profile icon
AdCharity

Well you could just use the request library + cheerio to manipulate DOM elements to make it a bit easier.

Profile icon
HackermonDev

@AdCharity I didn't know cheerio even existed.

Profile icon
[deleted]

@AdCharity this is what I was thinking. ATM this project isn't that amazing, just a very ghetto version of a DOM parser

Profile icon
AdCharity

@sanjaykdragon well I mean if you have a great library to retrieve DOM elements in node.js with similar usage to JQuery, I would just use it

Profile icon
[deleted]

@AdCharity yeah im recommending OP to use it, i don't do nodejs so I don't know the library name

Profile icon
AdCharity

@sanjaykdragon cheerio (that's the name)