Skip to content
← Back to Community
A little Webscraping Project
Profile icon
h
has Hacker Plan
InvisibleOne

I started doing some web scraping in python, which is usually what people soon after learning python. I've known python for quite a while and never really done any web scraping.

So I made this little project that can get some information about replit users.

Also, let me know if there's a better way to do what I'm doing, other than the sorting thingy for the leaderboard stuff, I slapped that together really quickly and I know it's not good, I'll probably fix it and streamline it later.

Enjoy!

Voters
Profile icon
maxina
Profile icon
sojs
Profile icon
sleepyperson123
Profile icon
PixiGem
Profile icon
JWZ6
Profile icon
Bunnytoes
Profile icon
ch1ck3n
Profile icon
VulcanWM
Profile icon
InvisibleOne
Comments
hotnewtop
Profile icon
ch1ck3n
Profile icon
InvisibleOne

I think my sorting thingy sorted you out of the list, I will fix that now @ch1ck3n

Profile icon
ch1ck3n
Profile icon
InvisibleOne

I see, well you should be on it now but the placing is incorrect.
Screen Shot 2021-07-29 at 3.36.26 PM
@ch1ck3n

Profile icon
InvisibleOne

The issue was this: d.replace(" ", "") when it should have been d=d.replace(" ", "")
@ch1ck3n

Profile icon
ch1ck3n

@InvisibleOne ok good to know

Profile icon
VulcanWM

Nice! For all of the leaderboards, it shows a user's top 30 leaderboard results.

Profile icon
InvisibleOne

Yeah I didn't find a way to find more, such as the top 100 or something but I didn't really try. @VulcanWM

Profile icon
VulcanWM
Profile icon
CalebNustad

where do I learn to web scrape?

Profile icon
InvisibleOne

Just google web scraping in python. There are literally thousands of tutorials on it. If you want to be even more specific look up web scraping in python with BeautifulSoup @CalebNustad

Profile icon
CalebNustad1

@InvisibleOne ok, thank you so much!

Profile icon
sojs
Profile icon
InvisibleOne
Profile icon
sojs

huh. It actually got in the new lines.

Profile icon
ruiwenge2
Profile icon
InvisibleOne

The username has to be lowercase, but I'll fix it. @ruiwenge2

Profile icon
storymaster
Profile icon
InvisibleOne

Cool, it's a good start. @storymaster

Profile icon
Bunnytoes

this is cool

Profile icon
InvisibleOne