*This project when completed will be published as free and open-source software under an MIT License

Problem Description

Build a Pay w/Bitcoin Universal Web Scraper. UI Should be a single input field for a URL. User drops a URL and pays in Bitcoin to have the resource at that URL scraped and converted into formatted txt file with meaningful formatting.

This project can also be submitted by the bounty hunter for the AI4ALL remote hackathon running until July 31st, and be in the running for up to $10,000 in bitcoin and over $20,000 in prizes and credits! Sign up here: https://bolt.fun/tournaments/ai4all/overview and hop in the discord to get help from bitcoin devs on completing the project: https://discord.gg/u4QnzarJ

Acceptance Criteria:

Scraper should be multimodal e.g.
User drops a mp3/mp4: transcribed to text, text passed into LLM for categorization / summary / labelling, etc.
User drops a webpage: site is scraped for content, filtered for meaningful information, passed into LLM for categorization and labelling.

User should be able to download the output .txts

Extra credit ideas to improve project for hackathon:

1. Recurse on links inside the webpage. Prompt the user to pay additional for each one.
2. Add-on pricing. Do a generic first pass then offer the user additional services like summarization/categorization/translation/etc for additional payments.