A powerful and user-friendly web scraping application that leverages advanced AI models to extract and analyze web content. This app allows users to input any website URL, scrape its content, and parse specific information using various models. Perfect for researchers, developers, and anyone interested in data extraction!
- Scrape content from any webpage easily.
- Select from various AI models for parsing.
- View the raw DOM content.
- User-friendly interface with sidebar navigation.
- Responsive design for seamless user experience.
Check out the demo of the AI Web Scraper App on YouTube: Watch Now
Experience the live app on Hugging Face Spaces: Try It Now
- Enter the URL of the website you want to scrape in the input field.
- Click on the "Scrape Website" button to fetch the content.
- Describe what you want to parse in the provided text area.
- Select your preferred AI model for parsing from the sidebar.
- Click "Parse Content" to extract the desired information!
To run this application locally, clone the repository:
git clone https://github.com/usmanyousaaf/AI-Web-Scraper-App.git
cd AI-Web-Scraper-App
python -m venv env
source env/bin/activate # On Windows use `env\Scripts\activate`
pip install -r requirements.txt
streamlit run main.py
Made with โค๏ธ by Usman Yousaf ๐
Feel free to improve and expand this app for more powerful insights! ๐ฅ