Self-hosted webscraper. Contribute to jaypyles/Scraperr development by creating an account on GitHub.

Hacker News is a community-driven platform for sharing and discussing technology news, startups, and programming-related topics. Through user submissions and comments, Hacker News offers insights into emerging technology trends, industry developments, and entrepreneurial ventures. Readers can participate in discussions, share their insights, and stay informed about the latest advancements in technology and innovation.

Hacker News

Scraperr is a self-hosted web scraping solution that offers precise data extraction using XPath selectors. It features queue management, domain spidering, custom headers, media downloads, and visualization of results. Users can export data in multiple formats and receive notifications upon completion. Scraperr emphasizes legal and ethical use by respecting `robots.txt`, adhering to Terms of Service, and implementing rate limiting.

jaypyles/Scraperr: Self-hosted webscraper.

<p>Does it handle client side rendered content such as modern NextJS based websites?</p>


<p>Do I need to install docker for it to run ?</p>
