WP Web Scraper for WordPress

. January 22, 2011 . 0 Comments

WP Web Scraper is a plugin by akshay_raje described as an easy to implement professional web scraper for WordPress. This can be used to display realtime data from any websites directly into your posts, pages or sidebar. Use this to include realtime stock quotes, cricket or soccer scores or any other generic content. The scraper is an extension of WP_HTTP class for scraping and uses phpQuery or xpath for parsing HTML. Features include:

Can be easily implemented using the button in the post / page editor.
Configurable caching of scraped data. Cache timeout in minutes can be defined in minutes for every scrap.
Configurable Useragent for your scraper can be set for every scrap.
Scrap output can be displayed thru custom template tag, shortcode in page, post and sidebar (through a text widget).
Other configurable settings like timeout, disabling shortcode etc.
Error handling – Silent fail, error display, custom error message or display expired cache.
Clear or replace a regex pattern from the scrap before output.
Option to pass post arguments to a URL to be scraped.
Dynamic conversion of scrap to specified character encoding (using incov) to scrap data from a site using different charset.
Create scrap pages on the fly using dynamic generation of URLs to scrap or post arguments based on your page’s get or post arguments.
Built-in module for stock market data (NSE, BSE and NASDAQ supported currently), other markets to follow.

WP Web Scraper Project Page at http://webdlabs.com/projects/wp-web-scraper/

Category: Plugin

Leave a Reply

Your email address will not be published. Required fields are marked *