WP Crawler – A crawler/bot/ application, which crawls the specified URL, and creates the content
<!DOCTYPE html PUBLIC ”-//W3C//DTD XHTML 1.0 Transitional//EN” “http://www.w3.org/TR/xhtml1/DTD/xhtml1-transitional.dtd”>
<meta http-equiv=”Content-Type” content=”text/html; charset=utf-8” />
<title>WP Crawler – By Pluginology.Space</title>
It’s a crawler/bot/spider application, which crawls the specified URL, and creates the table of contents with the findings. The findings include:
The version of the WordPress that the site is running.
- WordPress Theme
All the information about the theme: name, description, author, etc.
All the internal and external links on the page.
All the images on the page, with the actual image and the URL to it.
- Post Content
The entire content of the post/page is retrieved and displayed using the style of your active theme.
- Post Content as Plain Text
The content with the tags removed. That’s how Google and other search spiders see your page.
- Top 25 Keywords
The software analyses the page SEO to identify what the page is all about, and displays the top 25 keywords identified.
Here’s the sample output (only the Generator and WordPress Theme are shown):
Using the Plugin
The plugin adds the spider icon to the WordPress Visual Editor, which inserts the shortcode with the URL to crawl:
Another way to use the plugin is to provide the crawl form on a page: