Web Crawler is the most advanced WordPress plugin to grab content & post automatically from any web site for creating a personal website.
With this plugin, you can make a collection of various theme, plugins, apps & images. Also, collect various products from shopping sites, and get affiliate programs to make money.
Additionally, manually you can crawl the website content with several features such as cookies, quick fixes, proxies, warnings, duplicate post checking etc.
Key Features Of WordPress Crawler Plugin For Web
Visual Selector (Visual Inspector)
You can click to an element for finding its CSS selector and get its alternative way according to the requirement without leaving the admin panel.
Recrawl (Update) Posts
Web content crawler allows you to recrawl posts, contents automatically to keep them updated all the time. You can control scheduling and set the limit for post updates, set update interval, and neglect old posts.
Save Every Post Detail
You can save the custom post and their details using post meta and taxonomy options. Save every information of the website like title, excerpt, content, tags, slug (permalink), date, featured image, post images, status, content templates etc.
Find and Replace Anything
In web crawler WordPress plugin you can use plain text or regular expressions to find and replace content. Also, it allows you can create and modify the HTML elements and image URLs of the page.
Password Protection
The plugin allows you to protect information from unauthorized users by setting a password for the posts. Also, the users having the password can view the post.
Email Notifications
You can set CSS selector for empty category and post pages. Using those selectors, you can get an email notification for empty value.
Create Gallery
WP content crawler plugin has several templates to create an image gallery and save the images as WooCommerce gallery by just checking one checkbox.
Cookies
It allows you to elegantly inform users by attaching cookies to each request such as session cookies for crawling the targeted site.
Comprehensive Dashboard
With this plugin, you get a comprehensive dashboard that provides several options to see background details like-
- Site Activity
- Number of posts crawled
- Number of updated posts
- Last crawled & added URLs
- Last and next run of CRON events etc.
Option Box
Define many options like calculation, template, and JSON parsing settings for finding the values by a CSS selector.
Automatic Translation
In this plugin, use the artificial intelligence of Google Cloud Translation API or Microsoft Translator Text API to translate the posts automatically.
Some Other Prominent Features-
- It supports the latest versions of PHP.
- Add & activate unlimited numbers of sites.
- Enable/disable automatic crawling for a specific website.
- Add URLs to the database using the manual crawling tool.
- Show the details of the error so that you can fix it right away.
- You can convert the encoding by checking a single checkbox and handle different character encodings.
- Without waiting for page reloading you can you can save the settings quickly with quicksave button.
- You can import and export site settings easily by copy and paste the plugin code.
- With templates, you can save media file for defining title, description, caption, and alt texts for using any shortcode.
You May Also Like:
