Crawlomatic Multisite Scraper Post Generator Plugin for WordPress is a breaking edge website crawling and scraping, post generator autoblogging plugin that uses website crawling and scraping to turn your website into a autoblogging or even a money making machine!
Get content from almost any webpage! You no longer need API’s which requires registration and provides limited access, also you can retrieve data from non API providing websites. Schedule it for once and let it autopilot your posts 7/24 for you like a master!
This plugin will crawl the seed URL you give it (crawling means that it will search all links that the webpage contains) and will visit and extract content from each crawled URL. The crawling process is customizable: you can set the crawling depth, crawling rate, maximum crawled article count, crawl only links with specific class or ID and many more customizations.
In the v2.0 update, a new live scraper shortcode was added to the plugin: [crawlomatic-scraper]. This new feature makes this plugin an easy to implement web data extractor for WordPress. As a result, it can be used to display real-time data from any websites directly into your posts, pages or sidebar. It also temporarily caches the scraped content, so your website will not over use on resources. You can use this plugin to include real-time stock quotes, cricket or soccer scores or any other generic content from public domains!
New features included in this update:
Check the official documentation of the v2 update, browse through examples and check FAQ for crafting a perfectly optimized web scraper.
Also, you can automatically generate unlimited number of custom website crawling and scraping.
For more info on how to configure the plugin, please check also this 1 hour long tutorial video, which covers the full feature set of the plugin.
Version 1.0 Release Date 2017-08-15
First version released!
Version 1.1 Release Date 2017-08-16
Fixed some small issues
Version 1.2 Release Date 2017-08-17
Added the ability to crawl page by div class or id
Version 1.2.1 Release Date 2017-08-18
Fixed incompatibility with some WordPress installs
Version 1.2.2 Release Date 2017-08-22
Added a shortcode to display post generated by this plugin
Version 1.2.3 Release Date 2017-08-30
Added an option to crawl the page from Google cache when direct crawling fails (blocked)
Version 1.2.4 Release Date 2017-08-31
Added the ability to set proxies for crawling pages
Version 1.2.5 Release Date 2017-09-04
Added the canonicalization for generated articles
Version 1.2.6 Release Date 2017-09-13
Made the plugin timezone aware
Version 1.2.7 Release Date 2017-09-14
Fixed post date for non gmt blogs
Version 1.2.8 Release Date 2017-09-23
Added paginated post importing support
Version 1.2.9 Release Date 2017-09-27
Version 1.3.0 Release Date 2017-09-28
Fixed rule restore
Version 1.3.1 Release Date 2017-10-20
Fixed featured image generation
Version 1.3.2 Release Date 2017-10-22
Added crawling helper
Version 1.3.3 Release Date 2017-11-06
Fixed a memory issue
Version 1.3.4 Release Date 2017-11-07
Version 1.3.5 Release Date 2017-12-14
Fixed class selector not working in all cases
Version 1.3.6 Release Date 2017-12-18
Added the ability to specify a custom user agent for each crawled webpage
Version 1.3.7 Release Date 2018-01-20
Added a new text spinner service: Spinrewriter
Version 1.3.8 Release Date 2018-01-22
Plugin can now continuously import content
Version 1.3.9 Release Date 2018-02-02
Fixed issue when multiple crawl classes where specified
Version 1.4.0 Release Date 2018-02-22
Major update: added the ability to crawl imported product prices (WooCommerce compatible) Added the ability to crawl serial content (paged crawling - crawling for articles will continue on the next page)
Version 1.4.1 Release Date 2018-03-07
Version 1.4.2 Release Date 2018-03-21
Fixed a duplicate posting issue
Version 1.4.3 Release Date 2018-03-22
Fixed a critical issue with multiple rule running
Version 1.4.4 Release Date 2018-04-04
Added the ability to define multiple proxies. The plugin will select one at random at each page access
Version 1.4.5 Release Date 2018-07-13
Updated built-in readability module
Version 1.4.6 Release Date 2018-07-16
Version 1.4.7 Release Date 2018-07-19
Added the ability to not translate links
Version 1.4.8 Release Date 2018-09-05
Version 1.4.9 Release Date 2018-09-18
Version 1.5.0 Release Date 2018-09-24
Added the ability to add custom post taxonomies from crawled content Added the ability to add unlimited crawled variables to posts's content/ meta/ taxonomies
Version 1.5.1 Release Date 2018-10-16
Fixed issue when importing large pages
Version 1.5.2 Release Date 2018-10-24
Added the ability to shorten links using Shorte.st
Version 1.5.3 Release Date 2018-10-29
Fixed issue when importing paginated posts
Version 1.5.4 Release Date 2018-11-06
Added the ability to strip HTML elements by tag name (div,a,span,etc.)
Version 1.5.5 Release Date 2018-11-07
Added WooCommerce product category creation support
Version 1.5.6 Release Date 2018-12-16
Added nested importing support - import mixed content into a single post, from multiple plugins created by CodeRevolution
Version 1.5.7 Release Date 2018-12-16
Added the ability to define a list of URLs to skip from crawling and importing
Version 1.5.8 Release Date 2019-01-08
Added the ability to import royalty free images for created posts
Version 1.5.9 Release Date 2019-01-12
Added Gutenberg blocks support
Version 1.6.0 Release Date 2019-02-01
Added the ability to make screenshots of scraped pages
Version 1.6.1 Release Date 2019-02-06
Improved compatibility with some crawled pages
Version 1.6.2 Release Date 2019-04-19
Version 1.6.3 Release Date 2019-05-15
Fixed some recently found bugs with post pagination
Version 1.6.4 Release Date 2019-05-17
Added support for TurkceSpin content spinner
Version 1.6.5 Release Date 2019-05-27
Added a much demanded new feature: Visual Content Selector for assigning scraped page content Added the ability to scrape pages from bottom to top Added the ability to replace words in scraped content Other minor bug fixes and functionality improvements
Version 1.6.6 Release Date 2019-07-26
Fixed timeout issue with some crawled pages Many small issues fixed and features improved
Version 1.6.7 Release Date 2019-08-05
Fixed issue with Google Translate
Version 1.6.8 Release Date 2019-11-15
WordPress 5.3 compatibility update
Version 1.6.9 Release Date 2020-05-11
New features added for content templates Bugfix update
Version 1.7.0 Release Date 2020-07-21
Added support for scraping more sites
Version 1.7.1 Release Date 2020-09-28
Added the ability to crawl sitemaps and to scrape posts linked in them Added the ability to respect the directives set in the robots.txt files
Version 2.0.0 Release Date 2020-12-08
Added a new shortcode and Gutenberg block alternative that will enable live scraping of any website Major performance improvement Fixed reported bugs
Version 2.1.0 Release Date 2021-01-02
Added support for using the Tor Browser to crawl dark web sites! Scrape .onion websites like you would scrape any other public website!
Version 2.1.1 Release Date 2021-01-04
Added the ability to crawl and scrape pages using POST requests (POST form submission scraping support)
Version 2.2.0 Release Date 2021-01-14
Version 2.2.1 Release Date 2021-01-16
PHP 8 compatibility update Added support for crawling links from RSS feeds
Version 2.2.2 Release Date 2021-01-28
Fixed rare issue when saving importing rule settings on some PHP 8 configurations
Version 2.2.3 Release Date 2021-02-01
Improved content extraction algorithm
Version 2.2.4 Release Date 2021-02-17
Added the ability to not spin posts generated by specific rules
Version 2.2.5 Release Date 2021-03-07
Added the ability to enter multiple URLs (one per line) to be crawled and scraped
Version 2.2.6 Release Date 2021-03-07
Visual Selector improvements - now it will be able to use HeadlessBrowserAPI/Puppeteer/PhantomJS/Tor to visualize scrape content
Version 2.2.7 Release Date 2021-04-02
Fixed rare issues when crawling links with URL parameters
Version 2.2.8 Release Date 2021-04-07
Fixed rare issues with relative URL paths in crawled content
Version 2.2.9 Release Date 2021-05-03
Added the ability to skip publishing of new posts if not images found (separately, for each rule)
Version 2.3.0 Release Date 2021-05-19
Added the ability to make screenshots of websites using the HeadlessBrowserAPI feature
Version 2.3.1 Release Date 2021-06-10
Fixed content extracting/stripping in case of some websites with dynamically generated content
If you already bought this and you have tried it out, please contact me in the item’s comment section and give me feedback, so I can make it a better WordPress plugin!
WordPress 5.7 Tested!
Through this plugin you are able to grab content from various websites that does not necessary belong to you or which are not under your control. If you grab copyrighted material without the author’s permission, the plugin’s developer does not assume any responsibility for your actions. Also, the plugin’s developer has no control over the nature, content and availability of those sites.
Do you like our work and want more of it?
Check out this MEGA plugin bundle.
Great content. Appreciate it.
Viagra with Duloxetine [url=https://uspharmacymsn.com/]tour de pharmacy online[/url] rx plus pharmacy glendale
Truly all kinds of wonderful data.
clark howard canadian pharmacy [url=https://canadianpharmacies-24h.com/]canada drugs wichita ks[/url] best canadian drugstore
Nicely put, Thanks a lot!
ed pills online pharmacy canadian international pharmacy the canadian pharmacy
Whoa a lot of excellent tips.
pharmacy technician target store cvs pharmacy technician online pharmacy stuff store
With thanks! Fantastic stuff!
canadian pharmacy lyrica [url=https://canadianpharmacyonlinedb.com/]indian pharmacy[/url] prescription drugs without prior prescription
Thank you. Ample tips.
cheap prescription drugs online [url=https://canadapharmacies-24h.com/]med pharmacy[/url] best canadian pharmacies
Incredible all kinds of valuable facts!
cvs pharmacy store location king canadian pharmacy review tadalafil online canadian pharmacy
Thanks a lot! Plenty of content.
pharmacy online australia free shipping Glucophage SR cvs pharmacy cvs store
Whoa quite a lot of superb advice!
best drugstore bb cream online pharmacy fungal nail indian pharmacy online shopping
You mentioned this wonderfully!
target pharmacy store global online pharmacy canadian drugstore
Nicely put, With thanks!
u.s online pharmacy [url=https://rxpharmacyteam.com/]reviews canadian pharmacy online[/url] pharmacy technician target store cvs
Wow tons of good facts!
apollo pharmacy store locator [url=https://pharmacyclineds.com/]vipps canadian online pharmacies[/url] canadian pharmacy association
Excellent postings. Appreciate it!
vipps canadian pharmacy list [url=https://online-pharmacy-inc.com/]Apcalis SX[/url] london drugs photo center canada
Wow many of very good tips!
online pharmacy mexico [url=https://edpharmsn.com/]celexa canadian pharmacy[/url] lloyds online pharmacy
Nicely spoken without a doubt. !
narcotics online pharmacy [url=https://canadianpharmacylist.com/]Viagra Super Active[/url] pharmacy drugs
Excellent stuff. Cheers!
world pharmacy store discount number [url=https://canadapharmacyspace.com/]prescription drugs abuse list[/url] is canada drug pharmacy legitimate
Cheers! I like it!
canadian pharmacies that are legit [url=https://canadianpharmacyonlinedb.com/]canada pet pharmacy[/url] canadian pharmacy discount code
You actually mentioned that really well.
best canadian pharmacies online pharmacy in montreal canada oxford pharmacy store
Good posts. Thanks!
reliable online pharmacy reviews [url=https://sopharmsn.com/]osco pharmacy store locator[/url] apply for cvs pharmacy online
Seriously tons of terrific data.
cheap prescription drugs online modafinil online pharmacy online pharmacies uk
Truly tons of very good knowledge!
pharmacy discount [url=https://canadapharmacyspace.com]canadian pharmacy viagra brand[/url] canadian online pharmacies
Thanks, Ample forum posts!
writing essay introduction [url=https://agbsl.pro]customized essay writing[/url] custom writing review
Nicely put. Appreciate it.
cheap custom essay writing [url=https://topswritingservices.com]essay typer[/url] i need help writing my personal statement
This is nicely said! !
prescription cost comparison [url=https://canadarx-drugservices.com]canada pharma limited llc[/url] online pharmacy viagra https://canadapharmacies-24h.com
Great facts. Many thanks!
canadian drug [url=https://rxpharmacyteam.com]on line pharmacy[/url] canadian viagra generic pharmacy
Good data. Thanks a lot!
global pharmacy canada canadian drugstore reviews global pharmacy canada
Thanks a lot. I like this!
website that writes essays for you [url=https://ouressays.com]essay typer[/url] dissertation writing service
Very good knowledge. Cheers!
discount pharmaceuticals [url=https://canadianpharmacyonlinedb.com]cialis online[/url] canadian prescriptions https://online-pharmacy-inc.com
Seriously plenty of good advice.
writing essay for college [url=https://englishessayhelp.com]https://englishessayhelp.com/[/url] top essay writing services
Cheers! Lots of forum posts!
how to write an essay for a scholarship how to write an argument essay help with writing personal statement
Kudos, Very good information!
canadianpharmacy [url=https://northwestpharmacylabs.com]mexican border pharmacies[/url] canadian pharmacy certified canada pharmacy online
Great posts, With thanks!
do my essay for cheap [url=https://agbsl.pro]https://agbsl.pro/[/url] cheap custom essay writing service
Incredible loads of amazing knowledge!
outstanding college essays [url=https://essaywriting4you.com]act writing essay[/url] essays on writing by writers
Seriously a lot of useful information.
online discount pharmacy [url=https://onlinepharmacycanadahelp.com]cialis online pharmacy[/url] canadian pharmacy meds
Amazing forum posts. Thank you!
canadian pharmacy online viagra best online canadian pharcharmy prescription drugs online without doctor
You made your point.
canadian pharmacy king prescription discount pharmacie canadienne
Thanks a lot, Loads of content!
famous essay writers essay writing services executive resume writing service seattle
Fantastic postings. Thanks a lot!
doctor prescription [url=https://northwestpharmacylabs.com]prescription pricing[/url] prescription drug assistance https://canadianpharmacylist.com
Tips effectively taken..
how to write 5 paragraph essay [url=https://dissertationwritingtops.com]essays writing services[/url] custom writing website
Nicely put. Regards!
cheap essay writing service [url=https://essaypromaster.com]how to write an argumentative essay[/url] best freelance content writing websites
Many thanks. Great information.
english essay writing service [url=https://essaypromaster.com]writing essays for money[/url] best freelance content writing websites
You actually reported this terrifically!
what to write a persuasive essay on [url=https://englishessayhelp.com]essays writers[/url] online writing services
Nicely put, Thanks a lot!
drug costs shoppers pharmacy meds online
Awesome facts. Thanks a lot.
how to write an objective essay [url=https://essaypromaster.com]mba essay editing service[/url] cheap custom essay writing services
Very good stuff. Many thanks.
online medicine tablets shopping [url=https://northwestpharmacylabs.com]pharmacy canada[/url] canada drugs pharmacy https://canadianpharmacyonlinedb.com
Truly all kinds of useful facts!
online canadian pharcharmy [url=https://canadarx-drugservices.com]viagra from canada[/url] health canada drug database
Regards, I like this.
canadian prescription drugs londondrugs online discount pharmacy
Amazing tons of awesome knowledge.
writing a good college application essay [url=https://orangepornhub.com]how to write an intro to an essay[/url] writer dissertation
Awesome advice. Many thanks!
steps to writing a college essay [url=https://freshappshere.com]essay writing service[/url] top online resume writing services
Kudos. Loads of forum posts.
prescription cost [url=https://canadarx-drugservices.com]canada discount drug[/url] canadian drugs online pharmacy
Awesome facts. With thanks!
pharmacy price comparison cheap drugs online rx pharmacy
You suggested that superbly!
descriptive writing essay college writing essay best custom essay writing services
Many thanks, Terrific information!
how to write research essay [url=https://quality-essays.com]argumentative essay[/url] custom essay writing service
Nicely put. Appreciate it!
medicine online order [url=https://canadapharmacyspace.com]publix pharmacy online ordering[/url] rx price comparison https://canadianpharmacyonlinedb.com
Nicely put, With thanks.
medical school essay help [url=https://ouressays.com]how to write an essay paper[/url] help writing a dissertation
Many thanks, Helpful information.
writing a good scholarship essay [url=https://englishessayhelp.com]argumentative essay[/url] professional cv and resume writing services
You actually revealed it fantastically!
how to write a successful college essay [url=https://orangepornhub.com]how to write a how to essay[/url] novel writing help
Perfectly voiced without a doubt! .
nyu college essay https://quality-essays.com/ writing service online
Kudos, Useful information!
publix pharmacy online ordering indian pharmacy online pharmacies uk
Superb forum posts. Many thanks.
cliche college essays [url=https://writingthesistops.com]perfect college essay[/url] high quality article writing services
Thanks a lot. I value it.
professional custom essays college essay writing prompts website evaluation essay
Amazing write ups. Appreciate it.
write essays for me https://flowleadsua.com/ us writing services
Regards. A good amount of posts!
where can i write an essay online [url=https://service-essay.com]https://service-essay.com/[/url] essay writer website
Thank you, Wonderful information!
cheap pharmacy online [url=https://rxpharmacyteam.com]medical information online[/url] canada pharmacies prescription drugs
Thank you. Lots of posts.
help me write my college essay https://homeworkcourseworkhelps.com/ proposal writing services
Nicely put. Regards!
buy custom essay papers [url=https://theessayswriters.com]essay writing services[/url] business letter writing services
With thanks. A lot of material.
online pharmacies legitimate [url=https://canadadrugspower.com]mexican pharmacy online medications[/url] drugs without prescription https://canadapharmacies-24h.com
You said it very well..
safeway pharmacy [url=https://canadapharmacyspace.com]drug prices comparison[/url] canada pharmacies online pharmacy https://canadianpharmacylist.com
Nicely put, Thanks a lot. how to write good essays [url=https://essaypromaster.com/#]best dissertation[/url] dissertation examples
Nicely put. Kudos! [url=https://theessayswriters.com/#]mathematics homework help[/url] macbeth essay help
You must log in to submit a review.