This Method was discovered by accident a couple of days ago while trying to make a full RSS feed using yahoo pipes:
I found that some RSS feeds were not being pulled due to the “noindex” or sometimes the full content page was protected by robots.txt
Since then I’ve been testing RSS feeds via the same pipe to find the ones not indexed and to “borrow” the content from these pages.
I used a yahoo pipes tutorial to take a RSS feed that only displays a summary and convert the feed to display the entire content of the article or news story.
Hope that you’ll find this useful
0 comments:
Post a Comment