Full Text RSS Feed: Get the whole feed and nothing but the feed

  • We built a backend similar to this for our NewsRoom mobile client. (Android and Pre) Actually used some genetic algorithms to do the training for our content extraction, one of the more fun projects I've done.

    Word of warning, if it takes off, you basically start turning into someone who is both caching and harvesting the web every 15 minutes. There is an incredibly long tail on RSS feeds and it starts killing you to keep them all up to date. Storing and serving it is no big deal, but harvesting actually turns into real money when you figure out total bandwidth used. (we harvest about ~30,000 feeds every 15 minutes)

  • Could you darken up on the grey a bit? Grey on white on grey isn't exactly easy to read.

  • What's he using to pull out the articles? I had a hacky version set up using the Readability algorithm but never bothered to make it public.

  • Does this work for anybody? I've plugged in 3 feeds, one was "unable to retrieve full-text content" (an sfgate.com feed) and the other two returned nothing at all in the preview (one a feed from kqed.org, the other an older wordpress blog).

  • A similar service: http://fivefilters.org/content-only/ and it is opensource too. It uses a PHP version of readability to extract the full content. Also can the author of fulltextrssfeed.com explain some of the implementation details? I was planning on a similar project with node.js, jsdom and readability.

  • Is it legal ? Can you legally copy all the content of a site and publish it while striping the ads ?

    I've tough of this idea since 2 years, but I am so ineffective at building my own ideas that it doesn't surprise me that someone else built it, as the idea was really floating more and more since instapaper mobilizer.

    Considering the legal aspect I had more ideas about that. It is to hide behind the DMCA takedown, and provide an email address to take-down a feed. But do not map the www.example.com/feed.xml to http://fulltextrssfeed.com/www.example.com/feed.xml , but use an alias, so the take-down just remove the alias not the whole * .example.com*.

  • Immediate swap of current PG essays feed for:

    http://fulltextrssfeed.com/www.aaronsw.com/2002/feeds/pgessa...

  • Considering the impending lawyer-takedown, it would be great if this was made open source, so people can implement their own local versions on their own servers.

  • Could you also do the opposite: Take bulky feeds (e.g. http://feeds.feedburner.com/tedblog) and truncate them; showing title & first para & include a link? I use RSS primarily to scan what is available and mark some for later reading, and bulky feeds interrupt the scanning process.

  • Is there an argument to be made that the content providers only get 'paid' if the RSS reader is enticed to click through to the site? I'm all for neat services, but I think that this is a little bit unfair to the other party.

  • Not trying to be the show stopper here, but this is illegal right? I mean especially news sites like Reuters do create a fuss when this is done. Is that (legal drama) only in commercial projects or otherwise too?

  • Nice, this will come in very useful for an RSS-based project I'm working on too. Hopefully I won't slam your servers too hard. Are you considering making the source available?

  • This is nice but what's the difference from ViewText (http://www.viewtext.org)? ViewText has a JSONP API, which made it perfect for building into a recent little project I did (it was a web app). Plus, it's been around for a lot longer.

  • undefined

  • Excellent thanks, shall be applying this to all my Gawker feeds.

  • ##sigh##

    Yet another service that requires me to hand over information on what I read.

    Why couldn't this be made as a privacy-respecting application I can run from my own machine?

  • interesting project. I was doing a similar thing with yahoo pipes, but it got blocked because of robots.txt. What do you do about it?

  • The same service is offer by www.getrss.in and i am happy client of them for more then 8 months

  • Nice. Grabs the whole article text so you don't have to leave the RSS reader.

  • Is there a time delay between the source feed and the full feed?

  • Works great! Nice to have: concatenation of multi-page articles.

  • Works with BBC. Thanks.

  • Thank you so much! :-)

  • nice! how exactly does this generate the full text version?

  • I love it! It works for tumblr rss -- I really wish though that it you can opensource it. (Well, I would just hate it if you start having hosting problems or other problems that would cause you the need to shut down)

    Im currently using "Readable Feeds" Nirmal J. Patel (http://www.nirmalpatel.com/hacks/hnrss.html) and Andrew Trusty (http://andrewtrusty.com/2009/06/29/readable-feeds/)

    I like it -- but its really inconsistent!

    Cheers,

  • Click on our website:

    ╭══════════════╮ http://simurl.com/voblec ╰══════════════╯

    ╭══════════════╮ http://simurl.com/voblec ╰══════════════╯

    Website wholesale various fashion shoes, such as Nike, Jordan, prada, also includes the jeans, shirt, bags, hats and decoration. Personality manufacturing execution systems (Mes) clothing, Grab an eye bag coat + tide bag

    Air jordan(1-24)shoes $30

    Handbags(Coach l v f e n d i d&g) $35

    Tshirts (Polo ,ed hardy,lacoste) $15

    Jean(True Religion,ed hardy,coogi) $30

    Sunglasses(Oakey,coach,gucci,A r m a i n i) $15

    New era cap $12

    Bikini (Ed hardy,polo) $20

    accept paypal and free shipping

    ╭══════════════╮ http://simurl.com/voblec ╰══════════════╯

    ╭══════════════╮ http://simurl.com/voblec ╰══════════════╯

    ╭══════════════╮ http://simurl.com/voblec ╰══════════════╯

    ╭══════════════╮ http://simurl.com/voblec ╰══════════════╯

    ╭══════════════╮ http://simurl.com/voblec ╰══════════════╯

    ╭══════════════╮ http://simurl.com/voblec ╰══════════════╯

    ╭══════════════╮ http://simurl.com/voblec ╰══════════════╯

    ╭══════════════╮ http://simurl.com/voblec ╰══════════════╯