A node.js river-of-news aggregator.
A few different people have asked me recently how I created the activity stream/life stream you see in the sidebar of Dented Reality. It’s actually really simple, and all it does is load up the feeds from a few different locations, combine them in date order and then output them on my page using an HTML “UL” (unordered list). Based on the source of each feed, it also adds a CSS class to each list element (LI) so that I can add an appropriate icon. Here’s the complete code that I use, and then I’ll explain some parts of it, and some of what makes it tick: (more…)
I’ve just updated the code for FeedGrowler so that it supports custom icons for each feed that you are monitoring. All you need to do is include the full path to an icon/image file as the second argument when you call feedgrowler.php (or in your crontab).
This version also supports Atom feeds (in addition to previous RSS 2.0 support).
Check out the latest FeedGrowler.
I just thought of an interesting delivery mechanism that could help people actually get through an eBook (or any longer electronic text for that matter). Basically the idea would be that rather than throwing the whole book at someone and leaving it up to them to read it, you would deliver it piece by piece so that they only had to consume small chunks at a time. There are 2 ways that I’m thinking this could work; email and RSS.
For either delivery mechanism, the user would go to the site, purchase a book, then select their options for how and when they’d like it delivered. Some of the important bits would be:
- Delivery Schedule: Daily? Weekdays only? at 8am? at 8pm?
- Amount per Delivery: 1 page? 500 words? 1 chapter?
- Format: Full text in email/RSS? Link to current location in online version, with their “quota” highlighted somehow?
Once you have those options configured, you’d get your periodic email (or feed, via a customized URL that would point to your specific delivery configuration) containing the current portion to read, and you would want some options in each payload I think:
- Give me more next time
- Give me less next time
- Give me more right now
- Put my deliveries on hold
This probably isn’t a business, but it’s a feature that would be pretty cool for existing eBook retailers to offer. I’d be happy to make it for someone if they want it 🙂
In amongst some work that I’ve been doing recently, and looking at my own work habits and trends, I realized that something super-useful to have would be a very accessible “microcontent storage system” where you would be able to store small snippets of information, tag them, have them fully-indexed and searchable using a simple, slick interface. Basically, I’m seeing this as del.icio.us, with more space for storing text, and no requirement for a link.
So I see this as a series of “items”, stored with a note/body item of some sort, which would normally be text. In addition to that, you’d have an optional title and link/URL. You’d have a list of tags/keywords, and perhaps allow for arbitrary meta-data. I like the idea of the meta-data because it makes the system simple, yes extensible in ways that simple tags don’t provide (easily).
The UI would probably be largely based around search (a la Google), and would provide a list of items recently added as the default result-set. When searching, we’d probably use AJAX to make it “live search” to aid progressive discovery. I’d like to be able to save a search as well, and have that available as a navigation item of some sort (e.g. All items tagged “work” and “urgent” but note “done”). Adding an item should be a matter of clicking a link, then typing a few items and hitting a button. You’d also want a bookmarklet to be available so you could do this from anywhere. Perhaps even a Firefox plugin a la the del.icio.us one.
I’d also want RSS feeds available, specifically “recent items added” and “all items tagged x”.
Privacy controls, the ability to share items (or tags) and some other things like that would come down the line. I’d specifically like to be able to invite people to access my stream, and grant them the ability to see only items tagged with certain tags.
From here, we would also want a robust API so that we could plug the system in as the storage/backend behind any number of other apps. I see the use of POST to create new items, GET being able to retrieve a simple XML description of an item, PUT updating existing ones, and DELETE removing one. Standard REST stuff. The interesting thing here is that there’s no real reason why you couldn’t do it all with namespaced RSS (2.0) or Atom. I think that’d be a good approach because the basic structure is there, you just need to add some meta-data options which is no real problem.
The API is where the real fun lies – this could be the Twitter of… everything else. I see it as a generalized micro-content publishing system. Two immediate things that I think would be fun to plug on top of it (perhaps as paid services?) would be an email reader and an RSS reader. Basically these 2 systems would periodically check email/RSS feeds, then parse new items, tag them (using existing tags or some style of content analysis) and then POST the new item to your Stanso stream. It’d be interesting to see your email, notes, RSS feeds and potentially other things all mixed in together, tagged using a common scheme etc. Who knows where it could go? This could be a todo list, an email client, a news reader, a blogging platform, a status system, a bookmark repository, a password storage tool, a file manager, or all sorts of other things.
Obviously this could be built very simply using something like Scuttle (del.icio.us clone), or just from scratch using the normal LAMP stack (or RoR, or whatever). Another option I’ve been pondering is Amazon Web Services. Of particular interest are SimpleDB (still in beta, waiting on the list…) and potentially S3.
SimpleDB allows you to store a very loosely-structured set of data around a “record” in a fast-lookup, easily-queryable environment. Seems perfect for the task. It could handle arbitrary meta-data per item if you wanted, and could handle unlimited tags per item easily as well. I think S3 could be an interesting addition if you added the ability to upload a file (with tags etc), which was sidelined into S3, then automatically linked (via the URL field in an item) into your Stanso stream.
Another possibility would be to use something like WordPress to build this, since it actually handles a lot of elements of the system already (post title, body, tags, meta-data, the general blogging/posting flow). Having worked with WordPress a lot in the last 6 months though, I’d have to think that it was overkill for this, and provides a lot of other (wasted) functionality that provides more overhead than is worth adopting. Probably taking something like Scuttle and modifying it would be a best bet for a prototype at least. If building on AWS then you’d have to get pretty custom.
- Simple note storage — you post small notes and snippets to remind you of things, or to hang on to passwords etc so you can find them later.
- Feed reader — feeds come in, are tagged and added to your stream, you navigate by tag or by “recentness”.
- Email client — email is pulled in and automatically tagged based on content analysis, sender details, etc. Being able to add your own tags would be awesome.
- Todo list — post items that you need to do, tagging them as “not done” perhaps. When they are done, you remove that tag (or just delete the item).
- Micro-blogging — post small updates on what you’re doing, what you’re thinking etc, then publish it out from the system via the “recent” RSS feed
- Bookmark storage — as per del.icio.us, minus all the social stuff.
- File manager — with file uploads going to S3, and meta stored in Stanso, you could store things in any “structure” (via tags) you wanted.
The cool thing is that you could actually do a number of these (if not all) at once, since you would have the ability to segment out your storage/retrieval of items based on tags as well.
Of course, after I started writing all of this, I realized it was just a slimmed down version of HTFS… so yes, I really should be building that system 🙂
My brother recently emailed me with the relatively simple question, “what exactly is Web 2.0?” I know a lot of other people out there have taken a stab at defining the damn thing, but I thought I’d take a shot as well. Here’s what I replied with:
It’s kind of a “catch-all” expression for a lot of the things that are going on online now. It generally refers to things like blogs and wikis and sites where the user is actually doing all the work (thus the common term “User-Generated Content” or UCG).
Just to confuse things, a lot of people have started referring to a specific design style and set of technologies as being “Web 2.0” as well. This tends to include:
- anything mobile
- anything including mapping/geo
- widgets (which are a whole other confusing mess of their own)
- anything that uses RSS/Atom feeds
So yeah… it’s not easy to give a simple one-line answer, because it’s kinda all of those things and more. Some people argue that it’s a “revolution” of the way the web works, because “Web 1.0” was all about companies or bigger groups publishing information online, whereas 2.0 is more about “the little guy” out there (users) controlling and publishing their own content (think YouTube, Flickr, etc). To me, it’s actually just an evolution though, a logical progression that just took a while because we had to figure out and refine the technologies to allow things to be easy enough for everyone to be involved.
That’s my take on it anyway 🙂