One of my favorite blogs has a crazy piece today about playing the NY Times web site, musically.

All the magic happens with a Firefox extension called Lily, which takes its inspiration from modular audio patching software like Max/MSP.

When the patch starts, the browser enters a DOM inspection mode and mousing over a DOM element highlights the node. Clicking on a node writes the element’s data (its innerHTML value if it’s a text element or the binary data if it’s an image) as a sound file and the file is then loaded in a quicktime player in the patch. The sounds can then be triggered using OSC messages.

Some other great video examples are on the Lily blog, including this interesting SVG audio sequencer.