click here for background

[kespernorth]

oh, and i had inspirations about integrating text and AV media yesterday. after some research, it looks like implementation shouldn't be too difficult.

note to self: learn java.

i just don't understand why nobody else has done this. *sigh* people, i swear.

Comments

[vanquishedart.livejournal.com]

You're big words are hurting my head.

*sniffles*





C.

You are too vague.

[rfreebern.livejournal.com]

"Integrating text and AV media" has been done for decades upon decades. Every single television commercial does it. Millions of web sites do it. Macromedia Flash does it. Many interactive fiction languages/interpreters do it. DVDs do it. Blah blah blah.

Are you reinventing the wheel?

Oh well. You obviously can't tell me. I guess you will just have to wow me several years from now!

Re: You are too vague.

[kespernorth.livejournal.com]

No, they haven't.

I have yet to see a single example of good digital media integration on the web or on TV. The farthest anyone has gotten is using text as a jumping-off point for AV -- the whole "click on the link to start this movie" thing, basically, with a little description of it. Or subtitles. There's no crossover, no simultinaety. And for sure no one's thought of this particular application...

Oh. I should probably point out that my business idea revolves around a service, not a new technology. Any given coder with Java experience could implement my idea, or duplicate it, with very little trouble.

Commentary tracks come closer to what I have in mind, but IMO they can be too intrusive.

Interactive fiction is a genre I know little of. How does it mix text and AV? I've only seen interactive fic that involves text.

[archmage.livejournal.com]

Perhaps it was just waiting for you, Bjorn.

[foobiwan.livejournal.com]

it ultimately comes down to marshalling multiple streaming datatypes and creating an intelligent ui for displaying/decaying that RT data (having a little buffer of relevant links underneath the video, set to click/dissapear as time goes on, summaries by RSS, etc) - by and large, it could be done with java, and turningone frame per second into metadata such as links and summaries, thus making it single-stream and firewall safe.

on the other hand, i'm drunk, and don't give a shit, going to scotland tomorrow, and this is why software never gets written

BECAUSE WE'RE LAZY

Re: You are too vague.

[rfreebern.livejournal.com]

The popular IF design systems support more than just text (so does Infocom's Z-machine, but it's not as easy as some of the newer systems to incorporate multimedia). You could check out Six Stories, developed in HTML TADS, or Guilty Bastards, a Hugo game.

Granted, they're not streaming, and not flashy or anything, but they're incorporating text and photos and audio to tell a story.

If foo's post below is what you're actually thinking of, I know that similar stuff (non-streaming, but nearly the same end result) can be done in Flash, and I believe that Windows Media Player and WMV can do it in a streaming fashion. Not that I like Microsoft, but I think the technology's out there.

[kespernorth.livejournal.com]

What would it take to convert that frame into metadata?