HTML5 Theora Video Codec for Silverlight

I’m glad to announce the first release of our fully managed Theora audio / video decoder implementation for the Silverlight platform! The Highgate media suite will bring installation-free support for HTML5 streaming video to an additional ~40% of web users overnight.

Theora

So, a few drinks will be in order to celebrate the release at the FOSDEM beer event, Friday — drop by! And of course, I’d like to invite anyone excited about making open codecs a first class citizen of the Silverlight / Moonlight ecosystem to visit the Mono dev room over the weekend for source code and some frivolous demos between sessions.

Technology

We’ll be releasing a high-performance decoder for Theora video / Ogg Vorbis audio streams that plugs into the Silverlight 3 streaming media abstraction, as well as a reference front-end player interface and JavaScript bridge layer providing basic compatibility with standard HTML5 media tags, adding support for the standard to Internet Explorer and extending the capabilities of WebKit-based browsers like Safari and Epiphany. A cunning plan, one might say!

This entry was posted in Mono, Nuanti. Bookmark the permalink.

50 Responses to HTML5 Theora Video Codec for Silverlight

  1. Anonymous says:

    High-performance managed theora / vorbis decoder? This is sorely needed, not only for Silverlight / Moonlight but also for standalone applications and especially games written in Mono/.Net.

    Something is telling me that “Highgate media suite” won’t be a free offering, though… What are the chances of a reasonable pricing scheme for hobbyist developers?

  2. mike says:

    @Anon: let’s see. I don’t think people will pay to get webvideo with theora, they’d rather invest in flash/h264 licences.

    And I think someone started an open implentation of Theora in C#/Mono already, so maybe this is just the final product?

    • alp says:

      Mike: Yeah, there is some history. A port of just the Vorbis audio codec from jorbis (Java) was done many years ago in the early days of Mono (in fact I wrote Platano media player built around that almost a decade ago). This was actually a great test suite for the fledgeling mcs compiler.

      The task of decoding video and synchronising it with audio has proved a significantly more complex challenge and the existing C# projects stalled at an early stage as far as I’m aware.

      Indeed even Highgate media suite is not a ground-up re-implementation but reuses many algorithms and ideas from existing implementations. It is however finely tuned to the capabilities of the CLR platform and takes full advantage of what’s available there.

    • Han Solo says:

      Yes, I will pay for h264 lincences instead a free and better theora codec for my next product. It sounds very smart.

  3. You mention a release. Will this be open source? Where can it be downloaded from?

  4. alp says:

    Anonymous, Silvia: We’re going open source with this! Over the last few years we found that our main business of developing mobile / custom web browser technology is getting more difficult with the demand for proprietary and patent-encumbered formats on the web which we simply can’t support. Perhaps a quarter of our developer time last year was spent trying to hack around bugs in the Adobe Flash player product, for example. So part of the strategy has been to encourage open formats, which means getting it in the hands of as many people as possible :-)

    These are the exact same reasons for our push on web standards and web accessibility incidentally.

  5. pvanhoof says:

    Alp, I owe you a Westvleteren for this at the Delirium cafe in Brussels. Promised.

  6. Ben says:

    Alp: That is great, great, great, great news!

    Great news.

    Thank you!

  7. Jeff says:

    Wow Planet GNOME has turned in to a Microsoft partner site. Wow congrats GNOME for selling out.

    • Stifu says:

      Never mind HTML5, Theora, open codecs or anything that might be mentioned in the article, it’s all an evil Microsoft plot in disguise!… So obvious!

      ¬_¬

    • Anonymous says:

      What twisted mind equates an implementation of Theora and Vorbis to a Microsoft sellout? How can someone be so blind to the fact that this effort promotes an *open* and *patent-free* standard over proprietary solutions that are in wide use today (MP3/H.264)?

  8. Anonymous says:

    Beautiful!

  9. Miguel de Icaza says:

    Absolutely brilliant!

    I cant wait to see you at FOSDEM!

    Miguel

  10. Baris says:

    Nice to see you back into blogging Alp! Keep pumping great tools. Too bad I won’t be able to attend Fosdem.

    Baris.

  11. This is wonderful news, leveraging Silverlight for good for once. And to all you h.264 fans out there, aside from dissing Theora you might remember that a free viable competitor will help to keep the mpeg-la protection racket from skyrocketing their fees too much.

  12. emmanuel says:

    great effort! unfortunately it doesn’t cover the iPhone but of course for the iPhone nobody can do anything about it except Apple… let’s see how this whole format war pans out but currently it doesn’t look too good for theora :-(

  13. xurfa says:

    Could this be incorporated into to the “video for everybody” [http://camendesign.com/code/video_for_everybody]
    so that only OggTheora would be needed on a website?

  14. Pingback: The Outside

  15. Rock on, Alp! This is awesome news!

  16. Prosthetic Conscience says:

    Given that Ogg Theora support is baked-into Firefox and Chrome, what’s the benefit of this? Allowing Windows users to view Theora in IE? Shouldn’t we just be encouraging them to use better products?

    • Anonymous says:

      Windows/IE is not the whole world. Plus, desktop applications also stand to profit from this initiative.

    • Anonymous says:

      Well, its an opportunity to put Ogg Theora in front of a majority of online users. Hate to break it to you, but IE still has an overwhelming market share. In addition, Silverlight also works on Macs, so you get Safari as well. Believe it or not, not everyone in the world runs Firefox on Linux.

    • The biggest point as far as the web is concerned is to enable _websites_ to use Theora without sacrificing most of their potential viewers. IE isn’t going to go away any time soon, and neither is H.264, but with this, at least going with Theora becomes a viable option as far as browser support is concerned. Thus there will probably be more Theora content available than there would otherwise be, which is a win for free browsers and players also.

    • cosku says:

      IE doesn’t support html5 video and safari doesn’t support OGG, so this silverlight decoder will virtually make your video visible in every browser on any system (assuming that moonlight will be ready by the time)

      also, currently you can’t do fullscreen within a browser. since this is a silverlight application it will enable fullscreen video.

  17. felide says:

    oh dear. Richard stallman was right. I didn’t thought i would care about mono, until i saw a screenshot of ie on planet.gnome.org. That’s disgusting!

    • Stifu says:

      This news is interesting for web developers, and the vast majority of web developers (especially professional ones) need to care about IE.
      It would be pointless to show the same screenshot in Firefox or another browser, as they can already play HTML5 videos natively. So yeah, please get off your high horse.

  18. Pingback: HTML5 Theora Video Codec for Silverlight

  19. David Gerard says:

    Which means Wikipedia users will be able to watch the videos without waiting thirty seconds for Java to start up. WIN.

    Once we find out how to do it with MediaWiki, of course. What will it be able to run on/be served from?

  20. Rakesh Pai says:

    Not sure I understand this. So, are you taking the HTTP stream and routing it through Silverlight once it’s reached the browser to provide codec support? Or are you making a way to pipe Theora to clients through a Silverlight thing, such that the developer has to use Silverlight technologies to encode the video?

    If it’s the latter, it’s wrong. I hope and trust it’s the former. Nothing against MS technologies as long as data formats are respected and work across platforms without imposing how it should piped down by the server.

  21. Jim Salter says:

    THANK YOU for this – an open source implementation of Ogg streaming as a Silverlight/Moonlight plugin is a giant ray of hope in the current nasty situation of codec wars. :)

    Now we just have to hope everybody on the OSS side doesn’t decide to abandon Ogg for Dirac and put it back at square one!

  22. Pingback: Nuanti brings HTML5 and Ogg Theora video to Silverlight « Digital Asylum

  23. I haven’t seen that many tech words in a title that didn’t include the word “killer” in it in quite some time!

    So is this similar to the Java cortado plugin, just in C# with JS hooks? Or is it the theora + decoder C libraries ported to some SL plugin infrastructure?

    • Gabriel says:

      He mentions it’s “fully managed” – eg C# (or VB.NET ;) ).

    • The “fully managed” and “installation-free” parts seem to strongly indicate “similar to Cortado with JS hooks”. The “managed” portion basically means that it’s fully confined to the .NET VM, requiring no native code (and thus Silverlight will happily run it without bothering the user much about it).

  24. Gabriel says:

    @Christopher Blizzard: It’s plugging into the Silverlight architecture. See the link below for a blog entry by Miguel de Icaza.
    http://tirania.org/blog/archive/2009/Mar-23-1.html

    @alp Is there a separate Vorbis decoder for SL?

  25. Pingback: sudo !! :: Week In Review (1-5 Feb 2010)

  26. Pingback: The Outside

  27. Pingback: TecNews: Noticias Tecnofagia

  28. Opera, anyone? Full screen mode, Ogg support. We love you long time now!

    My poor browser, so misunderstood and under-appreciated.

    But very happy to hear of a solution that will be open-sourced and allow for faster cross-platform adoption of embedded video.

    Molly :)

  29. Pingback: stick's corner » FOSDEM 2010 Report

  30. notboss says:

    But I was told by a secret source at Apple that plugins were evil and that HTML 5 was going to save us all from plugin prison! Does this mean there are good plugins and bad plugins? And, how am I supposed to tell the difference??? There doesn’t seem to be an Object tag attribute you can set to good or bad? Not even in the HTML 5 draft. What’s a person to do?

    Nice work by the way.

Leave a Reply

Your email address will not be published. Required fields are marked *

*

You may use these HTML tags and attributes: <a href="" title=""> <abbr title=""> <acronym title=""> <b> <blockquote cite=""> <cite> <code> <del datetime=""> <em> <i> <q cite=""> <strike> <strong>