Thursday, November 13, 2008

My Take on Red's Announcements

Very cool. The higher the bit-rates and the higher the resolution goes, the even greater need for high performance compressed digital immediate for post, mezzanine and long term archive, i.e. CineForm. And for anyone wishing to produce their own compressed RAW video cameras, Red and SI are not going to be in that business alone; CineForm RAW is ready when you are.


Anyone notice how the whole Red "Brain" line-up looks like chunker versions of Silicon Imaging dockable SI-2K Mini? Red continues to confirm SI's vision. :)

Friday, November 07, 2008

Even More Decode Speed

The last 2-3 weeks I found my time consumed with more decoder optimization. While the core of the CineForm codec has now been around for nearly 7 years, it enhancement has never stopped, whether we are adding new pixel formats, Active Metadata, improving quality or striving for more performance. Working on the codec core is more rewarding as an engineering success is not dependent on eccentricities the third party applications like Premiere or FCP, which like to get in the way.

The decoding engine has been threaded for 8 cores for some time, but it was only efficiently using about 3-4 cores. This inefficiency was not an issue for real-time playback as the codec was already very fast, faster than necessary for real-time multi-stream playback (even on dual core systems.) Each decoder during a transition or layered effect would happily use much of the available CPU. Better codec threading was needed for a new market the CineForm is finding itself in, file based film and television archives and mezzanine storage for HD distribution. These markets have been limited by the real-time nature of tape format like D5 and HDCAM SR. If you are going to switch to file based storage, no point in limiting yourself to 1:1 real-time, you want faster than real-time for batch processing and file format conversions wherever possible. This is one reason CineForm is displacing JPEG2000 for archives, is it just too slow for batch processing in software (typically much slower than real-time 1:1, i.e. slower than tape.)

While the current public beta is more efficiently threaded for up to 8 cores, up a 50% decoder speed-up for some sources, the in-house decoder (out soon) will support up to 32 cores, ready for those new Intel powered workstations with will have 6 and 8 cores per physical part coming very shortly.

Some performance numbers from my stock HP xw8600 8-core 3GHz workstation:
444 1080p 12-bit per channel StEM footage -- 64fps.
444 1080p 12-bit per channel Stereo (3D) -- 43fps per eye (86fps total throughput.)
RAW 4K 12-bit per channel with demosaic (no GPU acceleration) -- 22fps.
RAW 4K 12-bit per channel decoding at 2K (no GPU acceleration) -- 59fps.

All testing used Build 186 of Prospect 4K beta.

Tuesday, October 21, 2008

Oversampling

With all these new high resolution video sources out there, it great to know you can pan into a 2K, 3K or 4K frame and still deliver sharp results at your 720p/1080i output.  However, this oversampling advantage can be easily lost with incorrect use or setup within your NLE. We often see user setups that run the larger source media on a timeline that matches the target resolution, e.g. 4K source in a 1080i/p timeline.   This seems to be an obvious configuration, but I'm going to point out why this is the wrong way to setup your project, particularly if you want any oversampling advantage when re-cropping a larger frame.  Using Premiere Pro as an example, dragging 4K media into a 1080/2K timeline defaults to center cropping the image. This is an annoying default as you likely don't want any cropping for most clips, other than a few scenes that might need a little re-framing, so the 50% center crop default is a nuisance.  The are two solutions to address this center crop:
1) Go through all your clips on the timeline, adding a motion filter to re-frame back to the entire image (particular trickly to do fast with mix resolution sources.)  
2) Use the neat feature, "scale to frame size", which can be set up as the default for these types of projects.

If you pick 2), as it is certainly the easiest, you have lost all your oversampling advantages.  Really!  This scale happens BEFORE any of your timeline based filters see the data.  So 4K images on a 1080 timeline becomes only a 1080 source when you zoom in; push in more than 20% and the image will get soft.  There is nothing wrong with 4K on a 1080p timeline in this mode, as long as you remember to turn that feature off when doing any re-cropping, it is just too easy to forget.

If you go with solution 1), you still have your oversampling benefits for re-framing.  But now you have to be careful as the NLE is doing the resize not the importer, so you have to make sure all your scaling filters are deeper than 8-bit, otherwise you will have lost precision.  Adding a motion filter would seem best, as the Premiere motion filter does support 32-bit processing -- within Prospect HD/4K you can turn on the feature that displays the depth of the filter stack (handy to confirm you are maintaining quality.)  This additional scaling step can make things slower during your edit.

The better solution is to do your edit at your largest source resolution, i.e. editing 4K at 4K and 2K at 2K.  Set the "scale to default size" on so any lower resolution media (e.g. over-cranked sequences) are scaled to fit (no issues with the upscaling.) There are no limitations to doing this, particularly as Prospect 4K already dynamically decodes larger source data to half or quarter resolution as needed for editing speed.  There are many advantages, such as freeing the range of output options for frame size and frame aspect, to be performed at maximum quality.  4K within a default scale to frame 1080 project, will have a little poorer 720p exports, as scales would be 4K to 1080 then 720, rather than 4K oversampling and scaling directly to 720.   I've received some feedback to suggest some feel that zooming into 4K frame in a 4K timeline would result in softer images than the same source in a 2K timeline; they are missing the fact that oversampling happens upon export to whatever the target resolution may be, not how it previews at 100% pixel view on the timeline.  When pushing into a 4K frame, within a 4K project, you can check your sharpness at 1080/2K by setting the program window view to 50%, or look at the 1080p feed over HDSDI, both will allow you to see if you are pushing in too far and preview the quality of the final output.

While instinct tells us for most projects a 1080p export will be plenty of resolution, that doesn't automatically extend to being the ideal timeline format, particularly for oversampled re-framing.

Sunday, October 12, 2008

Playing with encoding curves.

As a gift for my 40th birthday, my wife got me the awesome 2nd gen. iPod Touch. I've been playing with a Graphing Calculator app, experimenting with various video encoding curves.

Legend.

Red - Linear
Blue - Gamma 2.2
Green - RedLog (Silicon Imaging Log-90 is very close)
Yellow - RedSpace

Todo -- Add PanaLog and Viper Filmstream

Friday, October 03, 2008

New betas for Prospect/NEO 4K

It is Friday and time for another beta release. Version 3.4.3 contains some cools upgrades and fixes, particular for Premiere support, but there are base level codec changes for NEO as well.

In Premiere we have renamed all the appropriate filters to it have 32-bit in their name (Prospect HD/4K only.) It's handy to know, but it is also great for selecting filters, just put "32" in the search field and up pops all of the CineForm deep pixel filters.

One of the long missing 32-bit filters is a Levels plug-in -- Finally! The Premiere levels control is only 8-bit, limiting it usefulness, while the Premiere Fast Color Corrector include 32-bit levels, it is pretty slow. This new filter is fast and simple to use and plays back in real-time.

As computers are getting faster the scrubbing will remain in 32-bit mode, unless you turn that feature off. Previously we switched between 32-bit and 8-bit to get a small improvement scrubbing speed, but it made high dynamic range work more painful. I think you will prefer it this way.

YC scopes now work correctly. Previously they clipped at 100% even if the data did not clip. That was also a related bug in the last few builds that clipped 107 IRE from YUV sources, that is now fixed.

Several minor bug fixes.

Of course let us know if there any introduced bugs, but if you are not in the middle of a big project, this is a beta worth trying out.

Download Links for v3.4.3: Prospect 4K and NEO 4K (only active while this beta version is the latest.)

PHD/NHD is on the build machine.

P.S. As it is a weekend and I'm in LA for the RED Los Angeles User Group where I will presenting using this new version on Prospect 4K. Please use my twitter page to send me any reports. Follow me at www.twitter.com/David_Newman

See me live at the RED LA User Group

I will be presenting the CineForm workflow for RED sources at Kappa Studios for the
RED Los Angeles User Group. Saturday October 4th, 9:00 - 12:00 noon. If you are interested in attending, please RSVP. CineForm is offering a door prize for one Prospect 4K or NEO 4K seat (winners choice.)

Monday, August 18, 2008

My 48 Hour Weekend

The weekend just past featured the screening the San Diego division of the 48 Hour Film Project, a film festival for extreme film-making (41 films shown all Saturday.) Like last year, CineForm sponsored the event by providing HD projection and up conversion services for all the submitted films. 90% of HD teams even submitted CineForm AVI or MOVs, making our job so much easier -- a thank you goes to all those teams. Also huge thanks goes to Wafian for loaning us a HR-F1 as a mobile playback server. While this unit is normally for on-set or field recording, at has a really neat new feature (in beta) to simplify festival projection. I had wireless access to a play-list, so I could fully control the Wafian's playback while sitting in the auditorium with all the paying customers. I used my laptop to start and stop the projection, jump to particular films, seek to startup frames while the presenters spoke, and select entire playback lists for automated projection. The same can done using any WiFi hand-held like a iPhone. Have you wished to have a remote control that worked in a full movie theater? That the power I had, it was great fun. Looking for forward to next year's innovations.