Tuesday, October 21, 2008

Oversampling

With all these new high resolution video sources out there, it great to know you can pan into a 2K, 3K or 4K frame and still deliver sharp results at your 720p/1080i output.  However, this oversampling advantage can be easily lost with incorrect use or setup within your NLE. We often see user setups that run the larger source media on a timeline that matches the target resolution, e.g. 4K source in a 1080i/p timeline.   This seems to be an obvious configuration, but I'm going to point out why this is the wrong way to setup your project, particularly if you want any oversampling advantage when re-cropping a larger frame.  Using Premiere Pro as an example, dragging 4K media into a 1080/2K timeline defaults to center cropping the image. This is an annoying default as you likely don't want any cropping for most clips, other than a few scenes that might need a little re-framing, so the 50% center crop default is a nuisance.  The are two solutions to address this center crop:
1) Go through all your clips on the timeline, adding a motion filter to re-frame back to the entire image (particular trickly to do fast with mix resolution sources.)  
2) Use the neat feature, "scale to frame size", which can be set up as the default for these types of projects.

If you pick 2), as it is certainly the easiest, you have lost all your oversampling advantages.  Really!  This scale happens BEFORE any of your timeline based filters see the data.  So 4K images on a 1080 timeline becomes only a 1080 source when you zoom in; push in more than 20% and the image will get soft.  There is nothing wrong with 4K on a 1080p timeline in this mode, as long as you remember to turn that feature off when doing any re-cropping, it is just too easy to forget.

If you go with solution 1), you still have your oversampling benefits for re-framing.  But now you have to be careful as the NLE is doing the resize not the importer, so you have to make sure all your scaling filters are deeper than 8-bit, otherwise you will have lost precision.  Adding a motion filter would seem best, as the Premiere motion filter does support 32-bit processing -- within Prospect HD/4K you can turn on the feature that displays the depth of the filter stack (handy to confirm you are maintaining quality.)  This additional scaling step can make things slower during your edit.

The better solution is to do your edit at your largest source resolution, i.e. editing 4K at 4K and 2K at 2K.  Set the "scale to default size" on so any lower resolution media (e.g. over-cranked sequences) are scaled to fit (no issues with the upscaling.) There are no limitations to doing this, particularly as Prospect 4K already dynamically decodes larger source data to half or quarter resolution as needed for editing speed.  There are many advantages, such as freeing the range of output options for frame size and frame aspect, to be performed at maximum quality.  4K within a default scale to frame 1080 project, will have a little poorer 720p exports, as scales would be 4K to 1080 then 720, rather than 4K oversampling and scaling directly to 720.   I've received some feedback to suggest some feel that zooming into 4K frame in a 4K timeline would result in softer images than the same source in a 2K timeline; they are missing the fact that oversampling happens upon export to whatever the target resolution may be, not how it previews at 100% pixel view on the timeline.  When pushing into a 4K frame, within a 4K project, you can check your sharpness at 1080/2K by setting the program window view to 50%, or look at the 1080p feed over HDSDI, both will allow you to see if you are pushing in too far and preview the quality of the final output.

While instinct tells us for most projects a 1080p export will be plenty of resolution, that doesn't automatically extend to being the ideal timeline format, particularly for oversampled re-framing.

Sunday, October 12, 2008

Playing with encoding curves.

As a gift for my 40th birthday, my wife got me the awesome 2nd gen. iPod Touch. I've been playing with a Graphing Calculator app, experimenting with various video encoding curves.

Legend.

Red - Linear
Blue - Gamma 2.2
Green - RedLog (Silicon Imaging Log-90 is very close)
Yellow - RedSpace

Todo -- Add PanaLog and Viper Filmstream

Friday, October 03, 2008

New betas for Prospect/NEO 4K

It is Friday and time for another beta release. Version 3.4.3 contains some cools upgrades and fixes, particular for Premiere support, but there are base level codec changes for NEO as well.

In Premiere we have renamed all the appropriate filters to it have 32-bit in their name (Prospect HD/4K only.) It's handy to know, but it is also great for selecting filters, just put "32" in the search field and up pops all of the CineForm deep pixel filters.

One of the long missing 32-bit filters is a Levels plug-in -- Finally! The Premiere levels control is only 8-bit, limiting it usefulness, while the Premiere Fast Color Corrector include 32-bit levels, it is pretty slow. This new filter is fast and simple to use and plays back in real-time.

As computers are getting faster the scrubbing will remain in 32-bit mode, unless you turn that feature off. Previously we switched between 32-bit and 8-bit to get a small improvement scrubbing speed, but it made high dynamic range work more painful. I think you will prefer it this way.

YC scopes now work correctly. Previously they clipped at 100% even if the data did not clip. That was also a related bug in the last few builds that clipped 107 IRE from YUV sources, that is now fixed.

Several minor bug fixes.

Of course let us know if there any introduced bugs, but if you are not in the middle of a big project, this is a beta worth trying out.

Download Links for v3.4.3: Prospect 4K and NEO 4K (only active while this beta version is the latest.)

PHD/NHD is on the build machine.

P.S. As it is a weekend and I'm in LA for the RED Los Angeles User Group where I will presenting using this new version on Prospect 4K. Please use my twitter page to send me any reports. Follow me at www.twitter.com/David_Newman

See me live at the RED LA User Group

I will be presenting the CineForm workflow for RED sources at Kappa Studios for the
RED Los Angeles User Group. Saturday October 4th, 9:00 - 12:00 noon. If you are interested in attending, please RSVP. CineForm is offering a door prize for one Prospect 4K or NEO 4K seat (winners choice.)

Monday, August 18, 2008

My 48 Hour Weekend

The weekend just past featured the screening the San Diego division of the 48 Hour Film Project, a film festival for extreme film-making (41 films shown all Saturday.) Like last year, CineForm sponsored the event by providing HD projection and up conversion services for all the submitted films. 90% of HD teams even submitted CineForm AVI or MOVs, making our job so much easier -- a thank you goes to all those teams. Also huge thanks goes to Wafian for loaning us a HR-F1 as a mobile playback server. While this unit is normally for on-set or field recording, at has a really neat new feature (in beta) to simplify festival projection. I had wireless access to a play-list, so I could fully control the Wafian's playback while sitting in the auditorium with all the paying customers. I used my laptop to start and stop the projection, jump to particular films, seek to startup frames while the presenters spoke, and select entire playback lists for automated projection. The same can done using any WiFi hand-held like a iPhone. Have you wished to have a remote control that worked in a full movie theater? That the power I had, it was great fun. Looking for forward to next year's innovations.

Sunday, August 03, 2008

Updates and Random Stuff August '08

Things continue to happen, but clearly not much on this blog. We have several of high-end projects and partnerships pending, but no news I can break yet. So often I post on technology issues, compression comparisons and pixel format, etc., but now with the base technology so mature, it the business relationships that are coming to the forefront (and I can't talk too much about those.)

Not that haven't been large additions to the code base in the last two months, and the plenty of next generation stuff in the works. The feature we have coined as Active Metadata has been expanded greatly, from a tool only SI-2K cameras could use, to supporting any source that can be encoded to CineForm. It is so crazy cool, potentially turning large sections of the workflow on it head (once again,) now to getting the market to really understand its power, and also dealing with the development feature creep this so easily generates. We need to create several how-to videos to help easily explain all the new stuff--ironic that a video company hasn't produced any online videos in the past.

Well we do produce videos, once per year we enter the San Diego division of the 48 Hour Film Project with a team of engineers and company friends. This is happening next weekend, so expect another post of the result short film in a few weeks. Like last year CineForm with Wafian is doing the HD projection for the entire festival (currently at 41 teams and rising.) Teams can submit HD content using CineForm files, instead of the standard DVD or DV submissions of other cities. Last year a good third of the teams submitted HD shorts in the 48 hours (hope for more this year.) So if your in San Ddiego on August 16th, please come to theatrical premiere.

This will be our fifth year for the 48 Hour, and it is interesting how rapidly the camera technology has developed through the equipment we used.

2004 - Shoot with two JVC HD10Us at 720p30 (first and only HDV camera.)
2005 - Shoot with two Sony HVR-z1Us at 1080F25 (CineFrame mode.)
2006 - Shoot with a way prototype SI-2k (then SI-1920) and Canon XL-H1 for sound and pickup shoots.
2007 - Shoot with two SI-2Ks with one with synced audio.
2008 - Planning on shooting a single SI-2K (learning our lesson the two is not always between than one.)

So we went from a contrasty barely 720p to wide latitude 2K and stayed there (single sensor, through three CCDs, and back to single sensor.) If you're thinking why not shoot Red as a logical progression, honestly they is no place for 4K is this type of project (the development times would kill your post time), plus it is not just resolution now that is defining the quality of the picture (although the larger sensor size would be helpful.) Also it is so much easier to move a 1-2kg 16mm camera and lens through rapid and interesting setups. There are several new technologies being applied this year, but I'll leave that discussion for the postmortem and another blog entry.

Friday, June 13, 2008

Nike + CineForm + SI-2K = Way Cool!



I just discovered this Nike "Evolution" commerical was shot nearly entire point of view using a SI-2K. The results are a lot of fun. Check it out: Nike Football.