Welcome, Guest. Please Login or Register
Home Help Search Login Register
Pages: 1 2 
Send Topic Print
IBL and gray ball lighting calibration issue (Read 67518 times)
jasonhuang1115
Ex Member


IBL and gray ball lighting calibration issue
01/26/10 at 17:00:46
 
Hi, Christian and everyone,

I am doing some IBL research trying to match my CG gray ball render to the photographed gray ball picture. What I don't understand is that why my CG gray ball render usually looks a lot darker than the gray ball in the photograph? Here below is my test setup:

shooting & post-processing HDRI:
I shot 9 JPEG brackets (DSLR + Sigma 8mm) and made sure the fastest brackets has not saturated pixels in the brightest area. The stitched spherical HDRI was then graded in Nuke to match the overall mid-tone of the reference gray ball image (shot with the same DSLR + kit lens), which is also in this case my BG plate, just to simplify the process.

Rendering:
In Maya, a pure diffuse sphere was textured with a file texture created in Photoshop (fill with 50% gray). The texture was gamma-correct inside of Maya and finally I apply a lens shader with gamma 2.2 as the Render Viewer LUT to address the linear workflow. Rendered with Final Gather and no CG lights in the scene.

What I got is: (Final gather primary diffuse scale = 1)
...

And if I crank up the Final gather primary diffuse scale to around 2, I will get better matched CG gray ball:
...

I am wondering if I did something wrong in the color management and linear workflow? I tested this workflow in different scenarios and my CG gray ball renders are always quite darker than the reference gray ball picture? Could anyone shed some light and I will be very appreciated.

cheers,
Jason
Back to top
 
 
IP Logged
 
jasonhuang1115
Ex Member


Re: IBL and gray ball lighting calibration issue
Reply #1 - 01/26/10 at 17:04:13
 
I did some more tests and upload the results:
In this test, a chrome ball instaed was used for acquiring HDR environment map.
...

A sunset scene. DSLR + Sigma 8mm for HDR environment map. This is the closest CG gray ball render I ever got with the default Final Gather value.
...

Outdoor afternoon. Final gather value has to be increased 6 times.
...

I expect a much closer CG gray ball render without artificially increase the illumination like crazy in 3D. Any thoughts?

cheers,
Jason
Back to top
 
 
IP Logged
 
Dschaga
Ex Member


Re: IBL and gray ball lighting calibration issue
Reply #2 - 01/26/10 at 20:29:56
 
It's all about white balance!

There is no material (except a 100% reflective mirror) which doesn't tint the reflections - on the other hand the white balance of a digicam pano can give better results, but can also lead to wrong results with artificial lightsources.

btw, the error of the camera WB can be corrected when you compile your image set to an HDR image.

The FG issue have probably to do with the key/sunlight, because you need at least one or two bounces to get a good result. If we are talking about MR in 3ds max, you also can handle the WB in the MR photographic exposure dialogue.

btw .. the reason why i always loved the idea of sIBL is that you can get good results from images with less dynamic range, because hdri's with less fstops always tint the renderings.
...
......
Back to top
 
 
IP Logged
 
jasonhuang1115
Ex Member


Re: IBL and gray ball lighting calibration issue
Reply #3 - 01/27/10 at 16:43:15
 
Thank you Dschaga.

Regarding the white balance, I am not quite getting what you mean.
If you were referring to the WB in brackets, although I didn't shoot RAWs but I am sure that all JPEG brackets and the gray ball image were shot with the same WB setting (sun light).
If you were referring to white-balance the HDR environment map as mentioned in Bloch book P.137, then I didn't do this because I was not trying to create a tone-mapped BG plate as in sIBL. I graded the HDR environment map to match my BG plate - the gray ball image.

About the final gather issue, what I can figure is that I will not be able to fully capture the sun intensity and hence the FG value has to be raised to add illumination. In the sunset scene above, the CG gray ball rendered with default FG value matches OK to the photographed one. However, what I wonder is that in the interior scene, where I (should) capture the full DR of the scene, my CG gray ball is still rendered much darker than the photographed one.

The BRDF of the gray ball is a big unknown in this test and pure diffusive CG gray ball is also in incorrect, but I wonder if this is the reason causing all these difference or there is something more to it.

Bt the way, to create a mid-gray texture, should I feed (R128, G128, B128) in a 8-bit color picker or (R187, R187, R187)?

Thanks,
Jason
Back to top
 
 
IP Logged
 
Kel Solaar
Moderator
*****
Offline


Curious Apprentice

Posts: 1117
Re: IBL and gray ball lighting calibration issue
Reply #4 - 01/28/10 at 00:13:54
 
Hello Smiley

That's something I would like to see more : Reference Chrome / Gray Balls in HDR / IBL sets so that you can match your plate perfectly.

Your issue is one Christian could reply I think Smiley

I may be wrong ( like REALLY wrong) but one issue is that when we do an HDR it's basically not "calibrated" : we dump the overall dynamic range of a scene into a file by merging multiple shots, then we estimate the correct exposure by looking at our merged file and setting it at the value that seems good looking, not too dark, not too overblown.

Then we bring that into our rendering package, put a plate and it's not matching : the plate is not really linked to the HDR file exposure wise. And sometime it's even tonemapped, so there is even more bias beetween the plate and the HDR file.

There is another issue regarding the gray ball itself, some ways to find it's CG matching color are either :

- Shoot your ball with a gretagMacbeth card near it, the RGB value of each color squares is available, so you should be able to guess the RGB value of your ball ( http://farm2.static.flickr.com/1234/553511566_19ae5d2e97.jpg ).

- Ask someone with a RGB Spectral Colour Meter to give you the RGB value of your ball by averaging a few sample (http://www.industrial-needs.com/technical-data/colour-meter-pce-rgb.htm or http://scilution.tarad.com/product.detail_378756_en_2529036).

Basically I end up color correcting my HDR / Light rig until I match up the gray ball, then I'm ok to continue with a model. I never got the chance to have a perfectly matching RL gray ball / CG one in the first render,

Though it's strange you have such a gap in your renders.

Anyway, Christian is the way to go for this Cheesy

I'm heading back for some code refactoring, time to remove the dust Smiley

KS
Back to top
 
 
IP Logged
 
jasonhuang1115
Ex Member


Re: IBL and gray ball lighting calibration issue
Reply #5 - 01/28/10 at 02:57:41
 
Hi, Kel,
Thank you for the gretagMacbeth card tip. I have a gray card for white balance and it may be of use.

Although I did try to search some information regarding absolute calibration via some apparatus, I would love to know if I did something obviously wrong on certain component during the whole workflow before I lose my mind and invest on those hardware.

In my calibration process, the actual BRDF of the real-world gray ball is a big unknown. Also, how I should define the material for the CG gray ball is another unknown to me. But I was thinking (maybe totally wrong) if I can keep using the same real-world gray ball, lock down the CG material, and make sure scene full DR is stored (not talking about direct sun-lit scene) in my HDRI, then maybe I can indirectly derive a setting that links between real-world luminance and scene luminance. It will be great to know exactly how professional VFX artist set up the scene for calibrating the scene luminance.

Don't get me wrong. Bloch will probably tell me: it is art. If it is all that rocket science, where is the fun? I totally buy that. But, again, I don't want to miss an obvious point and then just "art" it out. That would be so wrong....

Kel Solaar wrote on 01/28/10 at 00:13:54:
Though it's strange you have such a gap in your renders.


I would love to know the reason... Grin I found that cranking the default exposure of HDRI 1 stop up will usually bring my CG gray ball into ballpark, and I cannot figure out what is causing this gap??

BTW, I have tried to evaluate several sIBL sets and find no consistent relationships on the mid-tone values between the tone-mapped BG and the HDRI. Bloch ever said that back in days, some stock HDRI baked gamma into their HDRI so the render looks brighter. I find no this situation in the sIBL sets.

Back to experiments.....

- Jason
Back to top
 
 
IP Logged
 
Blochi
Administrator
*****
Offline



Posts: 1726
Hollywood
Re: IBL and gray ball lighting calibration issue
Reply #6 - 01/28/10 at 04:29:21
 
Hey Kel, good time to dive into the code, I'm currently working on it as well... Wink

Regarding the mismatch - you're absolutely right, there's no direct link between the exposure of a backdrop plate and the HDR. Which is a pity. Just had a long discussion about this here: http://www.hdrlabs.com/cgi-bin/forum/YaBB.pl?num=1261857570

However, your workflow sounds very correct. All I can think of is that your Nuke grading isn't quite there. You gotta make sure to keep it linear during that process, and not flatten it accidentally by burning in the viewing LUT. Essentially, all that should be done is an exposure shift and a white balance. Maybe holding them side-by-side in another program, like PS or Picturenaut?

Mid-grey is really 18%, and that does transfer to 128, 128, 128 in a color picker.

To be honest, I never hit it out of the ballpark right away either. But that's not so important, because when you render into EXR you're doing the final color match in comp anyway. Even IF the white balance in your HDR is way off, what really counts is that it has the correct relative relationships between all colors. So it all falls together when you match the render in Nuke...

However, here's a great color checker that I just got myself for Christmas:
http://www.xritephoto.com/ph_product_overview.aspx?id=1257
It nicely fits in the set bag, and is in a plastic protective case. And especially the swatches that are slightly off-white are awesome, they are the best white balance picker I've ever seen....
Back to top
 
WWW  
IP Logged
 
Gerardo
Senior Member
****
Offline



Posts: 74
Re: IBL and gray ball lighting calibration issue
Reply #7 - 01/31/10 at 09:07:46
 
Yes, color (hues) relationships is a key aspect. This is why it's advisable a similarity between the working color space gamut and the output medium gamut. When their gamuts are very different in shape, size and center, it's very difficult to avoid clipping and shifts in the hues relationships later in post.  This is why some CG elements don't match with the BG plate in some cases, even when the lighting artists and colorist are excellent and the color grading system is high-end. And in those cases, it's better to complete the CG work with some kind of 3DLUT or color profiles conversions.  But when these gamuts are similar, the hues/colors relationships are kept and this is easily solved in post as Blochi has already mentioned. 
 
Besides the diffuse/reflection shading and lighting acquisition/reconstruction aspects (and probably  the need of a kind of spatial IBL in some cases), something that is worth to consider about the 18% middle-grey is that some digital cameras are calibrated to a middle-grey reflectivity of about 12.5% - not 18% (!) as old analog cameras. I'm posting this here too, because it's something commonly overlooked. Some people deny this, some others claims that this is an inaccuracy of digital cameras hystogram or their builtin lightmeters.  However even Kodak recommends now to increase the exposure by a half f-stop ( 0.5 compensation factor) when using the 18% middle-grey card. The percentage is not also a consensus, some people says 12%, some others 13% and there's also people reporting 10% for some digital cameras (which would increase the compensation factor). In HDRI photography, we would need to re-adjust our film speed accordingly - let's say from ISO 100 to ISO 80 - or even less - to try to compensate Kodak's recommendation.     
 
After this compensation, in the cheater's workflow (or inverse linear workflow), the middle-grey would be RGB 128 again (unless you compensate in the lighting reconstruction process), and in the linear workflow the linearization value depends on the working color space gamma. 



Gerardo
Back to top
 
 
IP Logged
 
jasonhuang1115
Ex Member


Re: IBL and gray ball lighting calibration issue
Reply #8 - 02/01/10 at 22:41:09
 
Bloch, thank you for confirming the workflow and sharing experience.

Blochi wrote on 01/28/10 at 04:29:21:
However, here's a great color checker that I just got myself for Christmas:
http://www.xritephoto.com/ph_product_overview.aspx?id=1257
It nicely fits in the set bag, and is in a plastic protective case. And especially the swatches that are slightly off-white are awesome, they are the best white balance picker I've ever seen....


May I ask how this color checker can help you on the HDR imaging? Does it help more on the HDR photography (white balancing per se, or lighting for CGI works, or both? I checked the link and the accompanying CAMERA CALIBRATION SOFTWARE really interests me. Smiley

Thanks,
Jason
Back to top
« Last Edit: 02/02/10 at 00:44:26 by N/A »  
 
IP Logged
 
cateye
Ex Member


Re: IBL and gray ball lighting calibration issue
Reply #9 - 05/04/10 at 17:48:13
 
Hi Jason,

I'm wondering where did you purchase the gray ball? Did you paint it by yourself? If yes, is there any standard or method to match the color of paint? Thanks.
Back to top
 
 
IP Logged
 
jasonhuang1115
Ex Member


Re: IBL and gray ball lighting calibration issue
Reply #10 - 05/07/10 at 00:11:26
 
Quote:
Hi Jason,

I'm wondering where did you purchase the gray ball? Did you paint it by yourself? If yes, is there any standard or method to match the color of paint? Thanks.


I paint the gray ball myself. The sphere is just a $4 Christmas ornament ball and I brought my 18% gray card to a local paint store and ask them to make the color.

HTH.
Jason H.
Back to top
 
 
IP Logged
 
FlashPhoto
Junior Member
**
Offline


HDR Boy!

Posts: 6
Re: IBL and gray ball lighting calibration issue
Reply #11 - 04/01/11 at 18:58:38
 
Quote:
It's all about white balance!

There is no material (except a 100% reflective mirror) which doesn't tint the reflections - on the other hand the white balance of a digicam pano can give better results, but can also lead to wrong results with artificial lightsources.

btw, the error of the camera WB can be corrected when you compile your image set to an HDR image.

The FG issue have probably to do with the key/sunlight, because you need at least one or two bounces to get a good result. If we are talking about MR in 3ds max, you also can handle the WB in the MR photographic exposure dialogue.

btw .. the reason why i always loved the idea of sIBL is that you can get good results from images with less dynamic range, because hdri's with less fstops always tint the renderings.
http://www.cgtechniques.com/tutorials/synth_hdr/range.gif
http://www.cgtechniques.com/~upload/chris/convolvedhdr.jpghttp://www.cgtechniques.com/~upload/chris/tweakedhdr.jpg


White Balance might be the hardest thing to learn in photography, because you start off thinking it is so basic, and it is in reality so very technical. This thread is a great example. Recently I was working on a design for a professional still motion video and I had to start over because of my misjudgment on the white balance. It was very frustrating seeing what happened when we put the image files on to a dvd with dvd burning software. It really proves how sure you need to be ahead of time.
Back to top
« Last Edit: 02/22/12 at 19:01:29 by FlashPhoto »  

Why did you have to go and blink your red eye?
 
IP Logged
 
spittle
Ex Member


Re: IBL and gray ball lighting calibration issue
Reply #12 - 01/20/14 at 07:16:32
 
Regarding the grey paint - is there anywhere online to order the right colour paint?

I just bought an X-rite color passport - I took it to my local hardware store to try and get a match - I could see the screen as she was scanning it - the result was really different each time and she was trying to eyeball it.

She also scratched a nice shiny mark down the centre of my grey swatch, and then tried to wipe it with a rag with paint all over it until I politely told her to hand it back.

Back to top
 
 
IP Logged
 
Rork
Ex Member


Re: IBL and gray ball lighting calibration issue
Reply #13 - 02/05/14 at 12:46:15
 
if you have the cash: http://akromatic.com/gadgets-shop/
Back to top
 
 
IP Logged
 
spittle
Ex Member


Re: IBL and gray ball lighting calibration issue
Reply #14 - 02/11/14 at 08:39:36
 
I'd love to but can't really justify it at the moment. Anyway, I managed to get a paint match and have made my grey ball.

Back to top
 
 
IP Logged
 
Pages: 1 2 
Send Topic Print