braddewald Posted October 10, 2009 Share Posted October 10, 2009 I was wondering if anybody wanted to post their favorite anti-aliasing filter for V-Ray. I prefer to use Catmull-Rom because it makes the edges look very pronounced in architectural renderings. Does anybody else have a favorite they would like to share? Link to comment Share on other sites More sharing options...
BrianKitts Posted October 10, 2009 Share Posted October 10, 2009 I've gone through phases of using a lot of them, started with area, went to mitchel-netravali, went to catmul-rom, then settled on vray lanczos for the longest time. Now I don't use the filter at all unless I'm doing animation work. If you use a sharpening filter like catmul-rom you've rendered that sharpening into your file permanently. I prefer to go without and do the sharpening in post (unsharpening mask in PS) that way you can control it on an as needed basis and you don't end up with any ringing or burnt pixels that can't be corrected. For animation work I tend to use the area filter set somewhere between 1.7 and 1.8. (the video filter is too much blur) Link to comment Share on other sites More sharing options...
WAcky Posted October 10, 2009 Share Posted October 10, 2009 I tend to not use one anymore too. When it comes to heavy PS compositing you can run into all sorts of issues with those catmul-rom edges.... Link to comment Share on other sites More sharing options...
braddewald Posted October 12, 2009 Author Share Posted October 12, 2009 I didn't think that people didn't use filters? Is it better to apply an unsharp mask in photoshop? Link to comment Share on other sites More sharing options...
AndyC Posted October 13, 2009 Share Posted October 13, 2009 I didn't think that people didn't use filters? Is it better to apply an unsharp mask in photoshop? Yes! Link to comment Share on other sites More sharing options...
AndyC Posted October 13, 2009 Share Posted October 13, 2009 Yes! Sometimes, depends on the shot to be honest. And your skills. But I agree life is simpler without. Link to comment Share on other sites More sharing options...
Ricardo Eloy Posted October 13, 2009 Share Posted October 13, 2009 Agree. Besides, sharpening filters (like catmull) tend to give a floating point error, creating a dark line around light reflections and very bright things. Link to comment Share on other sites More sharing options...
braddewald Posted October 13, 2009 Author Share Posted October 13, 2009 (edited) Wow! I've just been trying out no filter and using the unsharp mask and it seems to be working really really well. Thanks! Edited April 6, 2010 by braddewald Link to comment Share on other sites More sharing options...
Brian Cassil Posted April 2, 2010 Share Posted April 2, 2010 I'm digging up this somewhat older thread to ask a question about what specifically you guys do in PS to smooth out your edges? If I turn the filter off entirely, then I get some pretty bad jaggies. Using unsharp mask in PS actually makes that a little worse rather than better. Gausian blur looks like hell even if I set it to .1. Using the lanczos filter gives me much better results that I can't seem to duplicate in PS. What are you guys doing? Link to comment Share on other sites More sharing options...
3dterior Posted April 2, 2010 Share Posted April 2, 2010 Catmull-rom Link to comment Share on other sites More sharing options...
Brian Cassil Posted April 2, 2010 Share Posted April 2, 2010 Catmull-rom I'm sorry but you must have misunderstood my question. I'm not asking what antialiasing filter to use, but what do you do in PS to smooth the edges out. Link to comment Share on other sites More sharing options...
Crazy Homeless Guy Posted April 2, 2010 Share Posted April 2, 2010 Can you post a screen shot? ...is it jaggies due to unclamped colors, or specific to AA? Link to comment Share on other sites More sharing options...
Brian Cassil Posted April 2, 2010 Share Posted April 2, 2010 Can you post a screen shot? ...is it jaggies due to unclamped colors, or specific to AA? I can notice some jaggies in the clamped areas but they are mainly due to unclamped colors I think. But still, the filter does help with that. Is there another way to deal with jaggies due to unclamped colors? It's a little tough to see the jaggis because of the .jpg compression here. Link to comment Share on other sites More sharing options...
Brian Cassil Posted April 2, 2010 Share Posted April 2, 2010 (edited) Here are some .pngs with text. Should be a little easier to see. EDIT: AAARRRGGGHHH!!! Ignore the lanczos image. I didn't turn on the right layer. Edited April 2, 2010 by Brian Cassil Link to comment Share on other sites More sharing options...
Brian Cassil Posted April 2, 2010 Share Posted April 2, 2010 correct lanczos image. Link to comment Share on other sites More sharing options...
Crazy Homeless Guy Posted April 2, 2010 Share Posted April 2, 2010 I usually tick the Sub-Pixel mapping, and Clamp Output under color mapping to deal with edges of this type. I like to clamp to .97 or so instead of 1.0 though. Not sure if this will help you situation. Link to comment Share on other sites More sharing options...
Brian Cassil Posted April 2, 2010 Share Posted April 2, 2010 Ahhh Hahh! Checking sub pixel mapping and clamp output together fixes it. Travis: Thanks for inserting the tip to avoid what would have been my first quadruple post in 8 years of membership. I'll play around with the clamp level. I'm not really sure what that means yet. Thanks man! Link to comment Share on other sites More sharing options...
Crazy Homeless Guy Posted April 2, 2010 Share Posted April 2, 2010 Right now the white area of your image is probably at 18 or something like that, and the color that meets the edge is probably at .7. Vray can not sample enough between the .7 and the 18 to create a smooth edge, so you get jaggies. Clamping the output limits how far beyond white a color can go. So, if you clamp to .97 or 1.0, then Vray only has to sample between .7 and .97. Which it can do well, and create a nice edge. Technically it is correct to go unclamped, but most mid range programs (Adobe programs) don't do a great job with unclamped color anyway. I say bah humbug with technically physically accurate, and give me something that produces the results I need. Link to comment Share on other sites More sharing options...
Brian Cassil Posted April 2, 2010 Share Posted April 2, 2010 Perfect explanation. Thanks again man! Link to comment Share on other sites More sharing options...
3dterior Posted April 2, 2010 Share Posted April 2, 2010 I'm sorry but you must have misunderstood my question. I'm not asking what antialiasing filter to use, but what do you do in PS to smooth the edges out. I'm really sorry for my misunderstood. Link to comment Share on other sites More sharing options...
Recommended Posts
Create an account or sign in to comment
You need to be a member in order to leave a comment
Create an account
Sign up for a new account in our community. It's easy!
Register a new accountSign in
Already have an account? Sign in here.
Sign In Now