Compositing Output "Halo" problems

[devres]

Ladies and Gentlemen,

 

I've never had to composite until recently to save time. We had an animation that had the wrong flooring material in it. So we decided to try and composite a new floor in. So far it's been a major headache, I could have re-rendered the entire animation by now.

 

I have a major problem when trying to composite two things together. We use 3D Max 9, VRay 1.5, and Shake 4.1 (the problem exists in Photoshop as well).

 

I take image one, a complete rendered frame with no alpha at all. Targa 32 bit, premultiplied alpha.

 

For image two, just the floor, I select everything else in the scene and use "Vray properties" to make them a Matte Object and set "Alpha Contribution" to -1 for all the other objects in the scene. Save out as Targa 32 bit with premultiplied alpha as well.

 

NOW: No matter what software, FCP, Shake, Photoshop when you run the composite you get a thin border around image 2, the floor.

 

See attached images. PLEASE HELP... I'm going crazy with this.

[Tommy L]

When you bring the footage into aftereffects, you choose pre-multipliedand change the swatch to white, i forget exactly, but you'll see when you try it

 

And in PS, goto Layer - matting - trim white matte.

[devres]

Well, I'm not using After Effects. I'm using Shake, like I mentioned before.

 

That would be ideal if someone had a solution there.

 

In PS CS2, I can now get it to work... BUT only if I render out PNG files and use the other one "Remove Black Matte".

 

Using "Remove White Matte" made it worse. So this is a temporary work around and is fine for our still frames. BUT, I would much much much rather have a working solution in Shake. I will keep working on it but if you have an answer or know somebody that might have an answer I will be forever grateful.

 

Workflow tutorial or something? I'm thinking I'm doing something wrong in Max that is making this difficult and opposite of what you said in regards to removing the matte.

 

Best Regards,

Todd

[Tommy L]

Have you tried de-fringe in photoshop? Its in the sma eplace as remove white matte. I dont use Shake, so Im sorry I cant help you there. May seem obvious, but have you tried the help files?

[devres]

Hey Tommy,

 

I really appreciate your time and input. In fact it did solve my problem.

 

I can run a batch in PS and actually use the "Remove BLACK Matte" and it works perfectly.

 

The "Remove WHITE Matte" makes it worse. I am trying to keep this a shake only workflow, but for now your solution is working.

 

If there is anybody that knows how to do this same thing IN Shake I would appreciate it.