VFX Back to Basics Series: 2. What is 3D modeling?

This is part of a series on the basic elements of Visual Effects. Each post will talk about a certain element which is one of the basic bricks used for building VFX shots.

In this second post I will talk about 3D modeling.

A 3D model of a gun.

Last time I was talking about rotoscoping which is what we call a 2D operation. We can manipulate the rotocurves only in two dimensions, height and width. In this post I am taking you into the 3D realm and I don't mean the stereoscopic view mode which you can see in the theaters while wearing funny glasses. This is real 3D with height, width and depth. Unfortunately "3D" stuck as a commercial term for selling cinema tickets and new TV sets and now it confuses the layman people when I talk about 3D.

So what is the point of working in a 3D space for making pretty pictures. The answer is simple. If there was no 3D we would have to make computer graphics objects frame by frame like artists drawing cell animation. That would be quite time consuming and highly inflexible. Don't get me wrong. 2D elements like matte paintings do exist and are extremely useful for VFX but it would limit us a lot. We can move around 3D objects, translate and rotate them so we can see them from all sides. This also means we have to light a shot only once. Once a model is made we can use it over and over again and the virtual camera will give us always the right perspective. There are a plethora of 3D packages out there for you to start modeling with and I can't really say which one is the best as I haven't tried them all. I use Maya as it is one of the most used packages in VFX. 3ds Max, Softimage XSI, Houdini, Lightwave and so many others are also great packages to try your modeling skills on.

There are several stages which artists have to complete before a photorealistic 3D animated creature or a futuristic city can be shown to the public. The first step is to create a model. You can see it a bit as a sculptor making a clay object. Especially with programs like ZBrush and Mudbox this metaphor becomes almost a reality. The more classic way however is to build a model made out of polygons, NURBS or subdivision surfaces. These are three types of surfaces to represent the "skin" of your object. 

Polygons are flat faces with three or more edges. By connecting these flat faces you can get a blocky surface. The more polygons you use the smoother the blocky surface will be but it comes at a price. The model becomes heavy and your computer will churn to a halt as it can not process the amount shown on your screen. They do model quite easy though and are usually used for games and low quality media.

A NURBS (Non Uniform Rational B-Splines) surface is a parametric surface built on a mathematical formula. This actually means they are extra smooth without making an attempt to kill your GPU for showing them on the screen. The drawback is that they are harder to texture since a surface patch is always square. They are usually used for design and CAD imagery.

Subdivision surfaces try to combine the best of both worlds. They are represented by a course polygon cage but give a smooth surface as a result. They texture almost as easy as polygons with the smoothness of NURBS without the need of a gazillion polygons for the cage. They can have sharp edges as well as rounded ones in the same surface. They are usually used in high quality VFX and my personal preference.

Check out the smoothness levels of the different methods. You can clearly see subdivision surfaces are as smooth as NURBS although they have the same polygon cage as the middle objects made out of polygons.

Quite an explanation on the building blocks but how can you start modeling? Modeling without an example is usually quite tough. Having a design on paper, a scanned real life object or even another 3D model is a good start by being a template for the model you wish to make. It is always a good idea to begin with a rough model and then refine it as you go along. Putting too much detail from the start will limit your options later on. It is also wise to think about how many meshes you will make for your model. Building one big mesh is very often done for games but will get you into trouble in high detailed photoreal work. A good rule of thumb is to divide them up by the amount of shaders you will apply on them. This will simplify the shader networks you have to build later on and avoids layering them up. There is nothing wrong with layered shaders but there is an extra cost in texture maps.

This concludes the second part of the VFX Back to Basics series.
Make sure to subscribe (at the top) or follow me on Twitter (check the link on the right) if you want to stay informed on the release of new posts.

In this series:
1. What is Rotoscoping?
3. What is Tracking and Match Moving?
4. What is 3D animation?
5. What is shading and texturing?
6. What is lighting and rendering?
7. What is matte painting?
8. What is compositing?

VFX Back to Basics Series: 1. What is rotoscoping?

This is part of a series on the basic elements of Visual Effects. Each post will talk about a certain element which is one of the basic bricks used for building VFX shots.

In this first post of the series I will talk about rotoscoping.

I am sure that most of the artists out there have dealt with some form of roto work in their career. I usually have to do it when the shooting crew didn't put in the time to set up a proper green screen or when the client wants some modifications on the live action plates which weren't planned for. Removing and replacing commercials signs while people walk in front of them are a classic. The whole point of rotoscoping is to create a cut out image so the image can be split up in several layers.

Although rotoscoping is used differently today it is one of the oldest tricks of the trade. The technique was originally used by classic animators in which they traced over projected live action film to capture the motion of the actors or animals to produce life like animations. It was invented by Max Fleischer in 1915 and has been used in famous features like Disney's Snow White and the Seven Dwarfs and the Beatles animated film Yellow Submarine.

Later on the technique was used  to create mattes to cut out bits out of live action movies. The mattes  were used to create layers during the compositing stage, which was still done with an optical printer, so they could place elements behind the rotoscoped elements or they could add effects which only affected the rotoscoped elements themselves. The famous lightsabers of the Star Wars series is a perfect example of this latter technique. These mattes were still hand painted frame by frame. It did cost the artist quite some time to finish a shot and it was prone to chatter. Chatter can be perceived when de movement of the matte is slightly erratic and wobbles over the edges.

Nowadays we have computers to help us out. We usually start by placing roto curves at specific keyframes and the software will create the curve for the in between frames. The in between frames can then manually be adjusted to create accurate mattes. Quite a bit faster than doing it frame by frame and it reduces possible chatter. Another advantage is that you can feather the mattes to create softer edges and that will make it easier to create mattes for motion blurred or out of focus elements. Roto work can also be combined with tracking. This technique works extremely well when the rotoscoped elements are non deformable and it speeds up the process considerably.

Here is a small example to illustrate one way to use rotoscoping.

original image

A roto shape around the target

Matted out area

Rotoscoping is usually seen as a junior position before people move onto compositing jobs. Although it looks simple enough and not a huge amount of training is needed it can be tricky to create perfect mattes. The big companies have specific roto departments while the smaller ones have their compositors taking care of the work. Most compositing packages like Nuke, Fusion and After Effects have built in roto tools but there is also dedicated software like Silhouette FX and Mocha to take care of the job.

This concludes the first part of the VFX Back to Basics series.
Make sure to subscribe (at the top) or follow me on Twitter (check the link on the right) if you want to stay informed on the release of new posts.

In this series:

2. What is 3D modeling?

3. What is Tracking and Match Moving?

4. What is 3D animation?

5. What is shading and texturing?

6. What is lighting and rendering?

7. What is matte painting?

8. What is compositing?