Week: 14 – 18 June

With 5 more days until dateline, I decided to give priority on finalising all the shots that I’ve managed to block last week. And if I had more time left, I would then work on the remaining shots. I actually planned to finalise the animation right after doing the blocking last week, but I was very busy with the Indie Film project in preparing the Maya files with road geo and final camera scaling, so that I could send the files to the team members as soon as possible for them to be able to carry out their tasks.

Finalising Character Animation

Back to the personal project, I started with Shot11 again this time as this shot has all the effects in it, so I can reuse all the effect settings that I setup in this shot for another shots.

During the previous blocking process, I intentionally used the constant interpolation so I can focus on the blocking poses and not distracted by the in-between motions. But to finalise the animation, I need to change it to another interpolation first.

I selected all the keyframes in the Graph Editor and changed the interpolation to ‘Bezier’.

But with the current ‘Bezier’ interpolation, an ‘Automatic’ handle type was assigned to it which caused the character’s motion to look a bit weird and it keep moving even the character has the same poses in 2 adjacent keyframes because Blender will try to smoothen the curves by averaging its shapes based on the location of the keyframes. It’s like when we add a ‘Subdivision Surface’ modifier to smoothen an object shape, and it use the location of edge loops and topology of the object to average the smooth shape.

To fix this, I changed the handle type to ‘Auto Clamped’ instead of ‘Automatic’. The animation looked better now but a bit more works need to be done. With the new interpolation, I’m now have more controls to change the timing and offset the animation for which parts should move slower or faster by adjusting the keyframes and curves.

I paid attention to each movement in the sequence including the subtle changes to character’s facial expression and animating small details such as the follow through motion of the pistol bag. And since this scene has a slow motion part, I animated the character’s finger pulling the trigger and also the movement for the top part of the gun.

During this proses, I constantly switched between the low-poly and subdivision mode to make sure the final shape doesn’t overlap with other parts or objects

I then proceeded to finalise the animation for other 4 shots. The process was almost similar with Shot11.

Render Properties

Before I proceeded with making the effects, I want to make sure that the render settings are correct first so I can get proper render results especially when I want to test and see how the effects will look in render.

I changed several parameter in the ‘Render Properties’ rollout. I decided to use ‘Cycles’ render engine instead of ‘Eevee’ because I want to have a better glass reflection for the bullet trail effects. I also turned on the ‘Transparent’ and ‘Transparent Glass’ so that the 3D character can be rendered on the footage and I will be able to achieve the glass effect that I want.

• 

• 

Since ‘Cycle’ generally take much longer time to render, I want to optimise it to get faster render but at the same time not sacrificing the quality too much. I reduced the render sampling from the default; 64 to 8 and tried to render a frame. The render was quite fast, about 20 second per frame with 1920 x 1080 resolution, but the result was too grainy and bad.

I countered the grainy image by activating the ‘Denoising’ with ‘OpenImageDenoise’. There are several other denoiser options such as NLM & OptiX, but ‘OpenImageDenoise’ is the fastest to calculate. I tried to render again with 8 sampling and Denoising turned on, and this time the render quality was a bit better but the duration increased to about double.

I didn’t quite satisfied yet so I increased the sampling to 16 and tried to render again. The render took about a minute now but the quality was nice with very minimal grain. I think it matched the background footage which also has a bit of noise.

I then experimented with higher sampling to see if I can still increase the quality with acceptable render time. The render quality was getting better but it took around 2 to 5 minute per frame to render. I also tried higher sampling rate without denoising turned on, but none of the results and time fit with what I want to achieve. So I reduced the sampling back to 16 which I think the soft spot for good quality and acceptable render time.

Early Compositing Setup

Normally, compositing would be done in the last phase. But as I want to make the effects, I need to configure this first, so all assets in the foreground and background layers including the effects can appear on the background footage as I intended.

In this project, since Blender has the compositing capability, I decided to do this process directly in Blender instead of using another compositing software such as Adobe After Effects and Nuke. I never done this in Blender before, so I always wanted to try it. The Blender’s compositing is a node-base and after several tries and playing around, I think its very straight forward and easy to understand.

Below was the early version of compositing nodes that I did for the shot to combine the character layer with the background plate.

I made sure that the ‘Convert Premultiplied’ in Alpha Over nodes were turned on to make the edges of any object in the layer blend smoothly with the background. The compositing nodes will be updated again later as I’m making the effects.

Spark Effect

With all the render settings and basic compositing ready, I proceeded to make the spark, muzzle and bullet effects. I decided to use manual method for all the effects instead of using particle simulation.

For the spark, I used several low-poly spheres that have been modified to an oval shape. I arranged them in several variations of sizes and positions so that they looked a bit random. The spark group was then parented to a dummy object (aka ‘Empty’ in Blender) called ‘Plain Axes’ so I can change its location to anywhere I want, even when the objects in the group have animation.

I then animated the oval shaped spheres to begin from a very small size to big and then small again until they disappear while moving in outward directions. The duration of the spark animation was very short, which is 8 frames only.

I created a new material for the spark with ‘Emission’ node connected to it so it will glow by itself even without lighting. I set the strength to 10.

I updated the previous composition node with 2 ‘Glare’ nodes and attached them to the ‘Composite’ and ‘Viewer’ output to make the emission effect appears in render and also in the viewport preview. I set the quality to ‘High’ and size to maximum 9.

In Shot11, the character will dodge the enemy’s bullets for 3 times and 2 of them required the spark effect. So I duplicated the spark into 2 and placed them at the right place and changed the animation timing as both of them will appear at different time in the scene.

Bullet Trail Effect

The bullet trail was created from a low-poly cylinder. I modified the object to imitate shape of the trail effects from the Killer Bean and The Matrix.

Next I created a bullet model and a new ‘Plain Axes’. I parented the trail model to the bullet, and then parented the bullet to the ‘Plain Axes’ object. This is the same method as I used for the previous spark effect.

I applied the ‘Array’ modifier with 10 count to make the trail longer and added the ‘Subdivision’ modifier to the model with level 2 of detail for both viewport and render to smoothen the shape.

• 

• 

I then animated the bullet from off camera towards the character. And since this shot has a slow motion part, I modified the bullet’s animation curve in the Graph Editor to go from fast at the beginning to suddenly moving really slow during the second half of the scene.

I inserted the ‘Taper’ modifier to the trail model to add a very subtle inflate and deflate motion to the effect. I then modified the curve in the Graph Editor.

For the trail’s final look, I insert a new material and tested various combination of different values of Metallic, Specular, Roughness etc to get the result I wanted. After numerous try an error, I ended up with 0.0 value for almost everything except 0.6 value for IOR and 1.0 for Transmission and Alpha.

Below are some of the render test I did when experimenting with different parameter values.

• 

• 

• 

• 

• 

• 

• 

• 

And here is the final look for the bullet trail effect.

Muzzle Flash

Similar to the 2 previous effects, I created the muzzle flash from a primitive object – a low-poly sphere to be exact. I modified the sphere into the shape below and applied a ‘Subdivision’ modifier to smoothen the shape.

I animated the muzzle by manipulating its size and adjusted the animation curve in the Graph Editor for smooth transition from fast to slow motion movement.

I then applied the same material as the spark effect which has emission on its own.

Final Compositing

Next, I imported the muzzle flash into another shots and noticed there were some visual errors on the muzzle effect when rendered. It’s like the effect was clipped or masked on the character shape.

After checking several places, I found the problem came from the layers and the ‘Convert Premultiplied’ in Alpha Over node when compositing the background and foreground layer. So, some tweaks need to be done. The ‘Convert Premultiplied’ don’t work well with object that has glowing effect or soft transparency like the muzzle.

I can disable the ‘Convert Premultiplied’ to fix the problem with the muzzle, but that would then caused a problem with the character. I need to keep that option active in order to get a smooth alpha blend for the character with the background footage. So I created another scene collection and layer just for the muzzle to separate it in compositing and render.

In the compositing window, I created a new ‘Render Layer’ node for the Muzzle layer and another ‘Alpha Over’ node without the ‘Convert Premultiplied’. I then combined the old ‘Alpha Over’ node and the Muzzle’s ‘Render Layers’ that I just created to the new ‘Alpha Over’.

This way, all objects and character in the foreground layer will be blended properly with the background using ‘Convert Premultiplied’, while the muzzle will be rendered separately without ‘Convert Premultiplied’.

And below is the result

As a final adjustment to the compositing, I added the ‘Bright/Contrast’ node to the Foreground Render Layers to change the brightness and contrast of the character so that it match with the background footage. I also added ‘Blur’ node to the Background Render Layers with animated Gaussian values to add focus and depth illusion when the character is closer to the camera.

Final Render

I applied the same process and steps to all shots and below are the final render.

Week: 7 – 13 June

With less than 2 weeks before dateline, I was very eager to start with the character animations phase that I targeted to animate at least 2 or 3 shots this week even though there were still some shots that have yet to be tracked. I want to do something different than tracking this week after the ‘Camera Tracking Mayhem’ last week. So doing animation could help me to refresh my mind a bit. Since I had about half of the shots tracked, I can slip to animation and see if I discover any problems quicker so I still have time to make any changes.

I decided to begin with Shot11 first. In this scene the character (Zeo) will dodge bullets several times and jump while spin his body slightly in slow motion towards the end of the shot. I don’t actually recorded the video in slow motion, but with the visual and camera movements on second half of the video, I think I can just animate the character with fake slow motion without looking weird when combined with the non-slow-mo video.

First thing I did was to match the size of the character with the environment by scaling the camera group with its tracking markers. The markers position on the floor was already correct, so to scale the camera properly without making the markers going below the floor, I cannot simply change the camera size using its own pivot but from the center grid. A bit different than Maya & 3dsmax, Blender has something called 3D Cursor that we can place anywhere and use as a temporary pivot. So I used the cursor by changing the ‘Transform Pivot Point’ to ‘3D Cursor’ which located at the center and scale from there.

Then I began making the key poses for the character. I used ‘Auto Keying’ to automatically key any changes I made to the controllers and bones.

During this process, I referred the actions and poses that I’ve chose from the Killer Bean animation.

After I got every single pose I want, I locked the full-body pose by selecting all the bones and controllers and keyed them by pressing ‘I > Location & Rotation’. This method was to prevent it from changing when I alter any next or previous key poses. I also changed the F-Curve interpolation to ‘Constrant’ (step) so I can focus on the blocking poses and not distracted by the in-between motion.

I continued making all the key poses and below are some of them.

I exaggerated some poses to make the action more visible during fast movement.

And of course the exaggeration was not pretty on different angle.

During the blocking process, I’m not really focus on the timing yet so it may off a bit. I will adjust the timing more during the splining phase. Below is the first blocking of Shot11.

Next, I proceeded with Shot10 and then Shot09, Shot08 and Shot07. It seem now that my animation flow was animating from back to the front. But I think that’s okay since it is the last few shots that have a lot of elements that I want to highlight in my showreel. So in a worse case scenario if I didn’t manage to finish all the shots, I would have the last few shots that I wanted ready before the dateline.

For all those 4 shots, the animation process was almost the same as what I did with the Shot11 before and below are the blocking videos:

While doing the blocking, I did go back and forth to some of the shots to match the continuity of the first and last poses.

Week: 31 May – 6 Jun

This week I worked on the camera tracking for the shots that were confirmed last week. I did the tracking in Blender using the knowledges that I learned in the Week: 26 Apr – 2 May.

At this moment, I also volunteered to do camera tracking tasks for the collaborative indie film project to help the team since they were struggled to track the blurry footages. So the timing was quite right as my mind was only about camera tracking this week although both projects are using 2 different tracking software which are Blender and 3D Equalizer.

I have 12 shots for personal project and 8 shots for the indie film project to track. So I called this week as ‘CAMERA TRACKING MAYHEM WEEK!’

I managed to track several shots of that project and currently I’m trying to solve several remaining shots. I can feel that I’ve starting to grow interest in camera tracking. It is something that I didn’t expect as I don’t really like it before. I also considered camera tracking was my lowest capability.

For the tracking process, I began with the shot that I thought was the easiest first to warm up and then I jumped to shot11 which I considered as the hardest. And, it turned out to be true. I spent almost a day to solve the camera that has a shift of position, level and perspective. I can tracked the first half of the video quite nicely but the second half still has several vibrations toward the end.

After numerous tries, I decided to not wasting more time and moved on to the other shots since the character will actually jump in the air and not touching the ground anyway during the second half of the shot11. I may try to fix the camera again when animating the shot.

Below are the footages that I managed to track this week. Some of them were quite straightforward to track and I managed to solve them within first or second try.

After using both software in the personal and indie film project, I can say that tracking in Blender is quite easy to do compared to 3D Equalizer since Blender is also a full fledge 3d software so I can quickly jump into 3d layout, adding, modify object and animation on the fly.

Blender tracking is quite limited in functions and settings, but it still able to track quite nicely. 3D Equalizer on the other hand feel a bit clunky to use with its rather odd interface. It can only perform ‘undo’ function for certain functions of the software, but still, 3D Equalizer is very powerful with more robust parameters and settings to accomplish high quality tracking, which making it one of the industry standards for tracking and matchmove.

Week: 24 – 30 May

Early this week, I managed to re-shoot the video plates to replace the rejected version recorded last week. I get up early in the morning at 5 o’clock as last time to avoid the crowds that coming out to go to work and school.

This time, I chose another place near my flat that was visible to the early morning light and not covered by the building’s shadow. This is to prevent the problem with the last videos where I need to increase the camera brightness which cause over expose to the other already bright areas in the video. With properly lit location, I can also get lower ISO as possible to prevent grainy videos.

I carefully shoot the videos. The location of the video is actually one of the main path for people to walk to go to work as there are several offices around this place. There is also a gym that is open early in the morning, and during the shooting there were already several people coming to exercise there. I cannot spend too much time to shoot as more and more people started passing by. I shoot as many variations as possible when there is no / not many people around.

After the shooting, I did a quick editing on my computer to check the scene. This time I’m very satisfied with the result as it has good camera angles, movements and overall, consistent brightness throughout the videos.

I cut each shot with the intended duration and exported them with extra 10 to 15 frames each as a safe frames for final cutting later. I will use this version of background plates for the camera tracking process in Blender next.

Week: 17 – 23 May

This week, I didn’t spent much time working on my personal project since I’m a bit busy with the collaborative indie film project.

I actually planned to (and should have) finalise the scenes and actions for the storyboard as soon as possible so I can shoot the background plates (video footages) for the camera tracking process. I thought long and hard to design a good actions sequence for the story but I still don’t have any concreate idea for this. I felt a bit stuck that I finally decided to follow some of the actions and shots from the old Killer Bean animation since the motive of my project was not to design the choreography but to do character animation and camera tracking.

I quickly referred the Killer Bean animation and drew a new rough story sketches to finalise the actions, the number of shots, angle and camera movement for the video shooting. There will be 12 shots, and I targeted it to have a duration of 30 seconds maximum for whole animation.

I woke up as early as 5 am in the morning to shoot the background plate videos to avoid the crowds and people that coming out in the morning to go to work and school. I shoot the videos using my iPhone only since I don’t have any better camera equipments. The angles were based from the story sketches I did last night. I made several variations and alternatives for each shot as backup.

Right after the shooting, I went to my computer and I made a quick editing see the result and how the shots coming together. Honestly, I’m not satisfied with the video. The location was not very good and since it was in between two buildings, the area was under the shadow which forced me to increase the camera brightness during shooting and made the other already bright areas to become over exposed.

I planned to do a re-shoot in another day, probably during the weekend or early next week.