tracking summary in short !!!!!

[Anonymous]

hi
herez a brief discription on how trackers work!

2D TRACKER

1)1point- PAN or TILT shot…
when there is only horizontal or vertical movement in a shot. from point a to point b in x n y axis !
2)2point- ZOOM and ROTATION
when your shot scales or rotates u need to track 2 points in space to calculate the zoom and rotation changes in the shot.
3)4points- CORNER PINNING
when u need to track a surface to a plane in perspective
u corner pin the four suraface edge points and track them.

3D TRACKER-

1)NODAL PAN- it gives u a 2.5d tracking solution to pan shots with a very little parallax bcoz the matchmove considers the shot as good as a 2d shot n hence thinks that all the objects are at a same z space n as a result it gives u a point cloud with a spherical plane due to the rotation of camera…….
2)FREE MOVE SHOTS- such shots include parallax in them
ur matchmove engine will solve them on the basis of the filmback, focal length, and the survey data u provide it. these are generally complex shots. u need to do an automatic tracking first (manual optional), the track engine will generate locators in 3d space and give u depth.
locators are track markers or reference track points u analyse. then after tracking u need to select the locators and calibrate them, refine them and define a coordinate system with origin and give 2 axis reference to the engine.
1 origin point and distance between 2points in x axis and y axis.
after your coordinates are set u define relations between points as stated earlier.
example points that share same x , y axis. then export it to an animation package and test by making checkerboard plane for each of the xyz axis!
if u get it right here then u can do set layout and finally composite it in a compositing package!

here are some oints i would like to highlight..
i know its pretty basic but it will help out beginners n others who are confused in this tracking logic

1)focal length n camera aperture together gives us the field of view
camera aperture is the opening in the camera measured in inches
focal length is the opening in the lens measured in mm
it is also te distance from the optical centre of the lens to the sensor…
together they give u a field of view measured in degrees…

2)parallax ( zoom shots ) – it is the expansion n contraction f the objects in a relationship
check out the fg n bg objects … notice how they change in relation to each other
nodal pan – ( pan shot ) – there is no parallax as none of the objects are expanding or contracting

3) to do a successful 3d track u need at least 9 points.. on 3 planes….

4)coordinates – it is used to tell the camera the orientation of the scene
relations – it defines the relationship between track points

5)tracking problems

please see that there are at least 9 trk points visible
use a 3d track point instead of 2d track point in 3d track
+ sign tracker works well as u can track the corners of the +
a circle changes shape as it rotates or defocus
triangles works well for a 3d as it froms a triangulation
try to increade the contrast of the footage before tracking
increase the size of the search n reference areas in case of moton blur
track the plate from the frame it is in focus incase if there it shifts focus… u may have to do forward n backward tracking
track in parts for occlussion.. then join the track curve from various trackers

6)automatic tracking
please do mask out the fg or bg object you dont wish to track ..
u can import image based mask from other applications
predictions show the 3d position of the 2d features that were used to calculate the camera
yellow points are 2d features visible in current frame
cyan are the features not found in the current frame
predictions exist for the entire length of the sequence even when the features they represent are out of shot
bojou has a y up coordinate system…

7) target tracking
when something goes out of the automatic trackers reach then u go for target tracking
or if u have sufficient survey information then go for target tracks

8) on set information –
please shoot grid for distortion reference ( optics compensation ls )
please place the track markers at places where it will not overlap the foreground object otherwise it will take days n days to
mask out the tracking markers
there should b at least 9 track markers visible
there should b three sides ( planes ) with 3 trackmarkers for correct tracking…
putting the wrong type of trackmarks at wrong places will make a shot impossible to composite even if
it might appear very simple
for shots requiring 3d track you must place or arrange the track markers in 3d space that is some before the
artist n some after the artist in various depths n sizes.. half cut tennis balls are preferable for outdoor tracking
please measure the distance between 2 track markers horizontally n vertically
please take care of tracking when the plates are being defocused n rack defocus

9) camera info

film back n focal length of each vfx shot
the distance of the camera from the subject
the lens aperture, the shutter angle n shutter speed, camera angle, height of the camera from ground
the type of camera used
any special type of lens, rigs, steadicams
the lens used
filters used if any
the exposure n the iso value of the camera
tilt angle
put a 3d cube or any object in scene but plese measure the size of that object
camera model
camera mount
film stock

10)lighting

please tell us the light direction
you can actually take pics of all the lights so that the compositor will know the light direction
please mention the type of lights that is hardlight, softlight or diffused fill
there should b no shadows on screen

11)planar tracking is very different from point tracking
mocha monet do planar tracking
here u use mask to calculate the perspective n the position of any planar object like screens or banners or billboards or mobile screens
u have to draw splines n then track them … later u can do adjust ….

so planar tacker is used to track planes n surfaces whereas point tracker is used to track objects n track the scene….

PLEASE DO FEEL FREE TO CORRECT ME
I M PROVIDING THIS INFO ON THE BASIS OF SOME RnD I DID FOR YEARS n thanks to fxphd and MR. BEHRAM PATEL, who taught me …. he is currently woking for pixion studios, mumbai and he is one of indias best faculty for vfx….
to b very honest three years ago i didnt knew a thing about vfx….
n today i supervise vfx shoots…
thanks fxphd….

for some this might b pretty basic but for others it might help… those who want to know basics of tracking….
adolf
[email protected]

[Brianne Guizar]

Hi there,

Great information.

Just wanted to know normally one would need the film back or the focal length so that the tracking software can figure out the missing information (film back or focal length)

What do you do if you do not have either and if you know the camera can you figure out the film back.

I shot some footage on a HDV camera and the CCD Sensor is 1/2.9″ (Sony HDR-HC1) but my question is how to convert this information to film back units (inches/mm ) so that I can plug it into the tracking software as I didnt take down the focal length when shot.

Any help would be great and thanks for the information.

Cheers

[Ron Dohanetz]

Couldn’t have put it better myself. Basics well and truly covered, very helpful. Thanks!

[Pa Triant]

bojou tips

bojou
1) bcause of lens distortion the tracker cannot track the edges as the distortion is prevelant at the edges of the frame.
the amount of distortion increases from the centre to the edges

2)whenever u track a nodal pan the translation x y z values are 0 and the rotation values are present as a nodal pan is rotation n not free move

3) if u have to track the fg n bg in the same shot then first track bg. mask out fg and bojou will gv u the focal length, etc.
then invert the mask and add the focal length which bojou gave u from bg track. then solve
exports- fg track- static camera moving scene
exports-bg track- moving camera static scene

4)Nodal pan shots are pure rotation and so they contain no parallax. Foreground objects do not appear to move
relative to background objects and so there is no way of knowing the positions of these objects in 3D space. When
boujou tracks shots like this it assumes that all 3D points are an equal distance from the camera’s centre of
rotation.

5)Because there is no depth information in the scene, all of the 3D predictions have been placed at an equal
distance from the camera in a nodal pan. This results in the point cloud appearing as the surface of a sphere with the camera
at the centre.

6) target tracks-You can find out
exactly what the tracking scores are per frame by right-clicking on the Timeline and selecting Properties from
the sub-menu.

7)go to 2d task in the menu bar and then do target track- check in timeline n by right clicking the properties of a track in tl.
then do a camera solve for that track

8 )To smooth the camera path click on the Camera Tracking button in the Toolbox again. This time set the Camera Tracking Mode to
Adjust Only and set the Amount of adjustment to Typical. In the Advanced solve refinement section of
the dialog select the Optimize camera path smoothness option. Click on the Start button.

9)The Non-Consecutive Feature Tracker in boujou three can match features in two images that are separated by
more than one frame. This is very useful if your scene contains an object that goes out of shot and then comes
back in later, or if a foreground object moves in front of the lens and cuts all of the background tracks.

10)Gold Tracks
A good way of increasing the number of feature tracks is to make some of the good tracks gold (right click on a
track and select gold from the menu) and then do the feature tracking again. Each time you do this more feature
tracks will be created (the gold tracks are being used as a guide for the automatic tracking). You can check the
number of feature tracks that have been created in each tracking pass by looking at the Feature Tracking Info
window. Keep repeating this process until the number of feature tracks does not increase significantly and then try
camera tracking.

11)Manual Locators
Add a manual locator over the problem frames before feature tracking. A manual locator is like a feature track
that you create by eye, one frame at a time. It is defined as a gold track by default and can help to guide boujou
automatic feature tracker through the problem areas. Manual locators are particularly useful if your sequence
contains several frames of motion blur. An animator will probably be able to judge how a feature should be moving
during motion blurred frames quite accurately, and so by adding some manual locator tracks the user can help out
boujou’s automatic tracker.

[Anonymous]

hi how are you

[Author]

Posts