In the previous exercises in this section you have prepared the Director Runtime to actually migrate Cards. You have:

  • Deployed the Source and Target Engine, copying the engine libraries to a common location 
  • Restarted the Director Track causing the Runtime to load your new engines
  • Run setup jobs to synchronize the Track and your engine. In this step the Track discovered the new Business Object Card as well as new Source System metadata, Views and Valuesets
  • Loaded the staging tables for Source System data, Views and Valusets


So now you are - almost - ready to execute the migration. Well, in fact you are, there is just a little thing you should note at this point. 


Parameters

You probably remember the Constants in Studio and how they came in two flavours:


Static
The value for the Constant is provided in Studio and 'baked into' the resulting engine
Runtime
The value is supplied in the Director at runtime


Before starting any new migration iteration it is prudent to assert that the current values for the Runtime Constants are set correctly. You can see and correct the values for these by selecting Source/Parameters or Target/Parameters in the Director menu. 


Here as an example are the Target Parameters:

 

In this case, the values of all the Parameters are correct, so you don't actually have to do anything. 


Process

The migration is a two step process involving Export and Import, entirely corresponding to the separation in Studio of the Source- and Target maps. 



The Source Engine is executing the Export, exporting the Business Object instances from the staging database producing the Export result for each instance:

  • Storing the Source Data extracted from the staging database
  • Storing the Export Result
  • Storing all Events fired

The Target Engine is executing the Import on the exported Business Object instances producing the Target result for each instance:

  • Storing the Target Result
  • Storing all Events fired


Note that up until now, we have been working with the Business Object as a blue-print for how the migration should work. Now we are switching to execution mode and applying this blue-print to actual instances of the Business Objects. 


Export Business Object Card

Select Source/Objects in the Director menu to display the Business Objects to Export



Card is present in the list but obviously no instances are exported yet. The meaning of the columns are:


Object
The Object is shown as a parent with one or more children. While this maybe makes less sense in this training setup, it does becomes useful if the copy function of the Source Map in Studio is brought into play.

This ability to copy a Business Object in the Source Map is not part of the exercises, but it was touched upon in the end of Exercise 2.7 - Map Business Object CardStatus. If the 3 copies of Account given in the sample in this exercise was part of the setup, Object: Account would have 3 children in the Objects list:
  • Object: Account
    • Current
    • Portfolio
    • Guarantee  
This would allow you to export each separately.
Source
The count of Business Object instances in the staging tables (as defined by the Break Fields on the Card Business Object in the Source Map)
Dropped
The number of Business Object instances dropped during the Export. The Business Object is dropped if a Severity Drop is assigned to a raised Flag when exporting a Business Object
Rejected
The number of Business Object instances that where Rejected during the Export by firing an Event with Severity Reject Root
Exported
The number of Business Object instances that where Exported successfully
Difference
Any difference between Source and the sum of Dropped, Rejected and Exported. Any difference indicates that not all Business Object instances have been processed


There are no dependencies in the export of Business Objects. If you exported all 3, Account, Card and Customer, the Director would submit 3 jobs to run in parallel, one for each. In this exercise however, you will only submit a job to export the Card Business Object


  • Select the Card Business Object
  • Click the Export button to show the Business Object Selection dialog


The Business Object Selection Dialog

With minor differences the Business Object Selection dialog is used to submit jobs several places in the Director interface. Let's have a quick look at it:



Available / Selected
Move Business Objects to the Selected box to include in the job(s) being submitted.
Key
If you know the key of a given instance of a Business Object, you can supply it here to process only this instance. The key is subject to an Sql like query and should at a minimum be pre- and suffixed with the Sql wildcard %.
Mode
Choose what to include:
  • All: All instances
  • Rejects: Only Rejected instances
  • Difference: Any instances in the Differences column
Wait for Debug
If checked, the job will be submitted but immediately pause until a debugger is attached. Allows you to debug your manual rule implementations.
Limit
Type a number to limit the instances processed by the job.
Fast Track
Only available when exporting. For each instance, the Director runtime will:
  • Execute the Source Engine
  • Execute the Target Engine immediately,
  • Only store the Target result. Unless the instance is Rejected, then everything is stored as normal
Profiling Level
The generated code is instrumented and in addition migFx provides you with the possibility to instrument manual rule implementations. If a Profiling Level other than None is chosen, this instrumentation is activated and will log elapsed time in the execution tree. Useful to locate potential bottlenecks if the migration is suddenly performing badly.


All you have to do is check that the Card Business Object is the only one in the Selected box and click the Submit button to submit the job.


You can follow the execution of the job in the Job list.


Import Business Object Card

Once the export job has finished it's time to do the import. Select Target/Objects in the Director menu.


The Objects list looks much the same as the Source/Objects list. The Exported column now shows the number of instances produced by the Export. But there is a fundamental difference between the Export an the Import. While there are no dependencies in the Export between the Business Object instances, there most certainly are dependencies in the Import.


Dependencies

These dependencies are the result of the Relationships between the Business Objects that were defined in the Target Map. After all, if a relationship from the Card Business Object to the Account Business Object is used to pick up a calculated value from an Account instance, this Account instance had better be imported before dependent Card instance.


The Director handles the resolution of these dependencies in several, different ways. First of all, there is the Full monty button. By clicking this you simply ask the Director to import everything automatically resolving the dependencies along the way. 


You can also import only a part of the Business Object instances by clicking the Import button to show the Business Object Selection dialog.


This selection dialog looks much like the same dialog for the Export above. There is one difference, though. Instead of the Fast Track option, the dialog now shows different options for handling dependencies, depending on whether one of more Business Objects are selected for Import


One Business Object selected
The Director will submit 1 job to import the instances of the selected Business Object. Any dependencies between the instances will be resolved.

A check mark in Include Descendants will cause the Director to include dependent instances of other Business Objects, even though these were not selected for Import
Multiple Business Objects selected
The Include Descendants checkbox is replaced with a drop down to select how the import should be executed

Separate jobs
The Director will submit one job per selected Business Object and not resolve any dependencies.

Use this option if you know there are no dependencies or that the iteration will not modify any values relevant for dependencies
One job (default)
The Director will submit 1 job to import the instances of the selected Business Objects. Any dependencies between the instances will be resolved.
One job with descendants
The Director will still submit one job to import the selected Business Objects  and resolve dependencies as above. But now the Director will in addition include instances of other Business Objects, even though these were not selected for Import


Dependency resolution is recursive. In fact, the Director runtime simply splits the import up into levels. All instances at a given level are imported before proceeding to the next level:

  • Level 0: Instances with 0 ancestors
  • Level 1: Instances with 1 ancestor
  • Level 2: Instances with 2 ancestors
  • ....
  • Level n: Instances with n ancestors


Do the import

In the case of importing the instances of Business Object Card, it's quite simple. While Card has relationships to both Account and Customer, we know that there are no Business Objects with any Relationship to Card. So you can just select Card for import and click the Submit button to submit the Import job. In this case it makes no difference if you check Include Descendants or not.


You can follow the execution of the job in the Job list.



What happened here?

After much ado leading up to this crucial moment it probably turned out to be quite boring to actually migrate the Card Business Object instances by executing the Export and afterwards the Import. But, hey! That's somehow the entire point of all this, to provide a consistent and complete toolset to deliver complete confidence and a logical approach to break down this highly complex problem domain - so in the end the task really ends up being trivial.


Take a moment to reflect on what happened here

  • The generated Source- and Target engines - with a bit of help from your manual Rule implementations - have executed exactly what you specified in Studio
  • All Events fired due to some Flag being raised have been stored together with the actual values from the migration to be merged into the Event text for presentation
  • The data extracted from the Staging database and used for the export for each Business Object instance has been stored
  • The Export result delivered by the Source engine for each Business Object instance has been stored
  • The Target result delivered by the Target engine for each Business Object instance has been stored

Of course, everything remains somewhat under the hood in the Director. In the next set of exercises you will start out by publishing the migration results in the Tracker.


But there are actually stuff available already in the Director: 


  • To to select either Source/Events and/or Target/Events in the Director menu to see an aggregation of the Events fired in the migration. Notice, that you here as well have an Export or Import button respectively, making it easy to redo the given migration step for a given event
  • On the Export or Import job in the Director job list, you can click the Events button to see a list of the Events fired, even as the job is running