SSIS Control Flow Chart


Tables used for Anonymization Process

@IDMS_ANM_CONFIG

Contains the data to be processed

ColumnDescription
U_IDMS_EntityNameContains the table name that is going to be processed by an action
U_IDMS_BPKeyNameContains a 'where clause' to be used in the action query. The @@CardCode is going to be replaced by @IDMS_ANM_DATA.U_IDMS_BPCode
U_IDMS_EntityFieldNameForAnonym

Contains the name of the field or a list of field names that are going to be processed by an action

C: filepath

U_IDMS_FindValueToReplaceIs not NULL only if the action is 'C'
U_IDMS_Action

A: Anonymize

C: Change

D: Delete

E: File List to Delete

U_IDMS_Note
U_IDMS_Order

@IDMS_ANM_DATA

ColumnDescription
U_IDMS_BPCode
U_IDMS_AnonymizationRequestFlag
U_IDMS_AnonymizationRequestor
U_IDMS_CallbackinfoUrl
U_IDMS_AnonymizationRequestTimestamp
U_IDMS_AnonymizationLastExecutionResult
U_IDMS_AnonymizationLastExecutionResultTimestamp
U_IDMS_AnonymizationLastExecutionResultNote
U_IDMS_ExecutionCount

@IDMS_ANM_AUDIT

Contains the processed data, serves as an archive

ColumnDescription
U_IDMS_BPKey@IDMS_ANM_CONFIG.U_IDMS_BPKeyName
U_IDMS_EntityName@IDMS_ANM_CONFIG.U_IDMS_EntityName
U_IDMS_EntityKey@IDMS_ANM_DATA.U_IDMS_BPCode
U_IDMS_EntityFieldNames@IDMS_ANM_CONFIG.U_IDMS_EntityFieldNameForAnonym
U_IDMS_ExceptionMsg
U_IDMS_ActionThe action that led to this table's data 
U_IDMS_CreateDateThe date when the process took place
U_IDMS_SSISExecuttionID


@IDMS_ANM_FLIST

Contains a list of files to be deleted

ColumnDescription
U_IDMS_FilepathThe data comes from @IDMS_ANM_CONFIG.U_IDMS_EntityFieldNameForAnonym, which in this case is a filepath
U_IDMS_CreateDate
U_IDMS_DeleteDate
U_IDMS_IsDeleted


Process Anonymization

  • The BPs to be anonymized are the ones with OCRD.U_IDMS_AnonymizationStatus=1.
  • The value of the field @IDMS_ANM_CONFIG.U_IDMS_Action signals which action needs to take place for each record ("E", "D", "A", "C")
    1. "D": Action Delete
    2. "A": Action Anonymize
    3. "E": Action List Files to Delete
    4. "C": Action Change
  • Anonymize: Replace 2 random characters in the value-field contained in "U_IDMS_EntityFieldNameForAnonym", update "U_IDMS_EntityName" with the anonymized value and insert into @IDMS_ANM_AUDIT the pre-organized value
  • Delete: Delete from @IDMS_ANM_CONFIG.U_IDMS_EntityName with @IDMS_ANM_DATA.U_IDMS_BPCode and insert the original record into @IDMS_ANM_AUDIT 
  • Change: Update the table @IDMS_ANM_CONFIG.U_IDMS_EntityName and set the column @IDMS_ANM_CONFIG.U_IDMS_EntityFieldNameForAnonym = @IDMS_ANM_CONFIG.U_IDMS_FindValueToReplace and insert the original record into @IDMS_ANM_AUDIT
  • List File to Delete:

Process History Tables Anonymization

The same Process, but in this case all entities are history tables

Process Result

  • Upon success, @IDMS_ANM_DATA is updated, as well as OCRD (OCRD.U_IDMS_AnonymizationStatus = 2)
  • Upon failure ,  @IDMS_ANM_DATA is updated, with an execution message also included



  • No labels

0 Comments

You are not logged in. Any changes you make will be marked as anonymous. You may want to Log In if you already have an account.