Versions Compared

Old Version 30

changes.mady.by.user Zhihong He

Saved on

compared with

New Version 31

changes.mady.by.user Zhihong He

Saved on

Key

  • This line was added.
  • This line was removed.
  • Formatting was changed.

...

Panel
borderColorlightgray
borderWidth1
borderStylesolid
titleDifferential upload User Guide


The 1st stage differential upload is to upload a .gpg file to add, update or delete records. The UPDATE_MODE and STATUS fields are used to give information to do differential upload. 

1.How to create the .gpg file 

  • Following the same process in the FULL upload user guide  Search & Match Service Data Submission Information to prepare the differential upload .gpg file.

  • Changes comparing to current FULL upload (Will later be updated in the FULL upload user guide)

    Field IdentifierRequiredDescriptionTypeLengthComment
    UPDATE_MODEYesUpdate mode of the inventory, i.e. FULL or DIFFupdateModeType4

    "FULL" means for full upload
    "DIFF" means differential upload 

    STATUSYesStatus of the donor/CBUstatusType2

    statusType: "AV" ,"TU" ,"RS",  "DE" *

    AV = Available for transplantation purposes
    TU = Temporarily unavailable
    RS = Reserved
    DE = Deleted, permanently unavailable*

    *DE in only supported in DIFF upload, will be rejected in FULL upload.







2.Expected behavior


Differential Update cases

DONOR Behavior

(The validation of ID will be improved after GRID become compulsory)

CBU Behavior
Add new records when STATUS is "AV"  or "TU" or "RS".
  • Valid records with not existing ID and GRID  will be added 
  • Valid records with not existing ID but duplicate GRID will be rejected.
  • Invalid records will be rejected.
  • Valid records with not existing ID will be added
  • Invalid records will be rejected.
Update existing records when STATUS is "AV" or "TU" or "RS"
  • Valid records, and no GRID duplication will be updated
  • Valid records with duplicated GRID will be rejected.
  • Invalid records will be rejected, and existing record with same ID in database will be deleted
in the database.
  • Valid records
will
  • with existing ID
and GRID
  • will be updated
  • Invalid records will be rejected, and existing record with same ID will be deleted in the database.
Deleted records when STATUS is "DE"Records existing
  • Record exists in database will be deleted.
Records do
  • Record does not
existing
  • exist in the database will generate a warning. 

Records existing in database will be deleted.

Records do not existing in the database will generate a warning. 


3. Business validation rules

Reference numberValidation levelValidation SourceDate rule is valid Effective since XSD version numberFiled NameError in fieldReported Validation messageAction
9File

2.0UPDATE_MODEInvalid update modeYour file has been rejected as the UPDATE_MODE must be equal to "FULL" or "DIFF".Reject file
222FileWMDA

UPDATE_MODEInvalid update mode for multiple inventoriesYour file has been rejected as we have identified mixed update modes in your XML inventories.Reject file









4.

Error

Errors and

warning

warnings in the processing report

Report

Code Block
themeConfluence
titleExample report of Differential upload
File: ION-0999-D.gpg 2019-09-09 11:39:22
Pool(s): 0999
Content Type: D
Update Mode: DIFF
Start processing: 2019-09-09 11:50:00
Schema version: 2.1
Total records processed: 14
Total records with warnings: 6
Total records rejected: 3
Total valid records: 8
Total updated records: 4
Total new records: 4
Total deleted records: 2

List of Records with duplicated ID or GRID:

POOL: 0999
GRIDs: 
1234000000000203420


W | 0999 | TD-000002 | N/A | (Warning) GRID 774800006001853603 must be 19 characters.
W | 0999 | TD-000003 | N/A | (Warning) GRID 7748000060018E53612 checksum is not correct.
W | 0999 | TD-000010 | 1234000000000001031 | STAT_END_DATE (Warning) Status end date cannot be > 5yrs in the future.
W | 0999 | TD-000010 | 1234000000000001031 | STAT_REASON (Warning) Status reason cannot be provided with status AV or RS.
R | 0999 | TD-000013 | 999900000TD00001129 | BIRTH_DATE (Record Rejected) BIRTH_DATE is a mandatory field.
W | 0999 | TD-200006 | (Warning) Record with DE status does not exist.


List of deleted records
D | 0999 | TD-000005 
D | 0999 | TD-000011

Processing finished at: 2019-09-09 11:53:55
Total processing time: 3 minutes.


The processing report for differential upload has 4 parts.

  • 1st part is the summary of the file upload.
  • 2nd part is the duplication in the uploaded file, data uploader should clean up the duplication.
  • 3rd part is the rejections and warnings. Data uploader should clean up all of them.
  • 4th part is the list of the Deleted records. It is for information, and no action is needed.

Summary numbers:

We define some cases:

DE non exist: (Warning) Record with DE status does not exist." as ". 

GRID DB Dup: Duplication of GRID comparing existing GRID in the database with different ID. (Will be improved after GRID become compulsory)


Total records = Total records rejected+Total valid records+Total deleted records+DE non exist

Total valid records = Total valid records+Total new records

Total records rejected=Records with duplicated ID or GRID in part 2+ R in part 3 + GRID DB Dup


Record Errors/warnings:

TypeMessageDescription
RecordWarningRecord with DE status does not exist. When a record is with STATUS "DE" in differential upload file, but this record dose not exists in database



...