The 1st stage differential upload is to upload a .gpg file to add, update or delete records. The UPDATE_MODE and STATUS fields are used to give information to do differential upload. 1.Organizations allowed for DIFF upload- The registries thats upload donors with GRID
- All registries and CBBs upload CBUs
2.How to create the .gpg file 2.Expected behavior
Differential Update cases | DONOR Behavior (The validation of ID will be improved after GRID become compulsory) | CBU Behavior |
---|
Add new records when STATUS is "AV" or "TU" or "RS". | - Valid records with not existing ID and GRID will be added
- Valid records with not existing ID but duplicate GRID will be rejected.
- Invalid records will be rejected.
| - Valid records with not existing ID will be added
- Invalid records will be rejected.
| Update existing records when STATUS is "AV" or "TU" or "RS" | - Valid records, and no GRID duplication will be updated
- Valid records with duplicated GRID will be rejected.
- Invalid records will be rejected, and existing record with same ID in database will be deleted
| - Valid records with existing ID will be updated
- Invalid records will be rejected, and existing record with same ID will be deleted in the database.
| Deleted records when STATUS is "DE" | - Record exists in database will be deleted.
- Record does not exist in the database will generate a warning.
| Records existing in database will be deleted. Records do not existing in the database will generate a warning. |
3. Business validation rulesReference number | Validation level | Validation Source | Date rule is valid | Effective since XSD version number | Filed Name | Error in field | Reported Validation message | Action |
---|
9 | File |
|
| 2.0 | UPDATE_MODE | Invalid update mode | Your file has been rejected as the UPDATE_MODE must be equal to "FULL" or "DIFF". | Reject file | 222 | File | WMDA |
|
| UPDATE_MODE | Invalid update mode for multiple inventories | Your file has been rejected as we have identified mixed update modes in your XML inventories. | Reject file |
|
|
|
|
|
|
|
|
|
4. Errors and warnings in the processing reportReport Code Block |
---|
theme | Confluence |
---|
title | Example report of Differential upload |
---|
| File: ION-0999-D.gpg 2019-09-09 11:39:22
Pool(s): 0999
Content Type: D
Update Mode: DIFF
Start processing: 2019-09-09 11:50:00
Schema version: 2.1
Total records processed: 14
Total records with warnings: 6
Total records rejected: 3
Total valid records: 8
Total updated records: 4
Total new records: 4
Total deleted records: 2
List of Records with duplicated ID or GRID:
POOL: 0999
GRIDs:
1234000000000203420
W | 0999 | TD-000002 | N/A | (Warning) GRID 774800006001853603 must be 19 characters.
W | 0999 | TD-000003 | N/A | (Warning) GRID 7748000060018E53612 checksum is not correct.
W | 0999 | TD-000010 | 1234000000000001031 | STAT_END_DATE (Warning) Status end date cannot be > 5yrs in the future.
W | 0999 | TD-000010 | 1234000000000001031 | STAT_REASON (Warning) Status reason cannot be provided with status AV or RS.
R | 0999 | TD-000013 | 999900000TD00001129 | BIRTH_DATE (Record Rejected) BIRTH_DATE is a mandatory field.
W | 0999 | TD-200006 | (Warning) Record with DE status does not exist.
List of deleted records
D | 0999 | TD-000005
D | 0999 | TD-000011
Processing finished at: 2019-09-09 11:53:55
Total processing time: 3 minutes. |
The processing report for differential upload has 4 parts. - 1st part is the summary of the file upload.
- 2nd part is the duplication in the uploaded file, data uploader should clean up the duplication.
- 3rd part is the rejections and warnings. Data uploader should clean up all of them.
- 4th part is the list of the Deleted records. It is for information, and no action is needed.
Summary numbers: We define some cases: DE non exist: (Warning) Record with DE status does not exist." as ". GRID DB Dup: Duplication of GRID comparing existing GRID in the database with different ID. (Will be improved after GRID become compulsory)
Total records = Total records rejected+Total valid records+Total deleted records+DE non exist Total valid records = Total valid records+Total new records Total records rejected=Records with duplicated ID or GRID in part 2+ R in part 3 + GRID DB Dup
Record Errors/warnings:Type | Message | Description |
---|
RecordWarning | Record with DE status does not exist. | When a record is with STATUS "DE" in differential upload file, but this record dose not exists in database |
|
|
|
|