...
Status |
---|
...
|
...
This work instruction is subject to change because WMDA is developing and improving the infrastructure.
|
...
Table of Contents |
---|
Introduction
There are two ways to upload data for listing in the Search & Match Service:
- manual upload (described below) and
- automatic upload where a connection is established between computer system, so called REST API. The manual for the automatic upload can be found here.
If the data are received they are processed and available for search coordinators and transplant physicians who use the Search & Match Service for search.
This is a technical work instruction, feel free to contact us if you need any support or if you do not understand the work instruction. Our e-mail address is: support@bmdwsupport@wmda.org.info
Definitions
PGP | Pretty Good Privacy (PGP) is an encryption programme that provides cryptographic privacy and authentication for data communication |
XML | Extensible Markup Language |
, a structued file format |
API | Application Programming Interface (API) |
: a set of clearly defined methods of communication between various software components | |
ION | Issuing Organisation Number (ION) which is provided by ICCBBA to organisations listing in the Search & Match Service You may lookup IONS in the list of organisations maintained by WMDA |
XSD | XSD defines what elements and attributes may appear in an XML document; annually a new version of the XSD will be released; the current version is: 2.1 |
Purpose
This work instruction describes the manual upload method of an PgP/GpG encrypted XML file through the new submission platform. As part of continuous effort to streamline and enhance functionality for our registry users, WMDA have been developing the new data submission services in line with the file format transition from .Dot20 to XML. The automatic upload method via a REST API [1] will become available later as well as the corresponding manual.
General concepts:
General concepts:
- Only organisations that have an ION (listing organisations) will be able to upload
- Only organisations that have an ION (listing organisations) will be able to upload
- The usernames are your email address that you have requested to be added in our database as Data Uploaders
- Every organisation that is listing only donors or only cord blood units is allowed to have two dedicated accounts. If an organisation is listing both donors and cord blood units, they are allowed to have a maximum of four accounts. Multiple accounts of one organisation share one Workspace, but every user has its own login details.
- The platform is organised in so called 'Workspaces'. This Workspace is a private space for each organisation where files can be uploaded and processing reports become available.
- If your organisation submits data on behalf of other registries then as an uploading organisation you will only see one Workspace where you can upload files for other registry(ies) that you are affiliated with.
- Uploaded files should follow the XML guidelines as described in the Data submission information.
...
- Files should following the file naming rules as described in the Search & Match Service (formerly BMDW) Data submission information
- XML files larger than 200Mb should be compressed using ZIP (How to compress your file with ZIP can be found here)
- Only files with the .pgp and .gpg extension will be accepted for upload.
- XML files should be encrypted with a public key (How to encrypt a file can be found here)
...
- here)
Getting started
Accessing the data submission platform
We have 2 variants of the data submission platform :
- staging-dataupload.wmda.info : here organisations can upload their data for testing purposes and check their dataquality, before moving to
- dataupload.wmda.info : here production data is uploaded, which is permitted only after QA inspection by WMDA.
You can access the data submission platform through the web. You can access the web address (or URL) by entering the address: https://staging-dataupload.wmda.info/.
...
- As a new user, you should have received a welcome email that includes a link to the data upload service and instructions to set your password.
- Click on the link and then on the 'Forgot your password?' link.
- Fill out your email address and click on OK. You will now receive an email with a link to reset your password.
- Click on the link, choose your own password, confirm this password and click on the OK button.
- Go to https://staging-dataupload.wmda.info/ to login (Figure 1) If you just have set your password, the system should return you automatically to the login page.
- Within the login page you can optionally change your language by clicking on the flag just besides 'Enter login/password':
- You can also save a bookmark in your browser, e.g. for the data upload service, so that you are immediately directed to the login page rather than having to enter the URL.
- Enter your email address and your password.
- The system defaults to your personalized Workspace, where you will find your organisation Workspace and all other folders like notification and archived folder.
Imagefloat | ||
---|---|---|
| ||
Change password or forgot password
...
Tip: If you haven’t changed your password for a long time, we recommend that you do so to ensure that your profile is secure. We recommend that you change your password every 6 months.
Imagefloat | ||
---|---|---|
| ||
Imagefloat | ||
---|---|---|
| ||
If you attempt to login more than 3 times with incorrect credentials the system for security reasons will ask you to enter a code that appears in an image as shown in Figure 3b.
Imagefloat | ||
---|---|---|
| ||
Logging off from the service
...
PLEASE NOTE: Do not simply close your browser; otherwise your unsaved data may be lost.
Imagefloat | ||
---|---|---|
| ||
Settings button |
Home
After logging in, you get the screen as shown in Figure 5. On your home page, you can perform the following functions:
Imagefloat | ||
---|---|---|
| ||
- Your name: On the top left corner. This is the name of the user that logged into the system
- Notification indicator: This is the bell that will highlight if you have any new notifications around the status of your uploaded file
- Setting button : This is the menu for functions like - Logout and Updating account details
- Search box: Useful when trying to find files, for example using a specific date
- My Workspace: Your own Workspace named with the ION of your organisation. In conjunction with your Workspace you also see two separate folders called Archives and Reports. For further details on the purpose of these folders please see section around Archive/Reports.
- Recent history of submissions in the middle main pane
...
When you login for the first time, the Workspace will be empty (Figure 6).
Imagefloat | ||
---|---|---|
| ||
|
Once you have used your Workspace to upload file(s), a new block will appear with your latest "Workspace activity" on the right hand menu. This menu shows the processes that your files have been through and also at what stage of the processing procedure the file is.
...
PLEASE NOTE: The time to upload your file to the system depends on the file size and your internet upload speed.
Imagefloat | ||
---|---|---|
| ||
Imagefloat | ||
---|---|---|
| ||
You are only allowed to upload files that are encrypted. If you try and upload files that are non PgP/GpG encrypted the system will give you an upload error as shown in figure 8b.
Imagefloat | ||
---|---|---|
| ||
|
Manage/Update existing uploaded files
...
- Within your Workspace select the file you wish to update/delete and click on the 'Delete' button/tab if you wish to delete file. You can also delete the file by clicking on the file with your right mouse button and select 'Delete' from the drop-down menu.
- The system will warn you to ensure if you really want to delete this file (Figure 9).
- If you click OK the file is deleted and will no longer be processed.
Imagefloat | ||
---|---|---|
| ||
|
PLEASE NOTE: Once the file has been added to the processing pipeline service the file will then move to the Archive folder. As a user you only have read/write access to your Workspace.
...
Scenario | Event stage | Description | Type of message |
File with wrong filename | The system will reject the file if the file name doesn't conform to the agreed format which is : ION-1234-D.PgP, ION-1234-D.xml.Pgp, ION-1234-D.zip.PgP, ION-1234-C.PgP, ION-1234-C.xml.Pgp, ION-1234-C.zip.PgP. | Rejected - ADD MESSAGE AS PART OF THE REPORT | |
If a user uploads two files consecutively with same file name. Eg ION-1234-D.PgP and ION-1234-D.PgP | In such a scenario the most recently uploaded file is taken through the pipeline, the previous file is deleted and not processed. | ||
If a user uploads two files consecutively with different file names. E.g ION-1234-D.PgP and ION-1234-C.PgP | In such a scenario the system will process the two files as separate files. | ||
If a user uploads a PgP encrypted file with a invalid key. | Decrypted | In such a scenario the system will not be able to decrypt the file and the pipeline will not be able to process the file. | Rejected - ADD MESSAGE AS PART OF THE REPORT |
If a user has uploaded a zipped file which isn't an XML | Decompressed | In such a scenario once the system has decrypted the file and finds the file isn't an XML the pipeline will not be able to process the file. | Rejected - ADD MESSAGE AS PART OF THE REPORT |
If a user has uploaded a file with the file creation time set in the future | XSD file validation | In such a scenario once the system has decrypted the file and finds that the file creation date/time is in the future then the pipeline will not be able to process the file. | Rejected - ADD MESSAGE AS PART OF THE REPORT |
If a user has uploaded a file with the file creation date and/or time in an incorrect format | XSD file validation | In such a scenario once the system has decrypted the file and finds that the file creation date/time is in an incorrect format then the pipeline will not be able to process the file. | Rejected - ADD MESSAGE AS PART OF THE REPORT |
If a user has uploaded a file where the listing organisation doesn't match the ION number in the file name | XSD file validation | Rejected - ADD MESSAGE AS PART OF THE REPORT | |
If a user has uploaded a file where the update mode is other than full | XSD file validation | Rejected - ADD MESSAGE AS PART OF THE REPORT | |
If a user has uploaded a file where the file name and content type do not match. | XSD file validation | In such a scenario once the system has decrypted the file and finds that there is a discrepancy in the file name content type and the file content type then the pipeline will not be able to process the file. E.g File name = ION-1234-D.PgP and the Content type = C | Rejected - ADD MESSAGE AS PART OF THE REPORT |
If a user has uploaded a file that has content type of both donor and cord | XSD file validation | Rejected - ADD MESSAGE AS PART OF THE REPORT | |
If a user has uploaded a file where the file version isn't correct | XSD file validation | Rejected - ADD MESSAGE AS PART OF THE REPORT |
[1] The specification is available at https://pydio.com/en/docs/references/api/v2#!/File/uploadStream
STANDARD OPERATING PROCEDURE | |||
| |||
TITLE: | Data submission protocol | ||
VERSION No: | 0.3 | ||
DATE OF ORIGINAL ISSUE: | March 2017 | ||
REVIEW INTERVAL: | 12 months (This includes the testing process) | ||
ORIGINAL PREPARED BY: | Manish Kakkar | ||
QM REVIEWED BY: | Quality Team | ||
AUTHORISED BY: | Chief Executive | ||
COPY and LOCATION | Master Copy – WMDA Share – DOCxxx | ||
Document Version History | |||
Version | Author | Changes | |
0.1 | Manish Kakkar | SOP generated | |
0.2 | Beer Holties | Update (Sprint 3/4) | |
0.3 | Jorine Koenderman | Release staging version (28-07-2017) | |
0.4 | Manish Kakkar | Updated post release to staging version (07-08-2017) |