Blog from July, 2017

You have been previously informed on the development work BMDW is performing to improve the donor/cord data submission services. The development includes mainly the following features:

  • Acceptance of a different file format (XML)
  • Streamlined web-based BMDW data upload service
  • Processing and validation based on the XSD files
  • Improved reporting and downloading functions

As part of these changes we have been communicating the XML schema definitions files before and a proof of concept upload platform was used by some users to upload their test XML files. All those users have received the validation results and revised test XML files can be uploaded again on the new BMDW data upload service later today.

  • If you received login details of the previous test upload platform, you will get a welcome email today with instructions how you can access the new BMDW data upload service.
  • Also people who requested already access before or who sent their XML file by email, will receive the welcome email with instructions.
  • If you also finished your test XML file and would like to get access to the BMDW data upload service, please send us an email to support@bmdw.org . We will then create an account for you and a welcome email will be send to gain access to the service.

Important file requirements (also described in the new manual on BMDW public access)

  • All files need to be encrypted with the new BMDW public key
  • Files larger then 200Mb needs to be compressed by ZIP
  • File naming should be in accordance with the guidelines

PLEASE NOTE: The existing public key for submitting .dot 20 format files for production remain unchanged. The new key is only for XML files.

We are still working on the automatic data upload method through an API connection to the new data upload service. Once we have completed that development, we will be in touch again with relevant details in order for organisations to use this method for submitting their XML files.

We would like to encourage all organisations to start uploading their new XML file to this data upload service as it gives your organisation the opportunity to make relevant changes to the XML prior to going live. This is also very valuable for our development work as with testing files we can validate our work and resolve as much issues as possible. Please be aware that the new BMDW data upload service is running on a development server. Therefore, you may notice outages, changes to your data, or even find some functions broken and giving errors. These potentially issues are either due to new functional deployments taking place or their being a bug in the software. If you do come across any bugs or defects, please do report these as well as any other feedback by sending an email to support@bmdw.org.

Our new data upload service is almost ready again for our users to upload test XML files. We expect that we can open the service for users at the end of the week.

Please be aware that this service is running on a staging environment and developers are also still working on some features. Therefore, you might experience changes over time.

  • If you already uploaded data through the test upload platform (Pydio) before, you will receive information how you can login to the new service.
  • If you haven't used the test upload platform before, but you have a test XML ready for upload, you can request login details by sending an email to support@bmdw.org

We will update you as soon as the service is available.

Last week, we finished the third sprint of our development. The new data upload service is now almost ready again for our users to upload their test XML files again. We just have to resolve some minor issues and finalize the corresponding user guide. We expect the upload service to be ready at the end of this week.

Furthermore, the first parts of the processing pipeline have been developed. Overall, this includes the following: after upload of an encrypted XML file, the pipeline will pick-up this file, decrypt the file, unzip the file, and check if the file is an XML file.

The next sprints will involve the implementation of all validation rules. This work is very critical and exceeds several sprints.

We will update you again in about two weeks.

A large part of the phase two development work includes the redesign of the new pipeline, which involves the process of accepting, processing, validating and exporting of data in the new XML format. This development is divided in so-called sprints of 2 weeks each. We have finished the first two sprints. During these sprints, our developer delivered the development and test environment and partly the data upload platform. We hope that the new data upload platform will be ready for upload of test XML files at the end of next week. Furthermore, we are now working on the processes of screening all the workspaces in the upload platform for new files, extracting the new files from the data upload platform, and unzip and decrypt the files.

We will update you again in about two weeks.

We just finished the server migration of the BMDW Search & Match Service and it is up and running again.

Due to the merging of BMDW with WMDA last January, we decided that all servers should be affiliated to WMDA. Therefore, the new web address for the BMDW Search and Match Service will from now on be search.wmda.info. For a short period of time the old web address (search.bmdw.org) will be redirected to the new address. If you have bookmarked the old address, please change this to prevent any problems when we switch of the redirect.

If you are experiencing any problems after the maintenance, please contact us through support@bmdw.org .

Thank you for your patience.

Maintenance BMDW Search & Match Service at 10th of July

BMDW Search & Match Service system has been scheduled for a maintenance on the 10th July at 11:00 CEST. The system will not be available for approximately 2 Hrs. We would advice users not to use the system between 10:45 - 13:00 CEST on the 10th July 2017 to avoid any data loss or interruptions in your searching processes.

A new version of the XSD schema files have been published which can be found within WMDA share -BMDW Public access page.

The reason for this update was that for proper functioning of the new data processing process, we need to know which version of the XSD schema files are used by the listing organisation to create their XML files. Additionally, also certain business rules might be only applicable to specific versions. 

To elevate some of your concerns around having to adapt your present XML files to the new XSD changes, we have made a conscious decision to accept XML files based on 2 versions of XSD schema files, i.e the current version and previous version. Any XML files without schema version are assumed to be based on version 2.0.

If you haven't started your implementation to create XML files, please use the latest version 2.1.

We have validated all test XML files received through the data exchange platform during the proof of concept period.

All organisations who sent their test files, should have received an analysis report as well as an error report. If you have previously sent a file, but haven't received the analysis report, please contact us through support@bmdw.org.

Please be aware that we only validated your XML files against the XSD schema files with some additional manual check. The specific BMDW business rules cannot be validated yet and it is possible that records that were accepted now, will be rejected later due to these additional validation rules. As soon as we can also validate the BMDW business rules, we will test files again.

Currently, we are working to develop the new (and final) upload platform. We anticipate using the new upload platform in the next two weeks. You will be informed with instructions and new credentials as soon as you can upload the updated test XML files following on from the error reports provided by us.

Thank you for your patience and we will notify you about any updates as soon as possible.