Data Interoperability Pipeline
Last updated
Last updated
The app's main functionality is sending data to Go.Data from a DHIS2 instance where the development of a disease outbreak has been tracked using Event Capture and/or Tracker Capture.
When we want to do so for the first time, we need to start by filling a blank Go.Data instance with the data recorded in a DHIS2 instance using this app. The first thing we need to do would be Setting Up the App, Configuring Mappings and then Configuring Tasks. However, if your system administrator has configured these for you, you only need to know how to run Interoperability Tasks. It is very important to understand that there is a very specific order in which we need to pass the data from DHIS2 to Go.Data: the Data Interoperability Pipeline, as can be seen in figure 9. This is because some of the elements in Go.Data reference other elements, so we need to transfer the "parent" element types (such as Go.Data Locations) before the "child" element types that reference them (such as Go.Data Outbreaks). The figure below illustrates the Data Interoperability Pipeline.
The following steps indicate in which order the different elements need to be sent from your DHIS2 instance to your new Go.Data instance. Transferring a given type of element simply means running the previously configured Interoperability Task for that element.
The process must start with running the Interoperability Task for Locations (please consult Running a Task to see how to run a previously configured task). It is very important that this part is carefully done, and in principle, the transfer of locations should be a one-time task.
If changes to the DHIS2 organization unit tree are introduced after a Go.Data instance has been filled with locations, it's crucial that the location tree in Go.Data is manually updated according to the changes introduced in the DHIS2 organization unit tree to avoid that any inconsistencies could cause data loss.
After transferring the locations, we can transfer the outbreaks. The DHIS2 element matching the Go.Data concept of Outbreak is the Program. However, it is possible that the match is not one-to-one. This is the case of the DHIS2 COVID-19 metadata packages, where more than one DHIS2 program maps to the same Go.Data outbreak, that unifies the information from the Cases and the Contacts DHIS2 programs. This means that in the following steps we may need to send DHIS2 cases and DHIS2 contacts from two different DHIS2 Programs to a single Go.Data Outbreak.
When running the Interoperability Task for an outbreak, the app will create a new outbreak in Go.Data. Using the Outbreak interoperability task is necessary to guarantee the workflow of the app: cases and contacts transfers may fail if the Go.Data outbreak has been created manually.
After transferring the outbreak, it is necessary to retrieve the outbreak identifier from Go.Data and introducing it correctly into the Metadata Mapping for Events, Cases, and/or Contacts (as explained in Case 2: Go.Data variable maps to a value) and also into the respective Interoperability Tasks (as explained in Configuring Tasks). Even if your mappings and tasks have been configured by your system administrator, introducing the outbreakId in the mappings and tasks is a necessary step.
Once the locations and the outbreak have been transferred, it's time to transfer either events or cases. If your DHIS2 instance is based on Event Capture, you will only need to transfer events. If your instance is based on Tracker Capture, you will need to send first your cases, and then your contacts. This last part is important because contacts should be associated to a given case, so cases need to be transferred before contacts.
It is necessary to introduce the outbreakId in the Metadata Mapping and the Interoperability Task for Cases/Events and to set the newly created Go.Data outbreak as active in your Go.Data instance before running the respective tasks to transfer them.
If your DHIS2 instance is based on Tracker Capture, you will need to transfer your contacts after you have transferred your cases. This would be the last step in the process.
It is necessary to introduce the outbreakId in the Metadata Mapping and the Interoperability Task for Contacts before transferring the contacts. Make sure that, before transferring the contacts, the target outbreak is active in your Go.Data instance.
