New Interface for Data Import and Search Index Management

In the last months we worked on building a new management interface for the ongoing work of keeping parliamentary sources, databases and search indices in sync. Instead of spreading this across multiple tools, the new Manage > Import page concentrates the operational overview and the maintenance actions on one screen.

When new video recordings or new proceedings files are published by the parliament, we automatically retrieve, analyse and import them into the Open Parliament TV platform. Until now it was difficult to monitor this process. Now we have a unified view of the entire data import workflow, can quickly identify if something went wrong and can trigger manual maintenance actions.

On the same page it is also possible to manage batch updates of entity types from third-party data sources (like update information on all people, organisations, documents or terms from Wikidata, Wikipedia or parliamentary databases).

For future use cases, the new interface already supports managing multiple parliaments and search indices within the same platform.