Fusion Metadata Registry is a free to use structural metadata registry for SDMX supporting EDI, SDMX 1.0, 2.0, 2.1 and 3.0.
License
Web application: Public License Agreement
Source code: Apache 2.0
License Agreement
Fusion Metadata Registry is published under the BIS Open Tech initiative.
The BIS Open Tech is a platform for sharing statistical and financial software as public goods, by promoting international cooperation and coordination. These software tools are developed according to international best practices and standards and can be reused and further developed in a wide variety of environments
FMR helps official statistics organisations externalise and gain control of their statistical structural metadata with the benefits of maintainability, re-use, standardisation, harmonisation and improved metadata and data governance.
FMR provides:
Fusion Metadata Registry version 11 implements the SDMX 3.0 specification.
Download get the Docker image, or read the release notes
Backward compatibility with SDMX 2.1 and FMR 10 has been preserved where possible allowing upgrade to FMR 11 with few changes to operating procedures and intergated systems / processes.
Note that FMR 11 is not compatible with existing FMR 10 databases requiring a fresh install and export / import of the structural metadata content.
Function | Feature | Fusion Metadata Registry 10 | Fusion Metadata Registry 11 |
---|---|---|---|
Internal Information Model | SDMX 2.1 | ||
SDMX 3.0 | |||
Structural Metadata Formats | SDMX-ML v3.0 | ||
SDMX-ML v2.1 | |||
SDMX-ML v2.0 | |||
SDMX-ML v1.0 | |||
SDMX-JSON v2.0 | As of FMR 11.1.2: AgencyScheme Categorisation CategoryScheme Codelist ConceptScheme ContentConstraint DataConsumerScheme Dataflow DataProviderScheme DataStructureDefinition ProvisionAgreement RepresentationMap StructureMap The remainder of the structures are on the roadmap |
||
SDMX-JSON v1.0 | |||
EDI | |||
Structural Metadata Management | Load structural metadata from file | ||
Load structural metadata from URL | |||
Author and maintain structural metadata using the web interface | |||
Author and maintain structural metadata using FusionXL addin for Excel | |||
ACID structure repository | |||
Structural metadata import / export as SDMX | |||
Structural metadata import / export as Excel | |||
SDMX structures REST API | |||
Structure storage (limited by available memory) | |||
Structure comparison | |||
Structure validation on import | |||
Structure referential integrity enforcement | |||
Tools to correct referential integrity issues (fix 'zombie' structures) | |||
Time dependant constraints | |||
Structure-level validity | |||
Item-level validity | |||
Subscription / notification of changes to structures via email or HTTP POST | |||
Structure update transaction journalling | |||
Rollback structure changes to a specified journalled transaction | |||
Structural metadata time travel | On roadmap | ||
SDMX Structures | Agency Schemes | ||
Constraints | Converted to Data Constraints on import | ||
Categorisations | |||
Category Schemes | |||
Codelists | |||
Concept Schemes | |||
Data Consumer Schemes | |||
Data Provider Schemes | |||
Data Structure Definitions | |||
Dataflows | |||
Hierarchical Codelists | Converted to Hierarchies on import | ||
Metadata Structure Definitions | |||
Metadataflows | |||
Organisation Unit Schemes | |||
Processes | |||
Provision Agreements | |||
Reporting Taxonomies | |||
Structure Sets | Converted to Structure Maps on import | ||
Structure Map | |||
Representation Map | |||
Organisation Scheme Map | |||
Concept Scheme Map (SDMX 3.0) | On roadmap | ||
Category Scheme Map | On roadmap | ||
Reporting Taxonomy Map | On roadmap | ||
Value List | |||
Hierarchy | |||
Hierarchy Association | |||
Metadata Constraint | On roadmap | ||
Data Constraint | |||
Metadata Constraint | |||
Metadata Provision Agreement | |||
Metadata Provider Scheme | |||
Metadataset | |||
'Extended' Structures (structures that are not part of the formal SDMX specification) | Validation Schemes | ||
Reporting Templates | |||
Publication Tables | |||
Structural Metadata Storage Options | MySQL | ||
Oracle | |||
Microsoft SQL Server | |||
Identity and Access Management | Microsoft Active Directory service integration | ||
OpenLDAP directory service integration | |||
Fusion Security directory service integration | |||
Single-user mode (no directory service required) | |||
Certificate authentication | |||
SSO | |||
Data | Load data from file | ||
Load data from URL (file or REST API) | |||
SDMX-ML v3.0 structure specific data format (XML) | On roadmap | ||
SDMX-ML v2.1 structure specific data format (XML) | |||
SDMX-ML v2.0 structure specific data format (XML) | |||
SDMX-ML v2.1 generic data format (XML) | |||
SDMX-ML v2.0 generic data format (XML) | |||
SDMX-JSON v1.0 data format | |||
SDMX-JSON v2.0 data format | On roadmap | ||
SDMX-CSV v1.0 data format | |||
SDMX-CSV v2.0 data format | (some limitations) | ||
EDI data format | |||
Excel FusionXL data format | |||
Interactive data load using the web user interface | |||
Data storage | |||
Data processing REST API (validation, conversion, mapping) | |||
Data storage REST API | |||
Plugin interface for adding custom data readers | |||
Data Registration | SDMX data source registration | ||
Validation and indexing of registered data sources | |||
Reference Metadata | Store Reference Metadata Reports | ||
SDMX-ML v2.1 reference metadata report format read | (some limitations) | ||
SDMX-JSON v2.0 reference metadata report format | |||
Reference metadata submission API (POST) | |||
Reference metadata retrieval API (GET) | |||
Reference metadata deletion API (DELETE) | |||
Data Validation | Structural compliance | ||
Compliance of data values with the DSD | |||
Compliance with constraint rules | |||
Duplicate observations or series checks | |||
Mandatory attributes | |||
Validation Schemes - basic business rule validation expressions | |||
Validation Schemes - advanced business rule validation expressions | |||
Validation rules configuration - set what rules are applied and whether they prevent conversion or data publication | |||
Plugin interface for adding custom validators | |||
Data validation processing (load data, validate it against the defined structure and business rules, return a validation report plus valid and invalid series as separate output datasets) | |||
Data validation REST API | |||
SDMX-ML v2.1 Structure Specific data XML schema validation | |||
SDMX-ML v3.0 Structure Specific data XML schema | |||
VTL 2.0 | Storage of VTL programs as SDMX structural metadata | ||
Execution of VTL programs for validation or transformation of data | |||
SDMX Structure Mapping | Concept Scheme Maps (SDMX 2.1) | ||
Codelist Maps | |||
Data Structure Maps | |||
Dataflow Maps | |||
Regex pattern mapping rules | |||
N-to-N data maps | |||
N-to-1 data maps | |||
1-to-N data maps | |||
1-to-1 data maps | |||
Mapped Datasets | Mapped Datasets - like SQL views | ||
Virtual Dataflows | Virtual Dataflows describe a sub-cube of a dataflow | On roadmap | |
Data Transformation | Data transformation processing (load data, transform it to a different structure using SDMX Structure Mapping and return the result) | ||
Data transformation REST API | |||
Data Conversion | Between supported SDMX formats and versions (SDMX-ML, SDMX-JSON, SDMX-CSV, EDI) | ||
From Excel Reporting Template to SDMX formats | |||
Quick convert to SDMX-ML 2.1 Structure Specific format | |||
Conversion to and from Fusion Excel format for SDMX datasets | On roadmap | ||
Data Reporting | Excel Reporting Templates - definition and generation | ||
Excel Reporting Templates - validation and conversion of reported data | |||
Excel Reporting Templates - load and storage of reported data | |||
Excel Reporting Templates - configurable template security rules | |||
Content Security / Access Controls | Structure creation and maintenance controls (Agency privileges) | ||
Data load and modification controls (Data Provider privileges) | |||
Data access controls at the dataflow, series or observation level | |||
Structure access controls at the structure or item level | |||
Public mode - Registry content is readable by both unauthenticated guest and authenticated users | |||
Private mode - Registry content is accessible only to authenticated users | |||
Auditing | SDMX structure transaction auditing | ||
User activity auditing | |||
Enterprise Deployment | Load balancer support (clustering multiple Registry instances behind a load balancer for resilience and load tolerance) | ||
Apache Kafka Integration | Kafka 'Structure Notification' Producer for publishing changes to structural metadata on a definable topic | ||
Client-side API | IM-JS JavaScript client-side programming library | ||
SDMX-UI TypeScript client-side programming library (higher-level abstraction) | On roadmap | ||
Command Line Interface | Fusion Command Line Interface for managing structural metadata |
See the full changelog for details of all new features and bug fixes.
11.6.0 - March 2023maintenance release
11.1.2 - April 2022maintenance release
11.1.1 - February 2022maintenance release
11.1.0 - February 2022maintenance releases
11.0.1 - January 2022The heart of Fusion Metadata Registry is its structural metadata repository - essentially a database that implements the SDMX 3.0 information model.
All structural metadata objects are stored according to this model which provides a rigorous dependency graph that defines and enforces the metadata's referential integrity. This strongly enforced referential integrity provides confidence that the metadata model is always complete - a DSD for instance can never exist without its referenced Codelists.
FMR provides two interfaces:
FMR 10 implements the SDMX 2.1 registry specification.
FMR 11 implements the SDMX 3.0 registry specification.
In addition to its core role as a structural metadata registry, FMR's integrated data processing services support:
Finally for data collectors, FMR's Excel data collection forms generator generates cross-tabulation data collection forms allowing data reporters to simply fill in the blank cells with the required observation values. The precise content and layout of these forms are defined by creating templates from which a personalised form is generated for each data provider.
Point your browser at http://localhost:8080
The container will take between 1 and 2 minutes to start - so be patient!
There is a single Root User Account:
Username: root
Password: password
Log in to administer the system, and create, load and maintain SDMX structures.
More on Docker Hub.
Fusion Metadata Registry is a Java web applications that will run on most Windows, Linux or Apple Mac machines with a minimum of 4GB memory.
There are three key pre-requisities:
Take a look at the quick start guide
Quick Start Guide