We have a system that tracks the number of related entities, the confidence score returned by the Knowledge Graph API and several other data points on a dataset of several thousand known Entities. We have isolated three insightful aspects of these changes and measure them daily. We measure:
Magnitude: How many entities saw an increase or decrease (reach/breadth).
Amplitude: How significant that change, in confidence scores of the affected entities, was on a micro-level (scope/height).
Size: How many entities the Knowledge Vault contains.
The graph below shows Magnitude (Volatility) in purple, and Size in red. We are using amplitude and many other measurements internally as part of the paid Kalicube Pro platform and won’t be adding that publicly in the foreseeable future.
