nebula.addons.trustworthiness.metric

nebula.addons.trustworthiness.metric#

Attributes#

dirname

logger

Classes#

TrustMetricManager

Manager class to help store the output directory and handle calls from the FL framework.

Module Contents#

nebula.addons.trustworthiness.metric.dirname#
nebula.addons.trustworthiness.metric.logger#
class nebula.addons.trustworthiness.metric.TrustMetricManager#

Manager class to help store the output directory and handle calls from the FL framework.

factsheet_file_nm = 'factsheet.json'#
eval_metrics_file_nm = 'eval_metrics.json'#
nebula_trust_results_nm = 'nebula_trust_results.json'#
evaluate(scenario, weights, use_weights=False)#

Evaluates the trustworthiness score.

Parameters:

  • scenario (object) – The scenario in whith the trustworthiness will be calculated.

  • weights (dict) – The desired weghts of the pillars.

  • use_weights (bool) – True to turn on the weights in the metric config file, default to False.

Contents