Skip to content

orb

allennlp_models.rc.tools.orb

[SOURCE]


Official evaluation script for ORB. Usage: python evaluation_script.py --dataset_file --prediction_file --metrics_output_file

read_predictions#

def read_predictions(json_file)

read_labels#

def read_labels(jsonl_file)

compute_averages#

def compute_averages(all_metrics)

evaluate#

def evaluate(answers, predictions)

process_for_output#

def process_for_output(metrics)