Table 5 ROC AUC comparison between two AGATHA models trained on different MEDLINE snapshots: 2015 and 2020. A-15(20) stands for AGATHA 2015(20)

Amino Acid, Peptide, or Protein \(\leftrightarrow\) Gene or Genome

0.676

0.676

Amino Acid, Peptide, or Protein \(\leftrightarrow\) Organic Chemical

0.772

0.774

Disease or Syndrome \(\leftrightarrow\) Disease or Syndrome

0.838

0.849

Disease or Syndrome \(\leftrightarrow\) Neoplastic Process

0.831

0.838

Disease or Syndrome \(\leftrightarrow\) Organic Chemical

0.872

0.884

Gene or Genome \(\leftrightarrow\) Gene or Genome

0.600

0.605

Gene or Genome \(\leftrightarrow\) Organic Chemical

0.718

0.725

Gene or Genome \(\leftrightarrow\) Pharmacologic Substance

0.691

0.692

Organic Chemical \(\leftrightarrow\) Organic Chemical

0.907

0.913

Organic Chemical \(\leftrightarrow\) Pharmacologic Substance

0.908

0.916

Non-stratified ROC AUC

0.691

0.695