Skip to main content

Table 8 Results of the RoBERTa EHR model per entity type\(^{*}\)

From: Hybrid natural language processing tool for semantic annotation of medical texts in Spanish

UMLS

Precision

Recall

F1

Temporal

Precision

Recall

F1

entities

entities

ANAT

0.728

0.686

0.706

Age

0.926

0.947

0.936

[ 308 ]

(± 0.030)

(± 0.030)

(± 0.025)

[ 372 ]

(± 0.013)

(± 0.009)

(± 0.010)

CHEM

0.917

0.923

0.920

Date

0.931

0.895

0.913

[ 2932 ]

(± 0.005)

(± 0.008)

(± 0.005)

[ 412 ]

(± 0.015)

(± 0.014)

(± 0.013)

DEVI

0.645

0.791

0.711

Duration

0.918

0.893

0.905

[ 134 ]

(± 0.018)

(± 0.047)

(± 0.027)

[ 629 ]

(± 0.014)

(± 0.019)

(± 0.010)

DISO

0.890

0.903

0.896

Frequency

0.780

0.885

0.829

[ 3065 ]

(± 0.008)

(± 0.003)

(± 0.003)

[ 73 ]

(± 0.043)

(± 0.008)

(± 0.024)

LIVB

0.949

0.959

0.954

Time

0.722

0.809

0.762

[ 1685 ]

(± 0.004)

(± 0.006)

(± 0.002)

[ 113 ]

(± 0.068)

(± 0.042)

(± 0.052)

PHYS

0.766

0.765

0.765

Miscellaneous

Precision

Recall

F1

[ 308 ]

(± 0.021)

(± 0.012)

(± 0.008)

 

PROC

0.842

0.871

0.856

Concept

0.644

0.612

0.627

[ 4154 ]

(± 0.002)

(± 0.004)

(± 0.002)

[ 764 ]

(± 0.016)

(± 0.019)

(± 0.009)

Medication data

Precision

Recall

F1

Food/Drink

0.692

0.733

0.712

 

[ 27 ]

(± 0.049)

(± 0.071)

(± 0.058)

Contraindicated.

0.818

0.816

0.812

Observation

0.626

0.617

0.621

[ 76 ]

(± 0.047)

(± 0.104)

(± 0.049)

[ 822 ]

(± 0.015)

(± 0.010)

(± 0.010)

Dose

0.824

0.843

0.833

Quant./Qual.

0.700

0.661

0.680

[ 314 ]

(± 0.039)

(± 0.020)

(±  0.021)

[ 1202 ]

(± 0.015)

(± 0.020)

(± 0.008)

Form

0.932

0.884

0.907

Result/Value

0.828

0.910

0.867

[ 74 ]

(± 0.030)

(± 0.020)

(±  0.019)

[ 394 ]

(± 0.013)

(± 0.005)

(± 0.007)

Route

0.916

0.899

0.907

Experiencer/temp. attr.

Precision

Recall

F1

[ 288 ]

(± 0.037)

(± 0.022)

(±  0.017)

 

Negation/Speculation

Precision

Recall

F1

Family_member

0.721

0.920

0.808

 

[ 20 ]

(± 0.048)

(± 0.027)

(± 0.034)

Neg_cue

0.955

0.958

0.957

Other

0.852

0.805

0.828

[ 2484 ]

(± 0.006)

(± 0.006)

(±  0.005)

[ 120 ]

(± 0.019)

(± 0.015)

(± 0.011)

Negated

0.829

0.837

0.833

Patient

0.949

0.921

0.935

[ 3160 ]

(± 0.005)

(± 0.014)

(±  0.008)

[ 1462 ]

(± 0.003)

(± 0.005)

(± 0.003)

Spec_cue

0.834

0.859

0.846

Future

0.640

0.620

0.629

[ 756 ]

(± 0.021)

(± 0.017)

(±  0.007)

[ 70 ]

(± 0.040)

(± 0.059)

(± 0.045)

Speculated

0.708

0.719

0.713

History_of

0.742

0.667

0.703

[ 1008 ]

(± 0.019)

(± 0.016)

(±  0.016)

[ 647 ]

(± 0.021)

(± 0.016)

(± 0.010)

  1. \(^{*}\) The number of instances of each type in the test set (support) appears in square brackets
  2. (below each entity name in the first column); temp. att. stands for ‘temporality attributes’