Table 11 Results with different model reduction strategy
From: PCVR: a pre-trained contextualized visual representation for DNA sequence classification
Method | Param.(M) | Dist. related | Final | |||
|---|---|---|---|---|---|---|
| Â | Â | Supk. | Phyl. | Supk. | Phyl. | Genus |
PCVR-Large | 302.62 | 96.00 | 78.67 | 99.22 | 96.93 | 74.51 |
PCVR-Base | 85.29 | 94.59 | 75.08 | 98.97 | 96.29 | 74.65 |
PCVR-Small | 21.41 | 89.00 | 66.38 | 98.73 | 95.71 | 72.29 |
PCVR Base-to-Small distiilation | 21.41 | 81.35 | 64.03 | 97.79 | 93.28 | 64.98 |
PCVR-Tiny | 5.4 | 88.09 | 69.15 | 98.48 | 95.14 | 70.63 |
PCVR Base-to-Tiny distillation | 5.4 | 80.80 | 60.62 | 96.74 | 91.44 | 60.09 |