Table 4 TEST Error Analysis for the ShARe and OUD Data Set
Error type | Example | Proportion | ||
|---|---|---|---|---|
| Â | MODIFIER | ANNOTATION | MODEL | Â |
False negative (ShARe) | Ex1: His extremities also showed greater swelling in his left leg. | 46% | ||
COURSE | INCREASED | UNMARKED | ||
Ex2: He had slight decreased sensation in his right upper extremity. | ||||
SEVERITY | SLIGHT | UNMARKED | ||
Ex3: Peptic ulcer disease in the OMR, but the patient denies this. | ||||
NEGATION | YES | NO | ||
False positive (ShARe) | Ex1: These findings are consistent with a hematoma which appears more organized than on prior exam. | 54% | ||
UNCERTAINTY | NO | YES | ||
Ex2: Per her daughter she has been having shortness of breath. | ||||
SUBJECT | PATIENT | FAMILY MEMBER | ||
Ex3: Family History: Father died 66 from heart failure Mother died 59 from cervical cancer. Diabetes in father’s family as well as heart disease. | ||||
SUBJECT | OTHER | FAMILY MEMBER | ||
False negative (OUD) | Ex1: He was hospitalized in the CPM in 2011 for suicidal ideations for several days. | 58% | ||
DOCTIME | BEFORE | OVERLAP | ||
Ex2: Family History: 0 suicide attempts. | ||||
NEGATION | YES | NO | ||
Ex3: During interview she stated she has not been using illicit substances since D/C, but after UDS came back pos for amphetamines and benzos, she admitted to using these illicitly about a week ago due to her high anxiety. | ||||
IDU | TRUE | FALSE | ||
False positive (OUD) | Ex1: He said he was snorting heroin and is not sure exactly how much he took. | 42% | ||
UNCERTAINTY | NO | YES | ||
Ex2: How has addiction impacted your relationships?: Was dating my husband when I was using suboxone, hid it from him. | ||||
IDU | FALSE | TRUE | ||
Ex3: Lab Results : U Methadone Negative U Opiates Positive U Oxycodone Negative. | ||||
NEGATION | NO | YES | ||