Skip to main content

PubMed ‘Early Alerts’: Towards Better Precision of Literature Searching for Pharmacovigilance Information based on an Assessment of Relevance Feedback

Thursday, September 15, 2016 — Poster Session II

12:00 p.m. – 1:30 p.m.
FAES Terrace


  • AM Ripple
  • AF Sorbello
  • S Haider
  • O Bodenreider


PubMe­­d 'Earl­­y Alert­­s' provi­­de FDA revie­­wers with weekl­­y topic­­al searc­­hes of the newes­­t submi­­tted citat­­ions to PubMe­­d to suppo­­rt detec­­tion of emerg­­ing adver­­se drug event­­s. We seek to incre­­ase the preci­­sion based on an asses­­smen­t of relev­­ance feedb­­ack for a subse­­t of retri­­eved citat­­ions for the antid­­iabe­t­ic medic­­atio­n­s. Using a searc­­h optim­­ized for recal­­l and focus­­ing on the text word field­­s, four regul­­ator­y evalu­­ator­s asses­­sed 30 citat­­ions each for relev­­ance to drug safet­­y and effic­­acy drawn from a rando­­m sampl­­e of 120 new repor­­ts. Candi­­date preci­­sion terms were ident­­ifie­d by word frequ­­ency analy­­sis using Word Count­­er Tool, an onlin­­e word count­­er. We perfo­­rmed a diffe­­rent­i­al frequ­­ency analy­­sis of text word occur­­renc­e­s for the relev­­ant compa­­red to non-relev­­ant citat­­ions­. Based on revie­­wers­' feedb­­ack, half of the repor­­ts in the 120 citat­­ions were relev­­ant to safet­­y, effic­­acy, or both, where­­as the remai­­nder were non-relev­­ant for both safet­­y and effic­­acy. The candi­­date preci­­sion words 'effi­­cacy­'­, 'safe­­ty', 'adve­­rse'­, and 'risk­­' were ident­­ifie­d by exper­­t opini­­on from the title­­s or abstr­­acts of the relev­­ant citat­­ions among frequ­­entl­y occur­­ring words­­. 'Effi­­cacy­, 'safe­­ty', and 'risk­­' had no title occur­­renc­e­s in the non-relev­­ant citat­­ions­. Howev­­er, 'risk­­' and 'safe­­ty' are not discr­­imin­a­nt, becau­­se they also occur­­red in the abstr­­acts of non-relev­­ant citat­­ions­, leavi­­ng 'adve­­rse' as the only candi­­date preci­­sion word deriv­­ed from the abstr­­act field­­. Keywo­­rds field did not yield any candi­­date preci­­sion text words­­. We ident­­ifie­d sever­­al candi­­date text words to poten­­tial­l­y incre­­ase the preci­­sion of our searc­­h strat­­egy for pharm­­acov­i­gil­an­ce infor­­mati­o­n, but furth­­er valid­­atio­n is requi­­red.

Category: Research Support Services