Skip to main content
Home

Navigation controls

  • Search
  • Menu
September 9 – 12, 2025 | NIH Main Bethesda, Campus

Social

  • Twitter
  • Facebook
  • Email

Current Research Festival

  • 2025
  • 2024
    • General Schedule of Events
    • 2024 NIH Distinguished Scholars Program
    • Poster Sessions
    • Concurrent Workshops
    • NIH Resource Information Fair
    • National Academy of Science Mini-Symposium
    • Special Wednesday Events
    • Vendor Exhibit Information
    • Green Labs Fair
    • Research Festival Committee
  • 2023
    • General Schedule of Events
    • NIH Early–Career Investigator Lectures
    • Poster Sessions
    • Concurrent Workshops
    • NIH Resource Information Fair
    • Vendor Exhibit Information
    • Research Festival Committee
  • 2021
  • 2019
    • General Schedule of Events
    • Plenary Sessions
    • Poster Session
    • Data Blitz
    • FARE Award Ceremony
    • Special Exhibits on Resources for Intramural Research
    • Technical Sales Association (TSA) Research Festival Exhibit Tent Show
    • Research Festival Committee
  • 2018
    • General Schedule of Events
    • Plenary Sessions
    • Concurrent Symposia Sessions
    • Poster Sessions
    • FARE Award Ceremony
    • Special Exhibits on Resources for Intramural Research
    • Technical Sales Association (TSA) Research Festival Exhibit Tent Show
    • Research Festival Committees
  • 2017
    • General Schedule of Events
    • Plenary Sessions
    • Concurrent Symposia Sessions
    • Poster Sessions
    • FARE Award Ceremony
    • Future Research Leaders
    • Special Exhibits on Resources for Intramural Research
    • Technical Sales Association (TSA) Research Festival Exhibit Tent Show
    • Research Festival Committees
  • 2016
    • General Schedule of Events
    • Plenary Sessions
    • Concurrent Symposia Sessions
    • Poster Sessions
    • Browse by Presenter Name
    • Browse by Presenter IC
    • FARE Award Ceremony
    • Future Research Leaders
    • Special Exhibits on Resources for Intramural Research
    • Technical Sales Association (TSA) Research Festival Exhibit Tent Show
    • Tours of the National Library of Medicine and Clinical Center
    • Research Festival Committees
  • 2015
    • General Schedule of Events
    • Plenary Sessions
    • Concurrent Workshop Sessions
    • Poster Sessions
    • Browse by Presenter Name
    • Browse by Presenter IC
    • FARE Award Ceremony
    • Future Research Leaders
    • Special Exhibits on Resources for Intramural Research
    • TSA Research Festival Exhibit Show
    • NIH Tours
    • Research Festival Committees
  • 2014
  • 2013
  • 2012
  • 2011
  • 2010
  • 2009
  • 2008
  • 2007
  • 2006
  • 2005
  • 2004
  • 2003
  • 2002
  • 2001
  • 2000

Main navigation

  • All Research Festivals
    • 2025
    • 2024
    • 2023
    • 2021
    • 2019
    • 2018
    • 2017
    • 2016
    • 2015
    • 2014
    • 2013
    • 2012
    • 2011
    • 2010
    • 2009
    • 2008
    • 2007
    • 2006
    • 2005
    • 2004
    • 2003
    • 2002
    • 2001
    • 2000

NIH Research Festival

September 14 – 16, 2016

Learning to Read Chest X-Rays: Recurrent Neural Cascade Model for Automated Image Annotation

Friday, September 16, 2016 – Poster Session IV
12:00 – 1:30 p.m.

FAES Terrace

CC

BIOENG-3

Authors

  • H-C Shin
  • K Roberts
  • L Lu
  • D Demner-Fushman
  • J Yao
  • RM Summers

Abstract

Despite the recent advances in automatically describing image contents, their applications have been mostly limited to image caption datasets containing natural images (e.g., user photos). In this paper, we present a deep learning model to efficiently detect a disease from an image and annotate its contexts (e.g., location, severity and the affected organs). We employ a publicly available radiology dataset of chest x-rays and their reports, and use its image annotations to mine disease names to train convolutional neural networks (CNNs). In doing so, we adopt various regularization techniques to circumvent the large normal-vs-diseased cases bias. Recurrent neural networks (RNNs) are then trained to describe the contexts of a detected disease, based on the deep CNN features. Moreover, we introduce a novel approach to use the weights of the already trained pair of CNN/RNN on the domain-specific image/text dataset, to infer the joint image/text contexts for composite image labeling. Significantly improved image annotation results are demonstrated using the recurrent neural cascade model by taking the joint image/text contexts into account.

Scientific Focus Area: Biomedical Engineering and Biophysics

This page was last updated on Friday, March 26, 2021

  • General Schedule of Events
  • Plenary Sessions
  • Concurrent Symposia Sessions
  • Poster Sessions
  • Browse by Presenter Name
  • Browse by Presenter IC
  • FARE Award Ceremony
  • Future Research Leaders
  • Special Exhibits on Resources for Intramural Research
  • Technical Sales Association (TSA) Research Festival Exhibit Tent Show
  • Tours of the National Library of Medicine and Clinical Center
  • Research Festival Committees

2016 program

Download the 2016 Research Festival Schedule Overview (6 pages)

  • Email
  • Print
  • Share Twitter Facebook LinkedIn

Current Research Festival

  • 2025
  • 2024
    • General Schedule of Events
    • 2024 NIH Distinguished Scholars Program
    • Poster Sessions
    • Concurrent Workshops
    • NIH Resource Information Fair
    • National Academy of Science Mini-Symposium
    • Special Wednesday Events
    • Vendor Exhibit Information
    • Green Labs Fair
    • Research Festival Committee
  • 2023
    • General Schedule of Events
    • NIH Early–Career Investigator Lectures
    • Poster Sessions
    • Concurrent Workshops
    • NIH Resource Information Fair
    • Vendor Exhibit Information
    • Research Festival Committee
  • 2021
  • 2019
    • General Schedule of Events
    • Plenary Sessions
    • Poster Session
    • Data Blitz
    • FARE Award Ceremony
    • Special Exhibits on Resources for Intramural Research
    • Technical Sales Association (TSA) Research Festival Exhibit Tent Show
    • Research Festival Committee
  • 2018
    • General Schedule of Events
    • Plenary Sessions
    • Concurrent Symposia Sessions
    • Poster Sessions
    • FARE Award Ceremony
    • Special Exhibits on Resources for Intramural Research
    • Technical Sales Association (TSA) Research Festival Exhibit Tent Show
    • Research Festival Committees
  • 2017
    • General Schedule of Events
    • Plenary Sessions
    • Concurrent Symposia Sessions
    • Poster Sessions
    • FARE Award Ceremony
    • Future Research Leaders
    • Special Exhibits on Resources for Intramural Research
    • Technical Sales Association (TSA) Research Festival Exhibit Tent Show
    • Research Festival Committees
  • 2016
    • General Schedule of Events
    • Plenary Sessions
    • Concurrent Symposia Sessions
    • Poster Sessions
    • Browse by Presenter Name
    • Browse by Presenter IC
    • FARE Award Ceremony
    • Future Research Leaders
    • Special Exhibits on Resources for Intramural Research
    • Technical Sales Association (TSA) Research Festival Exhibit Tent Show
    • Tours of the National Library of Medicine and Clinical Center
    • Research Festival Committees
  • 2015
    • General Schedule of Events
    • Plenary Sessions
    • Concurrent Workshop Sessions
    • Poster Sessions
    • Browse by Presenter Name
    • Browse by Presenter IC
    • FARE Award Ceremony
    • Future Research Leaders
    • Special Exhibits on Resources for Intramural Research
    • TSA Research Festival Exhibit Show
    • NIH Tours
    • Research Festival Committees
  • 2014
  • 2013
  • 2012
  • 2011
  • 2010
  • 2009
  • 2008
  • 2007
  • 2006
  • 2005
  • 2004
  • 2003
  • 2002
  • 2001
  • 2000

Main navigation

  • All Research Festivals
    • 2025
    • 2024
    • 2023
    • 2021
    • 2019
    • 2018
    • 2017
    • 2016
    • 2015
    • 2014
    • 2013
    • 2012
    • 2011
    • 2010
    • 2009
    • 2008
    • 2007
    • 2006
    • 2005
    • 2004
    • 2003
    • 2002
    • 2001
    • 2000
  • Department of Health and Human Services
  • National Institutes of Health
  • USA.gov

Footer

  • Home
  • Contact Us
  • IRP
  • HHS Vulnerability Disclosure
  • Web Policies and Notices
  • Site Map
  • Search