Cookies on this website

We use cookies to ensure that we give you the best experience on our website. If you click 'Accept all cookies' we'll assume that you are happy to receive all cookies and you won't see this message again. If you click 'Reject all non-essential cookies' only necessary cookies providing core functionality such as security, network management, and accessibility will be enabled. Click 'Find out more' for information on how to change your cookie settings.

BACKGROUND AND AIMS: Pouchitis is a common adverse event after proctocolectomy with ileal pouch anal anastomosis for ulcerative colitis. Evaluation of pouchitis disease activity and response to treatment requires use of validated indices. We assessed the reliability of items evaluating endoscopic pouchitis disease activity. METHODS: Twelve panelists used a modified RAND appropriateness methodology to rate the appropriateness of items evaluating endoscopic pouchitis disease activity derived from a systematic review and also identified additional potential endoscopic items based on expert opinion. Four central readers then evaluated 50 pouchoscopy videos in triplicate, in random order. Intra- and inter-rater reliability for each item was assessed by calculating and comparing intraclass correlation coefficients (ICCs). A Delphi process identified common sources of disagreement among the readers. RESULTS: Ten existing endoscopic items were identified from the systematic review and an additional 7 exploratory items from the panelists. ICCs for inter-rater reliability were highest for the existing item of pouch ulceration (.72; 95% confidence interval [CI], .60-.82) and for the exploratory item of ulcerated surface in the pouch body (.67; 95% CI, .53-.75). Inter-rater reliability for all other existing and exploratory items was "moderate" (ICC < .60). The item "ulcerated surface in the pouch body" demonstrated the best correlation with a global evaluation of lesion severity (r = .80; 95% CI, .73-.85). CONCLUSION: Substantial reliability was observed only for the endoscopic items of ulceration and ulcerated surface in the pouch body. Future studies should assess responsiveness to treatment in the next stage toward development of an endoscopic pouchitis disease activity index.

Original publication




Journal article


Gastrointest Endosc

Publication Date





360 - 369.e2


Consensus, Delphi Technique, Endoscopy, Gastrointestinal, Humans, Observer Variation, Pouchitis, Reproducibility of Results, Review Literature as Topic, Severity of Illness Index, Ulcer, Video Recording