Inter-rater reliability of the Pediatric Transplant Rating Instrument (P-TRI): challenges to reliably identifying adherence risk factors during pediatric pre-transplant evaluations

The purpose of this study was to assess the inter-rater reliability of the P-TRI, a 17-item instrument developed to identify risk factors associated with poor treatment adherence in pediatric solid organ transplant candidates. Because factors influencing treatment adherence may vary with age, the 89 subject samples were divided into pre-adolescent (0-11 yr) and adolescent (12-19 yr) groups. Each subject received two independent P-TRI ratings based on pretransplant psychosocial assessments separately conducted by a PSYC and a SWTC. Inter-rater reliability was assessed using the delta statistic. Overall, agreement was higher in the pre-adolescent group, with delta>0.70 for five items and delta<0.30 for two items. For the adolescent group, one item had a delta>0.70 and seven items had a delta<0.30. Overall, PSYC P-TRI ratings indicated fewer areas of concern on items assessing family dynamics compared with SWTC P-TRI ratings, whereas the reverse was true for items related to psychiatric history. Results highlight the challenges of conducting a reliable pretransplant assessment of adherence-related risk factors and suggest the need for revisions to the P-TRI prior to its use in clinical practice.