Rorschach Performance Assessment System

The Rorschach Performance Assessment System (R-PAS)^{[1] [2]} is a scoring and interpretive method to be used with the Rorschach inkblot test.^[3] This system is being developed by several members of the Rorschach Research Council, a group established by John Exner to advance the research on the Comprehensive System, the most widely used scoring system for the Rorschach. Following Exner's death, the council admitted that the current Comprehensive System scoring was in need of revision. R-PAS was developed as an empirically based revision of the Exner Comprehensive System.

The R-PAS is an empirically based, and internationally normed scoring system that is easier to use than Exner's Comprehensive System.^[4] The R-PAS manual is intended to be a comprehensive tool for administering, scoring, and interpreting the Rorschach. The manual consists of two chapters that are basics of scoring and interpretation, aimed for use for novice Rorschach users, followed by numerous chapters containing more detailed and technical information.^[5] The manual is supplemented by a website in which additional information and resources are available to aid administration of the Rorschach.

Administration

R-optimized procedures of administration instruct examiners to ask the respondents to provide two or three responses for each of the 10 Rorschach cards. Examiners may use “prompts” to encourage examinees to give more responses or “pulls” to ask examinees to give the card back to the examiner. This procedure is meant to increase the stability of the administration and attempt to eliminate the extremes of responding; too few responses or too many responses.^[6]

Scoring

The authors did not create new variables or indices to be coded, but systematically reviewed variables that had been used in past systems.^[3] While all of these codes have been used in the past, many have been renamed to be more face valid and readily understood. Scoring of the indices has been updated (e.g. utilizing percentiles and Standard Scores) to make the Rorschach more in line with other popular personality measures.

In addition to providing coding guidelines to score examinee responses, the R-PAS provides a system to code an examinee's behavior during Rorschach administration. These behavioral codes are included as it is believed that the behaviors exhibited during testing are a reflection of someone's task performance and supplements the actual responses given. This allows generalizations to be made between someone's responses to the cards and their actual behavior.

Normative data

The R-PAS also recognized that scoring on many of the Rorschach variables differed across countries.^[3] Therefore, starting in 1997, Rorschach protocols from researchers around the world were compiled.^[7] After compiling protocols for over a decade, a total of 15 adult samples were used to provide a normative basis for the R-PAS. The protocols represent data gathered in the United States, Europe, Israel, Argentina and Brazil.

New Variables

The R-PAS includes new variables not from the Comprehensive System including Complexity, Space Integration, Space Reversal, Oral Dependency Language, the Mutuality of Autonomy scale, the Ego Impairment Index, and Aggressive Content. All of the variables selected for the R-PAS have been used by others in the past, either as part of previous systems for using the Rorschach, or as stand-alone independently coded variables. Prior research on these variables have shown correlation coefficients around approximately 0.9.^[8]

Inter-rater reliability

Preliminary data used to evaluate the reliability of the R-PAS scoring system shows that two different raters scored the same responses similarly. In the study, 50 records of responses to Rorschach cards were randomly selected and given to two different raters to be coded. The coded responses were compared and the results indicate an average intraclass correlation of 0.88 and median of 0.92 across all of the variables. The findings indicate good to excellent inter-rater reliability which is consistent with previous findings for the variables used in the scoring.^[9]

Forensic Application

There are advantages to using the R-PAS in forensic evaluations, and authors have described appropriated and inappropriate use of it in court.^[10] Some advantages to its use include incremental validity over self-report measures, protection against inaccurate symptom presentation, information regarding states and traits, adjustments for abnormal response records, accurate pathology interpretations, organization of results, and easily understood interpretations.^[11]

However, some present the argument the R-PAS fails to meet the necessary criteria for admissibility according to the Frye and Daubert guidelines. Some of the major concerns regarding the R-PAS include its psychometric properties, lack of current normative data, and the absence of independent groups completing research in the area.^[12][13] There is not consensus regarding the admissibility of the R-PAS in court, however, as others would argue the criteria are met.^[14]

References

1. Meyer, G. J., Viglione, D. J., Mihura, J. L., Erard, R. E., & Erdberg, P. (2011). Rorschach Performance Assessment System: Administration, coding, interpretation, and technical manual. Rorschach Performance Assessment System LLC.
2. "R-PAS Home Page". r-pas.org. Retrieved 2021-04-10.
3. Meyer, G. J.; Eblin, J. J. (2012). "An overview of the Rorschach Performance Assessment System (R-PAS)". Psychological Injury and Law. 5 (2): 107–121. doi:10.1007/s12207-012-9130-y. S2CID 143393022.
4. "R-PAS Description". R-pas.org. Retrieved 2014-03-21.
5. http://www.r-pas.org/Docs/Manual_TOC.pdf^{[bare URL PDF]}
6. Meyer, G. J. & Eblin, J. J. (2012). An overview of the Rorschach performance assessment system (R-PAS). Psychological Injury and Law, 5, 107-121.
7. Shaffer, T. W., Erdberg, P., & Meyer, G. J. (2007). Introduction to the JPA special supplement on international reference samples for the Rorschach Comprehensive System. Journal of Personality Assessment, 89, S2-S6.
8. Meyer, G. J. & Eblin, J. J. (2012), "An overview of the Rorschach performance assessment system (R-PAS)", Psychological Injury and Law, 5, pp.107-121.
9. Viglione, D. J., Blume-Marcovici, A., Miller, H. L., Giromini, L., & Meyer, G. (2012), "An inter-rater reliability study for the Rorschach performance assessment system", Journal of Personality Assessment, 94, pp.607-612.
10. Viglione, Donald J.; de Ruiter, Corine; King, Christopher M.; Meyer, Gregory J.; Kivisto, Aaron J.; Rubin, Benjamin A.; Hunsley, John (2022-03-04). "Legal Admissibility of the Rorschach and R-PAS: A Review of Research, Practice, and Case Law". Journal of Personality Assessment. 104 (2): 137–161. doi:10.1080/00223891.2022.2028795. ISSN 0022-3891. PMID 35180040. S2CID 246974081.
11. Erard, R. E. (2012). Expert testimony using the Rorschach performance assessment system in psychological injury cases. Psychological Injury and Law, 5, 122-134.
12. Gurley, J. R.; Sheeham, B. L.; Piechowski, L.D.; Gray, J. (2014). "The admissibility of the R-PAS in court". Psychological Injury and Law. 7 (7): 9–17. doi:10.1007/s12207-014-9182-2. S2CID 143591599.
13. Kivisto, A. J.; Gacono, C. B.; Medoff, D. (2013). "Does the R-PAS meet standards for forensic use? Considerations with introducing a new Rorschach coding system". Journal of Forensic Psychology Practice. 13 (5): 389–410. doi:10.1080/15228932.2013.838106. S2CID 143696818.
14. Erard, R. E.; Meyer, G. J.; Viglione, D. J. (2014). "Setting the record straight: Comment on Gurley, Piechowski, Sheehan, and Gray (2014) on the admissibility of the Rorschach performance assessment system (R-PAS) in court". Psychological Injury and Law. 7 (2): 165–177. doi:10.1007/s12207-014-9195-x. S2CID 144034589..