Qualitative comparative analysis

In statistics, qualitative comparative analysis (QCA) is a data analysis based on set theory to examine the relationship of conditions to outcome. QCA describes the relationship in terms of necessary conditions and sufficient conditions.^[1] The technique was originally developed by Charles Ragin in 1987^[2] to study data sets that are too small for linear regression analysis but large for cross-case analysis.^[3]

Summary of technique

In the case of categorical variables, QCA begins by listing and counting all types of cases which occur, where each type of case is defined by its unique combination of values of its independent and dependent variables. For instance, if there were four categorical variables of interest, {A,B,C,D}, and A and B were dichotomous (could take on two values), C could take on five values, and D could take on three, then there would be 60 possible types of observations determined by the possible combinations of variables, not all of which would necessarily occur in real life. By counting the number of observations that exist for each of the 60 unique combination of variables, QCA can determine which descriptive inferences or implications are empirically supported by a data set. Thus, the input to QCA is a data set of any size, from small-N to large-N, and the output of QCA is a set of descriptive inferences or implications the data supports.

In QCA's next step, inferential logic or Boolean algebra is used to simplify or reduce the number of inferences to the minimum set of inferences supported by the data. This reduced set of inferences is termed the "prime implicates" by QCA adherents. For instance, if the presence of conditions A and B is always associated with the presence of a particular value of D, regardless of the observed value of C, then the value that C takes is irrelevant. Thus, all five inferences involving A and B and any of the five values of C may be replaced by the single descriptive inference "(A and B) implies the particular value of D".

To establish that the prime implicants or descriptive inferences derived from the data by the QCA method are causal requires establishing the existence of causal mechanism using another method such as process tracing, formal logic, intervening variables, or established multidisciplinary knowledge.^[4] The method is used in social science and is based on the binary logic of Boolean algebra, and attempts to ensure that all possible combinations of variables that can be made across the cases under investigation are considered.

Motivation

The technique of listing case types by potential variable combinations assists with case selection by making investigators aware of all possible case types that would need to be investigated, at a minimum, if they exist, in order to test a certain hypothesis or to derive new inferences from an existing data set. In situations where the available observations constitute the entire population of cases, this method alleviates the small N problem by allowing inferences to be drawn by evaluating and comparing the number of cases exhibiting each combination of variables. The small N problem arises when the number of units of analysis (e.g. countries) available is inherently limited. For example: a study where countries are the unit of analysis is limited in that are only a limited number of countries in the world (less than 200), less than necessary for some (probabilistic) statistical techniques. By maximizing the number of comparisons that can be made across the cases under investigation, causal inferences are according to Ragin possible.^[5] This technique allows the identification of multiple causal pathways and interaction effects that may not be detectable via statistical analysis that typically requires its data set to conform to one model. Thus, it is the first step to identifying subsets of a data set conforming to particular causal pathway based on the combinations of covariates prior to quantitative statistical analyses testing conformance to a model; and helps qualitative researchers to correctly limit the scope of claimed findings to the type of observations they analyze.

Criticism

As this is a logical (deterministic) and not a statistical (probabilistic) technique, with "crisp-set" QCA (csQCA), the original application of QCA, variables can only have two values, which is problematic as the researcher has to determine the values of each variable. For example: GDP per capita has to be divided by the researcher in two categories (e.g. low = 0 and high = 1). But as this variable is essentially a continuous variable, the division will always be arbitrary. A second, related problem is that the technique does not allow an assessment of the effect of the relative strengths of the independent variables (as they can only have two values).^[5] Ragin, and other scholars such as Lasse Cronqvist, have tried to deal with these issues by developing new tools that extend QCA, such as multi-value QCA (mvQCA) and fuzzy set QCA (fsQCA). Note: Multi-value QCA is simply QCA applied to observations having categorical variables with more than two values. Crisp-Set QCA can be considered a special case of Multi-value QCA.^[6]

Statistical methodologists have argued that QCA's strong assumptions render its findings both fragile and prone to type I error. Simon Hug argues that deterministic hypotheses and error-free measures are exceedingly rare in social science and uses Monte Carlo simulations to demonstrate the fragility of QCA results if either assumption is violated.^[7] Chris Krogslund, Donghyun Danny Choi, and Mathias Poertner further demonstrate that QCA results are highly sensitive to minor parametric and model-susceptibility changes and are vulnerable to type I error.^[8] Bear F. Braumoeller further explores the vulnerability of the QCA family of techniques to both type I error and multiple inference.^[9] Braumoeller also offers a formal test of the null hypothesis and demonstrates that even very convincing QCA findings may be the result of chance.^[10]

Response to criticisms

QCA can be performed probabilistically or deterministically with observations of categorical variables. For instance, the existence of a descriptive inference or implication is supported deterministically by the absence of any counter-example cases to the inference; i.e. if a researcher claims condition X implies condition Y, then, deterministically, there must not exist any counterexample cases having condition X, but not condition Y. However, if the researcher wants to claim that condition X is a probabilistic 'predictor' of condition Y, in another similar set of cases, then the proportion of counterexample cases to an inference to the proportion of cases having that same combination of conditions can be set at a threshold value of for example 80% or higher. For each prime implicant that QCA outputs via its logical inference reduction process, the "coverage" — percentage out of all observations that exhibit that implication or inference — and the "consistency" — the percentage of observations conforming to that combination of variables having that particular value of the dependent variable or outcome — are calculated and reported, and can be used as indicators of the strength of such an explorative probabilistic inference. In real-life complex societal processes, QCA enables the identification of multiple sets of conditions that are consistently associated with a particular output value in order to explore for causal predictors.

Fuzzy set QCA aims to handle variables, such as GDP per capita, where the number of categories, decimal values of monetary units, becomes too large to use mvQCA, or in cases were uncertainty or ambiguity or measurement error in the classification of a case needs to be acknowledged.^[11]

Fields of use

QCA has now become used in many more fields than political science which Ragin first developed the method for.^[12] Today the method has been used in:

• Business (e.g. Romme 1995; Kask and Linton 2013; for a review see Misangyi et al. 2017^[13])^[14][15]
• Information Systems Management (e.g. Lee et al. 2019;^[16] for a review see Mattke et al. 2021^[3])
• Project Management (e.g. Invernizzi et al. 2020)^[17]
• Human behavior (e.g. Olya and Akhshik 2019)^[18]
• Innovation Management (e.g. Sukhov et al. 2018;^[19] Aşkun et al. 2021^[20])
• Entrepreneurship (e.g. Linton and Kask 2017)^[21]
• Education (e.g. Stevenson 2013)^[22]
• Environmental sciences (e.g. Basurto 2013)^[23]
• Health research (e.g. Blackman 2013)^[24]
• Retailing (e.g. Johansson and Kask 2017)^[25]
• Tourism (e.g. Olya & Altinay 2015; Olya & Gavilyan, 2016; Olya & Mehran, 2017;^[26][27][28] Çizel et. al. 2021^[29])
• Political science (e.g. Bara 2014; Binder 2015; Schneider and Maerz 2017)^[30][31][32]

See also

• Quine–McCluskey algorithm
• CORA - Combinational Regularity Analysis

References

1. Ragin, Charles C. (2014). The comparative method : moving beyond qualitative and quantitative strategies : with a new introduction. Oakland, California. ISBN 978-0-520-95735-0. OCLC 881322765.
2. Ragin, Charles C. (1987). The Comparative Method: Moving Beyond Qualitative and Quantitative Strategies. University of California Press.
3. Mattke, Jens; Maier, Christian; Weitzel, Tim; Thatcher, Jason Bennett (2021-01-01). "Qualitative comparative analysis in the information systems discipline: a literature review and methodological recommendations". Internet Research. ahead-of-print (ahead-of-print): 1493–1517. doi:10.1108/INTR-09-2020-0529. ISSN 1066-2243. S2CID 235510041.
4. qualitative comparative analysis - History Of qualitative comparative analysis | Encyclopedia.com: Dictionary Of Sociology
5. J. Goldthorpe, "Current issues in comparative macrosociology" in Comparative social research, 16, 1997, pp. 1–26.
6. Rihoux, Benoît (2006), "Qualitative Comparative Analysis (QCA) and Related Systematic Comparative Methods: Recent Advances and Remaining Challenges for Social Science Research", International Sociology, 21 (5): 679, doi:10.1177/0268580906067836, S2CID 14390758
7. Hug, Simon (2013-04-01). "Qualitative Comparative Analysis: How Inductive Use and Measurement Error Lead to Problematic Inference". Political Analysis. 21 (2): 252–265. doi:10.1093/pan/mps061. ISSN 1047-1987.
8. Krogslund, Chris; Choi, Donghyun Danny; Poertner, Mathias (2015-01-01). "Fuzzy Sets on Shaky Ground: Parameter Sensitivity and Confirmation Bias in fsQCA". Political Analysis. 23 (1): 21–41. doi:10.1093/pan/mpu016. ISSN 1047-1987.
9. Braumoeller, Bear F. (2015-07-25). "Guarding Against False Positives in Qualitative Comparative Analysis". Political Analysis. 23 (4): 471–487. doi:10.1093/pan/mpv017. ISSN 1047-1987.
10. Braumoeller, Bear (2015-05-19). "QCAfalsePositive: Tests for Type I Error in Qualitative Comparative Analysis (QCA)". Comprehensive R Archive Network. R Project. Retrieved 2015-08-26.
11. Rihoux, Benoît (2013), "QCA, 25 Years after"The Comparative Method": Mapping, Challenges, and Innovations--Mini-Symposium", Political Research Quarterly, 66: 167–235, doi:10.1177/1065912912468269
12. Roig-Tierno, Norat; Gonzalez-Cruz, Tomas F.; Llopis-Martinez, Jordi (2017-01-01). "An overview of qualitative comparative analysis: A bibliometric analysis". Journal of Innovation & Knowledge. 2 (1): 15–23. doi:10.1016/j.jik.2016.12.002. ISSN 2444-569X.
13. Misangyi, Vilmos F.; Greckhamer, Thomas; Furnari, Santi; Fiss, Peer C.; Crilly, Donal; Aguilera, Ruth (2017-01-01). "Embracing Causal Complexity: The Emergence of a Neo-Configurational Perspective". Journal of Management. 43 (1): 255–282. doi:10.1177/0149206316679252. ISSN 0149-2063. S2CID 64878752.
14. Romme, A.G.L. (1995), Self-organizing Processes in Top Management Teams: A Boolean Comparative Approach. Journal of Business Research 34 (1): 11-34.
15. Kask and Linton (2013) Business mating: when startups get it right http://www.tandfonline.com/doi/abs/10.1080/08276331.2013.876765#.U0UIwvl_t8E
16. Lee, Jae-Nam; Park, YoungKi; Straub, Detmar; Koo, Yunmo (2019-12-01). "Holistic Archetypes of IT Outsourcing Strategy: A Contingency Fit and Configurational Approach". Management Information Systems Quarterly. 43 (4): 1201–1225. ISSN 0276-7783.
17. Invernizzi, Diletta Colette; Locatelli, Giorgio; Brookes, Naomi; Davis, Allison (2020-11-01). "Qualitative comparative analysis as a method for project studies: The case of energy infrastructure". Renewable and Sustainable Energy Reviews. 133: 110314. doi:10.1016/j.rser.2020.110314. ISSN 1364-0321. S2CID 224852514. Archived from the original on 14 September 2020.
18. Olya, Hossein G. T.; Akhshik, Arash (23 January 2018). "Tackling the Complexity of the Pro-environmental Behavior Intentions of Visitors to Turtle Sites". Journal of Travel Research. 58 (2): 313–332. doi:10.1177/0047287517751676. S2CID 158334028.
19. SUKHOV, ALEXANDRE; SIHVONEN, ANTTI; OLSSON, LARS E.; MAGNUSSON, PETER R. (2018-11-28). "That Makes Sense to Me: Openness to Change and Sensemaking in Idea Screening". International Journal of Innovation Management. 22 (8): 1840009. doi:10.1142/s1363919618400091. ISSN 1363-9196.
20. Aşkun, Volkan; Çi̇zel, Rabia; Çi̇zel, Beykan (2021-08-01). "Ülkelerin İnovasyon Düzeyinin Sosyal Sermaye, Ekonomik Değer Algısı ve Politik Kültürle Karmaşık İlişkisi: Bulanık Küme Nitel Karşılaştırmalı Analiz". Eskişehir Osmangazi Üniversitesi İktisadi ve İdari Bilimler Dergisi (in Turkish). 16 (2): 317–340. doi:10.17153/oguiibf.895910. ISSN 1306-6730. S2CID 238790554.
21. Linton, Gabriel; Kask, Johan (2017). "Configurations of entrepreneurial orientation and competitive strategy for high performance". Journal of Business Research. 70: 168–176. doi:10.1016/j.jbusres.2016.08.022. ISSN 0148-2963.
22. Stevenson 2013. "Does Technology have an Impact on Learning? A Fuzzy Set Analysis of Historical Data on the Role of Digital Repertoires in Shaping the Outcomes of Classroom Pedagogy." Computers & Education 69 (0): 148-58.
23. Basurto, X. (2013), "Linking Multi-Level Governance to Local Common-Pool Resource Theory using Fuzzy-Set Qualitative Comparative Analysis: Insights from Twenty Years of Biodiversity Conservation in Costa Rica." Global Environmental Change 23 (3): 573-87.
24. Blackman, T. (2013), "Exploring Explanations for Local Reductions in Teenage Pregnancy Rates in England: An Approach Using Qualitative Comparative Analysis." Social Policy and Society 12 (1):61-72.
25. Johansson, Tobias; Kask, Johan (2017). "Configurations of business strategy and marketing channels for e-commerce and traditional retail formats: A Qualitative Comparison Analysis (QCA) in sporting goods retailing". Journal of Retailing and Consumer Services. 34: 326–333. doi:10.1016/j.jretconser.2016.07.009. ISSN 0969-6989.
26. Olya, Hossein GT; Mehran, Javaneh (2017-06-01). "Modelling tourism expenditure using complexity theory". Journal of Business Research. 75: 147–158. doi:10.1016/j.jbusres.2017.02.015.
27. Olya, Hossein G. T.; Altinay, Levent (2016). "Asymmetric modeling of intention to purchase tourism weather insurance and loyalty". Journal of Business Research. 69 (8): 2791–2800. doi:10.1016/j.jbusres.2015.11.015.
28. Olya, Hossein; Gavilyan, Yaqub (2017). "Configurational Models to Predict Residents' Support for Tourism Development". Journal of Travel Research. 56 (7): 893–912. doi:10.1177/0047287516667850. S2CID 157763812.
29. Çi̇zel, Beykan; Kirtil, İsmail Gökay; Çi̇zel, Rabia; Aşkun, Volkan (2021-12-01). "Covid-19 Pandemisi Sürecinde Seyahatten Kaçınma Niyetinin Karmaşıklık Bakış Açısı ile Analizi". Anatolia: Turizm Araştırmaları Dergisi (in Turkish). 32 (2): 212–223. doi:10.17123/atad.896981. ISSN 1300-4220. S2CID 239749559.
30. Bara C. Incentives and opportunities: A complexity-oriented explanation of violent ethnic conflict. Journal of Peace Research. 2014;51(6):696-710. doi:10.1177/0022343314534458
31. Binder M. Paths to intervention: What explains the UN’s selective response to humanitarian crises? Journal of Peace Research. 2015;52(6):712-726. doi:10.1177/0022343315585847
32. Schneider, C.Q., Maerz, S.F. Legitimation, cooptation, and repression and the survival of electoral autocracies. Z Vgl Polit Wiss 11, 213–235 (2017). https://doi.org/10.1007/s12286-017-0332-2

Further reading

• Duşa, Adrian (2008-10-01) [September 2007]. "A mathematical approach to the boolean minimization problem". Quality & Quantity. 44: 99–113. doi:10.1007/s11135-008-9183-x. S2CID 123042755. Article number: 99 (2010). (22 pages)
• Duşa, Adrian (2007). "Enhancing Quine-McCluskey" (PDF). University of Bucharest. (PDF) from the original on 2020-05-12. Retrieved 2020-05-12. (16 pages) (NB. QCA, an open source, R based implementation used in the social sciences.)

External links

• COMPASSS (COMPArative Methods for Systematic cross-caSe analySis), a website dedicated to qualitative comparative analysis