{rfName}
In

Indexed in

License and use

Icono OpenAccess

Altmetrics

Grant support

The codes used in the current study are available at an Open Science Framework repository, for reproducibility purposes: https://osf.io/e9f2c/?view_only=3732b311ef304b1793ee92613dcb0fe7.Research reported in this publication was supported by the National Institute on Aging of the National Institutes of Health under award R01AG024270. Luis Eduardo Garrido is supported by Grant 2018-2019-1D2-085 from the Fondo Nacional de Innovacion y Desarrollo Cientifico y Tecnologico (FONDOCYT) of the Dominican Republic. Jotheeswaran Amuthavalli Thiyagarajan and Ritu Sadana are staff members of the World Health Organization. All listed authors alone are responsible for the views expressed in this publication and they do not necessarily represent the decisions, policy, or views of the World Health Organization.

Analysis of institutional authors

Martinez-Molina, AgustinAuthor

Share

June 22, 2020
Publications
>
Article

Investigating the Performance of Exploratory Graph Analysis and Traditional Techniques to Identify the Number of Latent Factors: A Simulation and Tutorial

Publicated to:PSYCHOLOGICAL METHODS. 25 (3): 292-320 - 2019-12-01 25(3), DOI: 10.1037/met0000255

Authors: Golino, Hudson; Shi, Dingjing; Christensen, Alexander P.; Eduardo Garrido, Luis; Dolores Nieto, Maria; Sadana, Ritu; Thiyagarajan, Jotheeswaran Amuthavalli; Martinez-Molina, Agustin;

Affiliations

2 ;‎ Univ North Carolina Greensboro, Dept Psychol, Greensboro, NC USA - Author
3 ;‎ Pontificia Univ Catolica Madre & Maestra, Dept Psychol, Santiago De Los Caballer, Dominican Rep - Author
4 ;‎ Univ Autonoma Madrid, Dept Psychol, Madrid, Spain - Author
5 ;‎ WHO, Dept Agein & Life Course, Geneva, Switzerland - Author
6 ;‎ Univ Zaragoza, Dept Psychol, Zaragoza, Spain - Author
1 ;‎ Univ Virginia, Dept Psychol, 485 McCormick Rd,Gilmer Hall,Room 102, Charlottesville, VA 22903 USA - Author
See more

Abstract

Exploratory graph analysis (EGA) is a new technique that was recently proposed within the framework of network psychometrics to estimate the number of factors underlying multivariate data. Unlike other methods, EGA produces a visual guide-network plot-that not only indicates the number of dimensions to retain, but also which items cluster together and their level of association. Although previous studies have found EGA to be superior to traditional methods, they are limited in the conditions considered. These issues are addressed through an extensive simulation study that incorporates a wide range of plausible structures that may be found in practice, including continuous and dichotomous data, and unidimensional and multidimensional structures. Additionally, two new EGA techniques are presented: one that extends EGA to also deal with unidimensional structures, and the other based on the triangulated maximally filtered graph approach (EGAtmfg). Both EGA techniques are compared with 5 widely used factor analytic techniques. Overall, EGA and EGAtmfg are found to perform as well as the most accurate traditional method, parallel analysis, and to produce the best large-sample properties of all the methods evaluated. To facilitate the use and application of EGA, we present a straightforward R tutorial on how to apply and interpret EGA, using scores from a well-known psychological instrument: the Marlowe-Crowne Social Desirability Scale. Translational Abstract Understanding the structure and composition of data is an important undertaking for a wide range of scientific domains. An initial step in this endeavor is to determine how the data can be summarized into a smaller set of meaningful variables (i.e., dimensions). In this article, we extend a state-of-the-art network science approach, called exploratory graph analysis (EGA), used to identify the dimensions that exist in multivariate data. Using Monte Carlo methods, we compared EGA with several traditional eigenvalue-based approaches that are commonly used in the psychological literature including parallel analysis. Additionally, the simulation study evaluated the performance of new variants of the EGA method and considered a wider set of realistic conditions, such as unidimensional structures and variables of continuous and categorical levels of measurement. We found that EGA performed as well as or better than the most accurate traditional method (i.e., parallel analysis). Importantly, EGA offers a few advantages over traditional methods: (a) it provides an intuitive visual representation of the results, (b) this representation offers a more complex understanding of the data's structure, and (c) the algorithm is deterministic meaning there are fewer researcher degrees of freedom. In sum, our study demonstrates that EGA can accurately identify the underlying structure of multivariate data, while retaining the complexity of the data's structure. This implies that researchers can meaningfully summarize their data without sacrificing the finer details.

Keywords

ComponentsCriteriaDimensionalityExploratory factor analysisExploratory graph analysisInformationNumber of factorsParallel analysisSelectionVariables

Quality index

Bibliometric impact. Analysis of the contribution and dissemination channel

The work has been published in the journal PSYCHOLOGICAL METHODS due to its progression and the good impact it has achieved in recent years, according to the agency WoS (JCR), it has become a reference in its field. In the year of publication of the work, 2019, it was in position 5/138, thus managing to position itself as a Q1 (Primer Cuartil), in the category Psychology, Multidisciplinary. Notably, the journal is positioned above the 90th percentile.

This publication has been distinguished as a “Highly Cited Paper” by the agencies WoS (ESI, Clarivate) and ESI (Clarivate), meaning that it ranks within the top 1% of the most cited articles in its thematic field during the year of its publication. In terms of the observed impact of the contribution, this work is considered one of the most influential worldwide, as it is recognized as highly cited. (source consulted: ESI Nov 14, 2024)

And this is evidenced by the extremely high normalized impacts through some of the main indicators of this type, which, although dynamic over time and dependent on the set of average global citations at the time of calculation, already indicate that they are well above the average in different agencies:

  • Normalization of citations relative to the expected citation rate (ESI) by the Clarivate agency: 17.88 (source consulted: ESI Nov 14, 2024)
  • Weighted Average of Normalized Impact by the Scopus agency: 40.14 (source consulted: FECYT Feb 2024)
  • Field Citation Ratio (FCR) from Dimensions: 88.19 (source consulted: Dimensions Aug 2025)

Specifically, and according to different indexing agencies, this work has accumulated citations as of 2025-08-03, the following number of citations:

  • WoS: 230
  • Scopus: 285
  • Europe PMC: 71

Impact and social visibility

From the perspective of influence or social adoption, and based on metrics associated with mentions and interactions provided by agencies specializing in calculating the so-called "Alternative or Social Metrics," we can highlight as of 2025-08-03:

  • The use, from an academic perspective evidenced by the Altmetric agency indicator referring to aggregations made by the personal bibliographic manager Mendeley, gives us a total of: 194.
  • The use of this contribution in bookmarks, code forks, additions to favorite lists for recurrent reading, as well as general views, indicates that someone is using the publication as a basis for their current work. This may be a notable indicator of future more formal and academic citations. This claim is supported by the result of the "Capture" indicator, which yields a total of: 265 (PlumX).

With a more dissemination-oriented intent and targeting more general audiences, we can observe other more global scores such as:

  • The Total Score from Altmetric: 4.85.
  • The number of mentions on the social network X (formerly Twitter): 9 (Altmetric).

It is essential to present evidence supporting full alignment with institutional principles and guidelines on Open Science and the Conservation and Dissemination of Intellectual Heritage. A clear example of this is:

  • The work has been submitted to a journal whose editorial policy allows open Open Access publication.

Leadership analysis of institutional authors

This work has been carried out with international collaboration, specifically with researchers from: Dominica; Switzerland; United States of America.

There is a significant leadership presence as some of the institution’s authors appear as the first or last signer, detailed as follows: Last Author (MARTINEZ MOLINA, AGUSTIN).