META-ANALYSIS OF GENERALISATION OF RELIABILITY: ELABORATION OF A GUIDE FOR ITS CORRECT REALISATION AND REPORTING (Q3152197): Difference between revisions
Jump to navigation
Jump to search
(Created claim: summary (P836): PSYCHOLOGICAL TESTS ARE ROUTINELY USED IN RESEARCH AND PROFESSIONAL PRACTICE IN PSYCHOLOGY. IT IS COMMON FOR RESEARCHERS AND PROFESSIONALS TO FIND THE WRONG BELIEF THAT RELIABILITY IS AN INHERENT PROPERTY OF THE TEST. HOWEVER, THE RELIABILITY VARIES FROM ONE APPLICATION TO ANOTHER OF A TEST, AS IT IS A PROPERTY OF THE TEST SCORES OBTAINED IN A PARTICULAR APPLICATION. TO INVESTIGATE THE RELIABILITY OF TEST SCORES, GENERALISATION OF RELIABILITY (G...) |
(Changed label, description and/or aliases in en: translated_label) |
||
| label / en | label / en | ||
META-ANALYSIS OF GENERALISATION OF RELIABILITY: ELABORATION OF A GUIDE FOR ITS CORRECT REALISATION AND REPORTING | |||
Revision as of 14:51, 12 October 2021
Project Q3152197 in Spain
| Language | Label | Description | Also known as |
|---|---|---|---|
| English | META-ANALYSIS OF GENERALISATION OF RELIABILITY: ELABORATION OF A GUIDE FOR ITS CORRECT REALISATION AND REPORTING |
Project Q3152197 in Spain |
Statements
30,976.0 Euro
0 references
38,720.0 Euro
0 references
80.0 percent
0 references
30 December 2016
0 references
29 December 2019
0 references
UNIVERSIDAD DE MURCIA
0 references
37°59'32.57"N, 1°7'49.94"W
0 references
30030
0 references
LOS TESTS PSICOLOGICOS SON DE USO RUTINARIO EN LA INVESTIGACION Y EN LA PRACTICA PROFESIONAL EN PSICOLOGIA. ES HABITUAL ENCONTRAR ENTRE LOS INVESTIGADORES Y LOS PROFESIONALES LA CREENCIA ERRONEA DE QUE LA FIABILIDAD ES UNA PROPIEDAD INHERENTE AL TEST. SIN EMBARGO, LA FIABILIDAD VARIA DE UNA APLICACION A OTRA DE UN TEST, YA QUE ES UNA PROPIEDAD DE LAS PUNTUACIONES DEL TEST OBTENIDAS EN UNA APLICACION CONCRETA. PARA INVESTIGAR LA FIABILIDAD DE LAS PUNTUACIONES DE LOS TESTS SE LLEVAN A CABO ESTUDIOS DE GENERALIZACION DE LA FIABILIDAD (GF). UN ESTUDIO DE GF ES UN TIPO ESPECIAL DE META-ANALISIS EN EL QUE SE INTEGRAN ESTADISTICAMENTE LOS COEFICIENTES DE FIABILIDAD REPORTADOS EN LOS ESTUDIOS EMPIRICOS QUE HAN UTILIZADO UN DETERMINADO TEST. SU PROPOSITO ES COMPROBAR SI LA FIABILIDAD DE LAS PUNTUACIONES DEL TEST ES GENERALIZABLE EN SUS DIFERENTES APLICACIONES O SI ES HETEROGENEA Y, EN ESE CASO, ENCONTRAR CARACTERISTICAS DE LOS ESTUDIOS QUE EXPLIQUEN AL MENOS PARTE ESA HETEROGENEIDAD. EXISTE EVIDENCIA DE SERIAS DEFICIENCIAS EN LA REALIZACION Y REPORTE DE LOS ESTUDIOS DE GF. ENTRE TALES DEFICIENCIAS CABE SEÑALAR EL POBRE REPORTE DE LOS CRITERIOS DE SELECCION DE LOS ESTUDIOS Y DEL PROCESO DE BUSQUEDA DE LOS ESTUDIOS. TAMBIEN SE HAN OBSERVADO DEFICIENCIAS EN EL PROCESO DE EXTRACCION DE LOS DATOS DE LOS ESTUDIOS, EN LA NO UTILIZACION DE TRANSFORMACIONES DE LOS COEFICIENTES DE FIABILIDAD PARA NORMALIZAR SU DISTRIBUCION Y ESTABILIZAR SUS VARIANZAS Y EN LA ESPECIFICACION DEL MODELO ESTADISTICO ASUMIDO EN LOS CALCULOS META-ANALITICOS. ANTE TODA ESTA EVIDENCIA, EL PROPOSITO DE ESTE PROYECTO ES ELABORAR UNA GUIA PARA LA CORRECTA REALIZACION Y REPORTE DE ESTUDIOS DE GF, EN LA MISMA LINEA QUE LAS GUIAS PRISMA O AMSTAR PARA OTROS TIPOS DE META-ANALISIS. PARA ALCANZAR ESTE OBJETIVO SE REALIZARA UNA REVISION SISTEMATICA DE LOS ESTUDIOS DE GF QUE SE HAN REALIZADO HASTA LA FECHA Y SE VALORARA LA CALIDAD METODOLOGICA Y DEL REPORTE DE LOS MISMOS. MEDIANTE BUSQUEDAS INFORMALES, NUESTRO EQUIPO HA SIDO CAPAZ, HASTA LA FECHA, DE LOCALIZAR 115 ESTUDIOS DE GF. EN ESTA REVISION SISTEMATICA APLICAREMOS LAS GUIAS PRISMA Y AMSTAR Y REALIZAREMOS UNA VALORACION DEL GRADO EN QUE ESTAS GUIAS SON ADECUADAS PARA VALORAR LA CALIDAD DE LOS ESTUDIOS DE GF. NUESTRA HIPOTESIS DE PARTIDA ES QUE LAS GUIAS PRISMA Y AMSTAR NO SON APROPIADAS PARA ESTE FIN. TAMBIEN SE LLEVARAN A CABO AL MENOS TRES ESTUDIOS DE GF DE TESTS PSICOLOGICOS, CON OBJETO DE PODER DISPONER DE BASES DE DATOS DE TESTS HABITUALMENTE UTILIZADOS EN LA INVESTIGACION Y EN LA PRACTICA PSICOLOGICA. CON LAS BASES DE DATOS DE ESTOS ESTUDIOS DE GF, JUNTO CON OTRAS BASES DE DATOS DE OTROS ESTUDIOS DE GF REALIZADOS POR NUESTRO EQUIPO DE INVESTIGACION, REALIZAREMOS NUEVOS CALCULOS META-ANALITICOS PARA COMPROBAR EL GRADO EN QUE LOS RESULTADOS DE LOS ESTUDIOS DE GF SON SENSIBLES A VARIACIONES EN EL MODELO ESTADISTICO APLICADO, EL USO DE TRANSFORMACIONES DE LOS COEFICIENTES DE FIABILIDAD Y EL FACTOR DE PONDERACION. COMO RESULTADO DE LA REALIZACION DE TODOS ESTOS ANALISIS, EL PRODUCTO FINAL DEL PROYECTO SERA LA ELABORACION DE UNA GUIA PARA LA REALIZACION Y REPORTE DE ESTUDIOS DE GF QUE HEMOS CONVENIDO EN DENOMINAR ¿STANDARDS FOR PERFORMING AND REPORTING RELIABILITY GENERALIZATION META-ANALYSES¿, CON EL ACRONIMO REGEMA. (Spanish)
0 references
PSYCHOLOGICAL TESTS ARE ROUTINELY USED IN RESEARCH AND PROFESSIONAL PRACTICE IN PSYCHOLOGY. IT IS COMMON FOR RESEARCHERS AND PROFESSIONALS TO FIND THE WRONG BELIEF THAT RELIABILITY IS AN INHERENT PROPERTY OF THE TEST. HOWEVER, THE RELIABILITY VARIES FROM ONE APPLICATION TO ANOTHER OF A TEST, AS IT IS A PROPERTY OF THE TEST SCORES OBTAINED IN A PARTICULAR APPLICATION. TO INVESTIGATE THE RELIABILITY OF TEST SCORES, GENERALISATION OF RELIABILITY (GF) STUDIES ARE CARRIED OUT. A GF STUDY IS A SPECIAL TYPE OF META-ANALYSIS IN WHICH THE RELIABILITY COEFFICIENTS REPORTED IN EMPIRIC STUDIES THAT HAVE USED A CERTAIN TEST ARE STATISTICALLY INTEGRATED. ITS PURPOSE IS TO CHECK WHETHER THE RELIABILITY OF THE TEST SCORES IS GENERALIZABLE IN ITS DIFFERENT APPLICATIONS OR WHETHER IT IS HETEROGENEOUS AND, IN THAT CASE, FIND CHARACTERISTICS OF THE STUDIES THAT EXPLAIN AT LEAST PART OF THAT HETEROGENEITY. THERE IS EVIDENCE OF SERIOUS DEFICIENCIES IN THE CONDUCT AND REPORTING OF GF STUDIES. AMONG THESE SHORTCOMINGS IS THE POOR REPORT OF THE SELECTION CRITERIA OF THE STUDIES AND THE PROCESS OF SEARCHING FOR THE STUDIES. DEFICIENCIES HAVE ALSO BEEN OBSERVED IN THE PROCESS OF EXTRACTING THE DATA FROM THE STUDIES, IN THE NON-USE OF TRANSFORMATIONS OF RELIABILITY COEFFICIENTS TO NORMALISE THEIR DISTRIBUTION AND STABILISE THEIR VARIANCES AND IN THE SPECIFICATION OF THE STATISTICAL MODEL ASSUMED IN THE META-ANALYTIC CALCULATIONS. GIVEN ALL THIS EVIDENCE, THE PURPOSE OF THIS PROJECT IS TO DEVELOP A GUIDE FOR THE CORRECT CONDUCT AND REPORTING OF GF STUDIES, IN THE SAME LINE AS THE PRISM GUIDES OR AMSTAR FOR OTHER TYPES OF META-ANALYSIS. TO ACHIEVE THIS OBJECTIVE, A SYSTEMATIC REVIEW OF THE STUDIES OF GF THAT HAVE BEEN CARRIED OUT TO DATE WILL BE CARRIED OUT AND THE METHODOLOGICAL QUALITY AND THE REPORT OF THE SAME WILL BE EVALUATED. THROUGH INFORMAL SEARCHES, OUR TEAM HAS BEEN ABLE, TO DATE, TO LOCATE 115 GF STUDIES. IN THIS SYSTEMIC REVIEW WE WILL APPLY THE PRISM AND AMSTAR GUIDES AND PERFORM AN ASSESSMENT OF THE DEGREE TO WHICH THESE GUIDES ARE SUITABLE TO ASSESS THE QUALITY OF GF STUDIES. OUR STARTING HYPOTHESIS IS THAT THE PRISM AND AMSTAR GUIDES ARE NOT APPROPRIATE FOR THIS PURPOSE. AT LEAST THREE GF STUDIES OF PSYCHOLOGICAL TESTS WILL ALSO BE CARRIED OUT, IN ORDER TO BE ABLE TO HAVE DATABASES OF TESTS USUALLY USED IN RESEARCH AND PSYCHOLOGICAL PRACTICE. WITH THE DATABASES OF THESE GF STUDIES, TOGETHER WITH OTHER DATABASES OF OTHER GF STUDIES CARRIED OUT BY OUR RESEARCH TEAM, WE WILL PERFORM NEW META-ANALYTIC CALCULATIONS TO CHECK THE EXTENT TO WHICH THE RESULTS OF THE GF STUDIES ARE SENSITIVE TO VARIATIONS IN THE APPLIED STATISTICAL MODEL, THE USE OF TRANSFORMATIONS OF RELIABILITY COEFFICIENTS AND THE WEIGHT FACTOR. AS A RESULT OF THE REALISATION OF ALL THESE ANALYSES, THE FINAL PRODUCT OF THE PROJECT WILL BE THE ELABORATION OF A GUIDE FOR THE REALISATION AND REPORTING OF GF STUDIES THAT WE HAVE AGREED TO CALL “STANDARDS FOR PERFORMING AND REPORTING RELIABILITY GENERALISATION META-ANALYSES”, WITH THE ACRONIMO REGEMA. (English)
12 October 2021
0 references
Murcia
0 references
Identifiers
PSI2016-77676-P
0 references