Is the subject of the article within the scope of the subject category?
Yes
2
Are the interpretations / conclusions sound and justified by the data?
Partly
3
Is this a new and original contribution?
Yes
4
Does this paper exemplify an awareness of other research on the topic?
Yes
5
Are structure and length satisfactory?
Yes
6
Can you suggest brief additions or amendments or an introductory statement that will increase the value of this paper for an international audience?
Yes
7
Can you suggest any reductions in the paper, or deletions of parts?
Yes
8
Is the quality of the diction satisfactory?
Yes
9
Are the illustrations and tables necessary and acceptable?
Yes
10
Are the references adequate and are they all necessary?
Yes
11
Are the keywords and abstract or summary informative?
Yes
Other Comments:
This article deals with psychometric properties of the PSQ. However, there are significant shortcomings of the methods used for the purpose of assessing reliability and validity, even this is a preliminary study.
First, absolute minimum of subjects for a psychometric study is 50, and the study considered only 38.
Second, the author evaluated internal consistency reliability that is not “true reliability”, but a measure to what extant items in a questionnaire are correlated and measure the same concept. Therefore, if there is good internal consistency reliability, that does not mean that the questionnaire is free of a measurement error, what is in the base of reliability.
Third, the author used factor analysis to evaluate construct validity. They intended to explore the concept, namely used exploratory factor analysis. This is often done mistakenly using principal Component Analysis (PCA). PCA is not a factor analytical procedure in the basics. Principal axis factoring (PAF) should be used for the intended purpose. Moreover, absolute minimum of subjects for a factor analysis study is 100! Therefore,
See for details. Terwee et al, J Clin epidemiol 2007, 60: 34-42.
Competing interests: None
Invited by the author to review this article? : No
Have you previously published on this or a similar topic?: Yes
References:
Stevanović D, Lakić A, Damnjanović M. Some psychometric properties of the Pediatric Quality of Life Inventory? Version 4.0 Generic Core Scales (PedsQL(TM)) in the general Serbian population.
Qual Life Res. 2010 Dec 29.
Stevanovic D. Serbian KINDL questionnaire for quality of life assessments in healthy children and adolescents: reproducibility and construct validity. Health Qual Life Outcomes. 2009 Aug 28;7:79.
Experience and credentials in the specific area of science:
Psychometrics
How to cite: Stevanovic D .The ?determined? reliability of the measure is not reliable and the ?explored? validity is not reliable, too! [Review of the article 'The Reliability And Validity Of The Postgraduate Stressor Questionnaire (psq) Among Postgraduate Medical Trainees ' by Yusoff M].WebmedCentral 2011;2(2):WMCRW00499
We take your points and will plan a study with better research methodology and statistical analysis (e.g. Confirmatory factor analysis, Composite Reliability and Average Variance Extraceted) to verify our current findings.
Thank you for your constructive review. Responded by
Dr. Muhamad Saiful Bahri Yusoff on 23 Aug 2011 01:07:45 AM
We use cookies on this website to measure and improve performance. By continuing to browse the site, you are agreeing to our use of cookies.
This article deals with psychometric properties of the PSQ. However, there are significant shortcomings of the methods used for the purpose of assessing reliability and validity, even this is a preliminary study.
First, absolute minimum of subjects for a psychometric study is 50, and the study considered only 38.
Second, the author evaluated internal consistency reliability that is not “true reliability”, but a measure to what extant items in a questionnaire are correlated and measure the same concept. Therefore, if there is good internal consistency reliability, that does not mean that the questionnaire is free of a measurement error, what is in the base of reliability.
Third, the author used factor analysis to evaluate construct validity. They intended to explore the concept, namely used exploratory factor analysis. This is often done mistakenly using principal Component Analysis (PCA). PCA is not a factor analytical procedure in the basics. Principal axis factoring (PAF) should be used for the intended purpose. Moreover, absolute minimum of subjects for a factor analysis study is 100! Therefore,
Serbian KINDL questionnaire for quality of life assessments in healthy children and adolescents: reproducibility and construct validity.
Stevanovic D.
Health Qual Life Outcomes. 2009 Aug 28;7:79.
See for details. Terwee et al, J Clin epidemiol 2007, 60: 34-42.
None
No
Yes
Stevanović D, Lakić A, Damnjanović M. Some psychometric properties of the Pediatric Quality of Life Inventory? Version 4.0 Generic Core Scales (PedsQL(TM)) in the general Serbian population. Qual Life Res. 2010 Dec 29. Stevanovic D. Serbian KINDL questionnaire for quality of life assessments in healthy children and adolescents: reproducibility and construct validity. Health Qual Life Outcomes. 2009 Aug 28;7:79.
Psychometrics
Responded by Dr. Muhamad Saiful Bahri Yusoff on 23 Aug 2011 01:07:45 AM