Construct Development, Scale Creation, and Process Analysis
Cathleen Buckley, Christina Drakeford, Taquanta Johnson, Chad Hughes
PSYCH/655 – Psychometrics
November 5, 2018
Dr. Amy Logsdon
?
Construct Development, Scale Creation, and Process Analysis
Part I – Construct Development and Scale Creation
A. Construct to measure
1. Test Anxiety
a. Elementary (1st grade-6th grade)
b. Middle school (7th-8th grade)
c. High school (9th-12th grade)
d. College (Undergraduate)

B. Operational definition of the construct using three (3) peer-related journal articles
1. ..
2. ..
3. ..

C. Five items to sample the domain
1. Difficulty concentrating
a. Negative self-image
2. Restlessness
a. Inability to standstill, pacing, fidgeting, wringing hands/hair
3. Irritability
a. Short-tempered
4. Worry
a. Test performance
1. Cognitive
a. Preparing and taking
5. Emotional
a. Physiological reaction/responses
D. Selected method of scaling appropriate for the domain
1. Self-Reporting instrument
a. Paired comparisons
E. Justify selected scaling method
1. Valid data both qualitative and quantitative
a. Data can be collected at a low cost from different groups of people
2. Questions can be quantifiable
b. Easier to compare data between larger groups

F. Formatted items into an instrument to query respondents
G. Justify the interview or self-report instrument
1. This is considered a self-report instrument
a. The norm and reliability measure creates a self-reported test.
?
Part II – Analysis and Justification
Construct Development, Scale Creation, and Process Analysis
Many students experience test anxiety which frequently occurs during taking tests and at the risk of their consequences. Sufferers display this specific anxiety before taking a test and during the actual test-taking. The symptoms consist of specific, cognitive sections, and physiological effects (Pekrun, 2001). Test anxiety is a common phenomenon and drastically impacts students’ academic progress as well as, their physical and mental well-being. Given the pressures and increased number of tests required for an education, there is a necessity for construct development, a valid scale creation, and an analysis to measure test anxiety effects on students with the potential of academic and future issues.
This essay analyzes how this instrument is normalized and its reliability measures, determine the number of participants in the study, and defines their characteristics. In addition, it explains to whom the instrument is generalized, how validity is established and describes the item selection methodology. Lastly, it discusses whether cut-off scores are established and explains how the item selection is evaluated.
Description of Instrument Norm and Reliability Measures Used
“The instrument norm is designed for a group of test takers as a reference for evaluation, interpretation, and context placement of their individual test scores” (Cohen, Swerdlik ; Sturman, 2018, I-26). In this instance, a norm-referenced test would establish a baseline to exam cognitive functions using score comparisons and performance statistics to test its impact on test anxiety. For example, data may include poor test preparation to students’ traits of freezing on a test to heightened self-confidence. Using previouslysur established reliability measurements provide a method to compare similar constructs to other tests. A tool for reliability measurement is situation-specific to focus on emotional and cognitive measurements. This would emphasize study habits and skills, test perceptions, emotional factors and possibly, cognitive scale measurements for consistency over time (Cohen, Swerdlik & Sturman, 2018).
Number of Participants
We are working with a small population; therefore, the sample size is larger. This study has 400 students from local elementary, middle school, high school, and one university. For an equal representation, 25 male and 25 female (50) students will be randomly selected from each group and age appropriate according to grade level. Collection of data would occur during study hall and through study groups and surveys the one week prior to final exams where anxiety would be the highest.
Respondent Characteristics
In the article Anxious for Success….(n.d.), it was found that test anxiety correlates to a subsection of performance stressors and consists of cognitive, behavioral, and physiological characteristics. Each sample has its own unique stressors indicated in Table 1. Test anxiety characteristics surpass normal levels of studying students, when placed in stressful circumstances, that result in students performing poorly. The New York State Board found students who exhibit test anxiety often view testing situations as an aversive personal threat. When this occurs, they display high levels of anxiety under testing or evaluating conditions (Anxious for Success…, n.d.).
Respondent Characteristics
Elementary School Restlessness, irritability, aches and pains, temper tantrums, nightmare, nausea
Middle Internalized – worry or withdrawal
Physical symptoms, stomach aches
High School Excessive worry and insomnia, and preoccupied.
Keep worries to themselves
College Fear of failure, threatening situation, thoughts of inadequacy or incapability

Table 1. Anxious for Success….(n.d.)

Explanation To Whom the Instrument is Generalized
How Validity is Established
Methodology of Item Selection
The methodology of this test is to better understand how often a student develops test anxiety while attending academic classes. To research their frequency, the question will be
‘how often do they have anxiety when presented with taking tests and the results of the tests’ consequences. Additional insight into the frequency of test anxiety can be obtained by using a random selection of different age groups. Test reliability and the validity of the results are vital to properly score data. Appropriate timing of the test and following testing regulations and procedures will assist with increasing the test’s success.
Decision to Establish Cut-Off Scores
The cut-off score will be established and depend on the success of passing the exam or not. Since the norm test will be baselined, it is imperative that all students exceed the baseline for an accurate measurement. Simultaneously, comparison of scores will help evaluate the factors associated with poor study habits and other test anxiety issues. A standard (cut-off score) is required to establish a subjective argument rather than stating whether the students were successful during the test or not. However, if the test was not successful, justification is required. The cut-off score will provide support to determine the severity of the impact and the anxiety-driven factors effects on the students while testing.
Item Selection Evaluation
The DSM is very detailed about how worrying, irritability, and how the mind can draw blanks. Not only are these symptoms present, but many others. Sweats, inability to focus, and/or restlessness are other common symptoms of anxiety in general. Therefore, once these symptoms are understood a serious of yes or no questions must be asked. A detailed questionnaire can be given before the exam is even administered to help in detecting who may be suffering from a form of anxiety. In this situation, it would be evident that the factor is the exam the students are about to take. These questions would first be administered to those who have clinically been diagnosed with test anxiety. Once they complete the questionnaire then it can be given to the students. The answers are compared, reviewed and considered prior to taking the exam. This would assist as a preliminary review of which students experience symptoms of test anxiety.
Conclusion chris
References
Cohen, R. J., Swerdlik, M. E. ; Sturman, E. D. (2018). Psychological testing and assessment: An introduction to tests and measurement (9th ed.). New York, NY: McGraw-Hill.
Anxious for Success: High Anxiety in New York’s Schools (n.d.). New York State School Boards Association. Retrieved from
https://www.nyssba.org/clientuploads/nyssba_pdf/Test_Anxiety_Report.pdf
Pekrun, R. (2001). Test Anxiety and Academic Achievement. International Encyclopedia of the Social & Behavioral Sciences,15610-15614. doi:10.1016/b0-08-043076-7/02451-7