25. WJ IV author classifications Independent classifications
Battery/Test name Broad Narrow Broad Narrow
Tests of Cognitive Ability
01. Oral Vocabulary Gc VL,LD Gc VL
02. Number Series Gf RQ,I Gf RQ
03. Verbal Attention Gwm WM,AC
04. Letter-Pattern Matching Gs P
05. Phonological Processing Ga/Glr PC/LA,FW
06. Story Recall Glr/Gc MM/LS Glr MM
07. Visualization Gv Vz Gv Vz
08. General Information Gc K0 Gc K0
09. Concept Formation Gf I Gf I
10. Numbers Reversed Gwm WM Gwm WM
11. Number-Pattern Matching Gs P Gs P
12. Nonword Repetition Ga/Gwm PC,UM/MS
13. Visual-Auditory Learning Glr MA Glr MA
14. Picture Recognition Gv MV Gv MV
15. Analysis-Synthesis Gf RG Gf RG
16. Object-Number Sequencing Gwm WM Gwm WM
17. Pair Cancellation Gs/Gwm/Gv P/AC/SS Gs P
18. Memory for Words Gwm MS Gwm MS
Expert Consensus Evidence: Comparison of WJ IV author and independent
broad and narrow CHC classifications of WJ III tests retained in WJ IV
Independent classifications based on Flanagan et al. (2013) and Flanagan et al. (2006).
(Reported for all COG, OL and ACH tests)
27. Figural-visual
Speed-fluency
Quantitative-numeric
Reading-writing
Auditory-linguistic
-2 -1 0 1 2
-2
-1
0
1
2
ORLVOC
NUMSER
VRBATN LETPAT
PHNPRO
VAL VISUAL
GENINF
CONFRM NUMREV
NUMPAT
NWDREP
STYREC
PICREC
ANLSYN
OBJNUM
PAIRCN
MEMWRD
PICVOC
O
R
LCM
P
SEGMNT
RPCNAM
SENREP
UNDDIR
SNDBLN
RETFLU
SNDAWR
LWIDNT
APPRO
B
SPELL
PSGCMP
CALC
WRTSMP
WRDATK
ORLRDG
SNRDFL
MTHFLU
SNWFL
RDGREC
NUMMAT
EDIT
WRDFLU
SPLSND
RDGVOC
SCI
SOCHUM
MEMNAM
VRBANL
VISCLO
NUMSEN
Gs-Cog
Gs-Ach
Glr-LA
Ga
Grw
Gwm-
MS
Gv
Glr-MM
Gwm-
WM
Gc
Gq/Gf-RQ
Gf
Use of MDS
Guttman
Radex analysis to
evaluate content
validity
Figure is for WJ IV
norm study
participants from
ages 9-13 (model
development
sample; n = 785).
Results for 6 age
groups presented in
technical manual
28. Sources of validity
evidence presented
•Representativeness of the WJ IV Test Content, Process, and Construct Coverage
•Developmental Patterns of WJ IV Ability Clusters
•Internal Structure and Relations within the WJ IV
•Relationship of WJ IV Scores to Other Measures of Cognitive Abilities, Oral Language,
and Achievement
•Performance of Clinical Samples on WJ IV Measures
31. Stage 3:
Confirmatory
structural
model cross-
validation
phase
Stage 2:
Exploratory structural model
generation (MG) and evaluation
Ages 3-5 A
(n = 209)
Ages 3-5 B
(n = 208)
Ages 6-8 A
(n =412)
Ages 6-8 B
(n = 411)
Ages 9-13 A
(n = 785)
Ages 9-13 B
(n = 787)
Ages 14-19 A
(n = 842)
Ages 14-19 B
(n = 843)
Ages 20-39 A
(n = 625)
Ages 20-39 B
(n = 626)
Ages 40-90+ A
(n = 571)
Ages 40-90+ B
(n = 575 )
Model
Development
(MD)
samples (A)
Model
Cross-Validation
(MCV)
samples (B)
Stage 1:
Split-sample
random sample
generation
Three-stage internal/ structural validity procedures for WJ IV
battery
+
+
Cluster analysis
(CA)
Multidimensional
scaling analysis
(MDS)
Principal
component
analysis
(PCA)
Stage 2A
Exploratory structural
analysis in Sample A
Review of
prior WJ,
WJ-R, WJ III
structural
validity
research
Specify initial
confirmatory
factor analysis
model (CFA)
Review of
contemporary
CHC and
cognitive
neuroscience
research
CFA of MG model
result from MD (A)
sample in MCV (B)
sample(s)
Yes
Most
plausible
and best
fitting
odel?
Model adjustment(s)
No
Stage 2B
Specify initial CFA
models
Stage 2C
Evaluate and adjust
CFA
model
32. Stage 3:
Confirmatory
structural
model cross-
validation
phase
Stage 2:
Exploratory structural model
generation (MG) and evaluation
Ages 3-5 A
(n = 209)
Ages 3-5 B
(n = 208)
Ages 6-8 A
(n =412)
Ages 6-8 B
(n = 411)
Ages 9-13 A
(n = 785)
Ages 9-13 B
(n = 787)
Ages 14-19 A
(n = 842)
Ages 14-19 B
(n = 843)
Ages 20-39 A
(n = 625)
Ages 20-39 B
(n = 626)
Ages 40-90+ A
(n = 571)
Ages 40-90+ B
(n = 575 )
Model
Development
(MD)
samples (A)
Model
Cross-Validation
(MCV)
samples (B)
Stage 1:
Split-sample
random sample
generation
Three-stage internal/ structural validity procedures for WJ IV
battery
+
+
Cluster analysis
(CA)
Multidimensional
scaling analysis
(MDS)
Principal
component
analysis
(PCA)
Stage 2A
Exploratory structural
analysis in Sample A
Review of
prior WJ,
WJ-R, WJ III
structural
validity
research
Specify initial
confirmatory
factor analysis
model (CFA)
Review of
contemporary
CHC and
cognitive
neuroscience
research
CFA of MG model
result from MD (A)
sample in MCV (B)
sample(s)
Yes
Most
plausible
and best
fitting
odel?
Model adjustment(s)
No
Stage 2B
Specify initial CFA
models
Stage 2C
Evaluate and adjust
CFA
model
All Stage 2A
(exploratory)
results reported
in detail in the
technical manual
34. At most ages
7-10 principal
component
exploratory
solutions
were
extracted and
reviewed
35. At most ages
7-10 principal
component
exploratory
solutions
were
extracted and
reviewed
36. At most ages
7-10 principal
component
exploratory
solutions
were
extracted and
reviewed
37. -2 -1 0 1 2
-2
-1
0
1
2
ORLVOC
NUMSER
VRBATN LETPAT
PHNPRO
VAL VISUAL
GENINF
NUMREV
NUMPAT
NWDREP
STYREC
PICREC
ANLSYN
OBJNUM
PAIRCN
MEMWRD
PICVOC
O
R
LCM
P
SEGMNT
RPCNAM
SENREP
UNDDIR
SNDBLN
RETFLU
SNDAWR
LWIDNT
APPRO
B
SPELL
PSGCMP
CALC
WRTSMP
ORLRDG
SNRDFL
MTHFLU
SNWRFL
RDGREC
NUMMAT
EDIT
WRDFLU
SPLSND
RDGVOC
SCI
SOCHUM
MEMNAM
VRBANL
VISCLO
NUMSEN
Gs-Cog
Gs-Ach
Glr-LA
Ga
Grw
Gv
Glr-MM
Gc
Gq/Gf-RQ
Gwm-
WM
Gwm-
MS
WRDATK
MDS
(Guttman
Radex) of
ages 9-13
year sample
(model
development
sample A;
n=785 )
Gf
CONFRM
38. A
Two final WJ IV cross-
validated models reported
across age groups
A = Broad CHC top-down
model.
Results presented for all
cross-validation samples
39. Two final WJ IV cross-
validated models finalized
across age groups
B = Broad+narrow CHC
bottom-up model.
Results presented for all
cross-validation samples
B
40. Stage 3:
Confirmatory
structural
model cross-
validation
phase
Stage 2:
Exploratory structural model
generation (MG) and evaluation
Ages 3-5 A
(n = 209)
Ages 3-5 B
(n = 208)
Ages 6-8 A
(n =412)
Ages 6-8 B
(n = 411)
Ages 9-13 A
(n = 785)
Ages 9-13 B
(n = 787)
Ages 14-19 A
(n = 842)
Ages 14-19 B
(n = 843)
Ages 20-39 A
(n = 625)
Ages 20-39 B
(n = 626)
Ages 40-90+ A
(n = 571)
Ages 40-90+ B
(n = 575 )
Model
Development
(MD)
samples (A)
Model
Cross-Validation
(MCV)
samples (B)
Stage 1:
Split-sample
random sample
generation
Three-stage internal/ structural validity procedures for WJ IV
battery
+
+
Cluster analysis
(CA)
Multidimensional
scaling analysis
(MDS)
Principal
component
analysis
(PCA)
Stage 2A
Exploratory structural
analysis in Sample A
Review of
prior WJ,
WJ-R, WJ III
structural
validity
research
Specify initial
confirmatory
factor analysis
model (CFA)
Review of
contemporary
CHC and
cognitive
neuroscience
research
CFA of MG model
result from MD (A)
sample in MCV (B)
sample(s)
Yes
Most
plausible
and best
fitting
odel?
Model adjustment(s)
No
Stage 2B
Specify initial CFA
models
Stage 2C
Evaluate and adjust
CFA
model
All final Stage 2C
(exploratory) and
Stage 3
(confirmatory cross-
validation) results
reported in detail in
the technical manual
42. Two final WJ IV cross-validated models across age groups: A = Broad CHC top-down model; B = Broad+narrow CHC bottom-up model
A B
99.5 % of test and
latent factor
loadings cross-
validated (were
significant in all
age-differentiated
samples cross-
validation B
samples)
98.6 % of test and
latent factor
loadings cross-
validated (were
significant in all
age-differentiated
samples cross-
validation B
samples)
44. 15 independent WJ IV concurrent validity studies
differentiated by age/grade
WJIV COG compared to:
• WISC-IV, WAIS-IV, WPPSI-III, KABC-II, DAS-II
WJIV OL compared to:
• CELF-F, PPVT-4, CASL, OWLS
WJIV ACH compared to:
• KTEA-II, WAIT-III, OWLS-WE
45. Sources of validity
evidence presented
•Representativeness of the WJ IV Test Content, Process, and Construct Coverage
•Developmental Patterns of WJ IV Ability Clusters
•Internal Structure and Relations within the WJ IV
•Relationship of WJ IV Scores to Other Measures of Cognitive Abilities, Oral Language,
and Achievement
•Performance of Clinical Samples on WJ IV
Measures