1. Primary and Intermediate Measures of Music Audiation Carlee Francisco & Morgan Soja

3. $100 for the complete kit

4. http://www.giamusic.comIMMA Edwin Gordon, GIA Publications Inc., 1979, 1986. $100 for the complete kit http://www.giamusic.com Other products available

5. Purpose of Tests Designed to act as an objective aid Teachers and parents Help each child make the best use of his or her music aptitudes Provide appropriate opportunities and instruction PMMA and IMMA:

6. Purpose of Tests cont. Used periodically to evaluate tonal and rhythm aptitudes. Comparing scores helps inform instruction for child’s individual music needs. Used periodically to identify high achieving children who can profit from additional music activities. (PMMA is not designed to exclude). Used periodically to provide normative analysis (comparing each child with other children) to inform instruction and further the child’s individual music needs.

7. What is audiation? Gordon states: “Audiation takes places when one hears and feels music through recall or creativity, the sound not being physically present except when one is audiating while also aurally perceiving music that is being performed by others or that one is performing himself.” PMMA and IMMA = immediate reaction No memory involved

8. Individualized instruction requires understanding of aptitude Developmental music aptitude for young children seems directly concerned with same and different Stabilized music aptitude for older children and adults seems indirectly concerned with same and different Children and adults audiate differently thus, learn music differently, thus must be taught differently

9. Level PMMA K-Grade 3 Teaching 4-12, not necessarily appropriate Test audiation, identify students for remediation IMMA Grades 1-6 Developmental aptitude, AND stabilized aptitude Students with high achievement (80%+) on PMMA Changes in aptitude cannot be made by comparing scores on PMMA and IMMA. 5-6th grade chorus

10. Validity Content Concurrent Inverse Concurrent Congruent Longitudinal Predictive

11. Content Validity Gordon states: “unless the teacher who uses a test is satisfied that the test content fairly represents factors which should be measured, he will have no confidence in the results of the tests, even if the objective validity of the test is overwhelming.” Review of the manual, the purpose, the studies that provide the basis for the tests.

12. Intercorrelation of Test Items Intercorrelation was significant at the 1% level if the coefficient was .23 or higher. Only pairs of items that were intercorrelated at ±.30 or higher were used on the tests.

13. Intercorrelation of Test Items cont. 26% (422) of tonal pattern intercorrelations≤ .30 were positive, 8% negative (34% or 544 total) 17% (277) of rhythm pattern intercorrelations ≤ .30 were positive, 9% (147) negative (26% or 424 total) Lower rhythm is likely due to lower reliability on rhythm test items and test.

14. Concurrent Validity Gordon notes that correlation of test scores with teacher given grades is not the best measure of validity for a test of music aptitude. Constant variation of developmental music aptitude

15. Concurrent Validity cont. Chesnut Hill Academy – Philadelphia, PA Private boys school Music teacher asked to rate children on 5-point scale for overall music aptitude.

16. Chesnut Hill Academy cont. Music teacher ratings were correlated with IMMA scores * Note low rhythm correlations – emphasis of need to use test to diagnose musical strengths and weaknesses in all children

17. Concurrent Validity cont. Jenkintown, PA - Elementary School Band director (4th Grade) asked to rate children on a five-point scale for overall music aptitude 32 students in fourth grade – 21 in instrumental class (group who received ratings) IMMA was administered to children after ratings given

18. Jenkintown, PA cont. Music teacher ratings were correlated with IMMA scores Follow up study was conducted

19. Jenkintown, PA cont. 11 students that were not involved in instrumental class No real differences in the means of groups *Highest scoring student was in non-instrumental group

20. Concurrent Validity cont. West Irondequoit – Kindergarten 1st, 2nd , 3rd Means and standard deviations for PMMA given approximately two weeks apart show less than 1.3 points gained or lost when students were re-tested Practice effects do not effect validity of the PMMA or IMMA

21. Concurrent Validity cont. PMMA Test-Retest Means and Standard Deviations

22. Inverse Concurrent Validity PMMA and IMMA should have little in common with tests that are designed for purposes other than measuring music aptitude PMMA scores (tonal, rhythm, composite) were correlated with scores on academic achievement and intelligence tests.

23. Inverse Concurrent Validity cont. Kindergarten

24. Inverse Concurrent Validity cont. Grade One

25. Inverse Concurrent Validity cont. Grade Two

26. Inverse Concurrent Validity cont. Grade Three

27. Inverse Concurrent Validity cont. Grade Three

28. Inverse Concurrent Validity cont. Correlations between PMMA and academic/intelligence tests are low Correlations are similar to that of MAP and academic/intelligence tests Valid music aptitude tests should have no more than 15% of their variance in common with academic tests. What is in common is likely due to behaviors that are similar.

29. Congruent Validity Correlation of two tests that are designed for the same purposes Examination of PMMA, IMMA and MAP

30. Congruent Validity cont. Great Valley, PA PMMA and IMMA administered approximately one month apart

31. Congruent Validity cont. Correlations of PMMA and IMMA

32. Congruent Validity cont. Correlations of PMMA and IMMA are almost as high as split halves reliabilities for IMMA The two tests share much in common High scores on PMMA suggest need to administer IMMA

33. Congruent Validity cont. Troy, NY – IMMA and MAP -Only Tonal Imagery and Rhythm Imagery sections of MAP were used

34. Congruent Validity cont. IMMA has as much in common with the MAP as it has with the PMMA Valid for developmental and stabilized music aptitude

35. Congruent Validity cont. West Irondequoit, NY – 4th Grade PMMA and MAP administered to 227 children in 4th grade over 3 week period

36. Congruent Validity cont. High scores for 4th graders Ceiling effect Split halves reliabilities: Coefficients were corrected PMMA has more in common with IMMA than MAP

37. Longitudinal Predictive Validity Plymouth Meeting, PA – Parochial School Students required to take violin for one year Just after receiving violins and/or playing for no longer than a year, the PMMA was administered to 26 students who were 7 or 8 years old At the end of one year of violin instruction, students performed on violin and were rated in three categories by two judges

38. Longitudinal Predictive Validity cont. PMMA and Instrumental Performance Achievement One year predictive validity coefficients for PMMA are comparable to three year predictive validity coefficients for MAP

39. Longitudinal Predictive Validity cont. Violin teacher rated students (on a five point scale) in overall music aptitude after teaching them for one year Validity coefficients are lower than longitudinal predictive validity coefficients. -Teacher’s knowledge of music aptitude is less accurate than what PMMA can determine even before instruction

40. Longitudinal Predictive Validity cont. Hunter College Elementary – NYC, NY Five year old children from two classes (n=13, and n=10) PMMA administered before 12 week group violin lessons were taught by one instructor Children performed by rote two musical phrases with rhythmic variation Children’s performances were reviewed by two judges, whose ratings were correlated with PMMA scores

41. Longitudinal Predictive Validity cont. Hunter College Elementary – NYC, NY PMMA Longitudinal Predictive Validity Coefficients using Instrumental Performance Achievement

42. Longitudinal Predictive Validity cont. Chesnut Hill, PA 33 students, aged nine ( 4th grade) studied violin and recorder for one semester each IMMA was administered before instrumental instruction After instructional period, students sang two songs that they then performed on their instrument Two judges evaluated melodic and rhythmic accuracy and musical expression

43. Longitudinal Predictive Validity cont. Chesnut Hill, PA IMMA Longitudinal Predictive Validity Coefficients using Ratings of Instrumental Performance Achievement

44. Longitudinal Predictive Validity cont. Chesnut Hill, PA Coefficients are similar to predictive validity coefficients for the PMMA and the MAP To study practice and training effects, on the IMMA tests were given at the end of the instructional period Negligible differences IMMA is a valid test of developmental and stabilized music aptitude, and practice and training have no effect on a valid test of stabilized music aptitude

45. Longitudinal Predictive Validity cont. IMMA Pre and Post Instruction Means and SD IMMA Pre-and Post Instruction Correlations

47. Test-Retest Reliability

49. Reliability IMMA Reliability and SE

50. Reliability Tonal test reliabilities were higher Could be due to difficulty with audiation of rhythm patterns for young children IMMA includes criterion scores used for indentifying students with exceptionally high music aptitude Children who achieved the criterion score or higher received a 2, and those who did not were awarded a 1. Test-Retest reliabilities for criterion scores are higher than the split-halves reliabilities and lower than the test-retest reliabilities of the raw scores Odd/Even scores were not used for IMMA Abnormal distribution of item difficulties

51. Test Construction 2 subtests – Tonal, Rhythm Items presented on CD (although directions refer to cassette tape) First example is announced then played, second example is announced, then played Children circle two happy faces for “same”, one happy, one sad face for “different” Directions are spoken (female voice), examples are played on synthesizer

52. Standardization Process Instructions are clear Audio device where children can hear Answer sheets on desk when students come in, or given afterwards K – students may sit on floor and spread out Extra pencils for students Student’s name on answer sheet (clearly) Become familiar with recording before administering Make sure children understand Teacher may start and stop recording at any time Clearly written directions in manual

53. Manual Face validity  Attractiveness  Orderly and understandable  Necessary information provided  Usefulness to test administrator 

54. Manual Face validity  Attractiveness  Orderly and understandable  Necessary information provided  Usefulness to test administrator 

55. Audio Recording Quality of directions on recording is good Quality of tonal examples is good Rhythmic examples are difficult to hear at times Presentation is currently in CD form (previously cassette tape)

56. Scoring & Answer Sheet Scoring masks provided = Easy, quick scoring Accurate scoring with no machine CONVERSION OF SCORES? Answer sheet is clear and easily understandable Use of pictures instead of numbers

57. Norms

58. Norms cont.

59. Item Discrimination

60. Item Difficulty

61. Uses

62. General Opinion