Instructional Materials: Development and Evaluation is a Flipso resource designed to guide learners through the principles, processes, and practices involved in developing effective instructional materials. It covers key concepts, development strategies, and evaluation techniques that help ensure instructional materials are clear, relevant, engaging, and aligned with learning objectives.
UNIT 2: Instructional Materials Development, Evaluation, and Language Assessment Course Learning Outcome: By the end of this unit, learners should be able to: o Explain the principles, theories, and processes involved in instructional materials development and evaluation; and o Analyze existing instructional materials based on pedagogical, linguistic, cultural, and technological criteria. The unit also focuses on the types of English language assessment and the principles of quality assessment, particularly validity, reliability, authenticity, practicality, and fairness. PART I. INSTRUCTIONAL MATERIALS DEVELOPMENT AND EVALUATION 1. What Are Instructional Materials? Instructional materials are resources used by teachers and learners to facilitate teaching and learning. They provide information, practice opportunities, examples, activities, and assessment tasks that help learners achieve specific learning objectives. Instructional materials can be: • Printed – textbooks, worksheets, handouts, modules, flashcards • Visual – pictures, charts, diagrams, posters, infographics • Audio – recordings, podcasts, pronunciation materials • Audiovisual – videos, animations, educational films • Digital – presentations, interactive activities, online lessons, learning management systems • Real-world materials – newspapers, menus, advertisements, maps, forms, websites, brochures Example For an English lesson about ordering food, a teacher may use: 1. A vocabulary worksheet A sample restaurant menu 2. 3. An audio conversation between a customer and waiter 4. A role-play activity 5. An online quiz All of these can function as instructional materials. 1
2. Why Are Instructional Materials Important? Instructional materials are important because they: A. Support learning objectives Materials should help students achieve what the lesson intends them to learn. Example: If the objective is: "Students will be able to identify the main idea of a passage." The material should provide reading passages and activities that practice identifying main ideas. B. Make learning more concrete Some concepts are difficult to understand through explanation alone. Pictures, videos, diagrams, and examples can make abstract concepts easier to understand. C. Provide opportunities for practice Students need opportunities to apply what they have learned. D. Increase learner engagement Interesting and relevant materials can encourage students to participate actively. E. Address different learning needs Students differ in their abilities, interests, backgrounds, and learning preferences. Good materials provide multiple ways to interact with content. 3. Principles of Instructional Materials Development Instructional materials should not simply be created because they "look good." They must be instructionally effective. Important principles include: 2
3.1 Alignment Materials should be aligned with: • Learning outcomes • Content • Teaching strategies • Learning activities • Assessment Example: If the learning outcome requires students to speak English in everyday situations, a material consisting only of grammar exercises may not be sufficient. The material should include speaking activities such as: • dialogues • role-play • pair work • simulations Key idea: Objectives → Materials → Activities → Assessment These elements should work together. 3.2 Relevance Materials should contain information and activities that are relevant to the learners' needs. For English language learners, materials should reflect situations they may actually encounter. Example: Instead of practicing only: "John went to the supermarket." students could practice: "You are buying school supplies. Ask the store employee about the price and availability of an item." 3
The second activity provides a more meaningful context. 3.3 Appropriateness Materials should be appropriate for the learners': • Age • Grade level • Language proficiency • Cognitive ability • Interests • Cultural background A highly technical reading passage may be inappropriate for beginning English learners even if the topic is educational. 3.4 Clarity Instructions must be easy to understand. Poor instruction: "Using the following information, demonstrate your understanding through appropriate linguistic application." Better instruction: "Read the paragraph. Then answer the five questions." Good materials minimize unnecessary confusion. 3.5 Variety Materials should provide different types of activities. For example: • Reading • Writing • Listening • Speaking • Vocabulary • Grammar • Individual activities 4
• Pair activities • Group activities Variety prevents materials from becoming repetitive. 3.6 Authenticity Materials should expose learners to language that resembles real-life communication. For example: • Actual menus • Newspaper articles • Emails • Maps • Advertisements • Public announcements • Social media posts However, authenticity does not mean that every material must be taken directly from the real world. Teachers may adapt authentic materials to match the learners' level. 3.7 Flexibility Good instructional materials can be modified according to: • Learner ability • Class size • Available technology • Time • Learning environment For example, an online activity should ideally have an alternative if some students do not have reliable internet access. 3.8 Learner-Centeredness Materials should encourage students to actively participate rather than simply receive information. Instead of: Teacher explains → Students listen a learner-centered material may provide: 5
Students observe → discuss → analyze → practice → receive feedback PART II. THEORIES RELATED TO INSTRUCTIONAL MATERIALS 4. Behaviorism Behaviorism emphasizes observable behavior and learning through stimulus, response, practice, and reinforcement. In instructional materials, this may appear through: • Drills • Repetition • Immediate feedback • Practice exercises • Correct-answer reinforcement Example: A vocabulary activity gives: beautiful = ______ The student selects: A. magandang B. mabilis C. malaki Correct answers receive feedback. Strength: Useful for practicing: • Vocabulary • Grammar patterns • Pronunciation • Basic language structures Limitation: Too much repetition may not develop higher-order thinking or meaningful communication. 6
5. Cognitivism Cognitivism focuses on mental processes involved in learning. It considers: • Attention • Memory • Understanding • Problem-solving • Information processing Instructional materials based on cognitivism may organize information into: • Concept maps • Categories • Graphic organizers • Sequenced activities • Examples and explanations Example: Before reading a text about climate change, students examine a concept map showing: Climate Change → Causes → Effects → Solutions This helps organize information in the learner's mind. 6. Constructivism Constructivism views learners as active participants who construct knowledge based on their experiences and prior knowledge. Materials based on constructivism often include: • Problem-solving • Projects • Inquiry activities • Collaboration • Real-world tasks • Discovery learning Example: Instead of simply giving students vocabulary about environmental problems, the teacher asks students to examine waste-management problems in their community and propose solutions in English. 7
7. Communicative Language Teaching Communicative Language Teaching, or CLT, emphasizes the ability to use language for meaningful communication. Materials should therefore provide opportunities for: • Interaction • Negotiation of meaning • Real-life communication • Speaking • Listening • Functional language Example: Instead of only teaching: "Could you please...?" students practice using it in a realistic situation: Student A: Customer Student B: Store employee The goal is not merely knowing the grammar but using the language appropriately. PART III. EVALUATING INSTRUCTIONAL MATERIALS 8. What Is Materials Evaluation? Materials evaluation is the systematic process of examining instructional materials to determine whether they are suitable, effective, appropriate, and useful for a particular group of learners. Evaluation asks: "Is this material appropriate and effective for our learners and learning objectives?" Materials evaluation can happen: 8
Before use Pre-use evaluation The teacher examines materials before using them. During use In-use evaluation The teacher observes how effective the materials are while students are using them. After use Post-use evaluation The teacher determines whether the materials actually achieved their intended purpose. PART IV. FOUR CRITERIA FOR ANALYZING INSTRUCTIONAL MATERIALS The CILO specifically requires analysis based on: 1. Pedagogical 2. Linguistic 3. Cultural 4. Technological 9. PEDAGOGICAL CRITERIA Pedagogy refers to the principles and practices involved in teaching and learning. When evaluating materials pedagogically, ask: A. Are the objectives clear? Does the material clearly support what students are expected to learn? B. Is the content appropriate? 9
Is it appropriate for the learners': • Age? • Grade? • Level? • Learning needs? C. Does it encourage learning? Does the material provide opportunities to: • Practice? • Apply knowledge? • Think critically? • Collaborate? • Communicate? D. Is there appropriate scaffolding? Scaffolding means providing support that helps learners complete increasingly difficult tasks. Example: Step 1: Vocabulary introduction ↓ Step 2: Guided practice ↓ Step 3: Pair activity ↓ Step 4: Independent task E. Does it provide feedback? Students should have opportunities to determine whether their answers or performance are correct and how they can improve. 10. LINGUISTIC CRITERIA Linguistic evaluation focuses on the quality and appropriateness of the language used in the material. 10
Consider: Vocabulary Is the vocabulary: • Appropriate to the learners' level? • Useful? • Clearly explained? Grammar Are grammatical structures: • Correct? • Appropriate? • Presented clearly? Pronunciation For speaking and listening materials, is pronunciation: • Accurate? • Understandable? • Appropriate to the target context? Language skills Does the material appropriately develop: • Listening • Speaking • Reading • Writing Register Register refers to the level or style of language appropriate to a particular situation. Compare: 11
Informal: "What's up?" Formal: "How are you?" A good material teaches learners when different forms are appropriate. 11. CULTURAL CRITERIA Language cannot be separated completely from culture. When evaluating cultural content, ask: A. Does the material represent cultures fairly? Materials should avoid presenting one culture as superior to another. B. Does it avoid stereotypes? A stereotype is an oversimplified belief about a group. For example, materials should avoid suggesting that: "All members of a particular culture behave in exactly the same way." C. Is the material culturally sensitive? It should respect differences in: • Religion • Traditions • Family structures • Social practices • Gender roles • Customs • Values D. Does it represent diverse perspectives? Learners should encounter different people, experiences, and communities. E. Is the cultural content relevant? Culture should contribute to learning rather than simply being decorative. 12
12. TECHNOLOGICAL CRITERIA Technology has become an important component of instructional materials. When evaluating digital materials, consider: Accessibility Can students easily access the material? Usability Is the platform easy to navigate? Technical quality Are: • Audio clear? • Videos understandable? • Images readable? • Links working? Interactivity Does technology allow learners to: • Respond? • Practice? • Receive feedback? • Explore content? Compatibility Can students access the material using available: • Phones • Tablets • Computers • Browsers • Internet connections? 13
Digital safety Materials should also consider: • Privacy • Appropriate online behavior • Safe websites • Responsible use of digital resources PART V. A SIMPLE MATERIALS EVALUATION FRAMEWORK When analyzing an English instructional material, you can use this sequence: 1. Identify the objective ↓ 2. Examine the content ↓ 3. Evaluate pedagogy ↓ 4. Evaluate language ↓ 5. Evaluate culture ↓ 6. Evaluate technology ↓ 7. Determine strengths and weaknesses ↓ 8. Decide whether to adopt, adapt, or reject the material Adopt Use the material as it is. Adapt Modify parts of the material. Reject Do not use the material because it does not meet the learners' needs or standards. 14
PART VI. TYPES OF ENGLISH LANGUAGE ASSESSMENT 13. What Is Assessment? Assessment is the systematic process of collecting information about learners' knowledge, skills, abilities, and progress. Assessment can help teachers answer: What do students already know? What are they learning? What difficulties do they have? What have they learned? 14. DIAGNOSTIC ASSESSMENT Diagnostic assessment is conducted before instruction or at the beginning of a learning period to identify students' existing knowledge, skills, strengths, and weaknesses. Purpose To determine: • What students already know • What they do not know • Their learning needs • Areas requiring additional support Examples • Pre-tests • Placement activities • Reading assessments • Vocabulary checks • Grammar diagnostic tests Example: Before teaching paragraph writing, the teacher asks students to write a short paragraph. The teacher discovers that many students have difficulty with: • Sentence structure • Organization • Punctuation 15
The teacher can then adjust instruction. Keyword: DIAGNOSE Think: Before teaching → Find out where learners are. 15. FORMATIVE ASSESSMENT Formative assessment takes place during instruction. Its primary purpose is to monitor learning and provide feedback that can improve learning. Examples • Short quizzes • Exit tickets • Question-and-answer activities • Draft writing • Classroom discussions • Peer feedback • Teacher observation • Practice exercises Example: Students write a paragraph. The teacher reviews the drafts and tells students: "Your main idea is clear, but your supporting details need to be more specific." Students revise their work. Key word: IMPROVE During learning → Check progress → Give feedback → Improve. 16. SUMMATIVE ASSESSMENT Summative assessment is usually conducted at the end of an instructional period to determine the extent to which learning outcomes have been achieved. 16
Examples • Final examinations • End-of-unit tests • Final projects • Term examinations • Final presentations • Culminating performances Example: After completing a unit on academic writing, students take a final writing assessment. The teacher evaluates whether they achieved the intended learning outcomes. Key word: SUMMARIZE After learning → Determine achievement. 17. DIAGNOSTIC vs. FORMATIVE vs. SUMMATIVE Type When? Main Purpose Diagnostic Before instruction Identify needs Formative During instruction Monitor and improve learning Summative After instruction Determine achievement Easy memory: Diagnostic = BEFORE Formative = DURING Summative = AFTER 18. NORM-REFERENCED ASSESSMENT A norm-referenced assessment (NRA) compares a learner's performance with the performance of a larger reference group. 17
The question is essentially: "How did this learner perform compared with other learners?" Results may be reported using: • Percentiles • Ranks • Standard scores Example: A student performs better than 85% of the students who took the same assessment. The student's performance is interpreted in relation to the group. Common purpose: • Ranking • Selection • Classification • Large-scale testing Key idea: Norm = Compare with others. 19. CRITERION-REFERENCED ASSESSMENT A criterion-referenced assessment (CRA) measures a learner's performance against a predetermined standard, criterion, or learning objective. The question is: "Has the learner achieved the expected standard?" Example: Learning objective: Students should correctly use at least 8 out of 10 target vocabulary words in context. If the learner meets the criterion, the objective has been achieved. The learner does not need to outperform other students. 18
Key idea: Criterion = Compare with a standard. 20. NORM-REFERENCED vs. CRITERION-REFERENCED Norm-Referenced Criterion-Referenced Compares learners with others Compares learners with standards Focuses on relative performance Focuses on mastery Ranking may be important Achievement of objectives is important “How did you perform compared with others? “Did you meet the standard?” Memory trick: NORM = OTHERS CRITERION = STANDARD 21. ALTERNATIVE ASSESSMENT Alternative assessment refers to assessment approaches that go beyond traditional paper-and- pencil tests. It often focuses on learners' ability to apply knowledge and skills in meaningful contexts. Examples include: • Portfolios • Projects • Presentations • Performances • Role-playing • Journals • Self-assessment • Peer assessment • Observation • Learning logs 19
Portfolio Assessment A portfolio is a purposeful collection of a learner's work showing development and achievement over time. For an English class, a portfolio might contain: • First writing draft • Revised writing • Final essay • Reflection • Reading activities • Speaking tasks The teacher can observe the learner's development. Performance Assessment Students demonstrate what they can actually do. Example: Instead of taking a multiple-choice test about conversations, students perform a real-life dialogue. Self-Assessment Students evaluate their own learning. Example: "I can introduce myself confidently in English." Students rate their own level of performance and identify areas for improvement. Peer Assessment Students provide feedback on the work of their classmates using established criteria. PART VII. PRINCIPLES OF QUALITY ASSESSMENT A high-quality language assessment should demonstrate: 1. Validity 2. Reliability 3. Authenticity 20
4. Practicality 5. Fairness These principles help determine whether an assessment is actually useful and appropriate. 22. VALIDITY Validity refers to the extent to which an assessment actually measures what it is intended to measure. Simple definition: Validity = Are we measuring the right thing? Example: Learning objective: Students will demonstrate oral communication skills. Assessment: A 50-item written grammar test. Problem: The test may measure grammar knowledge, but it does not adequately measure actual oral communication ability. Therefore, the assessment may have limited validity for that particular objective. Example of a valid assessment: Students participate in a structured conversation and are evaluated using criteria such as: • Fluency • Pronunciation • Vocabulary • Grammar • Interaction 21
Types of Validity Content Validity Does the assessment adequately represent the content or skills it is supposed to measure? Construct Validity Does the assessment actually measure the theoretical ability or construct it claims to measure? Example: If a test claims to measure reading comprehension, it should primarily assess reading comprehension rather than unrelated factors. Criterion-Related Validity How well assessment results relate to an external criterion or established measure. 23. RELIABILITY Reliability refers to the consistency of assessment results. Simple definition: Reliability = Can we get consistent results? If an assessment is reliable, similar conditions should generally produce similar results. Example: Imagine two teachers assess the same speaking performance. Teacher A gives 95. Teacher B gives 72. If both teachers used the same rubric but interpreted the criteria very differently, the assessment may have a reliability problem. 22
Factors affecting reliability: • Unclear questions • Ambiguous instructions • Inconsistent scoring • Poor testing conditions • Too few assessment items • Rater differences 24. AUTHENTICITY Authenticity refers to how closely an assessment task reflects real-world language use and meaningful communication. Simple definition: Authenticity = Does the task resemble real-life language use? Less authentic: Choose the correct preposition. More authentic: Write an email requesting information about a school program. The second task requires students to use language for an actual communicative purpose. 25. PRACTICALITY Practicality refers to whether an assessment is manageable in terms of: • Time • Cost • Resources • Administration • Scoring • Available technology • Teacher workload 23
Example: A speaking assessment requiring 10 minutes per student may be valuable, but if there are 50 students and only one teacher, administration may be difficult. A practical assessment balances quality with available resources. Simple definition: Practicality = Can we realistically conduct it? 26. FAIRNESS Fairness means that assessment should provide learners with an equitable opportunity to demonstrate what they know and can do. A fair assessment should avoid unnecessary barriers unrelated to the learning objective. Fair assessment considers: • Appropriate language level • Clear instructions • Accessible materials • Appropriate accommodations when needed • Cultural sensitivity • Unbiased content • Consistent scoring Example: Suppose an English test is intended to measure reading comprehension. If many questions depend heavily on specialized background knowledge unrelated to the reading skill, some students may be disadvantaged for reasons unrelated to the target ability. PART VIII. THE FIVE PRINCIPLES COMPARED Principle Main Question Validity Are we measuring what we intend to measure? Reliability Are the results consistent? Authenticity Does the task resemble real-life language use? Practility Can we realistically administer and score it? Fairness Does every learner have an equitable opportunity to demonstrate learning? 24
Easy memory: V-R-A-P-F V = Validity → Right thing R = Reliability → Consistent A = Authenticity → Real life P = Practicality → Possible F = Fairness → Equitable PART IX. HOW TO ANALYZE AN ENGLISH LANGUAGE ASSESSMENT When evaluating a test or assessment, use the following questions: 1. What is the learning objective? What should students know or be able to do? 2. What type of assessment is it? Is it: • Diagnostic? • Formative? • Summative? • Norm-referenced? • Criterion-referenced? • Alternative? 3. Is it valid? Does it measure the intended skill? 4. Is it reliable? Will scoring and results be reasonably consistent? 5. Is it authentic? Does it resemble meaningful language use? 6. Is it practical? Can the teacher realistically administer and score it? 25
7. Is it fair? Does it provide an equitable opportunity for students to demonstrate their abilities? PART X. SAMPLE ANALYSIS Material/Assessment: A teacher gives students a final English-speaking task. Each student has three minutes to introduce themselves, describe their interests, and answer questions from the teacher. Pedagogical Analysis The activity provides an opportunity to apply speaking skills in a meaningful context. It can support communicative learning. Linguistic Analysis The assessment can evaluate: • Vocabulary • Grammar • Pronunciation • Fluency • Appropriate expressions Cultural Analysis The questions should avoid requiring students to reveal sensitive personal information or assume that all students have the same family, cultural, or social experiences. Technological Analysis If the task is recorded digitally, the teacher should ensure that the recording system is accessible and that students understand how it will be used. Validity If the objective is oral communication, a speaking task is generally more directly aligned with the objective than a purely written test. 26
Reliability A clear speaking rubric should be used to make scoring more consistent. Authenticity Introducing oneself and answering questions are realistic communicative activities. Practicality The teacher needs to consider the number of students and available time. Fairness All students should receive comparable instructions, sufficient preparation, and reasonable opportunities to demonstrate their skills. PART XI. INTEGRATING INSTRUCTIONAL MATERIALS AND ASSESSMENT Instructional materials and assessment should not be treated as completely separate components. They should form a coherent system: Learning Objectives ↓ Instructional Materials ↓ Learning Activities ↓ Assessment ↓ Feedback ↓ Improvement Example Objective: Students will be able to write a formal email. Material: Sample formal emails + vocabulary guide + email structure. Activity: Students identify parts of a formal email. 27
Practice: Students write a draft. Formative assessment: Teacher provides feedback. Summative assessment: Students submit a final formal email. Evaluation: Teacher uses a rubric based on content, organization, language, and appropriateness. This demonstrates alignment among instruction, materials, activities, and assessment. PART XII. KEY CONCEPTS TO REMEMBER Instructional Materials: Resources used to facilitate teaching and learning. Materials Development: The process of designing, producing, adapting, and organizing instructional resources. Materials Evaluation: The systematic examination of materials to determine their quality, appropriateness, and effectiveness. Pedagogical: Related to teaching and learning. Linguistic: Related to language, including vocabulary, grammar, pronunciation, and language skills. Cultural: Related to beliefs, values, traditions, identities, practices, and perspectives. Technological: Related to the use, accessibility, usability, and effectiveness of technology. QUICK REVIEWER Types of Assessment Diagnostic → Before instruction → Identifies strengths, weaknesses, and needs 28
Formative → During instruction → Monitors learning and provides feedback Summative → After instruction → Measures achievement Norm-Referenced → Compares learner with other learners Criterion-Referenced → Compares learner with a predetermined standard Alternative → Uses nontraditional or performance-based methods Quality Assessment Validity → Measures the intended construct Reliability → Produces consistent results Authenticity → Reflects meaningful real-world language use Practicality → Feasible in terms of time, cost, resources, and administration Fairness → Provides equitable opportunities for learners 29
ONE-MINUTE MEMORY GUIDE Before = Diagnostic During = Formative After = Summative Others = Norm-Referenced Standard = Criterion-Referenced Real-world/Performance = Alternative Assessment Right thing = Validity Consistent = Reliability Real life = Authenticity Possible = Practicality Equitable = Fairness Good instructional materials = Pedagogically sound + Linguistically appropriate + Culturally responsive + Technologically suitable The central idea of Unit 2 is that good instructional materials and good assessments must be purposeful, appropriate, and aligned with learning objectives. Materials should be examined not only for their content and appearance but also for their pedagogical effectiveness, linguistic accuracy, cultural sensitivity, and technological suitability. Likewise, language assessments should be evaluated through validity, reliability, authenticity, practicality, and fairness to ensure that assessment results genuinely represent learners' abilities. 30