Overview
Supports exam/assessment question creation and learning assessment design. It provides a learning assessment system that reflects analysis of past questions from the CSAT, civil service exams, and certification exams, mock exam creation, Bloom's Taxonomy-based item design, error analysis sheet generation, and 2026 edtech trends (AI automated scoring and error clinics).
Trigger Keywords
exam, past questions, certification, CSAT, question creation, assessment, quiz, learning assessment, mock exam, TOEIC, TOEFL, civil service exam, school exam, formative assessment, summative assessment, Bloom's Taxonomy
Workflow
Step 1: Identify Assessment Purpose
Assessment Type:
- Formative Assessment: Check understanding during learning (quiz, short answer)
- Summative Assessment: Measure achievement after learning (exam, certification mock exam)
Target Exam Type:
- CSAT (College Scholastic Ability Test)
- Civil Service Exam (administrative/technical)
- Certification Exam (Information Processing Engineer, Certified Real Estate Agent, etc.)
- Language Test (TOEIC, TOEFL, OPIC)
- School Exam (school achievement assessment)
Step 2: Set the Scope of Questions
Set Learning Objectives:
- Define units, topics, and core concepts
- Determine difficulty ratio (high/medium/low)
- Distribute by Bloom's Taxonomy level
Bloom's Taxonomy-based item design:
| Cognitive Level | Description | Example Item Types |
|---|---|---|
| Remember | Fact memorization | Term definitions, year matching |
| Understand | Concept explanation | Summary, comparison, classification |
| Apply | Actual use | Problem solving, calculation |
| Analyze | Identify structure | Cause analysis, identifying relationships |
| Evaluate | Judgment/critique | Validity evaluation, critique |
| Create | New output | Design, writing, project |
Step 3: Select Item Types
Multiple Choice:
- 4-option multiple choice (general)
- 5-option multiple choice (civil service, CSAT)
Short Answer/Essay:
- Short answer (keyword)
- Simple essay (2-3 lines)
- Essay (long-form)
True/False & Fill-in-the-Blank:
- True/False quiz
- Fill-in-the-blank
Mixed Composition:
- Multiple choice 70% + short answer 20% + essay 10%
Step 4: Write Items
Item Writing Principles:
- Directly linked to learning objectives
- Clear and unambiguous sentences
- Appropriate difficulty (target 50-70% correct answer rate)
- Distractor options as logical error types
Includes correct answers and explanations:
- Mark correct answers
- Explanations (including why wrong for incorrect options)
Step 5: Review and incorrect answer analysis table
Core concept linkage by question:
- Core concept assessed by the question
- Related unit/topic
Supplementary learning direction for incorrect answers:
- Error type analysis by incorrect option
- Recommended supplementary learning links/materials
2026 Korean assessment trends
AI-based assessment automation
Reflecting EduTech Korea Fair and AI courseware trends:
- Automated scoring: AI automatically scores short-answer and essay questions and provides feedback
- Automated question generation: AI generates questions aligned with educational objectives (including simple recall → higher-order thinking questions)
- Individualized incorrect answer clinic: Analyze each learner's incorrect answer patterns → recommend customized supplementary problems
- Competency mapping: Visualize learning depth by labeling each question's Bloom's Taxonomy level
Characteristics of major Korean exams
| Exam | Characteristics | AI utilization points |
|---|---|---|
| CSAT | Mixed multiple-choice + essay for Korean, math, English, and inquiry | Past exam pattern analysis, weakness diagnosis |
| Civil service exam | 5-choice multiple choice, fast accuracy | Automated repetitive memorization, mock exams |
| TOEIC/TOEFL | Reading, listening, speaking, writing | AI pronunciation correction, essay feedback |
| Certification | Varies by subject, includes practical exams | Automated theory question generation, practical exam preparation checklist |
| School exams | Diverse question-setting standards by school | Textbook-based predicted questions, performance assessment preparation |
Usage examples
Example 1: "Create 10 mock practical exam questions for the Information Processing Engineer certification" → Select unit → Allocate difficulty → Generate questions → Correct answers and explanations
Example 2: "Create predicted school exam questions that could appear in this unit" → Check learning objectives → Allocate Bloom's levels → Create mixed questions
Example 3: "Create a 4-week study plan targeting TOEIC 700" → Check current score → Analyze weaknesses → Weekly study plan → Mock exam schedule
Example 4: "Design formative assessment questions to evaluate students' comprehension" → Check learning objectives → Generate quiz questions → Incorrect answer analysis table
Deliverables
- Exam/assessment question paper (including correct answers and explanations)
- Mock exams (certification, civil service, school exams)
- Study plan (weekly, by target score)
- Incorrect answer analysis table (including supplementary learning direction)
- Past Exam Analysis Report
Precautions
Access to educational materials:
- If educational materials are inaccessible, questions can be generated if you provide only the learning objectives and a list of key concepts
- When creating questions based on a specific publisher's textbook, the textbook unit titles and key content must be entered
When learning objectives are unclear:
- First check the exam type and target level, then set the objectives together
Difficulty adjustment:
- If high/medium/low ratios are specified, distribute accordingly
Copyright of official exam past questions:
- Copyrighted past exam materials cannot be reproduced without permission
Related Skills
- moai-coworker/education-curriculum-designer: Curriculum design, defining learning objectives
- moai-coworker/education-research-assistant: Academic paper writing, data analysis
moai-coworker:ai-slop-reviewer— Final output AI slop review (Post-review, required)moai-writer:korean-humanize— Korean AI-ness removal (required after slop review)
When not to use this skill
- Curriculum and lecture plan design → the moai-tutor:education-curriculum-designer skill is more suitable
- Academic paper/report writing → use the moai-tutor:education-research-assistant skill
- Taking exams on behalf of someone → certification exams must be taken directly at the relevant institution
References
| File | Load Conditions |
|---|---|
| references/exam-prep.md | When analyzing exam trends, diagnosing weaknesses, creating customized study plans, mock exams, and error analysis |