{"id":7644,"date":"2026-07-17T09:04:33","date_gmt":"2026-07-17T09:04:33","guid":{"rendered":"https:\/\/tahricteaches.com\/esl-test-questions-ai-distractors\/"},"modified":"2026-07-17T12:03:43","modified_gmt":"2026-07-17T12:03:43","slug":"esl-test-questions-ai-distractors","status":"publish","type":"post","link":"https:\/\/tahricteaches.com\/uk\/esl-test-questions-ai-distractors\/","title":{"rendered":"Writing ESL Test Questions With AI: The Art of the Distractor"},"content":{"rendered":"<p class=\"wp-block-paragraph\">Ask an AI assistant to &#8220;write ten multiple-choice questions on the present perfect&#8221; and you will have a quiz on your screen before your coffee cools. The problem is not speed \u2014 it is that the quiz almost always looks better than it works. The correct answer is obvious, the wrong options are throwaway filler, and a student who knows nothing can still guess their way to a passing mark. Fluent English is not the same as a good test, and this is exactly where most teachers get let down by AI.<\/p><p class=\"wp-block-paragraph\">The single skill that separates a usable AI-generated test from a decorative one is the ability to shape the <em>distractors<\/em> \u2014 the wrong answers. This guide walks through how to prompt for assessment items that measure real ability, how to calibrate difficulty without a pilot group, how to catch the cultural bias AI quietly bakes in, and how to build answer keys and rubrics you can actually defend to a parent or a program director.<\/p><h2 class=\"wp-block-heading\">Why AI struggles with assessment even when its English is perfect<\/h2>\n<figure class=\"wp-block-embed is-type-video is-provider-youtube wp-block-embed-youtube wp-embed-aspect-16-9 wp-has-aspect-ratio\"><div class=\"wp-block-embed__wrapper\">\n<iframe width=\"560\" height=\"315\" src=\"https:\/\/www.youtube.com\/embed\/9Ch4a6ffPZY?feature=oembed\" title=\"Writing ESL Test Questions With AI: The Art of the Distractor\" frameborder=\"0\" allow=\"accelerometer; autoplay; clipboard-write; encrypted-media; gyroscope; picture-in-picture; web-share\" referrerpolicy=\"strict-origin-when-cross-origin\" allowfullscreen><\/iframe>\n<\/div><\/figure><p class=\"wp-block-paragraph\">A language model is trained to produce the most probable, most helpful-sounding text. That instinct works against you in testing. When you ask for a wrong answer, the model tends to produce something obviously, comfortably wrong \u2014 because &#8220;wrong but plausible&#8221; is a harder target than &#8220;wrong and clearly signposted.&#8221; The result is a question where the right choice glows on the page.<\/p><p class=\"wp-block-paragraph\">Assessment also has a hidden requirement that fluency does not: every question is supposed to measure one specific thing. A well-built item isolates a single skill or piece of knowledge, so that a wrong answer tells you <em>which<\/em> misunderstanding a student holds. AI does not know what you are trying to measure unless you tell it, and it will happily blend three different grammar points into one confusing question if you let it. The fix is not a better model \u2014 it is a better prompt and a teacher who knows what the question is for.<\/p><h2 class=\"wp-block-heading\">Start with the construct, not the question<\/h2><p class=\"wp-block-paragraph\">Before you type a prompt, decide what the item is supposed to reveal. Testing people call this the <em>construct<\/em> \u2014 the specific ability behind the question. &#8220;The present perfect&#8221; is too broad to be a construct. &#8220;Choosing between the present perfect and the simple past when a time reference is present&#8221; is a construct. So is &#8220;recognizing that <em>for<\/em> \u0456 <em>since<\/em> pair with different kinds of time expressions.&#8221;<\/p><p class=\"wp-block-paragraph\">When you hand the AI the construct instead of the topic, the quality of the output changes immediately. Compare these two prompts:<\/p><blockquote class=\"wp-block-quote is-layout-flow wp-block-quote-is-layout-flow\"><p><strong>Weak:<\/strong> &#8220;Write a multiple-choice question about the present perfect for B1 learners.&#8221;<\/p><p><strong>Strong:<\/strong> &#8220;Write one multiple-choice question for B1 learners that tests whether a student can choose the present perfect over the simple past when the sentence contains an unfinished time period like <em>this week<\/em>. Each wrong answer should reflect a real learner error, not a random tense.&#8221;<\/p><\/blockquote><p class=\"wp-block-paragraph\">The second prompt does most of the assessment design for you. You are no longer asking for a question; you are asking for a measurement. That framing is what turns AI from a quiz vending machine into a genuine drafting partner.<\/p><figure class=\"wp-block-image size-large\"><figure class=\"wp-block-image size-large\"><img decoding=\"async\" width=\"1080\" height=\"720\" src=\"https:\/\/tahricteaches.com\/wp-content\/uploads\/2026\/07\/esl-test-questions-ai-distractors-3.jpg\" alt=\"gray and white click pen on white printer paper\" class=\"wp-image-7640\" srcset=\"https:\/\/tahricteaches.com\/wp-content\/uploads\/2026\/07\/esl-test-questions-ai-distractors-3.jpg 1080w, https:\/\/tahricteaches.com\/wp-content\/uploads\/2026\/07\/esl-test-questions-ai-distractors-3-768x512.jpg 768w, https:\/\/tahricteaches.com\/wp-content\/uploads\/2026\/07\/esl-test-questions-ai-distractors-3-18x12.jpg 18w, https:\/\/tahricteaches.com\/wp-content\/uploads\/2026\/07\/esl-test-questions-ai-distractors-3-600x400.jpg 600w\" sizes=\"(max-width: 1080px) 100vw, 1080px\" \/><figcaption class=\"wp-element-caption\">gray and white click pen on white printer paper<\/figcaption><\/figure><\/figure><h2 class=\"wp-block-heading\">The real skill: writing distractors that reveal thinking<\/h2><p class=\"wp-block-paragraph\">A distractor is only doing its job if a student who holds a specific misconception is genuinely pulled toward it. Good distractors are the difference between a question that measures learning and one that measures luck. The best wrong answers come straight from the errors your students actually make.<\/p>\n<figure class=\"wp-block-image size-large\"><img decoding=\"async\" src=\"https:\/\/tahricteaches.com\/wp-content\/uploads\/2026\/07\/esl-english-teacher-whiteboard.jpg\" alt=\"ESL teacher at an English whiteboard guiding a student, illustrating how well-crafted distractors reveal learner thinking\"\/><\/figure><h3 class=\"wp-block-heading\">What makes a distractor work<\/h3><p class=\"wp-block-paragraph\">A strong distractor is plausible to someone who half-understands the point, and it maps to a diagnosable error. If a student picks it, you should be able to say exactly what they got wrong. In a present-perfect item, useful distractors might include the simple past (the classic overgeneralization), the present continuous (a common substitution from lower levels), and a subtly wrong participle form. Each one, if chosen, tells you something you can teach to next lesson.<\/p><p class=\"wp-block-paragraph\">Weak distractors, by contrast, are answers no reasonable student would consider: a wildly wrong tense, an obviously ungrammatical fragment, or a word from a different topic entirely. They pad the question to four options without adding any measurement. When AI gives you these \u2014 and it usually does on the first pass \u2014 that is your cue to push back rather than accept the draft.<\/p><h3 class=\"wp-block-heading\">The prompt pattern that gets you there<\/h3><p class=\"wp-block-paragraph\">The pattern that consistently produces better distractors is to make the AI justify each wrong answer. Add a line like: &#8220;For each option, state in a parenthesis the learner misconception it represents. If an option does not correspond to a real error, replace it.&#8221; This forces the model to reason about why a student would choose each answer, and it exposes the lazy fillers instantly \u2014 because the AI cannot invent a plausible misconception for a throwaway option.<\/p><p class=\"wp-block-paragraph\">A second reliable move is to feed the AI your students&#8217; actual mistakes. Paste three or four real error sentences from recent homework and say: &#8220;Base the distractors on the kinds of errors in these examples.&#8221; Now the wrong answers reflect your classroom instead of a generic global average, and the test starts diagnosing the students in front of you.<\/p><h2 class=\"wp-block-heading\">Calibrating difficulty without a pilot group<\/h2><p class=\"wp-block-paragraph\">Professional test writers trial their questions on real students and throw out the ones that are too easy or too hard. Classroom teachers rarely have that luxury, but AI can approximate the process if you ask the right question. Instead of asking &#8220;is this too hard?&#8221;, ask the model to role-play your learners.<\/p>\n<figure class=\"wp-block-image size-large\"><img decoding=\"async\" src=\"https:\/\/tahricteaches.com\/wp-content\/uploads\/2026\/07\/esl-classroom-assessment-distractors.jpg\" alt=\"ESL classroom with whiteboard and open workbooks on a desk, representing calibrating test difficulty without a pilot group\"\/><\/figure><p class=\"wp-block-paragraph\">A prompt like &#8220;Estimate what percentage of a typical B1 class would answer this correctly, and explain which distractor would trap the weakest third of the class&#8221; gives you a rough difficulty read and a sanity check in one move. It is not psychometric data, but it flags the two failure modes that matter most: a question so easy everyone passes it (measuring nothing) and a question so tangled that even strong students miss it (measuring test-reading, not English).<\/p><p class=\"wp-block-paragraph\">You can also ask the AI to produce the same construct at two difficulty levels \u2014 one for your stronger group and one for learners who need scaffolding. Because the construct is fixed, both versions test the same skill, which keeps a mixed-ability class fair while still meeting students where they are.<\/p><h2 class=\"wp-block-heading\">Catching the bias AI quietly builds in<\/h2><p class=\"wp-block-paragraph\">Language models lean heavily on the cultures that dominate their training data. Left alone, they will set reading passages in American shopping malls, name characters Jake and Emily, and assume everyone celebrates Thanksgiving. For an international classroom, that is a fairness problem: a question that requires cultural knowledge a student does not have is testing background, not English.<\/p>\n<figure class=\"wp-block-image size-large\"><img decoding=\"async\" src=\"https:\/\/tahricteaches.com\/wp-content\/uploads\/2026\/07\/esl-online-lesson-ai-testing.jpg\" alt=\"Young ESL student in an online lesson with a teacher on screen, illustrating checking AI-generated tests for hidden bias\"\/><\/figure><p class=\"wp-block-paragraph\">Two habits keep this in check. First, specify the context in your prompt: &#8220;Use neutral, internationally recognizable situations \u2014 no holidays, sports, or foods specific to one country.&#8221; Second, run a dedicated review pass after the questions are drafted: &#8220;Review these items for cultural or regional knowledge that a learner outside North America might not have, and flag anything that could disadvantage them.&#8221; The AI is surprisingly good at auditing bias when you ask it to \u2014 it simply will not do it unprompted. This same review discipline is worth applying to any AI-generated content, not just tests.<\/p><h2 class=\"wp-block-heading\">Building answer keys and rubrics you can defend<\/h2><p class=\"wp-block-paragraph\">An answer key is not just a list of letters. For any question that could reasonably have two defensible answers, you need to know why the key is what it is \u2014 because a sharp student or an unhappy parent will eventually ask. When you generate items with AI, generate the rationale alongside them: &#8220;For each answer, write one sentence explaining why it is correct and why the closest distractor is not.&#8221; Keep that rationale in your files. It doubles as instant feedback you can hand back to students.<\/p><p class=\"wp-block-paragraph\">For open-ended and writing tasks, AI is genuinely strong at drafting rubrics, but treat its first version as a starting point. Ask it to build a rubric tied to the same construct \u2014 &#8220;a four-band rubric for a short opinion paragraph, describing what distinguishes each band in terms of task completion, range, and accuracy&#8221; \u2014 then edit the descriptors into your own words and your program&#8217;s standards. The AI handles the tedious scaffolding; you supply the judgment about what actually counts as good work in your room.<\/p><figure class=\"wp-block-image size-large\"><figure class=\"wp-block-image size-large\"><img decoding=\"async\" width=\"1080\" height=\"608\" src=\"https:\/\/tahricteaches.com\/wp-content\/uploads\/2026\/07\/esl-test-questions-ai-distractors-6.jpg\" alt=\"Happy teacher attractive matude adult is smiling using laptop in class typing working with chalkboard in background. People a\" class=\"wp-image-7641\" srcset=\"https:\/\/tahricteaches.com\/wp-content\/uploads\/2026\/07\/esl-test-questions-ai-distractors-6.jpg 1080w, https:\/\/tahricteaches.com\/wp-content\/uploads\/2026\/07\/esl-test-questions-ai-distractors-6-768x432.jpg 768w, https:\/\/tahricteaches.com\/wp-content\/uploads\/2026\/07\/esl-test-questions-ai-distractors-6-18x10.jpg 18w, https:\/\/tahricteaches.com\/wp-content\/uploads\/2026\/07\/esl-test-questions-ai-distractors-6-600x338.jpg 600w\" sizes=\"(max-width: 1080px) 100vw, 1080px\" \/><figcaption class=\"wp-element-caption\">Happy teacher attractive matude adult is smiling using laptop in class typing working with chalkboard in background. People a<\/figcaption><\/figure><\/figure><h2 class=\"wp-block-heading\">Fitting assessment back into what you teach<\/h2><p class=\"wp-block-paragraph\">A test only means something if it lines up with what you taught. The fastest way to keep AI-written assessments honest is to feed the model your lesson objectives directly. Paste the week&#8217;s learning targets and say: &#8220;Write assessment items that measure only these objectives. If a question drifts beyond them, flag it.&#8221; This keeps the test from wandering into grammar you never covered \u2014 a common failure when AI free-associates around a topic.<\/p><p class=\"wp-block-paragraph\">It also works in the other direction. When you are building a unit, ask the AI to map each objective to the type of question that would best measure it. Some targets suit multiple choice; others \u2014 like producing a spoken request or writing a persuasive sentence \u2014 need a performance task. Letting the assessment shape the lesson, rather than bolting a quiz on at the end, is where AI stops being a shortcut and starts making your teaching tighter.<\/p><figure class=\"wp-block-image size-large\"><figure class=\"wp-block-image size-large\"><img decoding=\"async\" width=\"1080\" height=\"720\" src=\"https:\/\/tahricteaches.com\/wp-content\/uploads\/2026\/07\/esl-test-questions-ai-distractors-7.jpg\" alt=\"Dixon Ticonderoga pencil\" class=\"wp-image-7642\" srcset=\"https:\/\/tahricteaches.com\/wp-content\/uploads\/2026\/07\/esl-test-questions-ai-distractors-7.jpg 1080w, https:\/\/tahricteaches.com\/wp-content\/uploads\/2026\/07\/esl-test-questions-ai-distractors-7-768x512.jpg 768w, https:\/\/tahricteaches.com\/wp-content\/uploads\/2026\/07\/esl-test-questions-ai-distractors-7-18x12.jpg 18w, https:\/\/tahricteaches.com\/wp-content\/uploads\/2026\/07\/esl-test-questions-ai-distractors-7-600x400.jpg 600w\" sizes=\"(max-width: 1080px) 100vw, 1080px\" \/><figcaption class=\"wp-element-caption\">Dixon Ticonderoga pencil<\/figcaption><\/figure><\/figure><h2 class=\"wp-block-heading\">A repeatable routine for your next test<\/h2><p class=\"wp-block-paragraph\">Pulling it together, a reliable pass looks like this. Name the construct for each item so the AI knows exactly what to measure. Ask it to justify every distractor with the misconception it represents, and reject the fillers. Have it estimate difficulty and flag the trap options. Run a bias review against an international audience. Generate rationales for the answer key and a rubric for any open response. Finally, check every item against your lesson objectives before it goes anywhere near a student.<\/p><p class=\"wp-block-paragraph\">None of this takes as long as writing the test from scratch, and the output is dramatically better than the vending-machine quiz you get from a one-line prompt. The AI is doing the drafting; you are doing the assessment design. That division of labor is the whole game \u2014 because a test that measures the wrong thing quickly, or measures nothing at all, is worse than no test. Used well, AI gives you back the hours you used to spend writing plausible wrong answers, and hands them to the part of teaching only you can do: reading what the results are telling you and deciding what to teach next.<\/p><figure class=\"wp-block-image size-large\"><figure class=\"wp-block-image size-large\"><img decoding=\"async\" width=\"1080\" height=\"720\" src=\"https:\/\/tahricteaches.com\/wp-content\/uploads\/2026\/07\/esl-test-questions-ai-distractors-8.jpg\" alt=\"Female software engineer writes on whiteboard\" class=\"wp-image-7643\" srcset=\"https:\/\/tahricteaches.com\/wp-content\/uploads\/2026\/07\/esl-test-questions-ai-distractors-8.jpg 1080w, https:\/\/tahricteaches.com\/wp-content\/uploads\/2026\/07\/esl-test-questions-ai-distractors-8-768x512.jpg 768w, https:\/\/tahricteaches.com\/wp-content\/uploads\/2026\/07\/esl-test-questions-ai-distractors-8-18x12.jpg 18w, https:\/\/tahricteaches.com\/wp-content\/uploads\/2026\/07\/esl-test-questions-ai-distractors-8-600x400.jpg 600w\" sizes=\"(max-width: 1080px) 100vw, 1080px\" \/><figcaption class=\"wp-element-caption\">Female software engineer writes on whiteboard<\/figcaption><\/figure><\/figure><h2 class=\"wp-block-heading\">Sources and further reading<\/h2><ul class=\"wp-block-list\"><li><a href=\"https:\/\/www.cambridgeenglish.org\/\" target=\"_blank\" rel=\"noopener\">\u041a\u0435\u043c\u0431\u0440\u0438\u0434\u0436\u0441\u044c\u043a\u0430 \u0430\u043d\u0433\u043b\u0456\u0439\u0441\u044c\u043a\u0430<\/a> \u2014 research and principles of language assessment and item design.<\/li><li><a href=\"https:\/\/www.britishcouncil.org\/\" target=\"_blank\" rel=\"noopener\">\u0411\u0440\u0438\u0442\u0430\u043d\u0441\u044c\u043a\u0430 \u0420\u0430\u0434\u0430<\/a> \u2014 teaching resources and guidance on assessment for English learners.<\/li><li><a href=\"https:\/\/www.coe.int\/en\/web\/common-european-framework-reference-languages\" target=\"_blank\" rel=\"noopener\">Council of Europe \u2014 Common European Framework of Reference (CEFR)<\/a> \u2014 level descriptors for calibrating item difficulty.<\/li><li><a href=\"https:\/\/www.tesol.org\/\" target=\"_blank\" rel=\"noopener\">\u041c\u0456\u0436\u043d\u0430\u0440\u043e\u0434\u043d\u0430 \u0430\u0441\u043e\u0446\u0456\u0430\u0446\u0456\u044f TESOL<\/a> \u2014 professional standards and practice for English language teaching.<\/li><li><a href=\"https:\/\/www.amazon.com\/s?k=language+assessment+principles+and+classroom+practices\" target=\"_blank\" rel=\"noopener\">Books on language assessment principles and classroom practice<\/a> \u2014 foundational texts on writing and validating test items.<\/li><\/ul>","protected":false},"excerpt":{"rendered":"<p>AI can draft fluent English in seconds, but a good ESL test question needs more than fluency. Here is how to prompt AI to write assessment items with distractors that reveal what your students actually know.<\/p>","protected":false},"author":1,"featured_media":7639,"comment_status":"open","ping_status":"closed","sticky":false,"template":"","format":"standard","meta":{"rank_math_lock_modified_date":false,"_kadence_starter_templates_imported_post":false,"_kad_post_transparent":"","_kad_post_title":"","_kad_post_layout":"","_kad_post_sidebar_id":"","_kad_post_content_style":"","_kad_post_vertical_padding":"","_kad_post_feature":"","_kad_post_feature_position":"","_kad_post_header":false,"_kad_post_footer":false,"footnotes":""},"categories":[30],"tags":[1387,1659,1656,618,688,673,1658,1001,1655,1657,52,998],"class_list":["post-7644","post","type-post","status-publish","format-standard","has-post-thumbnail","hentry","category-article-posts","tag-ai-in-teaching","tag-classroom-tools","tag-distractors","tag-esl-assessment","tag-esl-teachers","tag-formative-assessment","tag-item-writing","tag-language-testing","tag-multiple-choice-questions","tag-quiz-design","tag-teaching-english","tag-test-writing"],"_links":{"self":[{"href":"https:\/\/tahricteaches.com\/uk\/wp-json\/wp\/v2\/posts\/7644","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/tahricteaches.com\/uk\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/tahricteaches.com\/uk\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/tahricteaches.com\/uk\/wp-json\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/tahricteaches.com\/uk\/wp-json\/wp\/v2\/comments?post=7644"}],"version-history":[{"count":3,"href":"https:\/\/tahricteaches.com\/uk\/wp-json\/wp\/v2\/posts\/7644\/revisions"}],"predecessor-version":[{"id":7651,"href":"https:\/\/tahricteaches.com\/uk\/wp-json\/wp\/v2\/posts\/7644\/revisions\/7651"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/tahricteaches.com\/uk\/wp-json\/wp\/v2\/media\/7639"}],"wp:attachment":[{"href":"https:\/\/tahricteaches.com\/uk\/wp-json\/wp\/v2\/media?parent=7644"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/tahricteaches.com\/uk\/wp-json\/wp\/v2\/categories?post=7644"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/tahricteaches.com\/uk\/wp-json\/wp\/v2\/tags?post=7644"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}