Principles of AI · Unit 2: Working With AI · Activity 2.1.1

Deep Dive: Context & Verification

🔬 Deep Dive
This is your textbook for this topic. Take your time. Read it more than once.
Principles of AI · 2.1.1Concept⚠ Watch Out

Context: What the Model Can't Guess

context = everything the model can read in this conversation

A language model works with the text in front of it: your messages, anything you paste in, and its own earlier replies. That is its context. It doesn't know your school's schedule, which library you mean, what you can't do, or what you already tried. In 1.2.2 you saw that a language model writes what fits, not what it looked up. When your prompt leaves a gap, the model fills it with something plausible, and it usually doesn't tell you that it guessed.

Context engineering means deciding what to put in front of the model so it doesn't have to guess. It is the difference between "How do I get to the mall?" and a prompt with the time, the starting point and the real bus schedule.

Essential, helpful, or noise?

Not every detail earns its place. Here is a rule that doesn't depend on opinion:

Three kinds of detail
  • Essential. The answer is wrong or unusable without it. The AI has to guess.
  • Helpful. A reasonable answer works without it, but the answer fits you better with it.
  • Noise. It changes nothing about the right answer.

Try it. Everything in this lab is invented. Start with only the essentials and watch what the AI is forced to guess.

Context lab · a bus prompt (all names invented)

Switch details on and off. The prompt always asks: Which bus should I take tomorrow?

Which bus should I take tomorrow? I need to be at Eastgate Mall by 3:30 p.m. It might rain tomorrow, but I'm taking the bus either way.
Essential details included1 of 4
Helpful details included0 of 2
Noise included1

The AI would have to guess: when you can leave; where you are starting from; the real bus times (it may make some up).

Noise doesn't break anything, but it doesn't help either. It just makes the prompt longer. Try adding every detail, then take away one essential at a time.

Notice that the weather detail is noise here, because you've already decided to take the bus. In another prompt the same detail could be essential (for example, "Should I bike or take the bus?"). A detail's role depends on the question, not on the detail.

Where does what you type go?

Inside one chat, the model rereads the whole conversation each time it replies. That is why a detail you gave earlier still shapes the next answer. The model does not rewrite itself while you chat. A new chat usually starts fresh, unless the tool has a memory feature that carries details over. Separately, a company may store conversations and, depending on its policy and your account settings, use them later to improve its products. What happens varies by tool and by account, and school accounts often work differently from personal ones.

⚠️Because you can't be sure where a prompt ends up, leave out anything personal: your full name, address, or private details about other people. Say "a friend" and "my town's library," not names and street addresses.
🔑The AI can't use context you didn't give it, and it won't always tell you when it is guessing.
Principles of AI · 2.1.1Skill⚠ Watch Out

Writing the Brief

A brief is a prompt that hands the AI what it needs, in an order it can use. Four parts cover most everyday prompts:

The four-part brief
  • Goal. What you want done, in one sentence.
  • Facts. What the AI can't know: dates, places, pasted text such as a schedule or menu.
  • Limits. What is off the table: time, budget, rules, what you have or can't do.
  • Format. What the answer should look like: length, a list or a table, reading level.

Then add one more line: "If anything essential is missing, ask me before you answer." A good AI will often ask. That is the AI telling you what you left out, instead of guessing.

ExampleBorrowing a library book

An invented example. You start with: "Tell me how to get a library book." Build it into a brief.

Step 1 — Goal
Say what you want done: Tell me how to get a library copy of The Glass Orchard (an invented title).

Here is the finished brief. Compare it with the one-line version you started with.

Goal: Tell me how to get a library copy of The Glass Orchard (an invented title). Facts: I live in Fairview. I need it by Friday. The library's hours are pasted below. Limits: I can only go after dinner, and I don't drive. Format: A numbered list of four steps, in plain language. If anything essential is missing, ask me before you answer. [pasted hours]

Paste it, don't point to it

Some AI tools can open links and files, and some can't. A tool that can't may still answer as if it had read the page, and it can make up what the page "says." If the details matter (a bus schedule, a menu, a set of rules), paste the text into the prompt. Then you know what the AI actually saw.

More isn't always better

Context can hurt as well as help. Three ways it goes wrong:

  • Noise. Details that change nothing make the prompt longer and can pull the answer off course.
  • Conflicting details. If you say "by Friday" early on and "by Monday" later, the AI may follow either. Fix the original line, or say clearly which one replaces which.
  • Out-of-date details. A schedule from last semester is worse than none, because the answer will fit it perfectly.
💡Using AI as a coach: you can paste one prompt into a chatbot and ask "What essential context is missing from this prompt?"That is a better question than "Is this a good prompt?", because chatbots tend to agree and praise. Treat its suggestions as options. You decide what to keep, and you still check the answer you get.
Principles of AI · 2.1.1Skill⚠ Watch Out

Fit Isn't Truth

fit = it follows my limits · truth = it is correct

A good brief makes the answer fit you: it takes the bus because you don't drive, and it picks a time after dinner. That is a real improvement. It is not the same as being true. The AI can follow every limit you gave it and still quote the wrong hours, add up the wrong total, or cite a study that doesn't exist. A well-briefed wrong answer is harder to catch than a vague one, because it looks exactly like what you asked for.

Fit vs. truth
True
Not true
Fits my limits
Use it
It follows everything you told it, and the facts hold up. This is the goal.
The dangerous one
It follows your limits perfectly, so it looks right. It still has the wrong hours, the wrong total, or an invented source.
Breaks my limits
Re-brief it
The facts may be fine, but it ignored something you said. Restate the limit and ask again.
Toss it
It breaks your limits and isn't true. Start again with a clearer brief.

Two kinds of check

The fit check happens inside the answer: did it follow each limit I gave? Reread your brief and tick them off. It catches an answer that ignored you. It cannot catch an answer that is wrong. For that you need an outside check: something that comes from outside the answer, as you learned in 1.2.2. Asking the same bot "Are you sure?" isn't one.

Outside checks, by type of claim
CheckWhat it coversHow to do it
FactsHours, prices, schedules, names, dates, placesThe official source for that fact (the library's own site, the transit agency's schedule). Write down the date you checked.
NumbersTotals, times, quantities, percentagesDo the arithmetic yourself from the numbers you gave it. Don't ask the same AI to "check its math"; it can repeat its own mistake.
SourcesStudies, quotes, "experts say", statisticsFind the original yourself and confirm it exists and says that. If you can't find it, don't use it.
ExampleThe library that closes early

An invented example. You paste the brief from the last section but leave out the pasted hours. The AI replies: "Fairview Library is open until 9 p.m. on Saturdays, so go at 7:30."

Step 1 — Fit check
You said you can only go after dinner and don't drive. The plan goes at 7:30 p.m. and doesn't use a car. It fits. That says nothing about whether it is true.

Numbers and sources

Numbers are the easiest claims to check, so do it every time. If the AI says two $4 slices and a $2 drink come to $12 per person, you can redo it yourself: 2 × 4 + 2 = 10. It was off by two dollars, and you can see that without any outside website. For a claim like "studies show students remember 40% more," look for the study. If you can't find it, it's not evidence, no matter how specific the number sounds.

⚠️The more an answer fits you, the more you want to believe it. That is the moment to check. The checking step is yours, and it should grow with the cost of being wrong: a wrong movie time costs you an evening, and a wrong medicine dose costs far more.
← Back to Activity 2.1.1📝 Formative Activity →