CCAO-F practice questions, answered and explained

An analyst asks Claude to "look at this spreadsheet and tell me what's interesting." The reply is a long, unfocused list that misses the quarterly variance the analyst cared about. What is the most effective change to the request?

• A Add "be thorough and detailed" so nothing significant is left out

Thoroughness is the opposite of the fix. The answer was already too broad; this makes it longer without making it relevant.

• B Break the spreadsheet into smaller files and ask about each one separately

Splitting the data destroys the quarter-on-quarter comparison the analyst actually wanted.

• C Ask the same question again, since a second attempt often produces a different angle

A second attempt varies phrasing, not the criterion that was missing — the reply will be differently unfocused.

• D State the decision the analysis feeds, the comparison that matters, and the form the answer should take

Correct. The gap is a missing standard for relevance; naming the decision, the comparison and the format supplies exactly that.

"Interesting" is the analyst's judgement, not a property of the data, so the model has nothing to aim at. Naming the decision, the comparison and the output format supplies the missing criterion. Re-asking varies the output without steering it, splitting the file removes the cross-quarter comparison entirely, and asking for thoroughness makes an unfocused answer longer.

A team wants Claude to write customer replies in their established house voice. They have roughly forty past replies they consider good. What is the most effective use of those examples?

• A Supply the single best example and ask the model to match it exactly

One example teaches imitation of that specific reply, so the voice breaks as soon as the situation differs.

• B Summarize the voice in adjectives drawn from the examples and supply the adjectives instead

Adjectives are a lossy summary of a voice; the phrasing habits that make it recognisable do not survive the compression.

• C Paste all forty so the model has the fullest possible picture of the voice

Past the first few, additional examples add length and cost far faster than they add signal, and they push the actual instruction further from the model's attention.

• D Include three or four that differ from each other, covering the range of situations the voice has to cover

Correct. A few contrasting examples convey both the pattern and its range, which is what makes the voice transferable to a new situation.

A handful of deliberately varied examples teaches the pattern and its range at once, which is what makes the voice reproducible across situations. Forty examples add cost and crowd the instruction without adding much signal past the first few. Adjectives lose the very specifics that make a voice recognisable, and one example teaches the model to imitate that situation rather than the style.

A first draft is close but too formal for the intended audience. What is the most efficient next step?

• A Start a fresh conversation with a better prompt so as to avoid contaminating the final result

Starting over throws away a draft that was already close, and nothing about the existing conversation is harming the result.

• B Ask for a revision that names the specific quality to change and keeps everything else

Correct. Naming the one dimension to change protects everything that already works and avoids regressions elsewhere.

• C Rewrite the formal passages by hand, since the model has shown it cannot hit the register

One adjustable miss on a single dimension is not evidence the register is unreachable; it has not yet been asked for directly.

• D Ask for five separate variations and simply pick whichever of them happens to read the best

Five variations create a selection problem where a single named adjustment would do, and each variation risks losing what worked.

A targeted revision preserves the parts already working and moves only the dimension that is wrong, which is both faster and less likely to regress. Starting over discards a draft that was nearly right, generating variations spends effort producing options nobody asked for, and abandoning the tool after one adjustable miss is premature.

Claude produces a market summary containing a specific market-size figure attributed to a named research firm. The employee has not supplied any source documents. What should happen before the figure is used in a client deck?

• A Use it, since the attribution to a named firm indicates the figure was retrieved from that source

An attribution is generated text like any other. Naming a real firm makes a wrong figure more damaging, not more trustworthy.

• B Verify the figure against the firm's actual publication before it appears anywhere client-facing

Correct. Nothing was supplied to ground the number, so the only thing that establishes it is the original publication.

• C Ask the model to confirm that the figure is correct and then use it if the model does confirm it

Self-confirmation is not verification; the model has no independent access to the source and will generally agree.

• D Use it with a hedge such as "approximately", which covers any minor inaccuracy in the figure itself

"Approximately" addresses precision. The problem here is whether the figure exists at all, which a hedge does not touch.

With no source supplied, both the number and the attribution are generated rather than retrieved, and a named firm makes a fabricated figure more dangerous rather than less because it borrows unearned credibility. Only checking the firm's actual publication establishes the fact. Hedging language misstates the problem, which is provenance rather than precision, and asking the model to confirm its own output produces agreement, not verification.

A request asked for risks, mitigations and owners for each risk. The output lists risks and mitigations clearly but names no owners. What is the appropriate response?

• A Rewrite the request from scratch with the three parts numbered

Starting over discards two parts that were delivered correctly, to fix one that only needs to be requested.

• B Accept it, since owners can be added later by whoever files the document

Deferring the gap moves it to someone with less context about which owner belongs to which risk.

• C Accept it, because the substantive analysis was the risks and mitigations

The requester asked for owners, which makes them part of the deliverable regardless of which part feels most analytical.

• D Return it against the original three-part ask and request the missing element

Correct. The shortfall is specific and known, so naming it recovers the missing third without touching the working parts.

The ask had three parts and two were delivered, so the specific gap is known and easily closed by naming it. Accepting silently moves the work to a later reader who has less context, deciding unilaterally that the missing part was the unimportant one overrides the person who asked, and restarting discards two-thirds of a usable result.

A drafted apology to a customer whose order was lost is accurate and complete but reads as procedural. Which revision most improves it?

• A Add an exclamation mark and a warmer sign-off

Surface friendliness over unchanged procedural content usually reads as insincere rather than warm.

• B Add an apology sentence to each paragraph so regret is unmistakable

Repetition reads as anxiety rather than sincerity, and it displaces the remedy the customer actually wants.

• C Acknowledge the specific inconvenience caused and state what happens next, without hedging responsibility

Correct. Naming the specific inconvenience and the concrete next step is what distinguishes an apology from an acknowledgement.

• D Lengthen the message so the customer sees that the issue was taken seriously

Length signals effort spent, not care taken, and a longer procedural message is still procedural.

A procedural apology fails because it treats the customer's situation as a case rather than an inconvenience to a person. Naming the specific harm and the concrete next step addresses both. Punctuation and sign-offs are surface warmth over the same procedural content, length signals effort rather than care, and repeated apologies read as anxious without adding remedy.

Which output characteristic most strongly suggests a claim needs verification before use?

• A The claim carries specific detail that could not have come from anything supplied in the conversation

Correct. Detail with no possible source in the supplied material was produced rather than retrieved, which is exactly the case needing a check.

• B The claim is stated in confident, specific language

Confident, specific language is characteristic of correct answers as well, so it separates nothing.

• C The claim contradicts what the reader expected to find

A surprising claim may simply be true; surprise measures the reader's expectation, not the claim's grounding.

• D The claim appears near the end of a long response

Position in the response is unrelated to whether a claim is supported.

The reliable signal is provenance: a specific figure, date or citation that has no possible source in the supplied material was generated rather than retrieved. Confidence is a property of the prose and is present in correct answers too, surprise reflects the reader's prior rather than the claim's support, and position in the response carries no information about grounding.

A team repeatedly answers questions from the same twenty reference documents and wants consistent answers across colleagues. Which approach fits best?

• A Each person pastes the relevant document into a fresh conversation as needed

Per-conversation pasting makes each answer depend on what that individual chose to include, which is the inconsistency being complained about.

• B Each person keeps a personal conversation of their own and returns to it as needed

Separate private conversations drift apart over time, since nothing holds them to a common source or standard.

• C A shared Project holding the documents and the team's standing instructions

Correct. Shared documents plus shared instructions is exactly the pairing that produces consistent answers across a team.

• D One person answers all such questions and then forwards the results on to everyone

Routing through one person is a bottleneck and loses the point of giving the team the capability.

The requirements are shared source material and consistent answers, which is what a Project provides: one place for the documents and one place for the instructions everyone works from. Pasting per conversation makes each answer depend on what that person happened to include, funnelling through one colleague creates a bottleneck, and private conversations diverge over time precisely because nothing is shared.

A workflow classifies several thousand short support messages a day into one of six categories. Accuracy is good with the smallest capable model. What most sensibly drives model choice here?

• A Alternate between models to balance cost against quality

Alternating gives the same input different treatment depending on timing, which makes downstream behavior unpredictable.

• B Always use the most capable available model, since accuracy matters most

Capability beyond the accuracy bar is spend without benefit, and at several thousand messages a day it compounds quickly.

• C Choose based on which model has the largest context window

Context window governs how much text fits, which is not the constraint when classifying short messages.

• D Use the smallest model that meets the accuracy bar, and re-test when the task or the models change

Correct. Smallest-that-passes is the right default for a stable high-volume task, provided it is re-checked when things change.

For a high-volume, well-defined task the smallest model clearing the accuracy bar is the right default, with re-testing when circumstances change. Defaulting to maximum capability spends heavily for accuracy already achieved, alternating produces inconsistent behavior for no gain on short inputs, and context window is irrelevant when the inputs are short messages.

An employee wants a single answer drawn from a 900-page document set that exceeds the context window. What is the appropriate approach?

• A Ask the question repeatedly until an answer referencing the whole set appears

Repetition does not extend the context window; unseen pages stay unseen however often the question is asked.

• B Split the set arbitrarily and take the first answer that sounds complete

Sounding complete is a property of the prose, and arbitrary splits make it likely the decisive section was never read.

• C Paste as much as fits and accept that the answer covers that portion

Whatever fits is an arbitrary slice, and an answer drawn from it will look no different from one drawn from the whole.

• D Narrow to the sections that bear on the question, or summarize in stages and reason over the summaries

Correct. Either narrow the input deliberately or reduce it in stages — both keep the reasoning tied to the relevant material.

When material exceeds the window the work is selection or staged reduction: narrow to the relevant sections, or summarize in passes and reason over the summaries. Taking whatever fits silently answers from an arbitrary slice, repeated asking cannot conjure unseen text, and picking the first complete-sounding answer selects for fluency over coverage.

A monthly reporting process involves pulling figures from a dashboard, writing commentary, and circulating the result for sign-off. Which part is the strongest candidate to hand to Claude first?

• A The whole process end to end, so the benefit is realised at once

Automating the whole chain at once removes the human check on the figures, which is what was making the commentary safe to trust.

• B Pulling the figures, since it is the most repetitive step

Repetition is not the criterion; extracting figures is a systems-access task, and an error there propagates into everything downstream.

• C Drafting the commentary from figures that a person has already pulled and checked

Correct. Language work over already-verified inputs plays to the strength and keeps a person between the data and the narrative.

• D Circulating for sign-off, since it is purely administrative

Circulation is routing and approval, which workflow tooling handles more reliably than a language model.

Drafting commentary from verified figures is language work over an input a person has already validated, which is where the tool is strong and the risk is contained. Pulling figures is a systems-access problem, circulation is a routing task better handled by workflow tooling, and automating the whole chain at once removes the verification step that makes the drafting safe.

Four drafting tasks are being automated. Which most requires human review before the output leaves the organization?

• A An internal meeting agenda circulated to the team that requested it

An internal agenda going to the people who asked for it is corrected in seconds by its own audience.

• B A set of alternative subject lines for an internal newsletter

Subject-line options are choices for a person to pick from, so nothing reaches an audience unreviewed.

• C A response to a regulator quoting the organization's compliance position

Correct. It is external, binding, quotes a stated position, and is the hardest of the four to walk back.

• D A first-draft summary of a public webinar for internal reading

A first draft for internal reading is labeled as such, and errors surface as it is used.

Review effort should follow consequence, and a regulatory response is externally binding, quotes a position that must be accurate, and is expensive to retract. The other three are internal, low-consequence, or explicitly drafts, where an error is caught cheaply by the reader who receives it.

A prompt for weekly status summaries works well for the person who wrote it but produces uneven results for colleagues. What most likely explains the difference?

• A The prompt is too long for consistent processing

Length affects everyone's results equally and does not produce variance that tracks who is using the prompt.

• B Results vary randomly between users regardless of prompt

Variation between runs is real but does not explain a stable pattern where one user consistently gets good results.

• C Colleagues are using a different model

A model difference would degrade the author's results too, so it does not explain a split that follows the person.

• D The prompt relies on context the author holds implicitly and never states

Correct. The author fills the gaps from their own knowledge of the job; colleagues fill them differently or not at all.

A prompt that works for its author and nobody else almost always encodes unstated assumptions — which audience, which definition of "status", which level of detail. The author supplies those silently from their own knowledge of the job. Model differences would affect the author equally, length does not produce user-specific variance, and randomness does not explain a consistent split between one user and the rest.

A Project's knowledge has grown to include current policies, superseded drafts and unrelated reference material. Answers have become less reliable. What is the first correction?

• A Remove superseded and unrelated material so the knowledge holds only what should be drawn on

Correct. Anything in the knowledge is fair game for retrieval, so what should not be used should not be there.

• B Split the Project into one per document

A Project per document abandons the grouping that made shared knowledge useful in the first place.

• C Restate the question more precisely each time

A sharper question does not prevent a superseded policy being retrieved and presented as current.

• D Add an instruction telling the model to prefer the most recent documents

Asking the model to prefer recency works around the problem rather than removing it, and superseded drafts are often undated.

Superseded material is indistinguishable from current material once both are in the knowledge, so the fix is to remove what should not be drawn on. An instruction to prefer recent documents asks the model to work around a problem that removal eliminates, one Project per document destroys the point of grouping, and more precise questions do not stop an outdated policy being retrieved as though it were live.

An employee attaches a scanned PDF of a signed contract and asks for the payment terms. The answer is vague and partly wrong. What is the most likely cause?

• A The contract is too long to process in one pass

Length typically causes omission rather than positive error, and payment terms are usually a short, findable section.

• B The scan's text was not reliably extracted, so the model is working from incomplete input

Correct. A scan is an image; the model sees only what extraction recovered, and gaps there appear as vagueness and error.

• C The question was insufficiently specific

An imprecise question yields a broad answer, not a confidently wrong one about specific terms.

• D Contracts are inherently ambiguous and resist summarization

Contracts are drafted to be precise. Ambiguity in the answer is more likely to come from the input than the genre.

A scan is an image, and whatever text extraction recovers is what the model sees. Poor extraction produces exactly this signature — vague where the text was legible and wrong where it was not. Length would tend to produce omissions rather than errors, contracts are drafted for precision, and a vague question would produce a vague but not incorrect answer.

Which instruction belongs in a Project's standing configuration rather than in individual prompts?

• A The specific question being asked today

Today's question is the definition of task-specific and changes with every use.

• B The organization's house conventions on terminology, spelling and citation format

Correct. Conventions apply to every piece of work in the Project, which is what makes them worth stating once.

• C The deadline for the current piece of work

Deadlines change per task and, in any case, do not shape the output.

• D The name of the colleague who requested the task

The requester varies per task and rarely changes how the work should be written.

Standing configuration is for what holds across every task in the Project, which is exactly what house conventions are: the same terminology and citation format apply whatever the question. The other three change task by task and belong in the prompt that describes the task.

An HR employee wants help drafting a performance improvement plan and considers pasting the employee's full file, including medical notes. What is the appropriate handling?

• A Paste the full file, since more context produces a better plan

More context is not better when the surplus is a special category of data the task does not require.

• B Paste the file after removing the employee's name

A file this detailed remains identifiable without a name, so redaction of the name alone is not real de-identification.

• C Include only what the plan requires — the role expectations and documented performance gaps — and leave medical information out

Correct. Supply what the plan is built from and omit what it is not — the medical notes serve no purpose here.

• D Paste the file but instruct the model not to refer to medical details

The disclosure happens when the data is supplied. An instruction about how to use it does not reverse that.

Data minimisation means supplying what the task needs and no more. A performance plan is built from role expectations and documented gaps; medical information is both unnecessary and a category that carries specific handling obligations. Removing the name leaves a file that is readily re-identifiable, and an instruction not to refer to something does not undo having disclosed it.

A marketing team uses Claude to draft blog posts that are then edited and published under a staff member's byline. What does responsible practice most clearly require?

• A No disclosure at all, since the text was edited by a person before it was ever published anywhere, which makes it that person's own work in the end

Editing improves quality but does not by itself resolve what the audience or a regulator is entitled to be told.

• B Following whatever disclosure standard the organization and its industry have set, and ensuring a named person takes responsibility for the published claims

Correct. Apply the standard that actually governs the context, and make sure a person is accountable for what is published.

• C Disclosure only where the post makes factual claims

Restricting disclosure to factual posts is a self-made rule that may not match what applies.

• D A disclosure on every single post stating clearly that AI was involved somewhere in the drafting of it, whatever the post itself happens to say in the end

A universal rule ignores that requirements differ by sector and audience, and it may still leave accountability unassigned.

Disclosure norms vary by sector, audience and regulator, so the defensible position is to follow the applicable standard rather than invent one — and in every case a named person must own the published claims. A blanket rule either over- or under-discloses depending on context, editing alone does not settle attribution, and confining disclosure to factual posts substitutes the drafter's judgement for the standard.

A recruiter asks Claude to rank a shortlist of candidates from their CVs and recommend who to interview. What is the primary concern?

• A Ranking people for an employment decision delegates a consequential judgement to a system that cannot account for it and may reproduce patterns present in its inputs

Correct. The decision is consequential and regulated, needs examinable reasons, and can silently carry forward patterns in the inputs.

• B Candidates may object to having their CVs processed by software rather than considered by a person, which raises a consent question for the organization

Candidate expectations matter, but the substantive problem is the decision being delegated rather than the processing itself.

• C The model may summarize some CVs more thoroughly than others, so the shortlist reflects uneven treatment rather than a consistent standard of assessment

Uneven summarization is a symptom worth noticing; the primary issue is that a ranking is standing in for a reasoned judgement.

• D The model may take considerably longer to work through the CVs than a recruiter reading them directly would, which removes a good deal of the saving the exercise was meant to deliver

Speed is not the concern; a fast unaccountable decision is worse than a slow one, not better.

The issue is the nature of the decision, not the speed of it. Employment decisions affect people materially, attract regulatory scrutiny, and demand reasons that can be examined — none of which a ranking produced from CV text can supply, and any patterns in the material can be reproduced without being visible. Processing speed, candidate sentiment and uneven summarization are real but secondary to delegating the judgement itself.

A prompt that produced good summaries for months now yields shallow ones. Nothing about the prompt changed. What is the most productive first check?

• A Assume that the model's behavior has changed and simply rewrite the whole prompt accordingly here

Rewriting before knowing the cause risks fixing the wrong thing and losing a prompt that may still be correct.

• B Compare a recent input against an older one, since the documents being summarized may have changed in kind

Correct. With the prompt constant, the input is what most plausibly changed, and comparing examples shows it immediately.

• C Move the work to a more capable model

A more capable model may paper over a change in the inputs that is worth understanding on its own terms.

• D Increase the requested output length, so that the summaries come back a good deal fuller than before

A longer output makes a shallow summary longer rather than deeper.

When the prompt is unchanged, the input is the variable most likely to have moved: documents that grew longer, changed format, or became more heterogeneous will produce shallower summaries from the same instruction. Rewriting, lengthening output or upgrading the model are all interventions applied before the cause is known, and each can mask the real change rather than fix it.