Capstone: Crafting a Prompt Iteration Workflow

Generative AI Prompting for Image Models

Chapter 10 · Capstone: Crafting a Prompt Iteration Workflow

One creative brief, taken through five real refinement passes, on one tool — Stable Diffusion (imgai1-5), chosen specifically because it's the only tool in this course whose mechanism (imgai1-2) can be reasoned about precisely at every step, rather than described only behaviorally (imgai1-4) or mediated through a rewriting layer (imgai1-6).

The brief
A promotional banner image for a fictional artisan coffee shop, "Ember & Oak": a warm, inviting, photorealistic interior shot suitable for a website header, showing a barista at the counter with a hand-lettered menu board visible in the background.

Pass 1 — The Naive Prompt

Prompt
a coffee shop interior

⚠ Problem: exactly the failure imgai1-3's own warn-box predicted — five words map to a huge, poorly-differentiated region of embedding space. The result is a plausible but generic coffee shop, with no warmth, no barista, no signage, and no connection to "Ember & Oak" at all.

Pass 2 — Applying the Six-Category Vocabulary (imgai1-3)

Prompt
a cozy artisan coffee shop interior, a barista standing behind a wooden counter, hand-lettered chalkboard menu board on the wall behind [subject]; warm rustic photorealistic style [style]; wide shot, counter centered, chalkboard visible in background [composition]; warm golden interior lighting, soft window light from the left [lighting]; 35mm lens, shallow depth of field [camera/lens]; photograph [medium]

⚠ Problem: much stronger overall, but the chalkboard menu text comes back as garbled, illegible lettering — exactly the mechanical limitation imgai1-2 and imgai1-8 explained (letters are learned as visual texture, not discrete symbols). No amount of rewording the subject line fixes this on its own.

A deliberate scope decision, not an oversight
Per imgai1-8's own honesty about text rendering, this is a structural limitation, not a wording bug. Rather than fighting it further, this workflow makes a deliberate choice: keep the chalkboard visually present as background texture (it still reads as "a menu board," which serves the brief), but don't attempt to force specific legible text onto it. Chasing perfectly legible generated text would require dedicated tools/techniques outside this chapter's own scope (see this chapter's closing scope note).

Pass 3 — Negative Prompt & CFG Adjustment (imgai1-5)

Negative prompt added
negative prompt: blurry, extra limbs, deformed hands, watermark, oversaturated, cartoon, illustration
CFG scale: 8

⚠ Problem observed at this pass: the barista's hand near the espresso machine shows a fused-finger artifact — the anatomical failure mode imgai1-8 covered in depth.

✓ Per imgai1-5's own CFG formula, the negative prompt's own embedding replaces the unconditional baseline, actively steering away from "deformed hands" at every denoising step, in addition to the general quality terms — a first, partial mitigation.

Pass 4 — Term Weighting (imgai1-7)

Weighted subject clause
a cozy artisan coffee shop interior, a barista standing behind a wooden counter, (hands resting on the counter, not visibly gripping anything:1.2), hand-lettered chalkboard menu board on the wall behind ...

✓ Per imgai1-7's own weighting mechanism, this doesn't add an anatomical rule the model never learned (imgai1-8's own warn-box on this exact point) — it does, however, steer the pose itself toward a simpler, less articulated hand position, which reduces how often the fuzziest, highest-variability poses (the ones most prone to fused-finger artifacts) get generated in the first place.

Pass 5 — A Checkpoint Swap (imgai1-5)

Model change, not a prompt change

The base checkpoint's own default style leaned slightly more illustrative than the brief's "photorealistic" requirement wanted. Per imgai1-5, this is exactly the situation a checkpoint swap exists for: switching to a community checkpoint fine-tuned specifically toward photorealistic interior photography changes the model's own underlying visual instincts before a single prompt word is reconsidered, rather than trying to fight the base checkpoint's own bias with ever-more-specific style language.

A copyright-conscious style choice (imgai1-9)
Notice what Pass 2's own Style category deliberately does not do: it never names a specific living photographer or illustrator to imitate. Per imgai1-9's own Issue 2, invoking a specific living artist's name raises a real, separate ethical question about economic harm, independent of the unsettled legal question in Issue 1 — generic style language ("warm rustic photorealistic style") sidesteps that question entirely while still achieving the brief's own goals.

Chapter Attribution

Capstone elementDrawn from
Recognizing why Pass 1 failedimgai1-3 (vague-prompt embedding-region mechanism)
Six-category prompt structureimgai1-3 (Subject/Style/Composition/Lighting/Camera-Lens/Medium)
Choosing Stable Diffusion specificallyimgai1-2 (mechanism), imgai1-5 (explainable parameters)
Recognizing the chalkboard-text limitationimgai1-2 / imgai1-8 (text-rendering mechanism)
Negative prompt & CFG scaleimgai1-5 (the full CFG/negative-prompt formula)
Recognizing the hand artifact honestlyimgai1-8 (anatomical-error mechanism)
Weighted pose clauseimgai1-7 (term weighting), applied with imgai1-8's own honest limits in mind
Checkpoint swapimgai1-5 (checkpoints as a genuinely unique open-source capability)
Avoiding a named living artistimgai1-9 (Issue 2 — style mimicry's separate ethical axis)

Honest Scope Note

What this capstone deliberately doesn't attempt
  • One tool only. This workflow was built and refined for Stable Diffusion specifically. Midjourney (imgai1-4) and DALL-E (imgai1-6) would each need their own tool-specific version of this same iteration process — the underlying six-category vocabulary (imgai1-3) transfers, the exact syntax and available controls don't.
  • No fine-tuning or LoRA-training walkthrough. Pass 5 swaps to an existing community checkpoint — it doesn't cover how to train a new checkpoint or LoRA from scratch, a genuinely separate skill set beyond this course's own prompting focus.
  • No video-generation models. This course, start to finish, covers still-image diffusion models only.
  • The chalkboard text remains imperfect even after five passes — per imgai1-8's own closing point, this is a real limitation that gets less severe with better tools, not one this workflow, or any prompting technique alone, fully eliminates.

Hands-On Exercises

Exercise 1

Explain why this capstone deliberately chose not to keep fighting the chalkboard's illegible text through further prompt rewording, using this chapter's own warn-box and imgai1-8's own honest distinction between mitigation and elimination.

📄 View solution
Exercise 2

Explain the difference between what Pass 3's negative prompt fixes and what Pass 4's term weighting fixes for the hand-artifact problem, and why both were needed rather than either alone.

📄 View solution
Exercise 3

Explain why this capstone was deliberately built on Stable Diffusion rather than Midjourney or DALL-E, using this chapter's own opening reasoning and the honest scope note's own admission about what would need to change for another tool.

📄 View solution

Chapter 10 Quick Reference — Course Summary

  • Image prompting is descriptor composition, not instruction-giving (imgai1-1), grounded in a real diffusion mechanism (imgai1-2)
  • Six shared descriptor categories (imgai1-3), wrapped in tool-specific syntax: Midjourney's parameters (imgai1-4), Stable Diffusion's explainable technical controls (imgai1-5), DALL-E's ChatGPT-mediated conversation (imgai1-6)
  • Cross-tool techniques — weighting, negative prompts, img2img, inpainting (imgai1-7)
  • Honest, mechanically-grounded limitations — anatomy, text, prompt bleeding (imgai1-8)
  • Four distinct ethical issues, four different responsibility-holders (imgai1-9)
  • This capstone combined all nine prior chapters into one real, five-pass iteration workflow