Image

In plain words: Image generation and editing

Designed 6 min read 5 glossary terms 8 connected pages
The short version written for the Snayu team

The planned image-making path (Image) for generating, editing, inpainting, structure-controlled and enhancement jobs, recording the exact operation, inputs, profile and what changed.

Why read it: Read this before integrating an image generation model or a ComfyUI-style workflow.
  1. 1One ImageJob names one operation: generate, edit, inpaint, control or enhance.
  2. 2Enhancement must declare whether it can invent detail; results are new artifacts with provenance.
  3. 3Technical settlement is separate from creative adoption, export and publication.

Designed Contracts and candidate tests only; study reviewed August 2026.

Words on this page, decoded click one for its card

The original text Underlined words open their plain-English card.

An image request owes more than new pixels. Image records which operation was requested, which sources and controls it may use, what changed, and which exact profile produced the candidate. An image-capable chat model can interpret the picture; this Maker/editor passage produces or transforms it.

Begin with the operation and expected return, then select a simple serving or full workflow route. The study was reviewed on 2026-08-26. These are Designed contracts and candidate bakes, with delivery owned by State. Technical settlement leaves creative adoption, export, and publication with their named owners.

One job, explicit operation

The image-producing surface should accept the whole useful input family without pretending that every admitted model implements every form:

Operation Inputs Required meaning
generate prompt Create one or more new candidates from text.
edit prompt plus one or more source or reference images Mutate, restyle, compose, or preserve identity according to the selected profile.
inpaint prompt, source image, and mask Replace only the declared region; outpainting is an expanded canvas plus an explicit mask.
control prompt plus pose, depth, edge, sketch, layout, or other control artifact Preserve the declared structure according to a separately baked control profile.
enhance source image and exact enhancement profile Restore, remove a background, or upscale while declaring whether the operation can hallucinate detail.

Request and provenance

Describe the intended change before resolving an engine. A candidate ImageJob@2 names its operation, prompt and negative prompt, and the authorized source, reference, mask, and control ArtifactRef values it may use. Dimensions, candidate count, seed policy, immutable preset, deadline, budget, and output policy bound the work. Supplying an optional input does not prove that an engine can use it; the selected profile must declare and prove that capability.

The job also retains the operator-facing prompt, its declared or detected source language when known, the requested model-facing language, and translation policy. A translator may derive a model-facing prompt only through an admitted transformation that preserves both texts, translator revision, and declared loss. Interface locale, model convenience, or prompt enhancement never silently replaces visual direction.

Source-grounded masks, regions, pose, depth, and other controls may come from Sight. Image retains the generative effect; the control's source coordinates, transform lineage, uncertainty, and exact artifact digest remain visible rather than becoming anonymous workflow tensors.

Technical settlement

ImageJob@2 settles whether the requested operation produced a technically valid candidate set. Atelier or another consuming CompositionApp then decides whether to adopt it creatively; successful custody and probes cannot make that choice for the owner. Each concrete execution uses Core's Designed ServiceJobAttempt@1 mechanics. An INDETERMINATE attempt remains contained and nonterminal, so it cannot count as either a successful or failed image result.

Qualify the interaction details separately too: numeric progress, previews, cancellation acceptance and settlement, multiple references, hard masks, deterministic seeds, and partial streaming are independent capability facts. A Connector cannot infer them from a broadly compatible endpoint.

Each result receipt retains source and output digests, original and derived prompt language and texts, translator revision and declared loss, engine and container revision, model and component digests, exact preset or graph digest, LoRA and control adapters, scheduler, steps, guidance, seed, dtype and quantization, dimensions, timing, warnings, and cancellation settlement. Provider filenames, image IDs, and embedded PNG metadata are evidence inputs, not canonical provenance.

Serving route and workflow route

The first implementation study keeps two complementary routes rather than forcing a workflow graph through a lowest-common-denominator API.

Candidate Office Present judgment
vLLM-Omni Apache-2.0 omni and diffusion serving through OpenAI-compatible /v1/images/generations and /v1/images/edits, including multiple images and masks where the model supports them. Primary simple serving candidate. It is a separate runtime project from ordinary vLLM even though it shares the ecosystem and command shape. Bake generation, editing, cancellation, quantization, output limits, and lifecycle independently.
ComfyUI GPL-3.0 graph inference server with image and mask upload, queued workflows, WebSocket progress, history, interruption, and model-memory release. Full-power workflow connector for control maps, LoRA stacks, multiple samplers, inpaint, upscale, detail passes, and future image/video/3D nodes. Only allowlisted built-in or exactly pinned custom nodes and immutable workflow presets may run.
SGLang-Diffusion Apache-2.0 performance-oriented diffusion server with OpenAI Images serving and native or Diffusers-backed pipelines. Challenger behind the same basic Images profile. Promote only where a model or measured throughput, batching, placement, or sharding advantage beats the first route.

Use OpenAI Images to carry requests where its dialect fits, while keeping the inner contract with Image. Profile generation and editing separately, including masks, multiple references, partial streams, and cancellation. Because the API offers no universal durable image-job resource, LychD must retain job identity, state, authority, retry law, and artifact custody.

For a Comfy route, select only the immutable preset and parameter openings admitted under the engine contract. Arbitrary graphs, runtime checkpoint downloads, partner API nodes, and ambient custom-node installation are forbidden. The engine graph supplies no SpellweaverWorkflow Engine or effect authority.

Diffusers remains the reference implementation and model-compatibility path. It is a Python library rather than a complete multi-user job service, so LychD should not build another general Diffusers server before a supported serving engine proves insufficient. Stable Diffusion is one model family runnable through these engines, not an automation runtime; every chosen checkpoint, encoder, VAE, adapter, and dependency retains its own license and bake.

One runtime adapter and endpoint may later expose separate admitted Image and Video dialect drivers for pinned graphs. Their operations, job profiles, and editorial boundaries remain separate; a generic Connector label cannot merge them.

First permissive model profiles

The initial model bake remains deliberately small:

Profile Intended office License and iron
FLUX.2 klein 4B Fast interactive text-to-image, single-reference edit, and multi-reference edit in one checkpoint. Apache-2.0 and approximately 13 GB VRAM by its official card. The FLUX.2 klein 9B, 9B-KV, and FLUX.2 dev models use non-commercial terms and are not substitutes for this profile.
Qwen-Image-2512 plus Edit-2511 and a pinned control profile High-quality generation and typography; identity-sensitive single/multi-image editing; masked and structural work across the family. Apache-2.0 but heavy: the official BF16 packages include roughly 57.7 GB of components. Treat as a stasis/offload or explicitly sharded quality route, not a permanent companion to a large Mind.

FLUX.2 klein 4B is the first resident-friendly default. The Qwen family is the first heavy quality and control route. Neither project logo proves every operation: FLUX generic reference editing is not a hard preservation mask, and separate Qwen checkpoints remain separate RuneService Config File profiles.

Coven, stasis, and the proving bake

Placement must work on the operator's actual devices. One possible CovenModel Group keeps a compact Multimodal Mind on one 24 GB GPU and FLUX.2 klein on the other. A large Qwen-Image profile may instead require affected work to release its leases through Prism's Stasis and readiness passage. Two 24 GB devices do not implicitly provide one 48 GB allocation. The exact runtime must prove sharding, offload, warm-up, cancellation, and complete release; neither Comfy nor a serving engine can choose placement or evict another AnimatorModel Runtime.

The first corpus should cover natural scenes, illustration, UI and poster text, Slovak diacritics, single- and multi-reference identity, preservation edits, masks and expanded canvases, pose/depth/ edge controls, transparent output, adversarial dimensions and metadata, cancellation, OOM, restart, and deterministic-seed replay. Measure prompt alignment, text accuracy, source and region preservation, identity deviation, control adherence, diversity, latency, peak VRAM, output validity, artifact lineage, and license closure.

Promote exact profiles: the first bake compares FLUX.2 klein through vLLM-Omni with the same basic profile where SGLang-Diffusion supports it, then proves one allowlisted Comfy workflow for the advanced path. Qwen-Image enters as the heavy quality/control route only after its exact quantization or offload topology passes on operator iron.