Simulated Color Separation in Screen Printing: The Definitive Technical Guide

Simulated color separation is the most versatile and widely used method for reproducing photographic and multi-color artwork in screen printing. Moreover, it is the technique that makes photographic t-shirt prints possible without the limitations of CMYK process printing — delivering vibrant, opaque color on dark garments, using spot-mixed inks for accurate color matching, and tolerating the registration and dot gain realities of production screen printing.

Furthermore, understanding simulated color separation — what it is, how it differs from other methods, and how to execute it at a professional level — is essential knowledge for any serious screen printer or prepress specialist.

What Is Simulated Color Separation?

Simulated color separation (also called simulated process, or “sims”) is a technique in which a full-color photographic image is reproduced using a set of spot-mixed opaque inks, each printed through a halftone screen. In contrast to CMYK process printing (which uses only four standard transparent inks), simulated process uses a custom-selected palette of 6–12 colors specifically chosen to best represent the tones and hues in the particular artwork.

The term “simulated” refers to the fact that the process simulates the appearance of full-color printing without using the standard four-color CMYK model. In other words, the colors are “simulated” by mixing halftone dots of opaque spot colors rather than by overlaying transparent standard process inks.

The Key Distinction from CMYK Process

In CMYK process printing:

• Four fixed inks (Cyan, Magenta, Yellow, Black)
• Transparent inks — colors are produced by optical mixing of overlapping dots
• Dots placed at specific angles (15°/75°/90°/45°) to avoid moiré
• Limited to the CMYK gamut
• Works best on white substrates (transparent inks on dark backgrounds produce poor color)

In contrast, in simulated color separation:

• Custom palette of 4–12 spot-mixed colors
• Opaque or semi-opaque inks — colors sit on the substrate rather than mixing through transparency
• Can work on dark garments with a white underbase
• Color gamut can be expanded beyond standard CMYK by choosing palette colors strategically
• Dot angles and frequencies are set per-channel based on color dominance rather than fixed CMYK angles

Why Simulated Process Outperforms CMYK for T-Shirt Printing

Standard CMYK process printing is the correct choice for printing on white paper with calibrated output. However, for t-shirt printing — especially on dark garments — simulated process delivers superior results for several reasons:

1. Opaque inks work on dark substrates. CMYK transparent inks on a dark garment produce washed-out, inaccurate color. As a result, opaque simulated process inks on a white underbase produce vibrant, accurate color on any garment color.

2. Ink colors can be optimized for the specific artwork. CMYK is fixed — you always use the same four inks. In contrast, for a design dominated by earthy tones, a simulated process palette can include warm browns, tans, and flesh tones that would require complex CMYK dot combinations. Similarly, for a design with vivid blues, the palette can include a custom royal blue or cerulean that reproduces more accurately than CMYK cyan.

3. More forgiving of dot gain. Opaque inks don’t mix where they overlap (the way transparent CMYK inks do). Consequently, shadow fill and color shift from dot gain are far less destructive.

4. Better registration tolerance. CMYK process requires tight registration (±0.1mm) for correct color. However, simulated process, because it uses opaque inks, is less sensitive — slight misregistration shifts an edge rather than producing the color contamination that occurs with overlapping transparent CMYK dots.

5. No moiré from ink angle interaction. CMYK requires specific halftone angles between channels to minimize moiré. By contrast, simulated process channels are assigned angles based on dominance rather than fixed values, which significantly reduces moiré risk.

The Simulated Color Separation Workflow

Step 1: Image Preparation

Begin with a high-resolution RGB image — 200–300 DPI at the intended print size. Specifically, simulated process separation requires:

• Correct color balance: The image must be color-accurate before separation begins. Wrong white balance in the source photo, or uncalibrated monitor display, will produce an inaccurate separation.
• Correct shadow and highlight range: Check levels — the darkest point in the image should be close to 0,0,0 (black) and the lightest point close to 255,255,255 (white). As a result, flat, low-contrast images produce flat, low-contrast prints.
• Sharpening: Apply unsharp mask before separation (Amount: 100–150%, Radius: 0.8–1.2px, Threshold: 2–4). This is because the halftone screen printing process slightly softens fine detail, and pre-sharpening compensates for that loss.

Step 2: Color Analysis and Palette Selection

Before creating any separations, analyze the image to determine which colors will be most effective in the palette. This is where simulated process requires creative judgment, not just technical execution.

Identify the dominant hues: What are the 3–5 most important colors in the image? For example, for a portrait: skin tone, hair color, background color, shadow color, highlight white. For a landscape: sky blue, green, earth tone, shadow, white highlight.

Identify the gamut extremes: What is the most saturated color? The darkest shadow? The brightest highlight? Consequently, these define the extremes the palette must reach.

Decide how many colors to use: This is typically determined by budget (number of screens = number of inks = cost) and press capacity. As a result, common simulated process color counts are:

Step 3: Creating the Separations

Simulated process separations are created manually in Photoshop — this is the “manual color separation” that defines professional prepress work, as distinct from automated software solutions.

The core technique: each color channel in the separation is built by selecting and masking the tonal range that that particular ink will represent in the final print. In practice, this means building each channel independently through the following steps:

Underbase white (for dark garments): Built first. It uses luminosity/brightness information from the image to determine where white underbase is needed. Shadow areas (dark garment contributes shadow) get less or no underbase; highlight areas get full white. Typically, it is a halftone channel, not solid white.

Black (or dark shadow color): The shadow/detail channel. It provides depth, shadow detail, and outlines. Usually a standard black or very dark brown. Moreover, it is applied at relatively coarse halftone frequency to maximize shadow depth.

Highlight white (for dark garments): A separate white channel printed last — on top of all other colors — to add brilliant pure-white highlights. Importantly, this is different from the underbase; this is the final white accent layer.

Color channels: Each color channel represents the tonal contribution of that ink to the final image. For example, the red channel, orange channel, flesh tone channel, or blue channel — each is extracted by:

1. Converting the image to Lab color mode to isolate luminance from chroma
2. Using Selective Color or Hue/Saturation to isolate the target color range
3. Creating a grayscale representation of that color’s tonal contribution
4. Applying halftone screening at the appropriate frequency and angle

Step 4: Halftone Frequency and Angle Assignment

Unlike CMYK with its fixed angle scheme, simulated process assigns halftone angles based on visual impact. Specifically, the assignment works as follows:

Most dominant color: 45° (the angle most pleasing to the human eye, least visible as a grid) Second most dominant: 75° or 15° Third: The other of 75°/15° Least dominant: 90° (the most visible angle, but reserved for the least important channel) Black/shadow: 45° (same rule as dominant color — this is usually the visually dominant channel)

Furthermore, halftone frequency for simulated process is typically 45–55 LPI for standard t-shirt printing, which requires 160–200 TPI mesh.

Step 5: Dot Gain Compensation

Apply a dot gain compensation curve to each channel before film output. Simulated process is particularly sensitive to dot gain in the highlight areas — fine highlight dots that lose even 5% gain cause visible shadow fill in what should be bright, open tonal areas.

A standard starting curve for simulated process on standard garments (medium mesh) is:

• 10% input → 6% output
• 25% input → 18% output
• 50% input → 38% output
• 75% input → 63% output
• 90% input → 82% output

After measuring actual press dot gain, adjust these values accordingly.

Step 6: Proofing

Before burning screens, proof the separation digitally:

• Create a composite of all channels in Photoshop by simulating the ink colors
• Compare to the original image
• Adjust any channel that is too heavy (filling shadows) or too light (losing highlight detail)

Additionally, a soft proof in Photoshop using the intended ink colors as spot channel colors gives a reasonable preview of the final print before any screens are produced.

Ink Selection for Simulated Process

The ink palette in simulated process is the creative core of the technique. Unlike CMYK (where you have no choice), simulated process allows custom palette selection that can be optimized for each image.

Building a Palette

Start with black and white. Nearly every simulated process job includes a black (or dark shadow) channel and a white (underbase and/or highlight white). Together, these provide the full tonal range of the image.

Add the primary hues needed by the image. For instance, a portrait needs skin tones. A landscape needs blues and greens. A product shot needs the product’s brand colors.

Use mixed colors, not standard gamut. Simulated process works best with custom-mixed inks that precisely match the dominant colors in the image — not standard primary colors. As a result, a flesh tone mixed specifically for the skin in the image will reproduce more accurately than trying to build flesh from standard red, yellow, and white halftone combinations.

Consider semi-transparent inks for some channels. While opaque inks are the foundation of simulated process (especially on dark garments), some channels benefit from semi-transparency — allowing subtle optical mixing in transition zones. However, this is a judgment call based on image content.

Typical 8-Color Simulated Process Palette (Dark Garment)

1. White underbase (opaque)
2. Highlight white (opaque, printed last)
3. Black / dark shadow
4. Warm light (light skin tone / warm highlight)
5. Mid-flesh / warm orange
6. Red / pink
7. Blue or teal
8. Yellow / warm light

Furthermore, this palette can be adjusted for any image type — replace blue with green for a nature print, add a purple for a sunset design, or add a gold for a product design.

Simulated Process vs. Index Color: When to Choose Each

Both simulated process and index color separation produce photographic results with opaque inks on dark garments. However, the choice between them depends on design content and production requirements.

Choose simulated process when:

• Print quality and color accuracy are the top priorities
• Budget allows 8–12 colors
• Press has reliable, precise registration
• Design contains complex skin tones or smooth gradients

On the other hand, choose index color when:

• Moiré is a recurring problem on press
• Design will be printed on textured fabrics
• Press registration is less precise
• A faster prepress workflow is needed

Troubleshooting: Simulated Color Separation Problems

Problem 1: Print Looks Too Dark / Shadows Filled In

Symptoms: Shadows blocked solid, highlight detail present but mid-tones too dark overall.

Causes and fixes:

• Black channel too heavy: Reduce the opacity of the black separation channel; lighten the curve in shadow areas.
• Dot gain not compensated: Apply dot gain compensation to all channels; this is most critical for shadow areas where large dots are already close to merging.
• Underbase too solid under shadow areas: For dark garment work, reduce or eliminate underbase under the darkest shadow areas — the dark garment contributes shadow depth naturally.
• Too much ink overlap in mid-tones: Multiple channels contributing ink to the same mid-tone zone create cumulative opacity. As a result, reduce the midtone density of secondary channels.

Problem 2: Colors Look Washed Out / Low Saturation

Symptoms: Print looks desaturated, muddy, or dull compared to the original image.

Causes and fixes:

• Underbase insufficient: Colors printing on insufficient white underbase will be contaminated by the dark garment. Therefore, check underbase opacity first.
• Ink colors too neutral / not saturated: The mixed inks may not be saturated enough. Compare printed ink patches to the palette colors — if the printed ink looks muted, check mixing and ink quality.
• Semi-transparent inks used where opaque needed: Transparent inks on dark garments or over each other produce muddy results. Consequently, verify ink opacity for each channel.
• Too much black channel: Excessive black reduces saturation of all colors. Therefore, reduce black channel density, particularly in saturated color areas.

Problem 3: Skin Tones Look Wrong

Symptoms: Flesh tones appear too orange, too pink, too red, or look posterized rather than smooth.

Causes and fixes:

• Flesh tone ink color inaccurate: Re-mix the flesh tone ink — compare printed ink patch to the target skin tone. Then adjust toward the correct hue.
• Insufficient flesh tone channel range: The flesh tone channel should carry a wide range from very light (highlight on skin) to medium (mid-tone skin). Therefore, check that the channel covers the full tonal range of the skin in the image.
• Black channel too heavy in skin areas: Black in skin tones creates a grayish cast. As a result, reduce black channel density in flesh areas using selective channel masking.
• Color profile mismatch: The monitor display is not accurately representing the image colors. Consequently, use a calibrated monitor and work in a consistent color space (sRGB for most photography).

Problem 4: Moiré Pattern Visible in Print

Symptoms: Repeating interference pattern visible in halftone areas.

Causes and fixes:

• Two channels sharing the same or similar halftone angle: Check angle assignments for all channels. No two visually significant channels should share the same angle or be within 15° of each other.
• Halftone frequency too close to mesh frequency: Change LPI or mesh count. For example, a 45 LPI halftone on a 160 mesh can sometimes produce interference — try 42 LPI or switch to 180 mesh.
• Misregistration causing channel interaction: Even slight misregistration between two halftone channels can create moiré in the overlap areas. Therefore, check and correct press registration.
• Consider switching to index color: For persistent moiré problems, index color separation eliminates the issue entirely.

Problem 5: Fine Highlight Dots Not Printing

Symptoms: Very light tonal areas (3–10% dots) print as blank white; gradients jump from white to the first visible dot rather than fading smoothly.

Causes and fixes:

• Emulsion not holding fine dots: Increase exposure time for halftone screens by 15–25% compared to solid stencil screens. This is because fine dots need complete polymerization to survive washout and printing.
• Mesh too coarse for fine dot size: Fine highlight dots require finer mesh. Therefore, increase mesh count.
• Dot gain compensation removing too much: If the compensation curve reduces 10% input to 3% output, dots that small may not print reliably. As a result, set minimum dot in the RIP to 5–8%.
• Ink viscosity too high for fine dots: Thick ink won’t flow through small dot openings. Consequently, reduce viscosity slightly.

Common Mistakes in Simulated Color Separation

1. Starting with a poorly prepared image. Simulated process cannot compensate for a flat, low-contrast, low-resolution, or poorly color-balanced source image. Therefore, always correct the image before separating it — the better the source, the better the separation.

2. Choosing too few colors and expecting photo quality. A 4-color simulated process can look excellent for graphic work. However, it will not reproduce complex photography convincingly. Consequently, budget for 8–10 colors for genuine photo-quality work.

3. Using standard CMYK angles for simulated process channels. CMYK angles are designed for standard CMYK ink sets. In contrast, for simulated process with custom palettes, assign angles based on channel dominance — the most visible channel at 45°, the least visible at 90°.

4. Not building a halftone underbase for dark garment photographic work. A solid white underbase under a photographic simulated process print produces heavy, stiff prints with crushed shadow detail. Therefore, the halftone underbase is a more sophisticated but significantly better approach.

5. Relying on automated separation software without manual adjustment. Automatic separation software provides a starting point, not a finished separation. As a result, every automated separation should be reviewed and adjusted channel by channel — shadow balance, skin tone accuracy, and highlight preservation always require manual refinement.

6. Not proofing the separation before burning screens. A soft proof in Photoshop reveals problems before screens are burned. For example, discovering a major color issue after screens are made costs hours; discovering it during proofing costs minutes.

7. Using the same dot gain curve for every job. Dot gain varies with mesh count, ink type, garment, and press conditions. Therefore, build and apply a specific compensation curve for each press/mesh/ink/substrate combination.

Summary

Simulated color separation is the professional standard for photographic screen printing — it combines the opacity and vibrancy of spot-color printing with the tonal complexity of photographic reproduction. Furthermore, it requires more prepress skill than either CMYK process or index color separation, but it delivers results that neither of those methods can match for multi-color photographic work on dark garments.

In conclusion, the key to excellent simulated process work is in the details: precise image preparation, thoughtful palette selection, careful channel construction, correct halftone assignment, dot gain compensation, and rigorous proofing. Each of these steps contributes to the final print quality. Therefore, skip any one of them, and the print will show it.

Dragonfly Colors specializes in manual simulated color separation — handcrafted, channel-by-channel prepress for screen printers who demand the best possible result. Contact us to discuss your next photographic printing project.