Dot Gain, Halftone, and Moiré in Screen Printing: The Complete Technical Guide

Screen printing with photographic images and gradients means working with halftones — and halftones introduce three challenges that every serious printer must understand: dot gain, moiré patterns, and halftone frequency selection. These are not occasional problems. In fact, they are physics. Understanding them separates printers who consistently produce clean, accurate work from those who spend hours troubleshooting prints that “just don’t look right.”

This guide explains the science behind halftone printing, how dot gain affects every print you make, why moiré patterns occur and how to prevent them, and the practical steps to get photorealistic results from a screen printing press.

What Is a Halftone?

A halftone is a reprographic technique that simulates continuous tones (like the gradients in a photograph) using discrete dots of a single ink color. The human eye averages the dot pattern at a viewing distance, perceiving areas of larger dots as darker and areas of smaller dots as lighter.

In screen printing, halftone dots are created by outputting film through a RIP (Raster Image Processor) that converts tonal values to dots of varying size. The dots are then burned into the screen stencil. As a result, when ink passes through the open dot areas, it recreates the tonal range of the original image.

Two fundamentally different halftone structures are used in screen printing:

Amplitude Modulated (AM) Halftone — Traditional Halftone

In AM halftoning, dots are placed at regular, fixed intervals (a grid), and size varies to control tone. Small dots = light tones; large dots = dark tones.

• Fixed screen angle and frequency
• Dots arranged in rows at specific angles
• Most susceptible to moiré patterns
• Common frequencies: 35–65 LPI (lines per inch) for screen printing

Frequency Modulated (FM) Halftone — Stochastic / Diffusion Dither

In FM halftoning, all dots are the same size, and spacing varies to control tone. Dense dots = dark tones; scattered dots = light tones.

• Random or pseudo-random dot placement
• No fixed screen angle
• Resistant to moiré patterns
• Requires finer mesh counts
• Used extensively in index color separation

Halftone Frequency: How to Choose LPI for Screen Printing

Lines Per Inch (LPI) — also called screen ruling or halftone frequency — describes how many lines of halftone dots exist per inch. Higher LPI = finer detail but requires a higher mesh count to reproduce.

The critical relationship: LPI and mesh count

A practical rule of thumb: mesh count in threads per inch should be roughly 4–4.5× the halftone frequency.

These figures are rounded to mesh counts that are actually sold, not to whatever the multiplication produces. In garment printing 90, 100, 120 and 140 are the standards; 110 is less common, and 150 belongs to a different branch of screen printing altogether.

Going above this ratio risks “sawtoother” dots (mesh threads cut through the dots) and poor ink transfer. On the other hand, going below it sacrifices detail.

Halftone Angles: Preventing Moiré

Moiré is the visible wave pattern that appears when two regular structures lie on top of each other. In halftone printing there are several such structures — and which one is actually dangerous depends on the substrate.

On Paper: Every Color at a Different Angle

In printing on paper what decides the outcome is the interference between the colors. Each halftone screen therefore has to be output at a different angle, because two screens sharing an angle will moiré immediately.

The 30° offset between the dominant colors (C, M, K) minimizes visible interference. Yellow, being the least visible color, takes the most potentially problematic angle (90°/0°).

Why 45° is special: The human visual system is most sensitive to diagonal interference patterns. Placing the darkest color (black) at 45° means its dot pattern blends into the image rather than appearing as a visible grid.

On Fabric: Every Color at the Same Angle

In garment screen printing that scheme does not apply. In CMYK process printing on fabric every color is output at the same angle — and this is not a shortcut, it is a different balance of forces.

The threat here is not interference between the colors, it is interference between the halftone and the mesh threads. The grid of halftone dots and the weave of the mesh are two regular structures lying one on the other, and those are the two that beat against each other. Varying the angle between colors achieves nothing, because every color prints through the same weave anyway.

So the halftone angle is chosen relative to the mesh threads, not relative to the other colors. 22.5° and 67.5° work best — they sit furthest from warp and weft (0° and 90°) and at the same time furthest from the 45° diagonal, that is, from every direction in which the weave has a regularity of its own.

What Causes Moiré in Screen Printing?

Moiré in screen printing occurs when:

1. The halftone angle falls close to the direction of the threads — the regular grid of the weave has a frequency and directions of its own. A halftone laid along them, or at 45°, starts to work against them; hence 22.5° and 67.5°
2. The halftone frequency is close to the mesh count — the two frequencies are then so similar that they beat against each other whatever the angle
3. Film angle does not match the actual printed angle — caused by film slipping during exposure, or the screen not sitting squarely under the vacuum frame. With one angle shared by every color, a single screen stretched out of square is enough to introduce an angular difference that was not meant to be there
4. Wrong mesh count for the halftone frequency — the relationship between dot size and mesh opening must be within the correct ratio

Dot Gain: The Fundamental Challenge of Halftone Printing

Dot gain (also called “dot spread” or “tonal value increase”) is the phenomenon where printed halftone dots are physically larger than the dots on the film or stencil. It is inevitable in screen printing — in other words, every dot gains.

Why Dot Gain Occurs

Mechanical dot gain happens at the moment of ink transfer. When the squeegee presses ink through the mesh, ink spreads slightly beyond the edges of the stencil opening. This is purely physical — surface tension, ink viscosity, and substrate absorbency all play a role.

Optical dot gain occurs even if the physical dot is perfectly reproduced. The paper or fabric substrate scatters light internally, consequently making dots appear larger to the eye than they actually measure.

Total dot gain = mechanical gain + optical gain

How Much Dot Gain to Expect

Screen printing typically produces more dot gain than offset lithography because:

• Ink deposit is thicker
• Substrate (especially textiles) is more absorbent and uneven
• Mesh geometry creates ink spread at dot edges

Typical screen printing dot gain at the 50% tonal value:

This means a 50% dot on film can print as a 68–85% tone. As a result, without compensation, shadows will fill in and the print will appear darker and muddier than the original artwork.

Dot Gain Compensation (Tonal Value Reduction)

The solution is to pre-compensate the film output: reduce tonal values in the artwork so that after dot gain, the printed result matches the intended tones.

This is done through a dot gain compensation curve in the RIP or in Photoshop:

1. Print a test target (step wedge from 5% to 95% in 5% increments)
2. Measure the actual printed tonal values with a densitometer
3. Plot the measured values against the intended values
4. Create a correction curve that shifts output values down by the gain amount
5. Apply this curve to all future film output for the same press/ink/substrate combination

For example: If a 40% dot on film prints as 58% on the substrate, the compensation curve should output 40% tones as approximately 28% on film, so the dot gain brings them back to the target 40%.

The Shadow Fill Problem

Dot gain is most destructive in shadow areas. At high tonal values (70%–90%), dots are large and close together. Even a small amount of gain, therefore, causes adjacent dots to merge, filling in shadow detail completely.

Fix: Limit maximum shadow density in halftone separations. Set the maximum black to 85%–90% in the film output settings. Furthermore, some printers use 80% as the maximum for heavily absorbent substrates.

Halftone Dot Shapes

The shape of halftone dots affects how they behave as they grow with dot gain:

For screen printing on textiles, elliptical dots are generally preferred because they manage the two-stage merger more gracefully, consequently reducing the visual impact of tonal jumps.

Stochastic Screening vs. AM Halftone: Practical Comparison

When to use stochastic screening (diffusion dither): Multi-color work on press setups with limited angle control, index color separation, or any situation where moiré is a persistent problem.

On the other hand, when to use AM halftone: Single-color photographic prints, CMYK process work where angles are well-controlled and the press is in good alignment.

Troubleshooting: Halftone and Dot Gain Problems

Problem 1: Moiré Pattern Visible in Print

Symptoms: Repeating wave or cross-hatch pattern in halftone areas, visible at normal viewing distance.

Diagnosis and fixes:

• Film/screen angle mismatch: Use a protractor to verify that film angles are exactly reproduced on the screen. Then re-output film at correct angles.
• Halftone angle too close to the thread direction: Move the angle toward 22.5° or 67.5°.
• Mesh-halftone frequency conflict: Change mesh count up or down, or change halftone frequency.
• Misregistration: Check registration on all stations. Even 0.5mm misregistration can cause moiré at fine frequencies.
• Switch to stochastic screening: This immediately eliminates angle-based moiré.

Problem 2: Shadows Filling In / Image Too Dark

Symptoms: Print appears darker than screen proof, shadow areas lose all detail, muddy image.

Diagnosis and fixes:

• Excess dot gain: Reduce maximum halftone dot to 80–85% in output settings
• Mesh count too low for frequency: Increase mesh count or decrease LPI
• Squeegee pressure too high: Reduce pressure; dots are spreading under printing pressure
• Ink too thin: Consequently, increase ink viscosity
• Off-contact too small: Increase off-contact to improve snap-off, reduce ink spread
• Apply dot gain compensation curve: Measure actual gain and pre-compensate in RIP

Problem 3: Highlights Disappearing (Dot Loss)

Symptoms: Light tones in the 3–15% range don’t print, creating a high-contrast, posterized look.

Diagnosis and fixes:

• Stencil overexposed: Under too long an exposure the fine highlight dots (3–5%) are light-struck, harden part way and will not wash out — the dot never opens, so there is nothing to print with. Shorten the exposure.
• Stencil too thin: Apply an additional emulsion coat. A thin EOM gives poor dot definition, and fine stencil dots break away more easily during the run.
• Ink too thick for fine dots: Reduce viscosity slightly; as a result, thick ink won’t pass through tiny dot openings

Problem 4: Halftone Prints with Visible Saw-Tooth Edges on Dots

Symptoms: Halftone dots look irregular or angular rather than round/smooth.

Diagnosis and fixes:

• Mesh too coarse for halftone frequency: The mesh threads are cutting through dot edges. Therefore, use a finer mesh or reduce LPI.
• Poor film quality: Recheck film output DPI; output at minimum 1200 DPI for halftones
• Insufficient vacuum contact in exposure unit: Poor contact between film and screen causes diffusion of UV light. Consequently, check vacuum pressure and vacuum blanket condition.

Problem 5: Color Shift Between Print Runs

Symptoms: Two print runs of the same artwork produce different color results.

Diagnosis and fixes:

• Inconsistent ink mixing: Weigh and record exact ink formulas; use gram scales, not estimates
• Dot gain variation between screens: Therefore, remeasure compensation curve for each new screen
• Squeegee pressure / speed inconsistency: Use consistent manual technique or switch to automatic press for critical work
• Flash cure timing affecting wet-on-wet color: Additionally, standardize flash cure settings

Common Mistakes with Halftones in Screen Printing

1. Using the wrong LPI for the mesh. Printing a 65 LPI halftone through a 196 TPI (77/cm) mesh is a recipe for filled shadows and blocked highlights. Therefore, always check the ratio before burning a screen.

2. Not running a dot gain test before production. Every press, every ink, every substrate combination produces a different dot gain profile. As a result, running test prints takes 30 minutes and saves hours of troubleshooting.

3. Burning halftone screens for as long as solid stencils. Halftone screens need a shorter exposure, so that the fine highlight dots are not light-struck. The time is matched to the mesh, not to what is sitting on it: many printers expose a 65 LPI halftone on a 120 mesh for the same time as solids on a 61.

4. Ignoring ink viscosity. Halftone printing is highly sensitive to ink consistency. Plastisol has to be mixed up properly in the bucket before printing — ink straight out of the tin, untouched, has not reached its working consistency yet and lays down differently from how it will lay down ten shirts later. The same applies through the run: ink that sits open on the press, evaporates solvents, or is modified with reducer behaves differently as the job progresses. Monitor and maintain viscosity.

5. Not test-printing for interference with the mesh. Before the production run, print a test and look at whether the halftone is working against the weave. The angle and the frequency have to suit that particular mesh, and you cannot judge that from a preview on screen — it only shows on a printed sheet. If a pattern appears: move the angle toward 22.5° or 67.5°, change the mesh count, or drop the frequency.

6. Printing halftones on heavily textured garments. The fabric texture introduces its own frequency pattern which beats against the halftone. Therefore, use diffusion dither (index color / stochastic) for textured fabrics.

7. Not accounting for ink opacity in multi-color halftone work. Transparent inks mix optically where they overlap — and that applies not only to CMYK process but equally to simulated process, that is, to a halftone separation. Opaque inks block each other, but no ink covers one hundred percent; plastisols always stay transparent to some degree. The separation method therefore has to match the real opacity of the inks, not the opacity claimed for them.

Discharge is a case of its own. There the inks do not mix at all, because it is not a matter of laying one layer over another: under heat, discharge pulls the fabric’s own dye out and puts the ink’s pigment in its place.

Summary

Dot gain is not a problem to be eliminated — it is, in fact, a physical reality to be measured, characterized, and compensated for. Similarly, moiré is a frequency interaction phenomenon that can be controlled through correct angle selection, mesh choice, and — most reliably — by switching to stochastic (FM) screening when precision angle control is unavailable.

Furthermore, the printers who get the most out of halftone work are those who approach it systematically: test, measure, compensate, document. In conclusion, the same press, the same ink, the same mesh should produce the same result every time — but only if all variables are understood and controlled.

Dragonfly Colors specializes in professional color separations for screen printing, including dot gain compensation and halftone optimization. Contact us for expert prepress support.