Raster vs Vector, Resolution & Image Quality

By Pritesh Yadav 15 min read

Every image that goes to a printing press is, at heart, one of two things: a grid of colored dots, or a set of math instructions. Knowing which is which — and how each behaves when you scale, edit, and output it — is the single biggest skill that separates print files that come out crisp from files that come out blurry. This section starts from "what is a pixel" and builds all the way to the layer math your designer tool quietly performs before it hands a file to the printer.

6.1 Two ways to describe a picture: raster and vector

Before any definitions, the core split:

Raster (also called bitmap)
A picture stored as a grid of pixels. A pixel ("picture element") is one tiny square that holds a single color value. The whole image is just rows and columns of these squares. Because the number of pixels is fixed the moment the image is created, raster is resolution-dependent — the detail is baked in and can never be increased later. Common formats: JPEG, PNG, TIFF, PSD, GIF, BMP, RAW. Made by cameras, scanners, and Photoshop. Best for photographs, continuous-tone images, and complex gradients — anything with subtle color change from one pixel to the next.
Vector
A picture stored as math — points, lines, curves, and fills — not pixels. There are no squares; there are instructions like "draw a circle of radius r, fill it blue." Because it is math, it is resolution-independent: at output time it is re-drawn (rasterized) at whatever resolution the device needs, so it stays razor-sharp at any size. Common formats: AI, EPS, SVG, PDF (vector content), CDR. Made by Illustrator, CorelDRAW, Inkscape — and the shapes, text, and paths inside a Fabric.js designer are vectors. Best for logos, icons, type, line art, and packaging die-lines — anything needing crisp edges at any scale.
Analogy: Raster vs vector is a photo mosaic vs a recipe. A mosaic has a fixed number of tiles — zoom in and you see the tiles, and you can't add detail that was never laid. A recipe ("draw a circle radius r") can be re-baked at any size and is always perfectly smooth.
PropertyRaster (pixels)Vector (math)
Made ofA fixed grid of colored pixelsPoints, lines, Bézier curves, fills
ScalingResolution-dependent — blurs/blocks when enlargedResolution-independent — sharp at any size
Best forPhotos, continuous tone, gradientsLogos, type, icons, line art, die-lines
FormatsJPEG, PNG, TIFF, PSD, RAWAI, EPS, SVG, PDF (vector), CDR
Output behaviourStuck at the pixels it hasRasterized at the device's full resolution

The plain rule for print: use vector for logos, type, and line art (it scales infinitely and prints at the device's full resolution), and raster for photos (a photo can't be "made vector" without losing realism). The dangerous middle is a logo left as a low-res JPEG — it has thrown away its scalability forever.

The handoff: rasterizing (RIP) at output

Vectors don't print directly as math — at the final stage they are rasterized (turned into dots) by the printer's RIP (Raster Image Processor, the software that converts a page into the dot pattern the press lays down). The key point: a vector logo sent to a 2400-dpi imagesetter gets 2400-dpi-sharp edges. The exact same logo flattened earlier to a 150-ppi JPEG is stuck at 150 ppi forever, no matter how good the press is.

Key takeaway: Raster bakes its detail in at creation and can only lose quality from there; vector carries instructions and is rendered fresh at the printer's full resolution. Match the type to the element: photos = raster, logos/type/line-art = vector.
Example: A customer emails a 400×400-px, 72-ppi JPEG logo pulled off their website to go on a 3-foot banner. Blown up that big it's a blurry mess. The vector .AI/.EPS/.SVG of the same logo prints knife-sharp at any size because it is re-rasterized at the printer's resolution.

6.2 Bézier curves & vector geometry — the math under a Fabric.js designer

If vectors are "math instructions," the most important instruction is the curve. Almost every smooth vector shape is built from Bézier curves. Here are the building blocks in plain words:

Anchor point (node)
An on-curve point where a curve segment starts or ends. The line actually passes through it.
Control handle (control point / direction handle)
An off-curve point that pulls the curve like a magnet. It sets the curve's direction and tension but the line does not pass through it.

The standard curve in PostScript, PDF, SVG, Illustrator, and Fabric is the cubic Bézier: four points P0, P1, P2, P3. The curve runs from P0 to P3 (the two anchors), while P1 and P2 are the off-curve control handles. As a parameter t sweeps from 0 to 1, the point on the curve is:

B(t) = (1-t)^3 P0 + 3(1-t)^2 t P1 + 3(1-t) t^2 P2 + t^3 P3

   P1 *----.            The 4 weights are the Bernstein
       \    `--.        polynomials:  (1-t)^3, 3t(1-t)^2,
        \      curve     3t^2(1-t), t^3  -- they ALWAYS
   P0 *--\----.   \      sum to 1.
          \    `-._ *  P3   Curve leaves P0 toward P1,
           `------* P2      arrives at P3 coming from P2.

The geometric meaning is friendlier than the formula: the curve leaves P0 heading straight toward P1 (so the line P0→P1 is the starting tangent) and arrives at P3 coming from P2 (line P2→P3 is the ending tangent). Handle length controls how strongly the curve bows; handle angle sets the tangent direction. The curve always stays inside the convex hull (the rubber-band outline) of its four points.

A quadratic Bézier uses only 3 points (one control): B(t) = (1-t)²P0 + 2(1-t)t·P1 + t²P2. TrueType fonts use quadratics; PostScript and OpenType-CFF fonts use cubics.

How it renders: the software steps t in small increments, computes (x,y) at each step, and joins them with short straight segments — this is called flattening. Finer steps look smoother on screen, but at print time the device rasterizes the true math regardless of your screen preview.

Analogy: Bézier handles are magnets pulling a wire. The two anchors pin the wire's ends; the control handles are magnets off to the side. The farther/stronger the magnet, the more the wire bows toward it — but the magnet itself never touches the wire.
Best practice: When drawing or editing nodes, place anchors at the curve's extrema (its top, bottom, left, and right points) and keep the handles horizontal/vertical there. You get fewer, cleaner nodes that are far easier to smooth and edit.

6.3 Resolution: DPI vs PPI vs LPI

These three abbreviations get used interchangeably in shops, but they are three different layers of the print process. Mixing them up is the root of most "why is it blurry?" confusion.

PPI — Pixels Per Inch
The pixel density of a digital image (file). This is the number that actually governs raster print sharpness. When someone says "300 dpi file," they almost always mean 300 PPI — the industry uses "dpi" loosely.
DPI — Dots Per Inch
The physical ink dots a printer lays on paper. Much higher than PPI (inkjet 1200–2880 dpi, laser 600–1200) because many tiny ink dots build a single image pixel or halftone cell.
LPI — Lines Per Inch
The halftone screen frequency — rows of halftone dots per inch in offset/litho printing. Typical values: newspaper 85 lpi; general commercial & magazines 133–150 lpi (150 lpi is the common standard); high-end art books 175–200 lpi.
  THE FILE          THE SCREEN          THE PRESS
  +---------+       +-----------+       +-----------+
  |  PPI    |  -->  |   LPI     |  -->  |   DPI     |
  | pixels  |       | halftone  |       | ink dots  |
  | per inch|       | per inch  |       | per inch  |
  +---------+       +-----------+       +-----------+
   your image      screen ruling       printer hardware
Key takeaway: PPI is your file, LPI is the halftone screen, DPI is the printer's ink. Only PPI is something you control in your artwork — get that right and the press handles the rest.

6.4 The 300 dpi rule and the 2× Quality Factor

"Use 300 dpi for print" is the most repeated rule in the business — and it's not magic. It comes from the Quality Factor (QF) rule: the image PPI you need is roughly 1.5× to 2× the LPI of the press, with 2:1 being the Adobe/industry standard.

So at the common commercial screen of 150 lpi: 150 lpi × 2 = 300 ppi. That's the entire origin of "300 dpi for print." Because it's a ratio, it scales with the screen ruling:

Press screen (LPI)Use caseRequired image PPI (QF=2)
85 lpiNewspaper~170 ppi
150 lpiGeneral commercial / magazines300 ppi
175 lpiHigh-end work350 ppi
200 lpiFine art books400 ppi

A QF below ~1.5 risks halftone artifacts and softness; above ~2 just wastes data — the RIP throws away the extra pixels, giving you bigger files with no visible gain. The big exception is large-format (banners, billboards): they're viewed from far away, so 100–150 ppi (or far less for billboards) is fine because the eye can't resolve the dots at distance.

Common mistake: Treating "300 dpi" as a universal law. Newspaper photos legitimately need only ~170 ppi, and a billboard far less — while a fine-art book at 200 lpi actually needs 400 ppi. Match the PPI to the press's LPI, not to a memorized number.

6.5 Effective resolution after scaling

Here's the trap that bites even experienced designers. When you place a raster image in a layout and resize it, the actual pixels don't change — but the effective (output) resolution does. The formula:

  Effective PPI = Original PPI / Scale Factor

  ENLARGE  -> effective resolution DROPS (danger)
    300 ppi @ 200%  = 150 ppi   (too low)
    300 ppi @ 120%  = 250 ppi   (still good)

  REDUCE   -> effective resolution RISES (always safe)
     72 ppi @  50%  = 144 ppi
     72 ppi @  25%  = 288 ppi
    300 ppi @  50%  = 600 ppi

Rule of thumb: enlarging a placed image up to about 120% keeps very good quality; beyond that the effective resolution falls below target. Reducing is always safe — you're packing more source pixels into each printed inch.

Common mistake — the "drag-to-fit" trap: A designer places a 300-ppi photo in InDesign, then drags the frame corner to fill the page, scaling it to 220%. Preflight flags the effective resolution at ~136 ppi — it will print soft. The fix is a bigger source file or a smaller placement, never just dragging it bigger.
Best practice: Always check effective resolution (after scaling), not just the file's stored PPI. This is why a good preflight tool catches "images dragged larger than they can support" rather than offering a "set to 300 dpi" button — bumping the PPI number does not add real detail.

6.6 Image resampling — bicubic, Lanczos, nearest neighbor

Resampling means changing an image's pixel count; the algorithm decides how the new (or removed) pixels are computed.

AlgorithmHow it worksQuality / use
Nearest neighborCopies the single closest pixelFastest; blocky/jagged. Only for pixel art or hard-edge images you don't want smoothed
BilinearAverages the 4 (2×2) nearest pixelsSmoother than nearest, softer and cheaper than bicubic
BicubicUses 16 (4×4) neighbors, non-linearSmooth, detail-preserving; Photoshop's default ("Smoother" for enlarging, "Sharper" for reducing)
LanczosWindowed-sinc over a larger neighborhoodSharpest, best detail retention; heaviest to compute. Preferred for downscaling (sharp/ImageMagick offer it)

Why upscaling degrades: there is no real information between the original pixels, so interpolation can only guess or blur. Detail is invented, never recovered. Why downscaling is safe: you're discarding surplus data, and a good filter averages many source pixels into each new one. (Downscaling still needs an anti-alias/low-pass step — nearest-neighbor downscaling just drops pixels and aliases badly, causing moiré.)

Analogy: Upscaling vs downscaling is like books and summaries. You can always summarize a long book into a paragraph (downscale: throw away detail cleanly). You cannot expand a paragraph back into the original book (upscale: you can only make stuff up).
Common mistake: Using a 72-ppi web image for print, then "fixing" it by upsampling the PPI number in software. This adds zero real detail — it only invents and blurs pixels. The only real fixes are a higher-resolution source or printing the image smaller.

6.7 Bit depth & channels

Bit depth is the number of bits used per channel — which sets how many tonal steps each color channel can hold.

8-bit per channel
256 levels per channel → about 16.7 million colors in RGB. The standard delivery depth; perfectly fine for final output.
16-bit per channel
65,536 levels per channel → trillions of colors. Vastly more headroom for editing.
Channels
The separate color components: RGB = 3 channels, CMYK = 4 (the print color space), grayscale = 1. Total image bits = depth × channels — so 8-bit RGB = 24-bit color, and 16-bit RGB = 48-bit.
Alpha channel
An extra channel storing per-pixel opacity (0 = transparent, 255 = fully opaque at 8-bit). Supported by PNG, TIFF, and PSD — but not by JPEG.

Why edit in 16-bit: heavy edits (curves, large gradients, dodging/burning) on an 8-bit image cause banding — visible stepping in smooth gradients like skies — because there simply aren't enough levels to redistribute. 16-bit keeps gradients smooth all the way through manipulation.

Example: A sunset edited heavily in 8-bit shows visible step-bands in the gradient when it hits the press. Redoing the same edit in 16-bit and exporting flat removes the banding entirely.
Best practice: Edit and retouch your master in 16-bit, convert to 8-bit only on final export. For print transparency, deliver TIFF-with-alpha or PNG (16-bit if smooth edges matter), never JPEG.

6.8 Alpha compositing & blend modes — layer math before flattening

When layers overlap, the software performs real math to combine them. Understanding it explains why some exports get ugly halos or "white boxes."

Alpha compositing

Alpha compositing is combining a layer over a background using its alpha (opacity) to fake partial transparency. The standard "over" operator (from Porter–Duff) is:

  out = src * alpha + dst * (1 - alpha)
        \_______/      \____________/
        top layer        background showing through

There are two ways alpha can be stored, and mixing them up causes edge halos:

Straight (unassociated) alpha
The RGB color is stored independently of the opacity value.
Premultiplied (associated) alpha
The RGB is already multiplied by alpha — faster to composite and avoids dark/light fringe halos at edges. Mixing the two wrongly produces edge halos, which matters when exporting from a canvas/designer for print.

Blend modes

Blend modes are per-channel math formulas that combine a source layer with the base layer below it:

  • Multiply: result = base × top ÷ 255 → always darkens. It mimics ink layering / CMYK absorption (each ink layer absorbs more light) — the print-realistic darkening mode.
  • Screen: the inverse of multiply → always lightens.
  • Overlay / Soft Light: contrast modes (multiply in the shadows, screen in the highlights).

Flattening

Flattening bakes all the layers, blend modes, and transparency down into one opaque raster. Once flattened it is permanent — the blend math is resolved into final pixel values and the layers are gone.

Common mistake — bad transparency flattening: Many RIPs and older PostScript can't render live transparency or blend modes, so prepress flattens them. Done badly, this causes "white box" artifacts, color shifts, hairline stitching lines, or soft rasterized-text edges wherever transparent objects overlap.
Best practice: Keep transparency live by exporting a PDF/X-4 file (it supports live transparency) instead of PDF/X-1a (which forces flattening). If you must flatten, flatten at high resolution. And always outline type to curves or embed fonts in the PDF/X — otherwise the RIP can't find the font, substitutes a wrong one, and text reflows or breaks.
Section summary:
  • Raster = pixels, vector = math. Use raster for photos, vector for logos/type/line-art; vector re-rasterizes at the printer's full resolution while raster is stuck at the pixels it was born with.
  • Bézier curves (cubic: P0–P3 with two off-curve handles) are the geometry under every vector tool — anchors pin the ends, handle length/angle bow the curve, and the math is rendered fresh at output.
  • PPI (file) → LPI (screen) → DPI (ink) are three different layers. The "300 dpi rule" is just Quality Factor 2 at 150 lpi; scale it with the press (350 ppi at 175 lpi, ~170 ppi for newspaper).
  • Effective PPI = original PPI ÷ scale factor. Enlarging drops resolution (keep under ~120%); reducing is always safe. Upscaling invents detail and never recovers it — downscale, never upscale.
  • Edit in 16-bit to avoid banding, keep an alpha/layered master, and export PDF/X-4 to preserve live transparency — flatten and convert to 8-bit only at the final output step.

Continue reading