2 DRAFT TIFF Technical Note #
2                            17-Mar-
95 
   3 ============================
 
   5 This Technical Note describes serious problems that have been found in
 
   6 TIFF 
6.0's design for embedding JPEG-compressed data in TIFF (Section 
22 
   7 of the TIFF 
6.0 spec of 
3 June 
1992).  A replacement TIFF/JPEG
 
   8 specification is given.  Some corrections to Section 
21 are also given.
 
  10 To permit TIFF implementations to continue to read existing files, the 
6.0 
  11 JPEG fields and tag values will remain reserved indefinitely.  However,
 
  12 TIFF writers are strongly discouraged from using the 
6.0 JPEG design.  It
 
  13 is expected that the next full release of the TIFF specification will not
 
  14 describe the old design at all, except to note that certain tag numbers
 
  15 are reserved.  The existing Section 
22 will be replaced by the
 
  16 specification text given in the second part of this Tech Note.
 
  19 Problems in TIFF 
6.0 JPEG
 
  20 =========================
 
  22 Abandoning a published spec is not a step to be taken lightly.  This
 
  23 section summarizes the reasons that have forced this decision.
 
  24 TIFF 
6.0's JPEG design suffers from design errors and limitations,
 
  25 ambiguities, and unnecessary complexity.
 
  28 Design errors and limitations
 
  29 -----------------------------
 
  31 The fundamental design error in the existing Section 
22 is that JPEG's
 
  32 various tables and parameters are broken out as separate fields which the
 
  33 TIFF control logic must manage.  This is bad software engineering: that
 
  34 information should be treated as private to the JPEG codec
 
  35 (compressor/decompressor).  Worse, the fields themselves are specified
 
  36 without sufficient thought for future extension and without regard to
 
  37 well-established TIFF conventions.  Here are some of the significant
 
  40 * The JPEGxxTable fields do not store the table data directly in the
 
  41 IFD/field structure; rather, the fields hold pointers to information
 
  42 elsewhere in the file.  This requires special-purpose code to be added to
 
  43 *every* TIFF-manipulating application, whether it needs to decode JPEG
 
  44 image data or not.  Even a trivial TIFF editor, for example a program to
 
  45 add an ImageDescription field to a TIFF file, must be explicitly aware of
 
  46 the internal structure of the JPEG-related tables, or else it will probably
 
  47 break the file.  Every other auxiliary field in the TIFF spec contains
 
  48 data, not pointers, and can be copied or relocated by standard code that
 
  49 doesn't know anything about the particular field.  This is a crucial
 
  50 property of the TIFF format that must not be given up.
 
  52 * To manipulate these fields, the TIFF control logic is required to know a
 
  53 great deal about JPEG details, for example such arcana as how to compute
 
  54 the length of a Huffman code table --- the length is not supplied in the
 
  55 field structure and can only be found by inspecting the table contents.
 
  56 This is again a violation of good software practice.  Moreover, it will
 
  57 prevent easy adoption of future JPEG extensions that might change these
 
  60 * The design neglects the fact that baseline JPEG codecs support only two
 
  61 sets of Huffman tables: it specifies a separate table for each color
 
  62 component.  This implies that encoders must waste space (by storing
 
  63 duplicate Huffman tables) or else violate the well-founded TIFF convention
 
  64 that prohibits duplicate pointers.  Furthermore, baseline decoders must
 
  65 test to find out which tables are identical, a waste of time and code
 
  68 * The JPEGInterchangeFormat field also violates TIFF's proscription against
 
  69 duplicate pointers: the normal strip/tile pointers are expected to point
 
  70 into the larger data area pointed to by JPEGInterchangeFormat.  All TIFF
 
  71 editing applications must be specifically aware of this relationship, since
 
  72 they must maintain it or else delete the JPEGInterchangeFormat field.  The
 
  73 JPEGxxTables fields are also likely to point into the JPEGInterchangeFormat
 
  74 area, creating additional pointer relationships that must be maintained.
 
  76 * The JPEGQTables field is fixed at a byte per table entry; there is no
 
  77 way to support 
16-bit quantization values.  This is a serious impediment
 
  78 to extending TIFF to use 
12-bit JPEG.
 
  80 * The 
6.0 design cannot support using different quantization tables in
 
  81 different strips/tiles of an image (so as to encode some areas at higher
 
  82 quality than others).  Furthermore, since quantization tables are tied
 
  83 one-for-one to color components, the design cannot support table switching
 
  84 options that are likely to be added in future JPEG revisions.
 
  90 Several incompatible interpretations are possible for 
6.0's treatment of
 
  93   * It is unclear whether restart markers must be omitted at TIFF segment
 
  94     (strip/tile) boundaries, or whether they are optional.
 
  96   * It is unclear whether the segment size is required to be chosen as
 
  97     a multiple of the specified restart interval (if any); perhaps the
 
  98     JPEG codec is supposed to be reset at each segment boundary as if
 
  99     there were a restart marker there, even if the boundary does not fall
 
 100     at a multiple of the nominal restart interval.
 
 102   * The spec fails to address the question of restart marker numbering:
 
 103     do the numbers begin again within each segment, or not?
 
 105 That last point is particularly nasty.  If we make numbering begin again
 
 106 within each segment, we give up the ability to impose a TIFF strip/tile
 
 107 structure on an existing JPEG datastream with restarts (which was clearly a
 
 108 goal of Section 
22's authors).  But the other choice interferes with random
 
 109 access to the image segments: a reader must compute the first restart
 
 110 number to be expected within a segment, and must have a way to reset its
 
 111 JPEG decoder to expect a nonzero restart number first.  This may not even
 
 112 be possible with some JPEG chips.
 
 114 The tile height restriction found on page 
104 contradicts Section 
15's
 
 115 general description of tiles.  For an image that is not vertically
 
 116 downsampled, page 
104 specifies a tile height of one MCU or 
8 pixels; but
 
 117 Section 
15 requires tiles to be a multiple of 
16 pixels high.
 
 119 This Tech Note does not attempt to resolve these ambiguities, so
 
 120 implementations that follow the 
6.0 design should be aware that
 
 121 inter-application compatibility problems are likely to arise.
 
 124 Unnecessary complexity
 
 125 ----------------------
 
 127 The 
6.0 design creates problems for implementations that need to keep the
 
 128 JPEG codec separate from the TIFF control logic --- for example, consider
 
 129 using a JPEG chip that was not designed specifically for TIFF.  JPEG codecs
 
 130 generally want to produce or consume a standard ISO JPEG datastream, not
 
 131 just raw compressed data.  (If they were to handle raw data, a separate
 
 132 out-of-band mechanism would be needed to load tables into the codec.)
 
 133 With such a codec, the TIFF control logic must parse JPEG markers emitted
 
 134 by the codec to create the TIFF table fields (when writing) or synthesize
 
 135 JPEG markers from the TIFF fields to feed the codec (when reading).  This
 
 136 means that the control logic must know a great deal more about JPEG details
 
 137 than we would like.  The parsing and reconstruction of the markers also
 
 138 represents a fair amount of unnecessary work.
 
 140 Quite a few implementors have proposed writing "TIFF/JPEG" files in which
 
 141 a standard JPEG datastream is simply dumped into the file and pointed to
 
 142 by JPEGInterchangeFormat.  To avoid parsing the JPEG datastream, they
 
 143 suggest not writing the JPEG auxiliary fields (JPEGxxTables etc) nor even
 
 144 the basic TIFF strip/tile data pointers.  This approach is incompatible
 
 145 with implementations that handle the full TIFF 
6.0 JPEG design, since they
 
 146 will expect to find strip/tile pointers and auxiliary fields.  Indeed this
 
 147 is arguably not TIFF at all, since *all* TIFF-reading applications expect
 
 148 to find strip or tile pointers.  A subset implementation that is not
 
 149 upward-compatible with the full spec is clearly unacceptable.  However,
 
 150 the frequency with which this idea has come up makes it clear that
 
 151 implementors find the existing Section 
22 too complex.
 
 154 Overview of the solution
 
 155 ========================
 
 157 To solve these problems, we adopt a new design for embedding
 
 158 JPEG-compressed data in TIFF files.  The new design uses only complete,
 
 159 uninterpreted ISO JPEG datastreams, so it should be much more forgiving of
 
 160 extensions to the ISO standard.  It should also be far easier to implement
 
 161 using unmodified JPEG codecs.
 
 163 To reduce overhead in multi-segment TIFF files, we allow JPEG overhead
 
 164 tables to be stored just once in a JPEGTables auxiliary field.  This
 
 165 feature does not violate the integrity of the JPEG datastreams, because it
 
 166 uses the notions of "tables-only datastreams" and "abbreviated image
 
 167 datastreams" as defined by the ISO standard.
 
 169 To prevent confusion with the old design, the new design is given a new
 
 170 Compression tag value, Compression=
7.  Readers that need to handle
 
 171 existing 
6.0 JPEG files may read both old and new files, using whatever
 
 172 interpretation of the 
6.0 spec they did before.  Compression tag value 
6 
 173 and the field tag numbers defined by 
6.0 section 
22 will remain reserved
 
 174 indefinitely, even though detailed descriptions of them will be dropped
 
 175 from future editions of the TIFF specification.
 
 178 Replacement TIFF/JPEG specification
 
 179 ===================================
 
 181 [This section of the Tech Note is expected to replace Section 
22 in the
 
 182 next release of the TIFF specification.]
 
 184 This section describes TIFF compression scheme 
7, a high-performance
 
 185 compression method for continuous-tone images.
 
 190 This TIFF compression method uses the international standard for image
 
 191 compression ISO/IEC 
10918-
1, usually known as "JPEG" (after the original
 
 192 name of the standards committee, Joint Photographic Experts Group).  JPEG
 
 193 is a joint ISO/CCITT standard for compression of continuous-tone images.
 
 195 The JPEG committee decided that because of the broad scope of the standard,
 
 196 no one algorithmic procedure was able to satisfy the requirements of all
 
 197 applications.  Instead, the JPEG standard became a "toolkit" of multiple
 
 198 algorithms and optional capabilities.  Individual applications may select
 
 199 a subset of the JPEG standard that meets their requirements.
 
 201 The most important distinction among the JPEG processes is between lossy
 
 202 and lossless compression.  Lossy compression methods provide high
 
 203 compression but allow only approximate reconstruction of the original
 
 204 image.  JPEG's lossy processes allow the encoder to trade off compressed
 
 205 file size against reconstruction fidelity over a wide range.  Typically,
 
 206 10:
1 or more compression of full-color data can be obtained while keeping
 
 207 the reconstructed image visually indistinguishable from the original.  Much
 
 208 higher compression ratios are possible if a low-quality reconstructed image
 
 209 is acceptable.  Lossless compression provides exact reconstruction of the
 
 210 source data, but the achievable compression ratio is much lower than for
 
 211 the lossy processes; JPEG's rather simple lossless process typically
 
 212 achieves around 
2:
1 compression of full-color data.
 
 214 The most widely implemented JPEG subset is the "baseline" JPEG process.
 
 215 This provides lossy compression of 
8-bit-per-channel data.  Optional
 
 216 extensions include 
12-bit-per-channel data, arithmetic entropy coding for
 
 217 better compression, and progressive/hierarchical representations.  The
 
 218 lossless process is an independent algorithm that has little in
 
 219 common with the lossy processes.
 
 221 It should be noted that the optional arithmetic-coding extension is subject
 
 222 to several US and Japanese patents.  To avoid patent problems, use of
 
 223 arithmetic coding processes in TIFF files intended for inter-application
 
 224 interchange is discouraged.
 
 226 All of the JPEG processes are useful only for "continuous tone" data,
 
 227 in which the difference between adjacent pixel values is usually small.
 
 228 Low-bit-depth source data is not appropriate for JPEG compression, nor
 
 229 are palette-color images good candidates.  The JPEG processes work well
 
 230 on grayscale and full-color data.
 
 232 Describing the JPEG compression algorithms in sufficient detail to permit
 
 233 implementation would require more space than we have here.  Instead, we
 
 234 refer the reader to the References section.
 
 237 What data is being compressed?
 
 238 ------------------------------
 
 240 In lossy JPEG compression, it is customary to convert color source data
 
 241 to YCbCr and then downsample it before JPEG compression.  This gives
 
 242 2:
1 data compression with hardly any visible image degradation, and it
 
 243 permits additional space savings within the JPEG compression step proper.
 
 244 However, these steps are not considered part of the ISO JPEG standard.
 
 245 The ISO standard is "color blind": it accepts data in any color space.
 
 247 For TIFF purposes, the JPEG compression tag is considered to represent the
 
 248 ISO JPEG compression standard only.  The ISO standard is applied to the
 
 249 same data that would be stored in the TIFF file if no compression were
 
 250 used.  Therefore, if color conversion or downsampling are used, they must
 
 251 be reflected in the regular TIFF fields; these steps are not considered to
 
 252 be implicit in the JPEG compression tag value.  PhotometricInterpretation
 
 253 and related fields shall describe the color space actually stored in the
 
 254 file.  With the TIFF 
6.0 field definitions, downsampling is permissible
 
 255 only for YCbCr data, and it must correspond to the YCbCrSubSampling field.
 
 256 (Note that the default value for this field is not 
1,
1; so the default for
 
 257 YCbCr is to apply downsampling!)  It is likely that future versions of TIFF
 
 258 will provide additional PhotometricInterpretation values and a more general
 
 259 way of defining subsampling, so as to allow more flexibility in
 
 260 JPEG-compressed files.  But that issue is not addressed in this Tech Note.
 
 262 Implementors should note that many popular JPEG codecs
 
 263 (compressor/decompressors) provide automatic color conversion and
 
 264 downsampling, so that the application may supply full-size RGB data which
 
 265 is nonetheless converted to downsampled YCbCr.  This is an implementation
 
 266 convenience which does not excuse the TIFF control layer from its
 
 267 responsibility to know what is really going on.  The
 
 268 PhotometricInterpretation and subsampling fields written to the file must
 
 269 describe what is actually in the file.
 
 271 A JPEG-compressed TIFF file will typically have PhotometricInterpretation =
 
 272 YCbCr and YCbCrSubSampling = [
2,
1] or [
2,
2], unless the source data was
 
 276 Basic representation of JPEG-compressed images
 
 277 ----------------------------------------------
 
 279 JPEG compression works in either strip-based or tile-based TIFF files.
 
 280 Rather than repeating "strip or tile" constantly, we will use the term
 
 281 "segment" to mean either a strip or a tile.
 
 283 When the Compression field has the value 
7, each image segment contains
 
 284 a complete JPEG datastream which is valid according to the ISO JPEG
 
 285 standard (ISO/IEC 
10918-
1).  Any sequential JPEG process can be used,
 
 286 including lossless JPEG, but progressive and hierarchical processes are not
 
 287 supported.  Since JPEG is useful only for continuous-tone images, the
 
 288 PhotometricInterpretation of the image shall not be 
3 (palette color) nor
 
 289 4 (transparency mask).  The bit depth of the data is also restricted as
 
 292 Each image segment in a JPEG-compressed TIFF file shall contain a valid
 
 293 JPEG datastream according to the ISO JPEG standard's rules for
 
 294 interchange-format or abbreviated-image-format data.  The datastream shall
 
 295 contain a single JPEG frame storing that segment of the image.  The
 
 296 required JPEG markers within a segment are:
 
 297         SOI     (must appear at very beginning of segment)
 
 299         SOS     (one for each scan, if there is more than one scan)
 
 300         EOI     (must appear at very end of segment)
 
 301 The actual compressed data follows SOS; it may contain RSTn markers if DRI
 
 304 Additional JPEG "tables and miscellaneous" markers may appear between SOI
 
 305 and SOFn, between SOFn and SOS, and before each subsequent SOS if there is
 
 306 more than one scan.  These markers include:
 
 309         DAC     (not to appear unless arithmetic coding is used)
 
 311         APPn    (shall be ignored by TIFF readers)
 
 312         COM     (shall be ignored by TIFF readers)
 
 313 DNL markers shall not be used in TIFF files.  Readers should abort if any
 
 314 other marker type is found, especially the JPEG reserved markers;
 
 315 occurrence of such a marker is likely to indicate a JPEG extension.
 
 317 The tables/miscellaneous markers may appear in any order.  Readers are
 
 318 cautioned that although the SOFn marker refers to DQT tables, JPEG does not
 
 319 require those tables to precede the SOFn, only the SOS.  Missing-table
 
 320 checks should be made when SOS is reached.
 
 322 If no JPEGTables field is used, then each image segment shall be a complete
 
 323 JPEG interchange datastream.  Each segment must define all the tables it
 
 324 references.  To allow readers to decode segments in any order, no segment
 
 325 may rely on tables being carried over from a previous segment.
 
 327 When a JPEGTables field is used, image segments may omit tables that have
 
 328 been specified in the JPEGTables field.  Further details appear below.
 
 330 The SOFn marker shall be of type SOF0 for strict baseline JPEG data, of
 
 331 type SOF1 for non-baseline lossy JPEG data, or of type SOF3 for lossless
 
 332 JPEG data.  (SOF9 or SOF11 would be used for arithmetic coding.)  All
 
 333 segments of a JPEG-compressed TIFF image shall use the same JPEG
 
 334 compression process, in particular the same SOFn type.
 
 336 The data precision field of the SOFn marker shall agree with the TIFF
 
 337 BitsPerSample field.  (Note that when PlanarConfiguration=
1, this implies
 
 338 that all components must have the same BitsPerSample value; when
 
 339 PlanarConfiguration=
2, different components could have different bit
 
 340 depths.)  For SOF0 only precision 
8 is permitted; for SOF1, precision 
8 or
 
 341 12 is permitted; for SOF3, precisions 
2 to 
16 are permitted.
 
 343 The image dimensions given in the SOFn marker shall agree with the logical
 
 344 dimensions of that particular strip or tile.  For strip images, the SOFn
 
 345 image width shall equal ImageWidth and the height shall equal RowsPerStrip,
 
 346 except in the last strip; its SOFn height shall equal the number of rows
 
 347 remaining in the ImageLength.  (In other words, no padding data is counted
 
 348 in the SOFn dimensions.)  For tile images, each SOFn shall have width
 
 349 TileWidth and height TileHeight; adding and removing any padding needed in
 
 350 the edge tiles is the concern of some higher level of the TIFF software.
 
 351 (The dimensional rules are slightly different when PlanarConfiguration=
2,
 
 354 The ISO JPEG standard only permits images up to 
65535 pixels in width or
 
 355 height, due to 
2-byte fields in the SOFn markers.  In TIFF, this limits
 
 356 the size of an individual JPEG-compressed strip or tile, but the total
 
 357 image size can be greater.
 
 359 The number of components in the JPEG datastream shall equal SamplesPerPixel
 
 360 for PlanarConfiguration=
1, and shall be 
1 for PlanarConfiguration=
2.  The
 
 361 components shall be stored in the same order as they are described at the
 
 362 TIFF field level.  (This applies both to their order in the SOFn marker,
 
 363 and to the order in which they are scanned if multiple JPEG scans are
 
 364 used.)  The component ID bytes are arbitrary so long as each component
 
 365 within an image segment is given a distinct ID.  To avoid any possible
 
 366 confusion, we require that all segments of a TIFF image use the same ID
 
 367 code for a given component.
 
 369 In PlanarConfiguration 
1, the sampling factors given in SOFn markers shall
 
 370 agree with the sampling factors defined by the related TIFF fields (or with
 
 371 the default values that are specified in the absence of those fields).
 
 373 When DCT-based JPEG is used in a strip TIFF file, RowsPerStrip is required
 
 374 to be a multiple of 
8 times the largest vertical sampling factor, i.e., a
 
 375 multiple of the height of an interleaved MCU.  (For simplicity of
 
 376 specification, we require this even if the data is not actually
 
 377 interleaved.)  For example, if YCbCrSubSampling = [
2,
2] then RowsPerStrip
 
 378 must be a multiple of 
16.  An exception to this rule is made for
 
 379 single-strip images (RowsPerStrip 
>= ImageLength): the exact value of
 
 380 RowsPerStrip is unimportant in that case.  This rule ensures that no data
 
 381 padding is needed at the bottom of a strip, except perhaps the last strip.
 
 382 Any padding required at the right edge of the image, or at the bottom of
 
 383 the last strip, is expected to occur internally to the JPEG codec.
 
 385 When DCT-based JPEG is used in a tiled TIFF file, TileLength is required
 
 386 to be a multiple of 
8 times the largest vertical sampling factor, i.e.,
 
 387 a multiple of the height of an interleaved MCU; and TileWidth is required
 
 388 to be a multiple of 
8 times the largest horizontal sampling factor, i.e.,
 
 389 a multiple of the width of an interleaved MCU.  (For simplicity of
 
 390 specification, we require this even if the data is not actually
 
 391 interleaved.)  All edge padding required will therefore occur in the course
 
 392 of normal TIFF tile padding; it is not special to JPEG.
 
 394 Lossless JPEG does not impose these constraints on strip and tile sizes,
 
 395 since it is not DCT-based.
 
 397 Note that within JPEG datastreams, multibyte values appear in the MSB-first
 
 398 order specified by the JPEG standard, regardless of the byte ordering of
 
 399 the surrounding TIFF file.
 
 405 The only auxiliary TIFF field added for Compression=
7 is the optional
 
 406 JPEGTables field.  The purpose of JPEGTables is to predefine JPEG
 
 407 quantization and/or Huffman tables for subsequent use by JPEG image
 
 408 segments.  When this is done, these rather bulky tables need not be
 
 409 duplicated in each segment, thus saving space and processing time.
 
 410 JPEGTables may be used even in a single-segment file, although there is no
 
 411 space savings in that case.
 
 416         N = number of bytes in tables datastream, typically a few hundred
 
 417 JPEGTables provides default JPEG quantization and/or Huffman tables which
 
 418 are used whenever a segment datastream does not contain its own tables, as
 
 421 Notice that the JPEGTables field is required to have type code UNDEFINED,
 
 422 not type code BYTE.  This is to cue readers that expanding individual bytes
 
 423 to short or long integers is not appropriate.  A TIFF reader will generally
 
 424 need to store the field value as an uninterpreted byte sequence until it is
 
 425 fed to the JPEG decoder.
 
 427 Multibyte quantities within the tables follow the ISO JPEG convention of
 
 428 MSB-first storage, regardless of the byte ordering of the surrounding TIFF
 
 431 When the JPEGTables field is present, it shall contain a valid JPEG
 
 432 "abbreviated table specification" datastream.  This datastream shall begin
 
 433 with SOI and end with EOI.  It may contain zero or more JPEG "tables and
 
 434 miscellaneous" markers, namely:
 
 437         DAC     (not to appear unless arithmetic coding is used)
 
 439         APPn    (shall be ignored by TIFF readers)
 
 440         COM     (shall be ignored by TIFF readers)
 
 441 Since JPEG defines the SOI marker to reset the DAC and DRI state, these two
 
 442 markers' values cannot be carried over into any image datastream, and thus
 
 443 they are effectively no-ops in the JPEGTables field.  To avoid confusion,
 
 444 it is recommended that writers not place DAC or DRI markers in JPEGTables.
 
 445 However readers must properly skip over them if they appear.
 
 447 When JPEGTables is present, readers shall load the table specifications
 
 448 contained in JPEGTables before processing image segment datastreams.
 
 449 Image segments may simply refer to these preloaded tables without defining
 
 450 them.  An image segment can still define and use its own tables, subject to
 
 451 the restrictions below.
 
 453 An image segment may not redefine any table defined in JPEGTables.  (This
 
 454 restriction is imposed to allow readers to process image segments in random
 
 455 order without having to reload JPEGTables between segments.)  Therefore, use
 
 456 of JPEGTables divides the available table slots into two groups: "global"
 
 457 slots are defined in JPEGTables and may be used but not redefined by
 
 458 segments; "local" slots are available for local definition and use in each
 
 459 segment.  To permit random access, a segment may not reference any local
 
 460 tables that it does not itself define.
 
 463 Special considerations for PlanarConfiguration 
2 
 464 ------------------------------------------------
 
 466 In PlanarConfiguration 
2, each image segment contains data for only one
 
 467 color component.  To avoid confusing the JPEG codec, we wish the segments
 
 468 to look like valid single-channel (i.e., grayscale) JPEG datastreams.  This
 
 469 means that different rules must be used for the SOFn parameters.
 
 471 In PlanarConfiguration 
2, the dimensions given in the SOFn of a subsampled
 
 472 component shall be scaled down by the sampling factors compared to the SOFn
 
 473 dimensions that would be used in PlanarConfiguration 
1.  This is necessary
 
 474 to match the actual number of samples stored in that segment, so that the
 
 475 JPEG codec doesn't complain about too much or too little data.  In strip
 
 476 TIFF files the computed dimensions may need to be rounded up to the next
 
 477 integer; in tiled files, the restrictions on tile size make this case
 
 480 Furthermore, all SOFn sampling factors shall be given as 
1.  (This is
 
 481 merely to avoid confusion, since the sampling factors in a single-channel
 
 482 JPEG datastream have no real effect.)
 
 484 Any downsampling will need to happen externally to the JPEG codec, since
 
 485 JPEG sampling factors are defined with reference to the full-precision
 
 486 component.  In PlanarConfiguration 
2, the JPEG codec will be working on
 
 487 only one component at a time and thus will have no reference component to
 
 491 Minimum requirements for TIFF/JPEG
 
 492 ----------------------------------
 
 494 ISO JPEG is a large and complex standard; most implementations support only
 
 495 a subset of it.  Here we define a "core" subset of TIFF/JPEG which readers
 
 496 must support to claim TIFF/JPEG compatibility.  For maximum
 
 497 cross-application compatibility, we recommend that writers confine
 
 498 themselves to this subset unless there is very good reason to do otherwise.
 
 500 Use the ISO baseline JPEG process: 
8-bit data precision, Huffman coding,
 
 501 with no more than 
2 DC and 
2 AC Huffman tables.  Note that this implies
 
 502 BitsPerSample = 
8 for each component.  We recommend deviating from baseline
 
 503 JPEG only if 
12-bit data precision or lossless coding is required.
 
 505 Use no subsampling (all JPEG sampling factors = 
1) for color spaces other
 
 506 than YCbCr.  (This is, in fact, required with the TIFF 
6.0 field
 
 507 definitions, but may not be so in future revisions.)  For YCbCr, use one of
 
 508 the following choices:
 
 509         YCbCrSubSampling field          JPEG sampling factors
 
 512         2,
2  (default value)            
2h2v, 
1h1v, 
1h1v
 
 513 We recommend that RGB source data be converted to YCbCr for best compression
 
 514 results.  Other source data colorspaces should probably be left alone.
 
 515 Minimal readers need not support JPEG images with colorspaces other than
 
 516 YCbCr and grayscale (PhotometricInterpretation = 
6 or 
1).
 
 518 A minimal reader also need not support JPEG YCbCr images with nondefault
 
 519 values of YCbCrCoefficients or YCbCrPositioning, nor with values of
 
 520 ReferenceBlackWhite other than [
0,
255,
128,
255,
128,
255].  (These values
 
 521 correspond to the RGB<=
>YCbCr conversion specified by JFIF, which is widely
 
 522 implemented in JPEG codecs.)
 
 524 Writers are reminded that a ReferenceBlackWhite field *must* be included
 
 525 when PhotometricInterpretation is YCbCr, because the default
 
 526 ReferenceBlackWhite values are inappropriate for YCbCr.
 
 528 If any subsampling is used, PlanarConfiguration=
1 is preferred to avoid the
 
 529 possibly-confusing requirements of PlanarConfiguration=
2.  In any case,
 
 530 readers are not required to support PlanarConfiguration=
2.
 
 532 If possible, use a single interleaved scan in each image segment.  This is
 
 533 not legal JPEG if there are more than 
4 SamplesPerPixel or if the sampling
 
 534 factors are such that more than 
10 blocks would be needed per MCU; in that
 
 535 case, use a separate scan for each component.  (The recommended color
 
 536 spaces and sampling factors will not run into that restriction, so a
 
 537 minimal reader need not support more than one scan per segment.)
 
 539 To claim TIFF/JPEG compatibility, readers shall support multiple-strip TIFF
 
 540 files and the optional JPEGTables field; it is not acceptable to read only
 
 541 single-datastream files.  Support for tiled TIFF files is strongly
 
 542 recommended but not required.
 
 545 Other recommendations for implementors
 
 546 --------------------------------------
 
 548 The TIFF tag Compression=
7 guarantees only that the compressed data is
 
 549 represented as ISO JPEG datastreams.  Since JPEG is a large and evolving
 
 550 standard, readers should apply careful error checking to the JPEG markers
 
 551 to ensure that the compression process is within their capabilities.  In
 
 552 particular, to avoid being confused by future extensions to the JPEG
 
 553 standard, it is important to abort if unknown marker codes are seen.
 
 555 The point of requiring that all image segments use the same JPEG process is
 
 556 to ensure that a reader need check only one segment to determine whether it
 
 557 can handle the image.  For example, consider a TIFF reader that has access
 
 558 to fast but restricted JPEG hardware, as well as a slower, more general
 
 559 software implementation.  It is desirable to check only one image segment
 
 560 to find out whether the fast hardware can be used.  Thus, writers should
 
 561 try to ensure that all segments of an image look as much "alike" as
 
 562 possible: there should be no variation in scan layout, use of options such
 
 563 as DRI, etc.  Ideally, segments will be processed identically except
 
 564 perhaps for using different local quantization or entropy-coding tables.
 
 566 Writers should avoid including "noise" JPEG markers (COM and APPn markers).
 
 567 Standard TIFF fields provide a better way to transport any non-image data.
 
 568 Some JPEG codecs may change behavior if they see an APPn marker they
 
 569 think they understand; since the TIFF spec requires these markers to be
 
 570 ignored, this behavior is undesirable.
 
 572 It is possible to convert an interchange-JPEG file (e.g., a JFIF file) to
 
 573 TIFF simply by dropping the interchange datastream into a single strip.
 
 574 (However, designers are reminded that the TIFF spec discourages huge
 
 575 strips; splitting the image is somewhat more work but may give better
 
 576 results.)  Conversion from TIFF to interchange JPEG is more complex.  A
 
 577 strip-based TIFF/JPEG file can be converted fairly easily if all strips use
 
 578 identical JPEG tables and no RSTn markers: just delete the overhead markers
 
 579 and insert RSTn markers between strips.  Converting tiled images is harder,
 
 580 since the data will usually not be in the right order (unless the tiles are
 
 581 only one MCU high).  This can still be done losslessly, but it will require
 
 582 undoing and redoing the entropy coding so that the DC coefficient
 
 583 differences can be updated.
 
 585 There is no default value for JPEGTables: standard TIFF files must define all
 
 586 tables that they reference.  For some closed systems in which many files will
 
 587 have identical tables, it might make sense to define a default JPEGTables
 
 588 value to avoid actually storing the tables.  Or even better, invent a
 
 589 private field selecting one of N default JPEGTables settings, so as to allow
 
 590 for future expansion.  Either of these must be regarded as a private
 
 591 extension that will render the files unreadable by other applications.
 
 597 [
1] Wallace, Gregory K.  "The JPEG Still Picture Compression Standard",
 
 598 Communications of the ACM, April 
1991 (vol. 
34 no. 
4), pp. 
30-
44.
 
 600 This is the best short technical introduction to the JPEG algorithms.
 
 601 It is a good overview but does not provide sufficiently detailed
 
 602 information to write an implementation.
 
 604 [
2] Pennebaker, William B. and Mitchell, Joan L.  "JPEG Still Image Data
 
 605 Compression Standard", Van Nostrand Reinhold, 
1993, ISBN 
0-
442-
01272-
1.
 
 608 This textbook is by far the most complete exposition of JPEG in existence.
 
 609 It includes the full text of the ISO JPEG standards (DIS 
10918-
1 and draft
 
 610 DIS 
10918-
2).  No would-be JPEG implementor should be without it.
 
 612 [
3] ISO/IEC IS 
10918-
1, "Digital Compression and Coding of Continuous-tone
 
 613 Still Images, Part 
1: Requirements and guidelines", February 
1994.
 
 614 ISO/IEC DIS 
10918-
2, "Digital Compression and Coding of Continuous-tone
 
 615 Still Images, Part 
2: Compliance testing", final approval expected 
1994.
 
 617 These are the official standards documents.  Note that the Pennebaker and
 
 618 Mitchell textbook is likely to be cheaper and more useful than the official
 
 622 Changes to Section 
21: YCbCr Images
 
 623 ===================================
 
 625 [This section of the Tech Note clarifies section 
21 to make clear the
 
 626 interpretation of image dimensions in a subsampled image.  Furthermore,
 
 627 the section is changed to allow the original image dimensions not to be
 
 628 multiples of the sampling factors.  This change is necessary to support use
 
 629 of JPEG compression on odd-size images.]
 
 631 Add the following paragraphs to the Section 
21 introduction (p. 
89),
 
 632 just after the paragraph beginning "When a Class Y image is subsampled":
 
 634         In a subsampled image, it is understood that all TIFF image
 
 635         dimensions are measured in terms of the highest-resolution
 
 636         (luminance) component.  In particular, ImageWidth, ImageLength,
 
 637         RowsPerStrip, TileWidth, TileLength, XResolution, and YResolution
 
 638         are measured in luminance samples.
 
 640         RowsPerStrip, TileWidth, and TileLength are constrained so that
 
 641         there are an integral number of samples of each component in a
 
 642         complete strip or tile.  However, ImageWidth/ImageLength are not
 
 643         constrained.  If an odd-size image is to be converted to subsampled
 
 644         format, the writer should pad the source data to a multiple of the
 
 645         sampling factors by replication of the last column and/or row, then
 
 646         downsample.  The number of luminance samples actually stored in the
 
 647         file will be a multiple of the sampling factors.  Conversely,
 
 648         readers must ignore any extra data (outside the specified image
 
 649         dimensions) after upsampling.
 
 651         When PlanarConfiguration=
2, each strip or tile covers the same
 
 652         image area despite subsampling; that is, the total number of strips
 
 653         or tiles in the image is the same for each component.  Therefore
 
 654         strips or tiles of the subsampled components contain fewer samples
 
 655         than strips or tiles of the luminance component.
 
 657         If there are extra samples per pixel (see field ExtraSamples),
 
 658         these data channels have the same number of samples as the
 
 661 Rewrite the YCbCrSubSampling field description (pp 
91-
92) as follows
 
 662 (largely to eliminate possibly-misleading references to
 
 663 ImageWidth/ImageLength of the subsampled components):
 
 665         (first paragraph unchanged)
 
 667         The two elements of this field are defined as follows:
 
 669         Short 
0: ChromaSubsampleHoriz:
 
 671         1 = there are equal numbers of luma and chroma samples horizontally.
 
 673         2 = there are twice as many luma samples as chroma samples
 
 676         4 = there are four times as many luma samples as chroma samples
 
 679         Short 
1: ChromaSubsampleVert:
 
 681         1 = there are equal numbers of luma and chroma samples vertically.
 
 683         2 = there are twice as many luma samples as chroma samples
 
 686         4 = there are four times as many luma samples as chroma samples
 
 689         ChromaSubsampleVert shall always be less than or equal to
 
 690         ChromaSubsampleHoriz.  Note that Cb and Cr have the same sampling
 
 693         In a strip TIFF file, RowsPerStrip is required to be an integer
 
 694         multiple of ChromaSubSampleVert (unless RowsPerStrip 
>=
 
 695         ImageLength, in which case its exact value is unimportant).
 
 696         If ImageWidth and ImageLength are not multiples of
 
 697         ChromaSubsampleHoriz and ChromaSubsampleVert respectively, then the
 
 698         source data shall be padded to the next integer multiple of these
 
 699         values before downsampling.
 
 701         In a tiled TIFF file, TileWidth must be an integer multiple of
 
 702         ChromaSubsampleHoriz and TileLength must be an integer multiple of
 
 703         ChromaSubsampleVert.  Padding will occur to tile boundaries.
 
 705         The default values of this field are [ 
2,
2 ].  Thus, YCbCr data is
 
 706         downsampled by default!