]> git.saurik.com Git - wxWidgets.git/blob - src/tiff/html/TIFFTechNote2.html
revert nested event loop support for wxGTK1 because it causes applications hangs
[wxWidgets.git] / src / tiff / html / TIFFTechNote2.html
1 <pre>
2 DRAFT TIFF Technical Note #2 17-Mar-95
3 ============================
4
5 This Technical Note describes serious problems that have been found in
6 TIFF 6.0's design for embedding JPEG-compressed data in TIFF (Section 22
7 of the TIFF 6.0 spec of 3 June 1992). A replacement TIFF/JPEG
8 specification is given. Some corrections to Section 21 are also given.
9
10 To permit TIFF implementations to continue to read existing files, the 6.0
11 JPEG fields and tag values will remain reserved indefinitely. However,
12 TIFF writers are strongly discouraged from using the 6.0 JPEG design. It
13 is expected that the next full release of the TIFF specification will not
14 describe the old design at all, except to note that certain tag numbers
15 are reserved. The existing Section 22 will be replaced by the
16 specification text given in the second part of this Tech Note.
17
18
19 Problems in TIFF 6.0 JPEG
20 =========================
21
22 Abandoning a published spec is not a step to be taken lightly. This
23 section summarizes the reasons that have forced this decision.
24 TIFF 6.0's JPEG design suffers from design errors and limitations,
25 ambiguities, and unnecessary complexity.
26
27
28 Design errors and limitations
29 -----------------------------
30
31 The fundamental design error in the existing Section 22 is that JPEG's
32 various tables and parameters are broken out as separate fields which the
33 TIFF control logic must manage. This is bad software engineering: that
34 information should be treated as private to the JPEG codec
35 (compressor/decompressor). Worse, the fields themselves are specified
36 without sufficient thought for future extension and without regard to
37 well-established TIFF conventions. Here are some of the significant
38 problems:
39
40 * The JPEGxxTable fields do not store the table data directly in the
41 IFD/field structure; rather, the fields hold pointers to information
42 elsewhere in the file. This requires special-purpose code to be added to
43 *every* TIFF-manipulating application, whether it needs to decode JPEG
44 image data or not. Even a trivial TIFF editor, for example a program to
45 add an ImageDescription field to a TIFF file, must be explicitly aware of
46 the internal structure of the JPEG-related tables, or else it will probably
47 break the file. Every other auxiliary field in the TIFF spec contains
48 data, not pointers, and can be copied or relocated by standard code that
49 doesn't know anything about the particular field. This is a crucial
50 property of the TIFF format that must not be given up.
51
52 * To manipulate these fields, the TIFF control logic is required to know a
53 great deal about JPEG details, for example such arcana as how to compute
54 the length of a Huffman code table --- the length is not supplied in the
55 field structure and can only be found by inspecting the table contents.
56 This is again a violation of good software practice. Moreover, it will
57 prevent easy adoption of future JPEG extensions that might change these
58 low-level details.
59
60 * The design neglects the fact that baseline JPEG codecs support only two
61 sets of Huffman tables: it specifies a separate table for each color
62 component. This implies that encoders must waste space (by storing
63 duplicate Huffman tables) or else violate the well-founded TIFF convention
64 that prohibits duplicate pointers. Furthermore, baseline decoders must
65 test to find out which tables are identical, a waste of time and code
66 space.
67
68 * The JPEGInterchangeFormat field also violates TIFF's proscription against
69 duplicate pointers: the normal strip/tile pointers are expected to point
70 into the larger data area pointed to by JPEGInterchangeFormat. All TIFF
71 editing applications must be specifically aware of this relationship, since
72 they must maintain it or else delete the JPEGInterchangeFormat field. The
73 JPEGxxTables fields are also likely to point into the JPEGInterchangeFormat
74 area, creating additional pointer relationships that must be maintained.
75
76 * The JPEGQTables field is fixed at a byte per table entry; there is no
77 way to support 16-bit quantization values. This is a serious impediment
78 to extending TIFF to use 12-bit JPEG.
79
80 * The 6.0 design cannot support using different quantization tables in
81 different strips/tiles of an image (so as to encode some areas at higher
82 quality than others). Furthermore, since quantization tables are tied
83 one-for-one to color components, the design cannot support table switching
84 options that are likely to be added in future JPEG revisions.
85
86
87 Ambiguities
88 -----------
89
90 Several incompatible interpretations are possible for 6.0's treatment of
91 JPEG restart markers:
92
93 * It is unclear whether restart markers must be omitted at TIFF segment
94 (strip/tile) boundaries, or whether they are optional.
95
96 * It is unclear whether the segment size is required to be chosen as
97 a multiple of the specified restart interval (if any); perhaps the
98 JPEG codec is supposed to be reset at each segment boundary as if
99 there were a restart marker there, even if the boundary does not fall
100 at a multiple of the nominal restart interval.
101
102 * The spec fails to address the question of restart marker numbering:
103 do the numbers begin again within each segment, or not?
104
105 That last point is particularly nasty. If we make numbering begin again
106 within each segment, we give up the ability to impose a TIFF strip/tile
107 structure on an existing JPEG datastream with restarts (which was clearly a
108 goal of Section 22's authors). But the other choice interferes with random
109 access to the image segments: a reader must compute the first restart
110 number to be expected within a segment, and must have a way to reset its
111 JPEG decoder to expect a nonzero restart number first. This may not even
112 be possible with some JPEG chips.
113
114 The tile height restriction found on page 104 contradicts Section 15's
115 general description of tiles. For an image that is not vertically
116 downsampled, page 104 specifies a tile height of one MCU or 8 pixels; but
117 Section 15 requires tiles to be a multiple of 16 pixels high.
118
119 This Tech Note does not attempt to resolve these ambiguities, so
120 implementations that follow the 6.0 design should be aware that
121 inter-application compatibility problems are likely to arise.
122
123
124 Unnecessary complexity
125 ----------------------
126
127 The 6.0 design creates problems for implementations that need to keep the
128 JPEG codec separate from the TIFF control logic --- for example, consider
129 using a JPEG chip that was not designed specifically for TIFF. JPEG codecs
130 generally want to produce or consume a standard ISO JPEG datastream, not
131 just raw compressed data. (If they were to handle raw data, a separate
132 out-of-band mechanism would be needed to load tables into the codec.)
133 With such a codec, the TIFF control logic must parse JPEG markers emitted
134 by the codec to create the TIFF table fields (when writing) or synthesize
135 JPEG markers from the TIFF fields to feed the codec (when reading). This
136 means that the control logic must know a great deal more about JPEG details
137 than we would like. The parsing and reconstruction of the markers also
138 represents a fair amount of unnecessary work.
139
140 Quite a few implementors have proposed writing "TIFF/JPEG" files in which
141 a standard JPEG datastream is simply dumped into the file and pointed to
142 by JPEGInterchangeFormat. To avoid parsing the JPEG datastream, they
143 suggest not writing the JPEG auxiliary fields (JPEGxxTables etc) nor even
144 the basic TIFF strip/tile data pointers. This approach is incompatible
145 with implementations that handle the full TIFF 6.0 JPEG design, since they
146 will expect to find strip/tile pointers and auxiliary fields. Indeed this
147 is arguably not TIFF at all, since *all* TIFF-reading applications expect
148 to find strip or tile pointers. A subset implementation that is not
149 upward-compatible with the full spec is clearly unacceptable. However,
150 the frequency with which this idea has come up makes it clear that
151 implementors find the existing Section 22 too complex.
152
153
154 Overview of the solution
155 ========================
156
157 To solve these problems, we adopt a new design for embedding
158 JPEG-compressed data in TIFF files. The new design uses only complete,
159 uninterpreted ISO JPEG datastreams, so it should be much more forgiving of
160 extensions to the ISO standard. It should also be far easier to implement
161 using unmodified JPEG codecs.
162
163 To reduce overhead in multi-segment TIFF files, we allow JPEG overhead
164 tables to be stored just once in a JPEGTables auxiliary field. This
165 feature does not violate the integrity of the JPEG datastreams, because it
166 uses the notions of "tables-only datastreams" and "abbreviated image
167 datastreams" as defined by the ISO standard.
168
169 To prevent confusion with the old design, the new design is given a new
170 Compression tag value, Compression=7. Readers that need to handle
171 existing 6.0 JPEG files may read both old and new files, using whatever
172 interpretation of the 6.0 spec they did before. Compression tag value 6
173 and the field tag numbers defined by 6.0 section 22 will remain reserved
174 indefinitely, even though detailed descriptions of them will be dropped
175 from future editions of the TIFF specification.
176
177
178 Replacement TIFF/JPEG specification
179 ===================================
180
181 [This section of the Tech Note is expected to replace Section 22 in the
182 next release of the TIFF specification.]
183
184 This section describes TIFF compression scheme 7, a high-performance
185 compression method for continuous-tone images.
186
187 Introduction
188 ------------
189
190 This TIFF compression method uses the international standard for image
191 compression ISO/IEC 10918-1, usually known as "JPEG" (after the original
192 name of the standards committee, Joint Photographic Experts Group). JPEG
193 is a joint ISO/CCITT standard for compression of continuous-tone images.
194
195 The JPEG committee decided that because of the broad scope of the standard,
196 no one algorithmic procedure was able to satisfy the requirements of all
197 applications. Instead, the JPEG standard became a "toolkit" of multiple
198 algorithms and optional capabilities. Individual applications may select
199 a subset of the JPEG standard that meets their requirements.
200
201 The most important distinction among the JPEG processes is between lossy
202 and lossless compression. Lossy compression methods provide high
203 compression but allow only approximate reconstruction of the original
204 image. JPEG's lossy processes allow the encoder to trade off compressed
205 file size against reconstruction fidelity over a wide range. Typically,
206 10:1 or more compression of full-color data can be obtained while keeping
207 the reconstructed image visually indistinguishable from the original. Much
208 higher compression ratios are possible if a low-quality reconstructed image
209 is acceptable. Lossless compression provides exact reconstruction of the
210 source data, but the achievable compression ratio is much lower than for
211 the lossy processes; JPEG's rather simple lossless process typically
212 achieves around 2:1 compression of full-color data.
213
214 The most widely implemented JPEG subset is the "baseline" JPEG process.
215 This provides lossy compression of 8-bit-per-channel data. Optional
216 extensions include 12-bit-per-channel data, arithmetic entropy coding for
217 better compression, and progressive/hierarchical representations. The
218 lossless process is an independent algorithm that has little in
219 common with the lossy processes.
220
221 It should be noted that the optional arithmetic-coding extension is subject
222 to several US and Japanese patents. To avoid patent problems, use of
223 arithmetic coding processes in TIFF files intended for inter-application
224 interchange is discouraged.
225
226 All of the JPEG processes are useful only for "continuous tone" data,
227 in which the difference between adjacent pixel values is usually small.
228 Low-bit-depth source data is not appropriate for JPEG compression, nor
229 are palette-color images good candidates. The JPEG processes work well
230 on grayscale and full-color data.
231
232 Describing the JPEG compression algorithms in sufficient detail to permit
233 implementation would require more space than we have here. Instead, we
234 refer the reader to the References section.
235
236
237 What data is being compressed?
238 ------------------------------
239
240 In lossy JPEG compression, it is customary to convert color source data
241 to YCbCr and then downsample it before JPEG compression. This gives
242 2:1 data compression with hardly any visible image degradation, and it
243 permits additional space savings within the JPEG compression step proper.
244 However, these steps are not considered part of the ISO JPEG standard.
245 The ISO standard is "color blind": it accepts data in any color space.
246
247 For TIFF purposes, the JPEG compression tag is considered to represent the
248 ISO JPEG compression standard only. The ISO standard is applied to the
249 same data that would be stored in the TIFF file if no compression were
250 used. Therefore, if color conversion or downsampling are used, they must
251 be reflected in the regular TIFF fields; these steps are not considered to
252 be implicit in the JPEG compression tag value. PhotometricInterpretation
253 and related fields shall describe the color space actually stored in the
254 file. With the TIFF 6.0 field definitions, downsampling is permissible
255 only for YCbCr data, and it must correspond to the YCbCrSubSampling field.
256 (Note that the default value for this field is not 1,1; so the default for
257 YCbCr is to apply downsampling!) It is likely that future versions of TIFF
258 will provide additional PhotometricInterpretation values and a more general
259 way of defining subsampling, so as to allow more flexibility in
260 JPEG-compressed files. But that issue is not addressed in this Tech Note.
261
262 Implementors should note that many popular JPEG codecs
263 (compressor/decompressors) provide automatic color conversion and
264 downsampling, so that the application may supply full-size RGB data which
265 is nonetheless converted to downsampled YCbCr. This is an implementation
266 convenience which does not excuse the TIFF control layer from its
267 responsibility to know what is really going on. The
268 PhotometricInterpretation and subsampling fields written to the file must
269 describe what is actually in the file.
270
271 A JPEG-compressed TIFF file will typically have PhotometricInterpretation =
272 YCbCr and YCbCrSubSampling = [2,1] or [2,2], unless the source data was
273 grayscale or CMYK.
274
275
276 Basic representation of JPEG-compressed images
277 ----------------------------------------------
278
279 JPEG compression works in either strip-based or tile-based TIFF files.
280 Rather than repeating "strip or tile" constantly, we will use the term
281 "segment" to mean either a strip or a tile.
282
283 When the Compression field has the value 7, each image segment contains
284 a complete JPEG datastream which is valid according to the ISO JPEG
285 standard (ISO/IEC 10918-1). Any sequential JPEG process can be used,
286 including lossless JPEG, but progressive and hierarchical processes are not
287 supported. Since JPEG is useful only for continuous-tone images, the
288 PhotometricInterpretation of the image shall not be 3 (palette color) nor
289 4 (transparency mask). The bit depth of the data is also restricted as
290 specified below.
291
292 Each image segment in a JPEG-compressed TIFF file shall contain a valid
293 JPEG datastream according to the ISO JPEG standard's rules for
294 interchange-format or abbreviated-image-format data. The datastream shall
295 contain a single JPEG frame storing that segment of the image. The
296 required JPEG markers within a segment are:
297 SOI (must appear at very beginning of segment)
298 SOFn
299 SOS (one for each scan, if there is more than one scan)
300 EOI (must appear at very end of segment)
301 The actual compressed data follows SOS; it may contain RSTn markers if DRI
302 is used.
303
304 Additional JPEG "tables and miscellaneous" markers may appear between SOI
305 and SOFn, between SOFn and SOS, and before each subsequent SOS if there is
306 more than one scan. These markers include:
307 DQT
308 DHT
309 DAC (not to appear unless arithmetic coding is used)
310 DRI
311 APPn (shall be ignored by TIFF readers)
312 COM (shall be ignored by TIFF readers)
313 DNL markers shall not be used in TIFF files. Readers should abort if any
314 other marker type is found, especially the JPEG reserved markers;
315 occurrence of such a marker is likely to indicate a JPEG extension.
316
317 The tables/miscellaneous markers may appear in any order. Readers are
318 cautioned that although the SOFn marker refers to DQT tables, JPEG does not
319 require those tables to precede the SOFn, only the SOS. Missing-table
320 checks should be made when SOS is reached.
321
322 If no JPEGTables field is used, then each image segment shall be a complete
323 JPEG interchange datastream. Each segment must define all the tables it
324 references. To allow readers to decode segments in any order, no segment
325 may rely on tables being carried over from a previous segment.
326
327 When a JPEGTables field is used, image segments may omit tables that have
328 been specified in the JPEGTables field. Further details appear below.
329
330 The SOFn marker shall be of type SOF0 for strict baseline JPEG data, of
331 type SOF1 for non-baseline lossy JPEG data, or of type SOF3 for lossless
332 JPEG data. (SOF9 or SOF11 would be used for arithmetic coding.) All
333 segments of a JPEG-compressed TIFF image shall use the same JPEG
334 compression process, in particular the same SOFn type.
335
336 The data precision field of the SOFn marker shall agree with the TIFF
337 BitsPerSample field. (Note that when PlanarConfiguration=1, this implies
338 that all components must have the same BitsPerSample value; when
339 PlanarConfiguration=2, different components could have different bit
340 depths.) For SOF0 only precision 8 is permitted; for SOF1, precision 8 or
341 12 is permitted; for SOF3, precisions 2 to 16 are permitted.
342
343 The image dimensions given in the SOFn marker shall agree with the logical
344 dimensions of that particular strip or tile. For strip images, the SOFn
345 image width shall equal ImageWidth and the height shall equal RowsPerStrip,
346 except in the last strip; its SOFn height shall equal the number of rows
347 remaining in the ImageLength. (In other words, no padding data is counted
348 in the SOFn dimensions.) For tile images, each SOFn shall have width
349 TileWidth and height TileHeight; adding and removing any padding needed in
350 the edge tiles is the concern of some higher level of the TIFF software.
351 (The dimensional rules are slightly different when PlanarConfiguration=2,
352 as described below.)
353
354 The ISO JPEG standard only permits images up to 65535 pixels in width or
355 height, due to 2-byte fields in the SOFn markers. In TIFF, this limits
356 the size of an individual JPEG-compressed strip or tile, but the total
357 image size can be greater.
358
359 The number of components in the JPEG datastream shall equal SamplesPerPixel
360 for PlanarConfiguration=1, and shall be 1 for PlanarConfiguration=2. The
361 components shall be stored in the same order as they are described at the
362 TIFF field level. (This applies both to their order in the SOFn marker,
363 and to the order in which they are scanned if multiple JPEG scans are
364 used.) The component ID bytes are arbitrary so long as each component
365 within an image segment is given a distinct ID. To avoid any possible
366 confusion, we require that all segments of a TIFF image use the same ID
367 code for a given component.
368
369 In PlanarConfiguration 1, the sampling factors given in SOFn markers shall
370 agree with the sampling factors defined by the related TIFF fields (or with
371 the default values that are specified in the absence of those fields).
372
373 When DCT-based JPEG is used in a strip TIFF file, RowsPerStrip is required
374 to be a multiple of 8 times the largest vertical sampling factor, i.e., a
375 multiple of the height of an interleaved MCU. (For simplicity of
376 specification, we require this even if the data is not actually
377 interleaved.) For example, if YCbCrSubSampling = [2,2] then RowsPerStrip
378 must be a multiple of 16. An exception to this rule is made for
379 single-strip images (RowsPerStrip >= ImageLength): the exact value of
380 RowsPerStrip is unimportant in that case. This rule ensures that no data
381 padding is needed at the bottom of a strip, except perhaps the last strip.
382 Any padding required at the right edge of the image, or at the bottom of
383 the last strip, is expected to occur internally to the JPEG codec.
384
385 When DCT-based JPEG is used in a tiled TIFF file, TileLength is required
386 to be a multiple of 8 times the largest vertical sampling factor, i.e.,
387 a multiple of the height of an interleaved MCU; and TileWidth is required
388 to be a multiple of 8 times the largest horizontal sampling factor, i.e.,
389 a multiple of the width of an interleaved MCU. (For simplicity of
390 specification, we require this even if the data is not actually
391 interleaved.) All edge padding required will therefore occur in the course
392 of normal TIFF tile padding; it is not special to JPEG.
393
394 Lossless JPEG does not impose these constraints on strip and tile sizes,
395 since it is not DCT-based.
396
397 Note that within JPEG datastreams, multibyte values appear in the MSB-first
398 order specified by the JPEG standard, regardless of the byte ordering of
399 the surrounding TIFF file.
400
401
402 JPEGTables field
403 ----------------
404
405 The only auxiliary TIFF field added for Compression=7 is the optional
406 JPEGTables field. The purpose of JPEGTables is to predefine JPEG
407 quantization and/or Huffman tables for subsequent use by JPEG image
408 segments. When this is done, these rather bulky tables need not be
409 duplicated in each segment, thus saving space and processing time.
410 JPEGTables may be used even in a single-segment file, although there is no
411 space savings in that case.
412
413 JPEGTables:
414 Tag = 347 (15B.H)
415 Type = UNDEFINED
416 N = number of bytes in tables datastream, typically a few hundred
417 JPEGTables provides default JPEG quantization and/or Huffman tables which
418 are used whenever a segment datastream does not contain its own tables, as
419 specified below.
420
421 Notice that the JPEGTables field is required to have type code UNDEFINED,
422 not type code BYTE. This is to cue readers that expanding individual bytes
423 to short or long integers is not appropriate. A TIFF reader will generally
424 need to store the field value as an uninterpreted byte sequence until it is
425 fed to the JPEG decoder.
426
427 Multibyte quantities within the tables follow the ISO JPEG convention of
428 MSB-first storage, regardless of the byte ordering of the surrounding TIFF
429 file.
430
431 When the JPEGTables field is present, it shall contain a valid JPEG
432 "abbreviated table specification" datastream. This datastream shall begin
433 with SOI and end with EOI. It may contain zero or more JPEG "tables and
434 miscellaneous" markers, namely:
435 DQT
436 DHT
437 DAC (not to appear unless arithmetic coding is used)
438 DRI
439 APPn (shall be ignored by TIFF readers)
440 COM (shall be ignored by TIFF readers)
441 Since JPEG defines the SOI marker to reset the DAC and DRI state, these two
442 markers' values cannot be carried over into any image datastream, and thus
443 they are effectively no-ops in the JPEGTables field. To avoid confusion,
444 it is recommended that writers not place DAC or DRI markers in JPEGTables.
445 However readers must properly skip over them if they appear.
446
447 When JPEGTables is present, readers shall load the table specifications
448 contained in JPEGTables before processing image segment datastreams.
449 Image segments may simply refer to these preloaded tables without defining
450 them. An image segment can still define and use its own tables, subject to
451 the restrictions below.
452
453 An image segment may not redefine any table defined in JPEGTables. (This
454 restriction is imposed to allow readers to process image segments in random
455 order without having to reload JPEGTables between segments.) Therefore, use
456 of JPEGTables divides the available table slots into two groups: "global"
457 slots are defined in JPEGTables and may be used but not redefined by
458 segments; "local" slots are available for local definition and use in each
459 segment. To permit random access, a segment may not reference any local
460 tables that it does not itself define.
461
462
463 Special considerations for PlanarConfiguration 2
464 ------------------------------------------------
465
466 In PlanarConfiguration 2, each image segment contains data for only one
467 color component. To avoid confusing the JPEG codec, we wish the segments
468 to look like valid single-channel (i.e., grayscale) JPEG datastreams. This
469 means that different rules must be used for the SOFn parameters.
470
471 In PlanarConfiguration 2, the dimensions given in the SOFn of a subsampled
472 component shall be scaled down by the sampling factors compared to the SOFn
473 dimensions that would be used in PlanarConfiguration 1. This is necessary
474 to match the actual number of samples stored in that segment, so that the
475 JPEG codec doesn't complain about too much or too little data. In strip
476 TIFF files the computed dimensions may need to be rounded up to the next
477 integer; in tiled files, the restrictions on tile size make this case
478 impossible.
479
480 Furthermore, all SOFn sampling factors shall be given as 1. (This is
481 merely to avoid confusion, since the sampling factors in a single-channel
482 JPEG datastream have no real effect.)
483
484 Any downsampling will need to happen externally to the JPEG codec, since
485 JPEG sampling factors are defined with reference to the full-precision
486 component. In PlanarConfiguration 2, the JPEG codec will be working on
487 only one component at a time and thus will have no reference component to
488 downsample against.
489
490
491 Minimum requirements for TIFF/JPEG
492 ----------------------------------
493
494 ISO JPEG is a large and complex standard; most implementations support only
495 a subset of it. Here we define a "core" subset of TIFF/JPEG which readers
496 must support to claim TIFF/JPEG compatibility. For maximum
497 cross-application compatibility, we recommend that writers confine
498 themselves to this subset unless there is very good reason to do otherwise.
499
500 Use the ISO baseline JPEG process: 8-bit data precision, Huffman coding,
501 with no more than 2 DC and 2 AC Huffman tables. Note that this implies
502 BitsPerSample = 8 for each component. We recommend deviating from baseline
503 JPEG only if 12-bit data precision or lossless coding is required.
504
505 Use no subsampling (all JPEG sampling factors = 1) for color spaces other
506 than YCbCr. (This is, in fact, required with the TIFF 6.0 field
507 definitions, but may not be so in future revisions.) For YCbCr, use one of
508 the following choices:
509 YCbCrSubSampling field JPEG sampling factors
510 1,1 1h1v, 1h1v, 1h1v
511 2,1 2h1v, 1h1v, 1h1v
512 2,2 (default value) 2h2v, 1h1v, 1h1v
513 We recommend that RGB source data be converted to YCbCr for best compression
514 results. Other source data colorspaces should probably be left alone.
515 Minimal readers need not support JPEG images with colorspaces other than
516 YCbCr and grayscale (PhotometricInterpretation = 6 or 1).
517
518 A minimal reader also need not support JPEG YCbCr images with nondefault
519 values of YCbCrCoefficients or YCbCrPositioning, nor with values of
520 ReferenceBlackWhite other than [0,255,128,255,128,255]. (These values
521 correspond to the RGB<=>YCbCr conversion specified by JFIF, which is widely
522 implemented in JPEG codecs.)
523
524 Writers are reminded that a ReferenceBlackWhite field *must* be included
525 when PhotometricInterpretation is YCbCr, because the default
526 ReferenceBlackWhite values are inappropriate for YCbCr.
527
528 If any subsampling is used, PlanarConfiguration=1 is preferred to avoid the
529 possibly-confusing requirements of PlanarConfiguration=2. In any case,
530 readers are not required to support PlanarConfiguration=2.
531
532 If possible, use a single interleaved scan in each image segment. This is
533 not legal JPEG if there are more than 4 SamplesPerPixel or if the sampling
534 factors are such that more than 10 blocks would be needed per MCU; in that
535 case, use a separate scan for each component. (The recommended color
536 spaces and sampling factors will not run into that restriction, so a
537 minimal reader need not support more than one scan per segment.)
538
539 To claim TIFF/JPEG compatibility, readers shall support multiple-strip TIFF
540 files and the optional JPEGTables field; it is not acceptable to read only
541 single-datastream files. Support for tiled TIFF files is strongly
542 recommended but not required.
543
544
545 Other recommendations for implementors
546 --------------------------------------
547
548 The TIFF tag Compression=7 guarantees only that the compressed data is
549 represented as ISO JPEG datastreams. Since JPEG is a large and evolving
550 standard, readers should apply careful error checking to the JPEG markers
551 to ensure that the compression process is within their capabilities. In
552 particular, to avoid being confused by future extensions to the JPEG
553 standard, it is important to abort if unknown marker codes are seen.
554
555 The point of requiring that all image segments use the same JPEG process is
556 to ensure that a reader need check only one segment to determine whether it
557 can handle the image. For example, consider a TIFF reader that has access
558 to fast but restricted JPEG hardware, as well as a slower, more general
559 software implementation. It is desirable to check only one image segment
560 to find out whether the fast hardware can be used. Thus, writers should
561 try to ensure that all segments of an image look as much "alike" as
562 possible: there should be no variation in scan layout, use of options such
563 as DRI, etc. Ideally, segments will be processed identically except
564 perhaps for using different local quantization or entropy-coding tables.
565
566 Writers should avoid including "noise" JPEG markers (COM and APPn markers).
567 Standard TIFF fields provide a better way to transport any non-image data.
568 Some JPEG codecs may change behavior if they see an APPn marker they
569 think they understand; since the TIFF spec requires these markers to be
570 ignored, this behavior is undesirable.
571
572 It is possible to convert an interchange-JPEG file (e.g., a JFIF file) to
573 TIFF simply by dropping the interchange datastream into a single strip.
574 (However, designers are reminded that the TIFF spec discourages huge
575 strips; splitting the image is somewhat more work but may give better
576 results.) Conversion from TIFF to interchange JPEG is more complex. A
577 strip-based TIFF/JPEG file can be converted fairly easily if all strips use
578 identical JPEG tables and no RSTn markers: just delete the overhead markers
579 and insert RSTn markers between strips. Converting tiled images is harder,
580 since the data will usually not be in the right order (unless the tiles are
581 only one MCU high). This can still be done losslessly, but it will require
582 undoing and redoing the entropy coding so that the DC coefficient
583 differences can be updated.
584
585 There is no default value for JPEGTables: standard TIFF files must define all
586 tables that they reference. For some closed systems in which many files will
587 have identical tables, it might make sense to define a default JPEGTables
588 value to avoid actually storing the tables. Or even better, invent a
589 private field selecting one of N default JPEGTables settings, so as to allow
590 for future expansion. Either of these must be regarded as a private
591 extension that will render the files unreadable by other applications.
592
593
594 References
595 ----------
596
597 [1] Wallace, Gregory K. "The JPEG Still Picture Compression Standard",
598 Communications of the ACM, April 1991 (vol. 34 no. 4), pp. 30-44.
599
600 This is the best short technical introduction to the JPEG algorithms.
601 It is a good overview but does not provide sufficiently detailed
602 information to write an implementation.
603
604 [2] Pennebaker, William B. and Mitchell, Joan L. "JPEG Still Image Data
605 Compression Standard", Van Nostrand Reinhold, 1993, ISBN 0-442-01272-1.
606 638pp.
607
608 This textbook is by far the most complete exposition of JPEG in existence.
609 It includes the full text of the ISO JPEG standards (DIS 10918-1 and draft
610 DIS 10918-2). No would-be JPEG implementor should be without it.
611
612 [3] ISO/IEC IS 10918-1, "Digital Compression and Coding of Continuous-tone
613 Still Images, Part 1: Requirements and guidelines", February 1994.
614 ISO/IEC DIS 10918-2, "Digital Compression and Coding of Continuous-tone
615 Still Images, Part 2: Compliance testing", final approval expected 1994.
616
617 These are the official standards documents. Note that the Pennebaker and
618 Mitchell textbook is likely to be cheaper and more useful than the official
619 standards.
620
621
622 Changes to Section 21: YCbCr Images
623 ===================================
624
625 [This section of the Tech Note clarifies section 21 to make clear the
626 interpretation of image dimensions in a subsampled image. Furthermore,
627 the section is changed to allow the original image dimensions not to be
628 multiples of the sampling factors. This change is necessary to support use
629 of JPEG compression on odd-size images.]
630
631 Add the following paragraphs to the Section 21 introduction (p. 89),
632 just after the paragraph beginning "When a Class Y image is subsampled":
633
634 In a subsampled image, it is understood that all TIFF image
635 dimensions are measured in terms of the highest-resolution
636 (luminance) component. In particular, ImageWidth, ImageLength,
637 RowsPerStrip, TileWidth, TileLength, XResolution, and YResolution
638 are measured in luminance samples.
639
640 RowsPerStrip, TileWidth, and TileLength are constrained so that
641 there are an integral number of samples of each component in a
642 complete strip or tile. However, ImageWidth/ImageLength are not
643 constrained. If an odd-size image is to be converted to subsampled
644 format, the writer should pad the source data to a multiple of the
645 sampling factors by replication of the last column and/or row, then
646 downsample. The number of luminance samples actually stored in the
647 file will be a multiple of the sampling factors. Conversely,
648 readers must ignore any extra data (outside the specified image
649 dimensions) after upsampling.
650
651 When PlanarConfiguration=2, each strip or tile covers the same
652 image area despite subsampling; that is, the total number of strips
653 or tiles in the image is the same for each component. Therefore
654 strips or tiles of the subsampled components contain fewer samples
655 than strips or tiles of the luminance component.
656
657 If there are extra samples per pixel (see field ExtraSamples),
658 these data channels have the same number of samples as the
659 luminance component.
660
661 Rewrite the YCbCrSubSampling field description (pp 91-92) as follows
662 (largely to eliminate possibly-misleading references to
663 ImageWidth/ImageLength of the subsampled components):
664
665 (first paragraph unchanged)
666
667 The two elements of this field are defined as follows:
668
669 Short 0: ChromaSubsampleHoriz:
670
671 1 = there are equal numbers of luma and chroma samples horizontally.
672
673 2 = there are twice as many luma samples as chroma samples
674 horizontally.
675
676 4 = there are four times as many luma samples as chroma samples
677 horizontally.
678
679 Short 1: ChromaSubsampleVert:
680
681 1 = there are equal numbers of luma and chroma samples vertically.
682
683 2 = there are twice as many luma samples as chroma samples
684 vertically.
685
686 4 = there are four times as many luma samples as chroma samples
687 vertically.
688
689 ChromaSubsampleVert shall always be less than or equal to
690 ChromaSubsampleHoriz. Note that Cb and Cr have the same sampling
691 ratios.
692
693 In a strip TIFF file, RowsPerStrip is required to be an integer
694 multiple of ChromaSubSampleVert (unless RowsPerStrip >=
695 ImageLength, in which case its exact value is unimportant).
696 If ImageWidth and ImageLength are not multiples of
697 ChromaSubsampleHoriz and ChromaSubsampleVert respectively, then the
698 source data shall be padded to the next integer multiple of these
699 values before downsampling.
700
701 In a tiled TIFF file, TileWidth must be an integer multiple of
702 ChromaSubsampleHoriz and TileLength must be an integer multiple of
703 ChromaSubsampleVert. Padding will occur to tile boundaries.
704
705 The default values of this field are [ 2,2 ]. Thus, YCbCr data is
706 downsampled by default!
707 </pre>