]> git.saurik.com Git - bison.git/blob - NEWS
Add gcc's -Wundef to test suite and fix another warning from it.
[bison.git] / NEWS
1 Bison News
2 ----------
3
4 * Changes in version 2.5 (????-??-??):
5
6 ** Named References Support
7
8 Historically, Yacc and Bison have supported positional references
9 ($n, $$) to allow access to symbol values from inside of semantic
10 actions code.
11
12 Starting from this version, Bison can also accept named references.
13 When no ambiguity is possible, original symbol names may be used
14 as named references:
15
16 if_stmt : 'if' cond_expr 'then' then_stmt ';'
17 { $if_stmt = mk_if_stmt($cond_expr, $then_stmt); }
18
19 In the more common case, explicit names may be declared:
20
21 stmt[res] : 'if' expr[cond] 'then' stmt[then] 'else' stmt[else] ';'
22 { $res = mk_if_stmt($cond, $then, $else); }
23
24 Location information is also accessible using @name syntax. When
25 accessing symbol names containing dots or dashes, explicit bracketing
26 ($[sym.1]) must be used.
27
28 These features are experimental in this version. More user feedback
29 will help to stabilize them.
30
31 ** IELR(1) and Canonical LR(1) Support
32
33 IELR(1) is a minimal LR(1) parser table generation algorithm. That
34 is, given any context-free grammar, IELR(1) generates parser tables
35 with the full language recognition power of canonical LR(1) but with
36 nearly the same number of parser states as LALR(1). This reduction in
37 parser states is often an order of magnitude. More importantly,
38 because canonical LR(1)'s extra parser states may contain duplicate
39 conflicts in the case of non-LR(1) grammars, the number of conflicts
40 for IELR(1) is often an order of magnitude less as well. This can
41 significantly reduce the complexity of developing of a grammar.
42
43 Bison can now generate IELR(1) and canonical LR(1) parser tables in
44 place of its traditional LALR(1) parser tables, which remain the
45 default. You can specify the type of parser tables in the grammar
46 file with these directives:
47
48 %define lr.type lalr
49 %define lr.type ielr
50 %define lr.type canonical-lr
51
52 The default reduction optimization in the parser tables can also be
53 adjusted using `%define lr.default-reductions'. See the documentation
54 for `%define lr.type' and `%define lr.default-reductions' in the
55 section `Bison Declaration Summary' in the Bison manual for the
56 details.
57
58 These features are experimental. More user feedback will help to
59 stabilize them.
60
61 ** Unrecognized %code qualifiers are now an error not a warning.
62
63 ** %define improvements.
64
65 *** Unrecognized variables are now an error not a warning.
66
67 *** Multiple invocations for any variable is now an error not a warning.
68
69 *** Can now be invoked via the command line.
70
71 Each of these command-line options
72
73 -D NAME[=VALUE]
74 --define=NAME[=VALUE]
75
76 -F NAME[=VALUE]
77 --force-define=NAME[=VALUE]
78
79 is equivalent to this grammar file declaration
80
81 %define NAME ["VALUE"]
82
83 except that the manner in which Bison processes multiple definitions
84 for the same NAME differs. Most importantly, -F and --force-define
85 quietly override %define, but -D and --define do not. For further
86 details, see the section "Bison Options" in the Bison manual.
87
88 *** Variables renamed.
89
90 The following %define variables
91
92 api.push_pull
93 lr.keep_unreachable_states
94
95 have been renamed to
96
97 api.push-pull
98 lr.keep-unreachable-states
99
100 The old names are now deprecated but will be maintained indefinitely
101 for backward compatibility.
102
103 *** Values no longer need to be quoted in grammar file.
104
105 If a %define value is an identifier, it no longer needs to be placed
106 within quotations marks. For example,
107
108 %define api.push-pull "push"
109
110 can be rewritten as
111
112 %define api.push-pull push
113
114 ** Symbol names.
115
116 Consistently with directives (such as %error-verbose) and variables
117 (e.g. push-pull), symbol names may include dashes in any position,
118 similarly to periods and underscores. This is GNU extension over
119 POSIX Yacc whose use is reported by -Wyacc, and rejected in Yacc
120 mode (--yacc).
121
122 ** Temporary hack for adding a semicolon to the user action.
123
124 Previously, Bison appended a semicolon to every user action for
125 reductions when the output language defaulted to C (specifically, when
126 neither %yacc, %language, %skeleton, or equivalent command-line
127 options were specified). This allowed actions such as
128
129 exp: exp "+" exp { $$ = $1 + $3 };
130
131 instead of
132
133 exp: exp "+" exp { $$ = $1 + $3; };
134
135 As a first step in removing this misfeature, Bison now issues a
136 warning when it appends a semicolon. Moreover, in cases where Bison
137 cannot easily determine whether a semicolon is needed (for example, an
138 action ending with a cpp directive or a braced compound initializer),
139 it no longer appends one. Thus, the C compiler might now complain
140 about a missing semicolon where it did not before. Future releases of
141 Bison will cease to append semicolons entirely.
142
143 ** Character literals not of length one.
144
145 Previously, Bison quietly converted all character literals to length
146 one. For example, without warning, Bison interpreted the operators in
147 the following grammar to be the same token:
148
149 exp: exp '++'
150 | exp '+' exp
151 ;
152
153 Bison now warns when a character literal is not of length one. In
154 some future release, Bison will report an error instead.
155
156 ** Verbose error messages fixed for nonassociative tokens.
157
158 When %error-verbose is specified, syntax error messages produced by
159 the generated parser include the unexpected token as well as a list of
160 expected tokens. Previously, this list erroneously included tokens
161 that would actually induce a syntax error because conflicts for them
162 were resolved with %nonassoc. Such tokens are now properly omitted
163 from the list.
164
165 * Changes in version 2.4.2 (????-??-??):
166
167 ** Detection of GNU M4 1.4.6 or newer during configure is improved.
168
169 ** Warnings from gcc's -Wundef option about undefined YYENABLE_NLS,
170 YYLTYPE_IS_TRIVIAL, and __STRICT_ANSI__ in C/C++ parsers are now
171 avoided.
172
173 ** %code is now a permanent feature.
174
175 A traditional Yacc prologue directive is written in the form:
176
177 %{CODE%}
178
179 To provide a more flexible alternative, Bison 2.3b introduced the
180 %code directive with the following forms for C/C++:
181
182 %code {CODE}
183 %code requires {CODE}
184 %code provides {CODE}
185 %code top {CODE}
186
187 These forms are now considered permanent features of Bison. See the
188 %code entries in the section "Bison Declaration Summary" in the Bison
189 manual for a summary of their functionality. See the section
190 "Prologue Alternatives" for a detailed discussion including the
191 advantages of %code over the traditional Yacc prologue directive.
192
193 Bison's Java feature as a whole including its current usage of %code
194 is still considered experimental.
195
196 ** Internationalization.
197
198 Fix a regression introduced in Bison 2.4: Under some circumstances,
199 message translations were not installed although supported by the
200 host system.
201
202 * Changes in version 2.4.1 (2008-12-11):
203
204 ** In the GLR defines file, unexpanded M4 macros in the yylval and yylloc
205 declarations have been fixed.
206
207 ** Temporary hack for adding a semicolon to the user action.
208
209 Bison used to prepend a trailing semicolon at the end of the user
210 action for reductions. This allowed actions such as
211
212 exp: exp "+" exp { $$ = $1 + $3 };
213
214 instead of
215
216 exp: exp "+" exp { $$ = $1 + $3; };
217
218 Some grammars still depend on this `feature'. Bison 2.4.1 restores
219 the previous behavior in the case of C output (specifically, when
220 neither %language or %skeleton or equivalent command-line options
221 are used) to leave more time for grammars depending on the old
222 behavior to be adjusted. Future releases of Bison will disable this
223 feature.
224
225 ** A few minor improvements to the Bison manual.
226
227 * Changes in version 2.4 (2008-11-02):
228
229 ** %language is an experimental feature.
230
231 We first introduced this feature in test release 2.3b as a cleaner
232 alternative to %skeleton. Since then, we have discussed the possibility of
233 modifying its effect on Bison's output file names. Thus, in this release,
234 we consider %language to be an experimental feature that will likely evolve
235 in future releases.
236
237 ** Forward compatibility with GNU M4 has been improved.
238
239 ** Several bugs in the C++ skeleton and the experimental Java skeleton have been
240 fixed.
241
242 * Changes in version 2.3b (2008-05-27):
243
244 ** The quotes around NAME that used to be required in the following directive
245 are now deprecated:
246
247 %define NAME "VALUE"
248
249 ** The directive `%pure-parser' is now deprecated in favor of:
250
251 %define api.pure
252
253 which has the same effect except that Bison is more careful to warn about
254 unreasonable usage in the latter case.
255
256 ** Push Parsing
257
258 Bison can now generate an LALR(1) parser in C with a push interface. That
259 is, instead of invoking `yyparse', which pulls tokens from `yylex', you can
260 push one token at a time to the parser using `yypush_parse', which will
261 return to the caller after processing each token. By default, the push
262 interface is disabled. Either of the following directives will enable it:
263
264 %define api.push_pull "push" // Just push; does not require yylex.
265 %define api.push_pull "both" // Push and pull; requires yylex.
266
267 See the new section `A Push Parser' in the Bison manual for details.
268
269 The current push parsing interface is experimental and may evolve. More user
270 feedback will help to stabilize it.
271
272 ** The -g and --graph options now output graphs in Graphviz DOT format,
273 not VCG format. Like --graph, -g now also takes an optional FILE argument
274 and thus cannot be bundled with other short options.
275
276 ** Java
277
278 Bison can now generate an LALR(1) parser in Java. The skeleton is
279 `data/lalr1.java'. Consider using the new %language directive instead of
280 %skeleton to select it.
281
282 See the new section `Java Parsers' in the Bison manual for details.
283
284 The current Java interface is experimental and may evolve. More user
285 feedback will help to stabilize it.
286
287 ** %language
288
289 This new directive specifies the programming language of the generated
290 parser, which can be C (the default), C++, or Java. Besides the skeleton
291 that Bison uses, the directive affects the names of the generated files if
292 the grammar file's name ends in ".y".
293
294 ** XML Automaton Report
295
296 Bison can now generate an XML report of the LALR(1) automaton using the new
297 `--xml' option. The current XML schema is experimental and may evolve. More
298 user feedback will help to stabilize it.
299
300 ** The grammar file may now specify the name of the parser header file using
301 %defines. For example:
302
303 %defines "parser.h"
304
305 ** When reporting useless rules, useless nonterminals, and unused terminals,
306 Bison now employs the terms "useless in grammar" instead of "useless",
307 "useless in parser" instead of "never reduced", and "unused in grammar"
308 instead of "unused".
309
310 ** Unreachable State Removal
311
312 Previously, Bison sometimes generated parser tables containing unreachable
313 states. A state can become unreachable during conflict resolution if Bison
314 disables a shift action leading to it from a predecessor state. Bison now:
315
316 1. Removes unreachable states.
317
318 2. Does not report any conflicts that appeared in unreachable states.
319 WARNING: As a result, you may need to update %expect and %expect-rr
320 directives in existing grammar files.
321
322 3. For any rule used only in such states, Bison now reports the rule as
323 "useless in parser due to conflicts".
324
325 This feature can be disabled with the following directive:
326
327 %define lr.keep_unreachable_states
328
329 See the %define entry in the `Bison Declaration Summary' in the Bison manual
330 for further discussion.
331
332 ** Lookahead Set Correction in the `.output' Report
333
334 When instructed to generate a `.output' file including lookahead sets
335 (using `--report=lookahead', for example), Bison now prints each reduction's
336 lookahead set only next to the associated state's one item that (1) is
337 associated with the same rule as the reduction and (2) has its dot at the end
338 of its RHS. Previously, Bison also erroneously printed the lookahead set
339 next to all of the state's other items associated with the same rule. This
340 bug affected only the `.output' file and not the generated parser source
341 code.
342
343 ** --report-file=FILE is a new option to override the default `.output' file
344 name.
345
346 ** The `=' that used to be required in the following directives is now
347 deprecated:
348
349 %file-prefix "parser"
350 %name-prefix "c_"
351 %output "parser.c"
352
353 ** An Alternative to `%{...%}' -- `%code QUALIFIER {CODE}'
354
355 Bison 2.3a provided a new set of directives as a more flexible alternative to
356 the traditional Yacc prologue blocks. Those have now been consolidated into
357 a single %code directive with an optional qualifier field, which identifies
358 the purpose of the code and thus the location(s) where Bison should generate
359 it:
360
361 1. `%code {CODE}' replaces `%after-header {CODE}'
362 2. `%code requires {CODE}' replaces `%start-header {CODE}'
363 3. `%code provides {CODE}' replaces `%end-header {CODE}'
364 4. `%code top {CODE}' replaces `%before-header {CODE}'
365
366 See the %code entries in section `Bison Declaration Summary' in the Bison
367 manual for a summary of the new functionality. See the new section `Prologue
368 Alternatives' for a detailed discussion including the advantages of %code
369 over the traditional Yacc prologues.
370
371 The prologue alternatives are experimental. More user feedback will help to
372 determine whether they should become permanent features.
373
374 ** Revised warning: unset or unused mid-rule values
375
376 Since Bison 2.2, Bison has warned about mid-rule values that are set but not
377 used within any of the actions of the parent rule. For example, Bison warns
378 about unused $2 in:
379
380 exp: '1' { $$ = 1; } '+' exp { $$ = $1 + $4; };
381
382 Now, Bison also warns about mid-rule values that are used but not set. For
383 example, Bison warns about unset $$ in the mid-rule action in:
384
385 exp: '1' { $1 = 1; } '+' exp { $$ = $2 + $4; };
386
387 However, Bison now disables both of these warnings by default since they
388 sometimes prove to be false alarms in existing grammars employing the Yacc
389 constructs $0 or $-N (where N is some positive integer).
390
391 To enable these warnings, specify the option `--warnings=midrule-values' or
392 `-W', which is a synonym for `--warnings=all'.
393
394 ** Default %destructor or %printer with `<*>' or `<>'
395
396 Bison now recognizes two separate kinds of default %destructor's and
397 %printer's:
398
399 1. Place `<*>' in a %destructor/%printer symbol list to define a default
400 %destructor/%printer for all grammar symbols for which you have formally
401 declared semantic type tags.
402
403 2. Place `<>' in a %destructor/%printer symbol list to define a default
404 %destructor/%printer for all grammar symbols without declared semantic
405 type tags.
406
407 Bison no longer supports the `%symbol-default' notation from Bison 2.3a.
408 `<*>' and `<>' combined achieve the same effect with one exception: Bison no
409 longer applies any %destructor to a mid-rule value if that mid-rule value is
410 not actually ever referenced using either $$ or $n in a semantic action.
411
412 The default %destructor's and %printer's are experimental. More user
413 feedback will help to determine whether they should become permanent
414 features.
415
416 See the section `Freeing Discarded Symbols' in the Bison manual for further
417 details.
418
419 ** %left, %right, and %nonassoc can now declare token numbers. This is required
420 by POSIX. However, see the end of section `Operator Precedence' in the Bison
421 manual for a caveat concerning the treatment of literal strings.
422
423 ** The nonfunctional --no-parser, -n, and %no-parser options have been
424 completely removed from Bison.
425
426 * Changes in version 2.3a, 2006-09-13:
427
428 ** Instead of %union, you can define and use your own union type
429 YYSTYPE if your grammar contains at least one <type> tag.
430 Your YYSTYPE need not be a macro; it can be a typedef.
431 This change is for compatibility with other Yacc implementations,
432 and is required by POSIX.
433
434 ** Locations columns and lines start at 1.
435 In accordance with the GNU Coding Standards and Emacs.
436
437 ** You may now declare per-type and default %destructor's and %printer's:
438
439 For example:
440
441 %union { char *string; }
442 %token <string> STRING1
443 %token <string> STRING2
444 %type <string> string1
445 %type <string> string2
446 %union { char character; }
447 %token <character> CHR
448 %type <character> chr
449 %destructor { free ($$); } %symbol-default
450 %destructor { free ($$); printf ("%d", @$.first_line); } STRING1 string1
451 %destructor { } <character>
452
453 guarantees that, when the parser discards any user-defined symbol that has a
454 semantic type tag other than `<character>', it passes its semantic value to
455 `free'. However, when the parser discards a `STRING1' or a `string1', it
456 also prints its line number to `stdout'. It performs only the second
457 `%destructor' in this case, so it invokes `free' only once.
458
459 [Although we failed to mention this here in the 2.3a release, the default
460 %destructor's and %printer's were experimental, and they were rewritten in
461 future versions.]
462
463 ** Except for LALR(1) parsers in C with POSIX Yacc emulation enabled (with `-y',
464 `--yacc', or `%yacc'), Bison no longer generates #define statements for
465 associating token numbers with token names. Removing the #define statements
466 helps to sanitize the global namespace during preprocessing, but POSIX Yacc
467 requires them. Bison still generates an enum for token names in all cases.
468
469 ** Handling of traditional Yacc prologue blocks is now more consistent but
470 potentially incompatible with previous releases of Bison.
471
472 As before, you declare prologue blocks in your grammar file with the
473 `%{ ... %}' syntax. To generate the pre-prologue, Bison concatenates all
474 prologue blocks that you've declared before the first %union. To generate
475 the post-prologue, Bison concatenates all prologue blocks that you've
476 declared after the first %union.
477
478 Previous releases of Bison inserted the pre-prologue into both the header
479 file and the code file in all cases except for LALR(1) parsers in C. In the
480 latter case, Bison inserted it only into the code file. For parsers in C++,
481 the point of insertion was before any token definitions (which associate
482 token numbers with names). For parsers in C, the point of insertion was
483 after the token definitions.
484
485 Now, Bison never inserts the pre-prologue into the header file. In the code
486 file, it always inserts it before the token definitions.
487
488 ** Bison now provides a more flexible alternative to the traditional Yacc
489 prologue blocks: %before-header, %start-header, %end-header, and
490 %after-header.
491
492 For example, the following declaration order in the grammar file reflects the
493 order in which Bison will output these code blocks. However, you are free to
494 declare these code blocks in your grammar file in whatever order is most
495 convenient for you:
496
497 %before-header {
498 /* Bison treats this block like a pre-prologue block: it inserts it into
499 * the code file before the contents of the header file. It does *not*
500 * insert it into the header file. This is a good place to put
501 * #include's that you want at the top of your code file. A common
502 * example is `#include "system.h"'. */
503 }
504 %start-header {
505 /* Bison inserts this block into both the header file and the code file.
506 * In both files, the point of insertion is before any Bison-generated
507 * token, semantic type, location type, and class definitions. This is a
508 * good place to define %union dependencies, for example. */
509 }
510 %union {
511 /* Unlike the traditional Yacc prologue blocks, the output order for the
512 * new %*-header blocks is not affected by their declaration position
513 * relative to any %union in the grammar file. */
514 }
515 %end-header {
516 /* Bison inserts this block into both the header file and the code file.
517 * In both files, the point of insertion is after the Bison-generated
518 * definitions. This is a good place to declare or define public
519 * functions or data structures that depend on the Bison-generated
520 * definitions. */
521 }
522 %after-header {
523 /* Bison treats this block like a post-prologue block: it inserts it into
524 * the code file after the contents of the header file. It does *not*
525 * insert it into the header file. This is a good place to declare or
526 * define internal functions or data structures that depend on the
527 * Bison-generated definitions. */
528 }
529
530 If you have multiple occurrences of any one of the above declarations, Bison
531 will concatenate the contents in declaration order.
532
533 [Although we failed to mention this here in the 2.3a release, the prologue
534 alternatives were experimental, and they were rewritten in future versions.]
535
536 ** The option `--report=look-ahead' has been changed to `--report=lookahead'.
537 The old spelling still works, but is not documented and may be removed
538 in a future release.
539
540 * Changes in version 2.3, 2006-06-05:
541
542 ** GLR grammars should now use `YYRECOVERING ()' instead of `YYRECOVERING',
543 for compatibility with LALR(1) grammars.
544
545 ** It is now documented that any definition of YYSTYPE or YYLTYPE should
546 be to a type name that does not contain parentheses or brackets.
547
548 * Changes in version 2.2, 2006-05-19:
549
550 ** The distribution terms for all Bison-generated parsers now permit
551 using the parsers in nonfree programs. Previously, this permission
552 was granted only for Bison-generated LALR(1) parsers in C.
553
554 ** %name-prefix changes the namespace name in C++ outputs.
555
556 ** The C++ parsers export their token_type.
557
558 ** Bison now allows multiple %union declarations, and concatenates
559 their contents together.
560
561 ** New warning: unused values
562 Right-hand side symbols whose values are not used are reported,
563 if the symbols have destructors. For instance:
564
565 exp: exp "?" exp ":" exp { $1 ? $1 : $3; }
566 | exp "+" exp
567 ;
568
569 will trigger a warning about $$ and $5 in the first rule, and $3 in
570 the second ($1 is copied to $$ by the default rule). This example
571 most likely contains three errors, and could be rewritten as:
572
573 exp: exp "?" exp ":" exp
574 { $$ = $1 ? $3 : $5; free ($1 ? $5 : $3); free ($1); }
575 | exp "+" exp
576 { $$ = $1 ? $1 : $3; if ($1) free ($3); }
577 ;
578
579 However, if the original actions were really intended, memory leaks
580 and all, the warnings can be suppressed by letting Bison believe the
581 values are used, e.g.:
582
583 exp: exp "?" exp ":" exp { $1 ? $1 : $3; (void) ($$, $5); }
584 | exp "+" exp { $$ = $1; (void) $3; }
585 ;
586
587 If there are mid-rule actions, the warning is issued if no action
588 uses it. The following triggers no warning: $1 and $3 are used.
589
590 exp: exp { push ($1); } '+' exp { push ($3); sum (); };
591
592 The warning is intended to help catching lost values and memory leaks.
593 If a value is ignored, its associated memory typically is not reclaimed.
594
595 ** %destructor vs. YYABORT, YYACCEPT, and YYERROR.
596 Destructors are now called when user code invokes YYABORT, YYACCEPT,
597 and YYERROR, for all objects on the stack, other than objects
598 corresponding to the right-hand side of the current rule.
599
600 ** %expect, %expect-rr
601 Incorrect numbers of expected conflicts are now actual errors,
602 instead of warnings.
603
604 ** GLR, YACC parsers.
605 The %parse-params are available in the destructors (and the
606 experimental printers) as per the documentation.
607
608 ** Bison now warns if it finds a stray `$' or `@' in an action.
609
610 ** %require "VERSION"
611 This specifies that the grammar file depends on features implemented
612 in Bison version VERSION or higher.
613
614 ** lalr1.cc: The token and value types are now class members.
615 The tokens were defined as free form enums and cpp macros. YYSTYPE
616 was defined as a free form union. They are now class members:
617 tokens are enumerations of the `yy::parser::token' struct, and the
618 semantic values have the `yy::parser::semantic_type' type.
619
620 If you do not want or can update to this scheme, the directive
621 `%define "global_tokens_and_yystype" "1"' triggers the global
622 definition of tokens and YYSTYPE. This change is suitable both
623 for previous releases of Bison, and this one.
624
625 If you wish to update, then make sure older version of Bison will
626 fail using `%require "2.2"'.
627
628 ** DJGPP support added.
629 \f
630 * Changes in version 2.1, 2005-09-16:
631
632 ** The C++ lalr1.cc skeleton supports %lex-param.
633
634 ** Bison-generated parsers now support the translation of diagnostics like
635 "syntax error" into languages other than English. The default
636 language is still English. For details, please see the new
637 Internationalization section of the Bison manual. Software
638 distributors should also see the new PACKAGING file. Thanks to
639 Bruno Haible for this new feature.
640
641 ** Wording in the Bison-generated parsers has been changed slightly to
642 simplify translation. In particular, the message "memory exhausted"
643 has replaced "parser stack overflow", as the old message was not
644 always accurate for modern Bison-generated parsers.
645
646 ** Destructors are now called when the parser aborts, for all symbols left
647 behind on the stack. Also, the start symbol is now destroyed after a
648 successful parse. In both cases, the behavior was formerly inconsistent.
649
650 ** When generating verbose diagnostics, Bison-generated parsers no longer
651 quote the literal strings associated with tokens. For example, for
652 a syntax error associated with '%token NUM "number"' they might
653 print 'syntax error, unexpected number' instead of 'syntax error,
654 unexpected "number"'.
655 \f
656 * Changes in version 2.0, 2004-12-25:
657
658 ** Possibly-incompatible changes
659
660 - Bison-generated parsers no longer default to using the alloca function
661 (when available) to extend the parser stack, due to widespread
662 problems in unchecked stack-overflow detection. You can "#define
663 YYSTACK_USE_ALLOCA 1" to require the use of alloca, but please read
664 the manual to determine safe values for YYMAXDEPTH in that case.
665
666 - Error token location.
667 During error recovery, the location of the syntax error is updated
668 to cover the whole sequence covered by the error token: it includes
669 the shifted symbols thrown away during the first part of the error
670 recovery, and the lookahead rejected during the second part.
671
672 - Semicolon changes:
673 . Stray semicolons are no longer allowed at the start of a grammar.
674 . Semicolons are now required after in-grammar declarations.
675
676 - Unescaped newlines are no longer allowed in character constants or
677 string literals. They were never portable, and GCC 3.4.0 has
678 dropped support for them. Better diagnostics are now generated if
679 forget a closing quote.
680
681 - NUL bytes are no longer allowed in Bison string literals, unfortunately.
682
683 ** New features
684
685 - GLR grammars now support locations.
686
687 - New directive: %initial-action.
688 This directive allows the user to run arbitrary code (including
689 initializing @$) from yyparse before parsing starts.
690
691 - A new directive "%expect-rr N" specifies the expected number of
692 reduce/reduce conflicts in GLR parsers.
693
694 - %token numbers can now be hexadecimal integers, e.g., `%token FOO 0x12d'.
695 This is a GNU extension.
696
697 - The option `--report=lookahead' was changed to `--report=look-ahead'.
698 [However, this was changed back after 2.3.]
699
700 - Experimental %destructor support has been added to lalr1.cc.
701
702 - New configure option --disable-yacc, to disable installation of the
703 yacc command and -ly library introduced in 1.875 for POSIX conformance.
704
705 ** Bug fixes
706
707 - For now, %expect-count violations are now just warnings, not errors.
708 This is for compatibility with Bison 1.75 and earlier (when there are
709 reduce/reduce conflicts) and with Bison 1.30 and earlier (when there
710 are too many or too few shift/reduce conflicts). However, in future
711 versions of Bison we plan to improve the %expect machinery so that
712 these violations will become errors again.
713
714 - Within Bison itself, numbers (e.g., goto numbers) are no longer
715 arbitrarily limited to 16-bit counts.
716
717 - Semicolons are now allowed before "|" in grammar rules, as POSIX requires.
718 \f
719 * Changes in version 1.875, 2003-01-01:
720
721 ** The documentation license has been upgraded to version 1.2
722 of the GNU Free Documentation License.
723
724 ** syntax error processing
725
726 - In Yacc-style parsers YYLLOC_DEFAULT is now used to compute error
727 locations too. This fixes bugs in error-location computation.
728
729 - %destructor
730 It is now possible to reclaim the memory associated to symbols
731 discarded during error recovery. This feature is still experimental.
732
733 - %error-verbose
734 This new directive is preferred over YYERROR_VERBOSE.
735
736 - #defining yyerror to steal internal variables is discouraged.
737 It is not guaranteed to work forever.
738
739 ** POSIX conformance
740
741 - Semicolons are once again optional at the end of grammar rules.
742 This reverts to the behavior of Bison 1.33 and earlier, and improves
743 compatibility with Yacc.
744
745 - `parse error' -> `syntax error'
746 Bison now uniformly uses the term `syntax error'; formerly, the code
747 and manual sometimes used the term `parse error' instead. POSIX
748 requires `syntax error' in diagnostics, and it was thought better to
749 be consistent.
750
751 - The documentation now emphasizes that yylex and yyerror must be
752 declared before use. C99 requires this.
753
754 - Bison now parses C99 lexical constructs like UCNs and
755 backslash-newline within C escape sequences, as POSIX 1003.1-2001 requires.
756
757 - File names are properly escaped in C output. E.g., foo\bar.y is
758 output as "foo\\bar.y".
759
760 - Yacc command and library now available
761 The Bison distribution now installs a `yacc' command, as POSIX requires.
762 Also, Bison now installs a small library liby.a containing
763 implementations of Yacc-compatible yyerror and main functions.
764 This library is normally not useful, but POSIX requires it.
765
766 - Type clashes now generate warnings, not errors.
767
768 - If the user does not define YYSTYPE as a macro, Bison now declares it
769 using typedef instead of defining it as a macro.
770 For consistency, YYLTYPE is also declared instead of defined.
771
772 ** Other compatibility issues
773
774 - %union directives can now have a tag before the `{', e.g., the
775 directive `%union foo {...}' now generates the C code
776 `typedef union foo { ... } YYSTYPE;'; this is for Yacc compatibility.
777 The default union tag is `YYSTYPE', for compatibility with Solaris 9 Yacc.
778 For consistency, YYLTYPE's struct tag is now `YYLTYPE' not `yyltype'.
779 This is for compatibility with both Yacc and Bison 1.35.
780
781 - `;' is output before the terminating `}' of an action, for
782 compatibility with Bison 1.35.
783
784 - Bison now uses a Yacc-style format for conflict reports, e.g.,
785 `conflicts: 2 shift/reduce, 1 reduce/reduce'.
786
787 - `yystype' and `yyltype' are now obsolescent macros instead of being
788 typedefs or tags; they are no longer documented and are planned to be
789 withdrawn in a future release.
790
791 ** GLR parser notes
792
793 - GLR and inline
794 Users of Bison have to decide how they handle the portability of the
795 C keyword `inline'.
796
797 - `parsing stack overflow...' -> `parser stack overflow'
798 GLR parsers now report `parser stack overflow' as per the Bison manual.
799
800 ** Bison now warns if it detects conflicting outputs to the same file,
801 e.g., it generates a warning for `bison -d -o foo.h foo.y' since
802 that command outputs both code and header to foo.h.
803
804 ** #line in output files
805 - --no-line works properly.
806
807 ** Bison can no longer be built by a K&R C compiler; it requires C89 or
808 later to be built. This change originally took place a few versions
809 ago, but nobody noticed until we recently asked someone to try
810 building Bison with a K&R C compiler.
811 \f
812 * Changes in version 1.75, 2002-10-14:
813
814 ** Bison should now work on 64-bit hosts.
815
816 ** Indonesian translation thanks to Tedi Heriyanto.
817
818 ** GLR parsers
819 Fix spurious parse errors.
820
821 ** Pure parsers
822 Some people redefine yyerror to steal yyparse' private variables.
823 Reenable this trick until an official feature replaces it.
824
825 ** Type Clashes
826 In agreement with POSIX and with other Yaccs, leaving a default
827 action is valid when $$ is untyped, and $1 typed:
828
829 untyped: ... typed;
830
831 but the converse remains an error:
832
833 typed: ... untyped;
834
835 ** Values of mid-rule actions
836 The following code:
837
838 foo: { ... } { $$ = $1; } ...
839
840 was incorrectly rejected: $1 is defined in the second mid-rule
841 action, and is equal to the $$ of the first mid-rule action.
842 \f
843 * Changes in version 1.50, 2002-10-04:
844
845 ** GLR parsing
846 The declaration
847 %glr-parser
848 causes Bison to produce a Generalized LR (GLR) parser, capable of handling
849 almost any context-free grammar, ambiguous or not. The new declarations
850 %dprec and %merge on grammar rules allow parse-time resolution of
851 ambiguities. Contributed by Paul Hilfinger.
852
853 Unfortunately Bison 1.50 does not work properly on 64-bit hosts
854 like the Alpha, so please stick to 32-bit hosts for now.
855
856 ** Output Directory
857 When not in Yacc compatibility mode, when the output file was not
858 specified, running `bison foo/bar.y' created `foo/bar.c'. It
859 now creates `bar.c'.
860
861 ** Undefined token
862 The undefined token was systematically mapped to 2 which prevented
863 the use of 2 by the user. This is no longer the case.
864
865 ** Unknown token numbers
866 If yylex returned an out of range value, yyparse could die. This is
867 no longer the case.
868
869 ** Error token
870 According to POSIX, the error token must be 256.
871 Bison extends this requirement by making it a preference: *if* the
872 user specified that one of her tokens is numbered 256, then error
873 will be mapped onto another number.
874
875 ** Verbose error messages
876 They no longer report `..., expecting error or...' for states where
877 error recovery is possible.
878
879 ** End token
880 Defaults to `$end' instead of `$'.
881
882 ** Error recovery now conforms to documentation and to POSIX
883 When a Bison-generated parser encounters a syntax error, it now pops
884 the stack until it finds a state that allows shifting the error
885 token. Formerly, it popped the stack until it found a state that
886 allowed some non-error action other than a default reduction on the
887 error token. The new behavior has long been the documented behavior,
888 and has long been required by POSIX. For more details, please see
889 Paul Eggert, "Reductions during Bison error handling" (2002-05-20)
890 <http://lists.gnu.org/archive/html/bug-bison/2002-05/msg00038.html>.
891
892 ** Traces
893 Popped tokens and nonterminals are now reported.
894
895 ** Larger grammars
896 Larger grammars are now supported (larger token numbers, larger grammar
897 size (= sum of the LHS and RHS lengths), larger LALR tables).
898 Formerly, many of these numbers ran afoul of 16-bit limits;
899 now these limits are 32 bits on most hosts.
900
901 ** Explicit initial rule
902 Bison used to play hacks with the initial rule, which the user does
903 not write. It is now explicit, and visible in the reports and
904 graphs as rule 0.
905
906 ** Useless rules
907 Before, Bison reported the useless rules, but, although not used,
908 included them in the parsers. They are now actually removed.
909
910 ** Useless rules, useless nonterminals
911 They are now reported, as a warning, with their locations.
912
913 ** Rules never reduced
914 Rules that can never be reduced because of conflicts are now
915 reported.
916
917 ** Incorrect `Token not used'
918 On a grammar such as
919
920 %token useless useful
921 %%
922 exp: '0' %prec useful;
923
924 where a token was used to set the precedence of the last rule,
925 bison reported both `useful' and `useless' as useless tokens.
926
927 ** Revert the C++ namespace changes introduced in 1.31
928 as they caused too many portability hassles.
929
930 ** Default locations
931 By an accident of design, the default computation of @$ was
932 performed after another default computation was performed: @$ = @1.
933 The latter is now removed: YYLLOC_DEFAULT is fully responsible of
934 the computation of @$.
935
936 ** Token end-of-file
937 The token end of file may be specified by the user, in which case,
938 the user symbol is used in the reports, the graphs, and the verbose
939 error messages instead of `$end', which remains being the default.
940 For instance
941 %token MYEOF 0
942 or
943 %token MYEOF 0 "end of file"
944
945 ** Semantic parser
946 This old option, which has been broken for ages, is removed.
947
948 ** New translations
949 Brazilian Portuguese, thanks to Alexandre Folle de Menezes.
950 Croatian, thanks to Denis Lackovic.
951
952 ** Incorrect token definitions
953 When given `%token 'a' "A"', Bison used to output `#define 'a' 65'.
954
955 ** Token definitions as enums
956 Tokens are output both as the traditional #define's, and, provided
957 the compiler supports ANSI C or is a C++ compiler, as enums.
958 This lets debuggers display names instead of integers.
959
960 ** Reports
961 In addition to --verbose, bison supports --report=THINGS, which
962 produces additional information:
963 - itemset
964 complete the core item sets with their closure
965 - lookahead [changed to `look-ahead' in 1.875e through 2.3, but changed back]
966 explicitly associate lookahead tokens to items
967 - solved
968 describe shift/reduce conflicts solving.
969 Bison used to systematically output this information on top of
970 the report. Solved conflicts are now attached to their states.
971
972 ** Type clashes
973 Previous versions don't complain when there is a type clash on
974 the default action if the rule has a mid-rule action, such as in:
975
976 %type <foo> bar
977 %%
978 bar: '0' {} '0';
979
980 This is fixed.
981
982 ** GNU M4 is now required when using Bison.
983 \f
984 * Changes in version 1.35, 2002-03-25:
985
986 ** C Skeleton
987 Some projects use Bison's C parser with C++ compilers, and define
988 YYSTYPE as a class. The recent adjustment of C parsers for data
989 alignment and 64 bit architectures made this impossible.
990
991 Because for the time being no real solution for C++ parser
992 generation exists, kludges were implemented in the parser to
993 maintain this use. In the future, when Bison has C++ parsers, this
994 kludge will be disabled.
995
996 This kludge also addresses some C++ problems when the stack was
997 extended.
998 \f
999 * Changes in version 1.34, 2002-03-12:
1000
1001 ** File name clashes are detected
1002 $ bison foo.y -d -o foo.x
1003 fatal error: header and parser would both be named `foo.x'
1004
1005 ** A missing `;' at the end of a rule triggers a warning
1006 In accordance with POSIX, and in agreement with other
1007 Yacc implementations, Bison will mandate this semicolon in the near
1008 future. This eases the implementation of a Bison parser of Bison
1009 grammars by making this grammar LALR(1) instead of LR(2). To
1010 facilitate the transition, this release introduces a warning.
1011
1012 ** Revert the C++ namespace changes introduced in 1.31, as they caused too
1013 many portability hassles.
1014
1015 ** DJGPP support added.
1016
1017 ** Fix test suite portability problems.
1018 \f
1019 * Changes in version 1.33, 2002-02-07:
1020
1021 ** Fix C++ issues
1022 Groff could not be compiled for the definition of size_t was lacking
1023 under some conditions.
1024
1025 ** Catch invalid @n
1026 As is done with $n.
1027 \f
1028 * Changes in version 1.32, 2002-01-23:
1029
1030 ** Fix Yacc output file names
1031
1032 ** Portability fixes
1033
1034 ** Italian, Dutch translations
1035 \f
1036 * Changes in version 1.31, 2002-01-14:
1037
1038 ** Many Bug Fixes
1039
1040 ** GNU Gettext and %expect
1041 GNU Gettext asserts 10 s/r conflicts, but there are 7. Now that
1042 Bison dies on incorrect %expectations, we fear there will be
1043 too many bug reports for Gettext, so _for the time being_, %expect
1044 does not trigger an error when the input file is named `plural.y'.
1045
1046 ** Use of alloca in parsers
1047 If YYSTACK_USE_ALLOCA is defined to 0, then the parsers will use
1048 malloc exclusively. Since 1.29, but was not NEWS'ed.
1049
1050 alloca is used only when compiled with GCC, to avoid portability
1051 problems as on AIX.
1052
1053 ** yyparse now returns 2 if memory is exhausted; formerly it dumped core.
1054
1055 ** When the generated parser lacks debugging code, YYDEBUG is now 0
1056 (as POSIX requires) instead of being undefined.
1057
1058 ** User Actions
1059 Bison has always permitted actions such as { $$ = $1 }: it adds the
1060 ending semicolon. Now if in Yacc compatibility mode, the semicolon
1061 is no longer output: one has to write { $$ = $1; }.
1062
1063 ** Better C++ compliance
1064 The output parsers try to respect C++ namespaces.
1065 [This turned out to be a failed experiment, and it was reverted later.]
1066
1067 ** Reduced Grammars
1068 Fixed bugs when reporting useless nonterminals.
1069
1070 ** 64 bit hosts
1071 The parsers work properly on 64 bit hosts.
1072
1073 ** Error messages
1074 Some calls to strerror resulted in scrambled or missing error messages.
1075
1076 ** %expect
1077 When the number of shift/reduce conflicts is correct, don't issue
1078 any warning.
1079
1080 ** The verbose report includes the rule line numbers.
1081
1082 ** Rule line numbers are fixed in traces.
1083
1084 ** Swedish translation
1085
1086 ** Parse errors
1087 Verbose parse error messages from the parsers are better looking.
1088 Before: parse error: unexpected `'/'', expecting `"number"' or `'-'' or `'(''
1089 Now: parse error: unexpected '/', expecting "number" or '-' or '('
1090
1091 ** Fixed parser memory leaks.
1092 When the generated parser was using malloc to extend its stacks, the
1093 previous allocations were not freed.
1094
1095 ** Fixed verbose output file.
1096 Some newlines were missing.
1097 Some conflicts in state descriptions were missing.
1098
1099 ** Fixed conflict report.
1100 Option -v was needed to get the result.
1101
1102 ** %expect
1103 Was not used.
1104 Mismatches are errors, not warnings.
1105
1106 ** Fixed incorrect processing of some invalid input.
1107
1108 ** Fixed CPP guards: 9foo.h uses BISON_9FOO_H instead of 9FOO_H.
1109
1110 ** Fixed some typos in the documentation.
1111
1112 ** %token MY_EOF 0 is supported.
1113 Before, MY_EOF was silently renumbered as 257.
1114
1115 ** doc/refcard.tex is updated.
1116
1117 ** %output, %file-prefix, %name-prefix.
1118 New.
1119
1120 ** --output
1121 New, aliasing `--output-file'.
1122 \f
1123 * Changes in version 1.30, 2001-10-26:
1124
1125 ** `--defines' and `--graph' have now an optional argument which is the
1126 output file name. `-d' and `-g' do not change; they do not take any
1127 argument.
1128
1129 ** `%source_extension' and `%header_extension' are removed, failed
1130 experiment.
1131
1132 ** Portability fixes.
1133 \f
1134 * Changes in version 1.29, 2001-09-07:
1135
1136 ** The output file does not define const, as this caused problems when used
1137 with common autoconfiguration schemes. If you still use ancient compilers
1138 that lack const, compile with the equivalent of the C compiler option
1139 `-Dconst='. autoconf's AC_C_CONST macro provides one way to do this.
1140
1141 ** Added `-g' and `--graph'.
1142
1143 ** The Bison manual is now distributed under the terms of the GNU FDL.
1144
1145 ** The input and the output files has automatically a similar extension.
1146
1147 ** Russian translation added.
1148
1149 ** NLS support updated; should hopefully be less troublesome.
1150
1151 ** Added the old Bison reference card.
1152
1153 ** Added `--locations' and `%locations'.
1154
1155 ** Added `-S' and `--skeleton'.
1156
1157 ** `%raw', `-r', `--raw' is disabled.
1158
1159 ** Special characters are escaped when output. This solves the problems
1160 of the #line lines with path names including backslashes.
1161
1162 ** New directives.
1163 `%yacc', `%fixed_output_files', `%defines', `%no_parser', `%verbose',
1164 `%debug', `%source_extension' and `%header_extension'.
1165
1166 ** @$
1167 Automatic location tracking.
1168 \f
1169 * Changes in version 1.28, 1999-07-06:
1170
1171 ** Should compile better now with K&R compilers.
1172
1173 ** Added NLS.
1174
1175 ** Fixed a problem with escaping the double quote character.
1176
1177 ** There is now a FAQ.
1178 \f
1179 * Changes in version 1.27:
1180
1181 ** The make rule which prevented bison.simple from being created on
1182 some systems has been fixed.
1183 \f
1184 * Changes in version 1.26:
1185
1186 ** Bison now uses automake.
1187
1188 ** New mailing lists: <bug-bison@gnu.org> and <help-bison@gnu.org>.
1189
1190 ** Token numbers now start at 257 as previously documented, not 258.
1191
1192 ** Bison honors the TMPDIR environment variable.
1193
1194 ** A couple of buffer overruns have been fixed.
1195
1196 ** Problems when closing files should now be reported.
1197
1198 ** Generated parsers should now work even on operating systems which do
1199 not provide alloca().
1200 \f
1201 * Changes in version 1.25, 1995-10-16:
1202
1203 ** Errors in the input grammar are not fatal; Bison keeps reading
1204 the grammar file, and reports all the errors found in it.
1205
1206 ** Tokens can now be specified as multiple-character strings: for
1207 example, you could use "<=" for a token which looks like <=, instead
1208 of chosing a name like LESSEQ.
1209
1210 ** The %token_table declaration says to write a table of tokens (names
1211 and numbers) into the parser file. The yylex function can use this
1212 table to recognize multiple-character string tokens, or for other
1213 purposes.
1214
1215 ** The %no_lines declaration says not to generate any #line preprocessor
1216 directives in the parser file.
1217
1218 ** The %raw declaration says to use internal Bison token numbers, not
1219 Yacc-compatible token numbers, when token names are defined as macros.
1220
1221 ** The --no-parser option produces the parser tables without including
1222 the parser engine; a project can now use its own parser engine.
1223 The actions go into a separate file called NAME.act, in the form of
1224 a switch statement body.
1225 \f
1226 * Changes in version 1.23:
1227
1228 The user can define YYPARSE_PARAM as the name of an argument to be
1229 passed into yyparse. The argument should have type void *. It should
1230 actually point to an object. Grammar actions can access the variable
1231 by casting it to the proper pointer type.
1232
1233 Line numbers in output file corrected.
1234 \f
1235 * Changes in version 1.22:
1236
1237 --help option added.
1238 \f
1239 * Changes in version 1.20:
1240
1241 Output file does not redefine const for C++.
1242
1243 Local Variables:
1244 mode: outline
1245 End:
1246
1247 -----
1248
1249 Copyright (C) 1995, 1996, 1997, 1998, 1999, 2000, 2001, 2002, 2003,
1250 2004, 2005, 2006, 2007, 2008, 2009 Free Software Foundation, Inc.
1251
1252 This file is part of Bison, the GNU Parser Generator.
1253
1254 This program is free software: you can redistribute it and/or modify
1255 it under the terms of the GNU General Public License as published by
1256 the Free Software Foundation, either version 3 of the License, or
1257 (at your option) any later version.
1258
1259 This program is distributed in the hope that it will be useful,
1260 but WITHOUT ANY WARRANTY; without even the implied warranty of
1261 MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. See the
1262 GNU General Public License for more details.
1263
1264 You should have received a copy of the GNU General Public License
1265 along with this program. If not, see <http://www.gnu.org/licenses/>.