]> git.saurik.com Git - bison.git/blob - NEWS
tests: cleanup.
[bison.git] / NEWS
1 Bison News
2 ----------
3
4 * Changes in version ?.? (????-??-??):
5
6 ** Additional yylex/yyparse arguments
7
8 The new directive %param declare additional argument to both yylex
9 and yyparse. The %lex-param, %parse-param, and %param directive
10 support one or more arguments. Instead of
11
12 %lex-param {arg1_type *arg1}
13 %lex-param {arg2_type *arg2}
14 %parse-param {arg1_type *arg1}
15 %parse-param {arg2_type *arg2}
16
17 one may now declare
18
19 %param {arg1_type *arg1} {arg2_type *arg2}
20
21 ** Java skeleton improvements
22
23 The constants for token names were moved to the Lexer interface.
24 Also, it is possible to add code to the parser's constructors using
25 "%code init" and "%define init_throws".
26
27 ** Variable api.tokens.prefix
28
29 The variable api.tokens.prefix changes the way tokens are identified in
30 the generated files. This is especially useful to avoid collisions
31 with identifiers in the target language. For instance
32
33 %token FILE for ERROR
34 %define api.tokens.prefix "TOK_"
35 %%
36 start: FILE for ERROR;
37
38 will generate the definition of the symbols TOK_FILE, TOK_for, and
39 TOK_ERROR in the generated sources. In particular, the scanner must
40 use these prefixed token names, although the grammar itself still
41 uses the short names (as in the sample rule given above).
42
43 ** Variable api.namespace
44
45 The "namespace" variable is renamed "api.namespace". Backward
46 compatibility is ensured, but upgrading is recommended.
47
48 ** Variable parse.error
49
50 The variable error controls the verbosity of error messages. The
51 use of the %error-verbose directive is deprecated in favor of
52 %define parse.error "verbose".
53
54 * Changes in version 2.5 (????-??-??):
55
56 ** Named References Support
57
58 Historically, Yacc and Bison have supported positional references
59 ($n, $$) to allow access to symbol values from inside of semantic
60 actions code.
61
62 Starting from this version, Bison can also accept named references.
63 When no ambiguity is possible, original symbol names may be used
64 as named references:
65
66 if_stmt : 'if' cond_expr 'then' then_stmt ';'
67 { $if_stmt = mk_if_stmt($cond_expr, $then_stmt); }
68
69 In the more common case, explicit names may be declared:
70
71 stmt[res] : 'if' expr[cond] 'then' stmt[then] 'else' stmt[else] ';'
72 { $res = mk_if_stmt($cond, $then, $else); }
73
74 Location information is also accessible using @name syntax. When
75 accessing symbol names containing dots or dashes, explicit bracketing
76 ($[sym.1]) must be used.
77
78 These features are experimental in this version. More user feedback
79 will help to stabilize them.
80
81 ** IELR(1) and Canonical LR(1) Support
82
83 IELR(1) is a minimal LR(1) parser table generation algorithm. That
84 is, given any context-free grammar, IELR(1) generates parser tables
85 with the full language recognition power of canonical LR(1) but with
86 nearly the same number of parser states as LALR(1). This reduction in
87 parser states is often an order of magnitude. More importantly,
88 because canonical LR(1)'s extra parser states may contain duplicate
89 conflicts in the case of non-LR(1) grammars, the number of conflicts
90 for IELR(1) is often an order of magnitude less as well. This can
91 significantly reduce the complexity of developing of a grammar.
92
93 Bison can now generate IELR(1) and canonical LR(1) parser tables in
94 place of its traditional LALR(1) parser tables, which remain the
95 default. You can specify the type of parser tables in the grammar
96 file with these directives:
97
98 %define lr.type lalr
99 %define lr.type ielr
100 %define lr.type canonical-lr
101
102 The default reduction optimization in the parser tables can also be
103 adjusted using `%define lr.default-reductions'. See the documentation
104 for `%define lr.type' and `%define lr.default-reductions' in the
105 section `Bison Declaration Summary' in the Bison manual for the
106 details.
107
108 These features are experimental. More user feedback will help to
109 stabilize them.
110
111 ** Unrecognized %code qualifiers are now an error not a warning.
112
113 ** %define improvements.
114
115 *** Unrecognized variables are now an error not a warning.
116
117 *** Multiple invocations for any variable is now an error not a warning.
118
119 *** Can now be invoked via the command line.
120
121 Each of these command-line options
122
123 -D NAME[=VALUE]
124 --define=NAME[=VALUE]
125
126 -F NAME[=VALUE]
127 --force-define=NAME[=VALUE]
128
129 is equivalent to this grammar file declaration
130
131 %define NAME ["VALUE"]
132
133 except that the manner in which Bison processes multiple definitions
134 for the same NAME differs. Most importantly, -F and --force-define
135 quietly override %define, but -D and --define do not. For further
136 details, see the section "Bison Options" in the Bison manual.
137
138 *** Variables renamed.
139
140 The following %define variables
141
142 api.push_pull
143 lr.keep_unreachable_states
144
145 have been renamed to
146
147 api.push-pull
148 lr.keep-unreachable-states
149
150 The old names are now deprecated but will be maintained indefinitely
151 for backward compatibility.
152
153 *** Values no longer need to be quoted in grammar file.
154
155 If a %define value is an identifier, it no longer needs to be placed
156 within quotations marks. For example,
157
158 %define api.push-pull "push"
159
160 can be rewritten as
161
162 %define api.push-pull push
163
164 ** Symbol names.
165
166 Consistently with directives (such as %error-verbose) and variables
167 (e.g. push-pull), symbol names may include dashes in any position,
168 similarly to periods and underscores. This is GNU extension over
169 POSIX Yacc whose use is reported by -Wyacc, and rejected in Yacc
170 mode (--yacc).
171
172 ** Temporary hack for adding a semicolon to the user action.
173
174 Previously, Bison appended a semicolon to every user action for
175 reductions when the output language defaulted to C (specifically, when
176 neither %yacc, %language, %skeleton, or equivalent command-line
177 options were specified). This allowed actions such as
178
179 exp: exp "+" exp { $$ = $1 + $3 };
180
181 instead of
182
183 exp: exp "+" exp { $$ = $1 + $3; };
184
185 As a first step in removing this misfeature, Bison now issues a
186 warning when it appends a semicolon. Moreover, in cases where Bison
187 cannot easily determine whether a semicolon is needed (for example, an
188 action ending with a cpp directive or a braced compound initializer),
189 it no longer appends one. Thus, the C compiler might now complain
190 about a missing semicolon where it did not before. Future releases of
191 Bison will cease to append semicolons entirely.
192
193 ** Character literals not of length one.
194
195 Previously, Bison quietly converted all character literals to length
196 one. For example, without warning, Bison interpreted the operators in
197 the following grammar to be the same token:
198
199 exp: exp '++'
200 | exp '+' exp
201 ;
202
203 Bison now warns when a character literal is not of length one. In
204 some future release, Bison will report an error instead.
205
206 ** Verbose error messages fixed for nonassociative tokens.
207
208 When %error-verbose is specified, syntax error messages produced by
209 the generated parser include the unexpected token as well as a list of
210 expected tokens. Previously, this list erroneously included tokens
211 that would actually induce a syntax error because conflicts for them
212 were resolved with %nonassoc. Such tokens are now properly omitted
213 from the list.
214
215 * Changes in version 2.4.2 (????-??-??):
216
217 ** Detection of GNU M4 1.4.6 or newer during configure is improved.
218
219 ** Warnings from gcc's -Wundef option about undefined YYENABLE_NLS,
220 YYLTYPE_IS_TRIVIAL, and __STRICT_ANSI__ in C/C++ parsers are now
221 avoided.
222
223 ** %code is now a permanent feature.
224
225 A traditional Yacc prologue directive is written in the form:
226
227 %{CODE%}
228
229 To provide a more flexible alternative, Bison 2.3b introduced the
230 %code directive with the following forms for C/C++:
231
232 %code {CODE}
233 %code requires {CODE}
234 %code provides {CODE}
235 %code top {CODE}
236
237 These forms are now considered permanent features of Bison. See the
238 %code entries in the section "Bison Declaration Summary" in the Bison
239 manual for a summary of their functionality. See the section
240 "Prologue Alternatives" for a detailed discussion including the
241 advantages of %code over the traditional Yacc prologue directive.
242
243 Bison's Java feature as a whole including its current usage of %code
244 is still considered experimental.
245
246 ** Internationalization.
247
248 Fix a regression introduced in Bison 2.4: Under some circumstances,
249 message translations were not installed although supported by the
250 host system.
251
252 * Changes in version 2.4.1 (2008-12-11):
253
254 ** In the GLR defines file, unexpanded M4 macros in the yylval and yylloc
255 declarations have been fixed.
256
257 ** Temporary hack for adding a semicolon to the user action.
258
259 Bison used to prepend a trailing semicolon at the end of the user
260 action for reductions. This allowed actions such as
261
262 exp: exp "+" exp { $$ = $1 + $3 };
263
264 instead of
265
266 exp: exp "+" exp { $$ = $1 + $3; };
267
268 Some grammars still depend on this `feature'. Bison 2.4.1 restores
269 the previous behavior in the case of C output (specifically, when
270 neither %language or %skeleton or equivalent command-line options
271 are used) to leave more time for grammars depending on the old
272 behavior to be adjusted. Future releases of Bison will disable this
273 feature.
274
275 ** A few minor improvements to the Bison manual.
276
277 * Changes in version 2.4 (2008-11-02):
278
279 ** %language is an experimental feature.
280
281 We first introduced this feature in test release 2.3b as a cleaner
282 alternative to %skeleton. Since then, we have discussed the possibility of
283 modifying its effect on Bison's output file names. Thus, in this release,
284 we consider %language to be an experimental feature that will likely evolve
285 in future releases.
286
287 ** Forward compatibility with GNU M4 has been improved.
288
289 ** Several bugs in the C++ skeleton and the experimental Java skeleton have been
290 fixed.
291
292 * Changes in version 2.3b (2008-05-27):
293
294 ** The quotes around NAME that used to be required in the following directive
295 are now deprecated:
296
297 %define NAME "VALUE"
298
299 ** The directive `%pure-parser' is now deprecated in favor of:
300
301 %define api.pure
302
303 which has the same effect except that Bison is more careful to warn about
304 unreasonable usage in the latter case.
305
306 ** Push Parsing
307
308 Bison can now generate an LALR(1) parser in C with a push interface. That
309 is, instead of invoking `yyparse', which pulls tokens from `yylex', you can
310 push one token at a time to the parser using `yypush_parse', which will
311 return to the caller after processing each token. By default, the push
312 interface is disabled. Either of the following directives will enable it:
313
314 %define api.push_pull "push" // Just push; does not require yylex.
315 %define api.push_pull "both" // Push and pull; requires yylex.
316
317 See the new section `A Push Parser' in the Bison manual for details.
318
319 The current push parsing interface is experimental and may evolve. More user
320 feedback will help to stabilize it.
321
322 ** The -g and --graph options now output graphs in Graphviz DOT format,
323 not VCG format. Like --graph, -g now also takes an optional FILE argument
324 and thus cannot be bundled with other short options.
325
326 ** Java
327
328 Bison can now generate an LALR(1) parser in Java. The skeleton is
329 `data/lalr1.java'. Consider using the new %language directive instead of
330 %skeleton to select it.
331
332 See the new section `Java Parsers' in the Bison manual for details.
333
334 The current Java interface is experimental and may evolve. More user
335 feedback will help to stabilize it.
336
337 ** %language
338
339 This new directive specifies the programming language of the generated
340 parser, which can be C (the default), C++, or Java. Besides the skeleton
341 that Bison uses, the directive affects the names of the generated files if
342 the grammar file's name ends in ".y".
343
344 ** XML Automaton Report
345
346 Bison can now generate an XML report of the LALR(1) automaton using the new
347 `--xml' option. The current XML schema is experimental and may evolve. More
348 user feedback will help to stabilize it.
349
350 ** The grammar file may now specify the name of the parser header file using
351 %defines. For example:
352
353 %defines "parser.h"
354
355 ** When reporting useless rules, useless nonterminals, and unused terminals,
356 Bison now employs the terms "useless in grammar" instead of "useless",
357 "useless in parser" instead of "never reduced", and "unused in grammar"
358 instead of "unused".
359
360 ** Unreachable State Removal
361
362 Previously, Bison sometimes generated parser tables containing unreachable
363 states. A state can become unreachable during conflict resolution if Bison
364 disables a shift action leading to it from a predecessor state. Bison now:
365
366 1. Removes unreachable states.
367
368 2. Does not report any conflicts that appeared in unreachable states.
369 WARNING: As a result, you may need to update %expect and %expect-rr
370 directives in existing grammar files.
371
372 3. For any rule used only in such states, Bison now reports the rule as
373 "useless in parser due to conflicts".
374
375 This feature can be disabled with the following directive:
376
377 %define lr.keep_unreachable_states
378
379 See the %define entry in the `Bison Declaration Summary' in the Bison manual
380 for further discussion.
381
382 ** Lookahead Set Correction in the `.output' Report
383
384 When instructed to generate a `.output' file including lookahead sets
385 (using `--report=lookahead', for example), Bison now prints each reduction's
386 lookahead set only next to the associated state's one item that (1) is
387 associated with the same rule as the reduction and (2) has its dot at the end
388 of its RHS. Previously, Bison also erroneously printed the lookahead set
389 next to all of the state's other items associated with the same rule. This
390 bug affected only the `.output' file and not the generated parser source
391 code.
392
393 ** --report-file=FILE is a new option to override the default `.output' file
394 name.
395
396 ** The `=' that used to be required in the following directives is now
397 deprecated:
398
399 %file-prefix "parser"
400 %name-prefix "c_"
401 %output "parser.c"
402
403 ** An Alternative to `%{...%}' -- `%code QUALIFIER {CODE}'
404
405 Bison 2.3a provided a new set of directives as a more flexible alternative to
406 the traditional Yacc prologue blocks. Those have now been consolidated into
407 a single %code directive with an optional qualifier field, which identifies
408 the purpose of the code and thus the location(s) where Bison should generate
409 it:
410
411 1. `%code {CODE}' replaces `%after-header {CODE}'
412 2. `%code requires {CODE}' replaces `%start-header {CODE}'
413 3. `%code provides {CODE}' replaces `%end-header {CODE}'
414 4. `%code top {CODE}' replaces `%before-header {CODE}'
415
416 See the %code entries in section `Bison Declaration Summary' in the Bison
417 manual for a summary of the new functionality. See the new section `Prologue
418 Alternatives' for a detailed discussion including the advantages of %code
419 over the traditional Yacc prologues.
420
421 The prologue alternatives are experimental. More user feedback will help to
422 determine whether they should become permanent features.
423
424 ** Revised warning: unset or unused mid-rule values
425
426 Since Bison 2.2, Bison has warned about mid-rule values that are set but not
427 used within any of the actions of the parent rule. For example, Bison warns
428 about unused $2 in:
429
430 exp: '1' { $$ = 1; } '+' exp { $$ = $1 + $4; };
431
432 Now, Bison also warns about mid-rule values that are used but not set. For
433 example, Bison warns about unset $$ in the mid-rule action in:
434
435 exp: '1' { $1 = 1; } '+' exp { $$ = $2 + $4; };
436
437 However, Bison now disables both of these warnings by default since they
438 sometimes prove to be false alarms in existing grammars employing the Yacc
439 constructs $0 or $-N (where N is some positive integer).
440
441 To enable these warnings, specify the option `--warnings=midrule-values' or
442 `-W', which is a synonym for `--warnings=all'.
443
444 ** Default %destructor or %printer with `<*>' or `<>'
445
446 Bison now recognizes two separate kinds of default %destructor's and
447 %printer's:
448
449 1. Place `<*>' in a %destructor/%printer symbol list to define a default
450 %destructor/%printer for all grammar symbols for which you have formally
451 declared semantic type tags.
452
453 2. Place `<>' in a %destructor/%printer symbol list to define a default
454 %destructor/%printer for all grammar symbols without declared semantic
455 type tags.
456
457 Bison no longer supports the `%symbol-default' notation from Bison 2.3a.
458 `<*>' and `<>' combined achieve the same effect with one exception: Bison no
459 longer applies any %destructor to a mid-rule value if that mid-rule value is
460 not actually ever referenced using either $$ or $n in a semantic action.
461
462 The default %destructor's and %printer's are experimental. More user
463 feedback will help to determine whether they should become permanent
464 features.
465
466 See the section `Freeing Discarded Symbols' in the Bison manual for further
467 details.
468
469 ** %left, %right, and %nonassoc can now declare token numbers. This is required
470 by POSIX. However, see the end of section `Operator Precedence' in the Bison
471 manual for a caveat concerning the treatment of literal strings.
472
473 ** The nonfunctional --no-parser, -n, and %no-parser options have been
474 completely removed from Bison.
475
476 * Changes in version 2.3a, 2006-09-13:
477
478 ** Instead of %union, you can define and use your own union type
479 YYSTYPE if your grammar contains at least one <type> tag.
480 Your YYSTYPE need not be a macro; it can be a typedef.
481 This change is for compatibility with other Yacc implementations,
482 and is required by POSIX.
483
484 ** Locations columns and lines start at 1.
485 In accordance with the GNU Coding Standards and Emacs.
486
487 ** You may now declare per-type and default %destructor's and %printer's:
488
489 For example:
490
491 %union { char *string; }
492 %token <string> STRING1
493 %token <string> STRING2
494 %type <string> string1
495 %type <string> string2
496 %union { char character; }
497 %token <character> CHR
498 %type <character> chr
499 %destructor { free ($$); } %symbol-default
500 %destructor { free ($$); printf ("%d", @$.first_line); } STRING1 string1
501 %destructor { } <character>
502
503 guarantees that, when the parser discards any user-defined symbol that has a
504 semantic type tag other than `<character>', it passes its semantic value to
505 `free'. However, when the parser discards a `STRING1' or a `string1', it
506 also prints its line number to `stdout'. It performs only the second
507 `%destructor' in this case, so it invokes `free' only once.
508
509 [Although we failed to mention this here in the 2.3a release, the default
510 %destructor's and %printer's were experimental, and they were rewritten in
511 future versions.]
512
513 ** Except for LALR(1) parsers in C with POSIX Yacc emulation enabled (with `-y',
514 `--yacc', or `%yacc'), Bison no longer generates #define statements for
515 associating token numbers with token names. Removing the #define statements
516 helps to sanitize the global namespace during preprocessing, but POSIX Yacc
517 requires them. Bison still generates an enum for token names in all cases.
518
519 ** Handling of traditional Yacc prologue blocks is now more consistent but
520 potentially incompatible with previous releases of Bison.
521
522 As before, you declare prologue blocks in your grammar file with the
523 `%{ ... %}' syntax. To generate the pre-prologue, Bison concatenates all
524 prologue blocks that you've declared before the first %union. To generate
525 the post-prologue, Bison concatenates all prologue blocks that you've
526 declared after the first %union.
527
528 Previous releases of Bison inserted the pre-prologue into both the header
529 file and the code file in all cases except for LALR(1) parsers in C. In the
530 latter case, Bison inserted it only into the code file. For parsers in C++,
531 the point of insertion was before any token definitions (which associate
532 token numbers with names). For parsers in C, the point of insertion was
533 after the token definitions.
534
535 Now, Bison never inserts the pre-prologue into the header file. In the code
536 file, it always inserts it before the token definitions.
537
538 ** Bison now provides a more flexible alternative to the traditional Yacc
539 prologue blocks: %before-header, %start-header, %end-header, and
540 %after-header.
541
542 For example, the following declaration order in the grammar file reflects the
543 order in which Bison will output these code blocks. However, you are free to
544 declare these code blocks in your grammar file in whatever order is most
545 convenient for you:
546
547 %before-header {
548 /* Bison treats this block like a pre-prologue block: it inserts it into
549 * the code file before the contents of the header file. It does *not*
550 * insert it into the header file. This is a good place to put
551 * #include's that you want at the top of your code file. A common
552 * example is `#include "system.h"'. */
553 }
554 %start-header {
555 /* Bison inserts this block into both the header file and the code file.
556 * In both files, the point of insertion is before any Bison-generated
557 * token, semantic type, location type, and class definitions. This is a
558 * good place to define %union dependencies, for example. */
559 }
560 %union {
561 /* Unlike the traditional Yacc prologue blocks, the output order for the
562 * new %*-header blocks is not affected by their declaration position
563 * relative to any %union in the grammar file. */
564 }
565 %end-header {
566 /* Bison inserts this block into both the header file and the code file.
567 * In both files, the point of insertion is after the Bison-generated
568 * definitions. This is a good place to declare or define public
569 * functions or data structures that depend on the Bison-generated
570 * definitions. */
571 }
572 %after-header {
573 /* Bison treats this block like a post-prologue block: it inserts it into
574 * the code file after the contents of the header file. It does *not*
575 * insert it into the header file. This is a good place to declare or
576 * define internal functions or data structures that depend on the
577 * Bison-generated definitions. */
578 }
579
580 If you have multiple occurrences of any one of the above declarations, Bison
581 will concatenate the contents in declaration order.
582
583 [Although we failed to mention this here in the 2.3a release, the prologue
584 alternatives were experimental, and they were rewritten in future versions.]
585
586 ** The option `--report=look-ahead' has been changed to `--report=lookahead'.
587 The old spelling still works, but is not documented and may be removed
588 in a future release.
589
590 * Changes in version 2.3, 2006-06-05:
591
592 ** GLR grammars should now use `YYRECOVERING ()' instead of `YYRECOVERING',
593 for compatibility with LALR(1) grammars.
594
595 ** It is now documented that any definition of YYSTYPE or YYLTYPE should
596 be to a type name that does not contain parentheses or brackets.
597
598 * Changes in version 2.2, 2006-05-19:
599
600 ** The distribution terms for all Bison-generated parsers now permit
601 using the parsers in nonfree programs. Previously, this permission
602 was granted only for Bison-generated LALR(1) parsers in C.
603
604 ** %name-prefix changes the namespace name in C++ outputs.
605
606 ** The C++ parsers export their token_type.
607
608 ** Bison now allows multiple %union declarations, and concatenates
609 their contents together.
610
611 ** New warning: unused values
612 Right-hand side symbols whose values are not used are reported,
613 if the symbols have destructors. For instance:
614
615 exp: exp "?" exp ":" exp { $1 ? $1 : $3; }
616 | exp "+" exp
617 ;
618
619 will trigger a warning about $$ and $5 in the first rule, and $3 in
620 the second ($1 is copied to $$ by the default rule). This example
621 most likely contains three errors, and could be rewritten as:
622
623 exp: exp "?" exp ":" exp
624 { $$ = $1 ? $3 : $5; free ($1 ? $5 : $3); free ($1); }
625 | exp "+" exp
626 { $$ = $1 ? $1 : $3; if ($1) free ($3); }
627 ;
628
629 However, if the original actions were really intended, memory leaks
630 and all, the warnings can be suppressed by letting Bison believe the
631 values are used, e.g.:
632
633 exp: exp "?" exp ":" exp { $1 ? $1 : $3; (void) ($$, $5); }
634 | exp "+" exp { $$ = $1; (void) $3; }
635 ;
636
637 If there are mid-rule actions, the warning is issued if no action
638 uses it. The following triggers no warning: $1 and $3 are used.
639
640 exp: exp { push ($1); } '+' exp { push ($3); sum (); };
641
642 The warning is intended to help catching lost values and memory leaks.
643 If a value is ignored, its associated memory typically is not reclaimed.
644
645 ** %destructor vs. YYABORT, YYACCEPT, and YYERROR.
646 Destructors are now called when user code invokes YYABORT, YYACCEPT,
647 and YYERROR, for all objects on the stack, other than objects
648 corresponding to the right-hand side of the current rule.
649
650 ** %expect, %expect-rr
651 Incorrect numbers of expected conflicts are now actual errors,
652 instead of warnings.
653
654 ** GLR, YACC parsers.
655 The %parse-params are available in the destructors (and the
656 experimental printers) as per the documentation.
657
658 ** Bison now warns if it finds a stray `$' or `@' in an action.
659
660 ** %require "VERSION"
661 This specifies that the grammar file depends on features implemented
662 in Bison version VERSION or higher.
663
664 ** lalr1.cc: The token and value types are now class members.
665 The tokens were defined as free form enums and cpp macros. YYSTYPE
666 was defined as a free form union. They are now class members:
667 tokens are enumerations of the `yy::parser::token' struct, and the
668 semantic values have the `yy::parser::semantic_type' type.
669
670 If you do not want or can update to this scheme, the directive
671 `%define "global_tokens_and_yystype" "1"' triggers the global
672 definition of tokens and YYSTYPE. This change is suitable both
673 for previous releases of Bison, and this one.
674
675 If you wish to update, then make sure older version of Bison will
676 fail using `%require "2.2"'.
677
678 ** DJGPP support added.
679 \f
680 * Changes in version 2.1, 2005-09-16:
681
682 ** The C++ lalr1.cc skeleton supports %lex-param.
683
684 ** Bison-generated parsers now support the translation of diagnostics like
685 "syntax error" into languages other than English. The default
686 language is still English. For details, please see the new
687 Internationalization section of the Bison manual. Software
688 distributors should also see the new PACKAGING file. Thanks to
689 Bruno Haible for this new feature.
690
691 ** Wording in the Bison-generated parsers has been changed slightly to
692 simplify translation. In particular, the message "memory exhausted"
693 has replaced "parser stack overflow", as the old message was not
694 always accurate for modern Bison-generated parsers.
695
696 ** Destructors are now called when the parser aborts, for all symbols left
697 behind on the stack. Also, the start symbol is now destroyed after a
698 successful parse. In both cases, the behavior was formerly inconsistent.
699
700 ** When generating verbose diagnostics, Bison-generated parsers no longer
701 quote the literal strings associated with tokens. For example, for
702 a syntax error associated with '%token NUM "number"' they might
703 print 'syntax error, unexpected number' instead of 'syntax error,
704 unexpected "number"'.
705 \f
706 * Changes in version 2.0, 2004-12-25:
707
708 ** Possibly-incompatible changes
709
710 - Bison-generated parsers no longer default to using the alloca function
711 (when available) to extend the parser stack, due to widespread
712 problems in unchecked stack-overflow detection. You can "#define
713 YYSTACK_USE_ALLOCA 1" to require the use of alloca, but please read
714 the manual to determine safe values for YYMAXDEPTH in that case.
715
716 - Error token location.
717 During error recovery, the location of the syntax error is updated
718 to cover the whole sequence covered by the error token: it includes
719 the shifted symbols thrown away during the first part of the error
720 recovery, and the lookahead rejected during the second part.
721
722 - Semicolon changes:
723 . Stray semicolons are no longer allowed at the start of a grammar.
724 . Semicolons are now required after in-grammar declarations.
725
726 - Unescaped newlines are no longer allowed in character constants or
727 string literals. They were never portable, and GCC 3.4.0 has
728 dropped support for them. Better diagnostics are now generated if
729 forget a closing quote.
730
731 - NUL bytes are no longer allowed in Bison string literals, unfortunately.
732
733 ** New features
734
735 - GLR grammars now support locations.
736
737 - New directive: %initial-action.
738 This directive allows the user to run arbitrary code (including
739 initializing @$) from yyparse before parsing starts.
740
741 - A new directive "%expect-rr N" specifies the expected number of
742 reduce/reduce conflicts in GLR parsers.
743
744 - %token numbers can now be hexadecimal integers, e.g., `%token FOO 0x12d'.
745 This is a GNU extension.
746
747 - The option `--report=lookahead' was changed to `--report=look-ahead'.
748 [However, this was changed back after 2.3.]
749
750 - Experimental %destructor support has been added to lalr1.cc.
751
752 - New configure option --disable-yacc, to disable installation of the
753 yacc command and -ly library introduced in 1.875 for POSIX conformance.
754
755 ** Bug fixes
756
757 - For now, %expect-count violations are now just warnings, not errors.
758 This is for compatibility with Bison 1.75 and earlier (when there are
759 reduce/reduce conflicts) and with Bison 1.30 and earlier (when there
760 are too many or too few shift/reduce conflicts). However, in future
761 versions of Bison we plan to improve the %expect machinery so that
762 these violations will become errors again.
763
764 - Within Bison itself, numbers (e.g., goto numbers) are no longer
765 arbitrarily limited to 16-bit counts.
766
767 - Semicolons are now allowed before "|" in grammar rules, as POSIX requires.
768 \f
769 * Changes in version 1.875, 2003-01-01:
770
771 ** The documentation license has been upgraded to version 1.2
772 of the GNU Free Documentation License.
773
774 ** syntax error processing
775
776 - In Yacc-style parsers YYLLOC_DEFAULT is now used to compute error
777 locations too. This fixes bugs in error-location computation.
778
779 - %destructor
780 It is now possible to reclaim the memory associated to symbols
781 discarded during error recovery. This feature is still experimental.
782
783 - %error-verbose
784 This new directive is preferred over YYERROR_VERBOSE.
785
786 - #defining yyerror to steal internal variables is discouraged.
787 It is not guaranteed to work forever.
788
789 ** POSIX conformance
790
791 - Semicolons are once again optional at the end of grammar rules.
792 This reverts to the behavior of Bison 1.33 and earlier, and improves
793 compatibility with Yacc.
794
795 - `parse error' -> `syntax error'
796 Bison now uniformly uses the term `syntax error'; formerly, the code
797 and manual sometimes used the term `parse error' instead. POSIX
798 requires `syntax error' in diagnostics, and it was thought better to
799 be consistent.
800
801 - The documentation now emphasizes that yylex and yyerror must be
802 declared before use. C99 requires this.
803
804 - Bison now parses C99 lexical constructs like UCNs and
805 backslash-newline within C escape sequences, as POSIX 1003.1-2001 requires.
806
807 - File names are properly escaped in C output. E.g., foo\bar.y is
808 output as "foo\\bar.y".
809
810 - Yacc command and library now available
811 The Bison distribution now installs a `yacc' command, as POSIX requires.
812 Also, Bison now installs a small library liby.a containing
813 implementations of Yacc-compatible yyerror and main functions.
814 This library is normally not useful, but POSIX requires it.
815
816 - Type clashes now generate warnings, not errors.
817
818 - If the user does not define YYSTYPE as a macro, Bison now declares it
819 using typedef instead of defining it as a macro.
820 For consistency, YYLTYPE is also declared instead of defined.
821
822 ** Other compatibility issues
823
824 - %union directives can now have a tag before the `{', e.g., the
825 directive `%union foo {...}' now generates the C code
826 `typedef union foo { ... } YYSTYPE;'; this is for Yacc compatibility.
827 The default union tag is `YYSTYPE', for compatibility with Solaris 9 Yacc.
828 For consistency, YYLTYPE's struct tag is now `YYLTYPE' not `yyltype'.
829 This is for compatibility with both Yacc and Bison 1.35.
830
831 - `;' is output before the terminating `}' of an action, for
832 compatibility with Bison 1.35.
833
834 - Bison now uses a Yacc-style format for conflict reports, e.g.,
835 `conflicts: 2 shift/reduce, 1 reduce/reduce'.
836
837 - `yystype' and `yyltype' are now obsolescent macros instead of being
838 typedefs or tags; they are no longer documented and are planned to be
839 withdrawn in a future release.
840
841 ** GLR parser notes
842
843 - GLR and inline
844 Users of Bison have to decide how they handle the portability of the
845 C keyword `inline'.
846
847 - `parsing stack overflow...' -> `parser stack overflow'
848 GLR parsers now report `parser stack overflow' as per the Bison manual.
849
850 ** Bison now warns if it detects conflicting outputs to the same file,
851 e.g., it generates a warning for `bison -d -o foo.h foo.y' since
852 that command outputs both code and header to foo.h.
853
854 ** #line in output files
855 - --no-line works properly.
856
857 ** Bison can no longer be built by a K&R C compiler; it requires C89 or
858 later to be built. This change originally took place a few versions
859 ago, but nobody noticed until we recently asked someone to try
860 building Bison with a K&R C compiler.
861 \f
862 * Changes in version 1.75, 2002-10-14:
863
864 ** Bison should now work on 64-bit hosts.
865
866 ** Indonesian translation thanks to Tedi Heriyanto.
867
868 ** GLR parsers
869 Fix spurious parse errors.
870
871 ** Pure parsers
872 Some people redefine yyerror to steal yyparse' private variables.
873 Reenable this trick until an official feature replaces it.
874
875 ** Type Clashes
876 In agreement with POSIX and with other Yaccs, leaving a default
877 action is valid when $$ is untyped, and $1 typed:
878
879 untyped: ... typed;
880
881 but the converse remains an error:
882
883 typed: ... untyped;
884
885 ** Values of mid-rule actions
886 The following code:
887
888 foo: { ... } { $$ = $1; } ...
889
890 was incorrectly rejected: $1 is defined in the second mid-rule
891 action, and is equal to the $$ of the first mid-rule action.
892 \f
893 * Changes in version 1.50, 2002-10-04:
894
895 ** GLR parsing
896 The declaration
897 %glr-parser
898 causes Bison to produce a Generalized LR (GLR) parser, capable of handling
899 almost any context-free grammar, ambiguous or not. The new declarations
900 %dprec and %merge on grammar rules allow parse-time resolution of
901 ambiguities. Contributed by Paul Hilfinger.
902
903 Unfortunately Bison 1.50 does not work properly on 64-bit hosts
904 like the Alpha, so please stick to 32-bit hosts for now.
905
906 ** Output Directory
907 When not in Yacc compatibility mode, when the output file was not
908 specified, running `bison foo/bar.y' created `foo/bar.c'. It
909 now creates `bar.c'.
910
911 ** Undefined token
912 The undefined token was systematically mapped to 2 which prevented
913 the use of 2 by the user. This is no longer the case.
914
915 ** Unknown token numbers
916 If yylex returned an out of range value, yyparse could die. This is
917 no longer the case.
918
919 ** Error token
920 According to POSIX, the error token must be 256.
921 Bison extends this requirement by making it a preference: *if* the
922 user specified that one of her tokens is numbered 256, then error
923 will be mapped onto another number.
924
925 ** Verbose error messages
926 They no longer report `..., expecting error or...' for states where
927 error recovery is possible.
928
929 ** End token
930 Defaults to `$end' instead of `$'.
931
932 ** Error recovery now conforms to documentation and to POSIX
933 When a Bison-generated parser encounters a syntax error, it now pops
934 the stack until it finds a state that allows shifting the error
935 token. Formerly, it popped the stack until it found a state that
936 allowed some non-error action other than a default reduction on the
937 error token. The new behavior has long been the documented behavior,
938 and has long been required by POSIX. For more details, please see
939 Paul Eggert, "Reductions during Bison error handling" (2002-05-20)
940 <http://lists.gnu.org/archive/html/bug-bison/2002-05/msg00038.html>.
941
942 ** Traces
943 Popped tokens and nonterminals are now reported.
944
945 ** Larger grammars
946 Larger grammars are now supported (larger token numbers, larger grammar
947 size (= sum of the LHS and RHS lengths), larger LALR tables).
948 Formerly, many of these numbers ran afoul of 16-bit limits;
949 now these limits are 32 bits on most hosts.
950
951 ** Explicit initial rule
952 Bison used to play hacks with the initial rule, which the user does
953 not write. It is now explicit, and visible in the reports and
954 graphs as rule 0.
955
956 ** Useless rules
957 Before, Bison reported the useless rules, but, although not used,
958 included them in the parsers. They are now actually removed.
959
960 ** Useless rules, useless nonterminals
961 They are now reported, as a warning, with their locations.
962
963 ** Rules never reduced
964 Rules that can never be reduced because of conflicts are now
965 reported.
966
967 ** Incorrect `Token not used'
968 On a grammar such as
969
970 %token useless useful
971 %%
972 exp: '0' %prec useful;
973
974 where a token was used to set the precedence of the last rule,
975 bison reported both `useful' and `useless' as useless tokens.
976
977 ** Revert the C++ namespace changes introduced in 1.31
978 as they caused too many portability hassles.
979
980 ** Default locations
981 By an accident of design, the default computation of @$ was
982 performed after another default computation was performed: @$ = @1.
983 The latter is now removed: YYLLOC_DEFAULT is fully responsible of
984 the computation of @$.
985
986 ** Token end-of-file
987 The token end of file may be specified by the user, in which case,
988 the user symbol is used in the reports, the graphs, and the verbose
989 error messages instead of `$end', which remains being the default.
990 For instance
991 %token MYEOF 0
992 or
993 %token MYEOF 0 "end of file"
994
995 ** Semantic parser
996 This old option, which has been broken for ages, is removed.
997
998 ** New translations
999 Brazilian Portuguese, thanks to Alexandre Folle de Menezes.
1000 Croatian, thanks to Denis Lackovic.
1001
1002 ** Incorrect token definitions
1003 When given `%token 'a' "A"', Bison used to output `#define 'a' 65'.
1004
1005 ** Token definitions as enums
1006 Tokens are output both as the traditional #define's, and, provided
1007 the compiler supports ANSI C or is a C++ compiler, as enums.
1008 This lets debuggers display names instead of integers.
1009
1010 ** Reports
1011 In addition to --verbose, bison supports --report=THINGS, which
1012 produces additional information:
1013 - itemset
1014 complete the core item sets with their closure
1015 - lookahead [changed to `look-ahead' in 1.875e through 2.3, but changed back]
1016 explicitly associate lookahead tokens to items
1017 - solved
1018 describe shift/reduce conflicts solving.
1019 Bison used to systematically output this information on top of
1020 the report. Solved conflicts are now attached to their states.
1021
1022 ** Type clashes
1023 Previous versions don't complain when there is a type clash on
1024 the default action if the rule has a mid-rule action, such as in:
1025
1026 %type <foo> bar
1027 %%
1028 bar: '0' {} '0';
1029
1030 This is fixed.
1031
1032 ** GNU M4 is now required when using Bison.
1033 \f
1034 * Changes in version 1.35, 2002-03-25:
1035
1036 ** C Skeleton
1037 Some projects use Bison's C parser with C++ compilers, and define
1038 YYSTYPE as a class. The recent adjustment of C parsers for data
1039 alignment and 64 bit architectures made this impossible.
1040
1041 Because for the time being no real solution for C++ parser
1042 generation exists, kludges were implemented in the parser to
1043 maintain this use. In the future, when Bison has C++ parsers, this
1044 kludge will be disabled.
1045
1046 This kludge also addresses some C++ problems when the stack was
1047 extended.
1048 \f
1049 * Changes in version 1.34, 2002-03-12:
1050
1051 ** File name clashes are detected
1052 $ bison foo.y -d -o foo.x
1053 fatal error: header and parser would both be named `foo.x'
1054
1055 ** A missing `;' at the end of a rule triggers a warning
1056 In accordance with POSIX, and in agreement with other
1057 Yacc implementations, Bison will mandate this semicolon in the near
1058 future. This eases the implementation of a Bison parser of Bison
1059 grammars by making this grammar LALR(1) instead of LR(2). To
1060 facilitate the transition, this release introduces a warning.
1061
1062 ** Revert the C++ namespace changes introduced in 1.31, as they caused too
1063 many portability hassles.
1064
1065 ** DJGPP support added.
1066
1067 ** Fix test suite portability problems.
1068 \f
1069 * Changes in version 1.33, 2002-02-07:
1070
1071 ** Fix C++ issues
1072 Groff could not be compiled for the definition of size_t was lacking
1073 under some conditions.
1074
1075 ** Catch invalid @n
1076 As is done with $n.
1077 \f
1078 * Changes in version 1.32, 2002-01-23:
1079
1080 ** Fix Yacc output file names
1081
1082 ** Portability fixes
1083
1084 ** Italian, Dutch translations
1085 \f
1086 * Changes in version 1.31, 2002-01-14:
1087
1088 ** Many Bug Fixes
1089
1090 ** GNU Gettext and %expect
1091 GNU Gettext asserts 10 s/r conflicts, but there are 7. Now that
1092 Bison dies on incorrect %expectations, we fear there will be
1093 too many bug reports for Gettext, so _for the time being_, %expect
1094 does not trigger an error when the input file is named `plural.y'.
1095
1096 ** Use of alloca in parsers
1097 If YYSTACK_USE_ALLOCA is defined to 0, then the parsers will use
1098 malloc exclusively. Since 1.29, but was not NEWS'ed.
1099
1100 alloca is used only when compiled with GCC, to avoid portability
1101 problems as on AIX.
1102
1103 ** yyparse now returns 2 if memory is exhausted; formerly it dumped core.
1104
1105 ** When the generated parser lacks debugging code, YYDEBUG is now 0
1106 (as POSIX requires) instead of being undefined.
1107
1108 ** User Actions
1109 Bison has always permitted actions such as { $$ = $1 }: it adds the
1110 ending semicolon. Now if in Yacc compatibility mode, the semicolon
1111 is no longer output: one has to write { $$ = $1; }.
1112
1113 ** Better C++ compliance
1114 The output parsers try to respect C++ namespaces.
1115 [This turned out to be a failed experiment, and it was reverted later.]
1116
1117 ** Reduced Grammars
1118 Fixed bugs when reporting useless nonterminals.
1119
1120 ** 64 bit hosts
1121 The parsers work properly on 64 bit hosts.
1122
1123 ** Error messages
1124 Some calls to strerror resulted in scrambled or missing error messages.
1125
1126 ** %expect
1127 When the number of shift/reduce conflicts is correct, don't issue
1128 any warning.
1129
1130 ** The verbose report includes the rule line numbers.
1131
1132 ** Rule line numbers are fixed in traces.
1133
1134 ** Swedish translation
1135
1136 ** Parse errors
1137 Verbose parse error messages from the parsers are better looking.
1138 Before: parse error: unexpected `'/'', expecting `"number"' or `'-'' or `'(''
1139 Now: parse error: unexpected '/', expecting "number" or '-' or '('
1140
1141 ** Fixed parser memory leaks.
1142 When the generated parser was using malloc to extend its stacks, the
1143 previous allocations were not freed.
1144
1145 ** Fixed verbose output file.
1146 Some newlines were missing.
1147 Some conflicts in state descriptions were missing.
1148
1149 ** Fixed conflict report.
1150 Option -v was needed to get the result.
1151
1152 ** %expect
1153 Was not used.
1154 Mismatches are errors, not warnings.
1155
1156 ** Fixed incorrect processing of some invalid input.
1157
1158 ** Fixed CPP guards: 9foo.h uses BISON_9FOO_H instead of 9FOO_H.
1159
1160 ** Fixed some typos in the documentation.
1161
1162 ** %token MY_EOF 0 is supported.
1163 Before, MY_EOF was silently renumbered as 257.
1164
1165 ** doc/refcard.tex is updated.
1166
1167 ** %output, %file-prefix, %name-prefix.
1168 New.
1169
1170 ** --output
1171 New, aliasing `--output-file'.
1172 \f
1173 * Changes in version 1.30, 2001-10-26:
1174
1175 ** `--defines' and `--graph' have now an optional argument which is the
1176 output file name. `-d' and `-g' do not change; they do not take any
1177 argument.
1178
1179 ** `%source_extension' and `%header_extension' are removed, failed
1180 experiment.
1181
1182 ** Portability fixes.
1183 \f
1184 * Changes in version 1.29, 2001-09-07:
1185
1186 ** The output file does not define const, as this caused problems when used
1187 with common autoconfiguration schemes. If you still use ancient compilers
1188 that lack const, compile with the equivalent of the C compiler option
1189 `-Dconst='. autoconf's AC_C_CONST macro provides one way to do this.
1190
1191 ** Added `-g' and `--graph'.
1192
1193 ** The Bison manual is now distributed under the terms of the GNU FDL.
1194
1195 ** The input and the output files has automatically a similar extension.
1196
1197 ** Russian translation added.
1198
1199 ** NLS support updated; should hopefully be less troublesome.
1200
1201 ** Added the old Bison reference card.
1202
1203 ** Added `--locations' and `%locations'.
1204
1205 ** Added `-S' and `--skeleton'.
1206
1207 ** `%raw', `-r', `--raw' is disabled.
1208
1209 ** Special characters are escaped when output. This solves the problems
1210 of the #line lines with path names including backslashes.
1211
1212 ** New directives.
1213 `%yacc', `%fixed_output_files', `%defines', `%no_parser', `%verbose',
1214 `%debug', `%source_extension' and `%header_extension'.
1215
1216 ** @$
1217 Automatic location tracking.
1218 \f
1219 * Changes in version 1.28, 1999-07-06:
1220
1221 ** Should compile better now with K&R compilers.
1222
1223 ** Added NLS.
1224
1225 ** Fixed a problem with escaping the double quote character.
1226
1227 ** There is now a FAQ.
1228 \f
1229 * Changes in version 1.27:
1230
1231 ** The make rule which prevented bison.simple from being created on
1232 some systems has been fixed.
1233 \f
1234 * Changes in version 1.26:
1235
1236 ** Bison now uses automake.
1237
1238 ** New mailing lists: <bug-bison@gnu.org> and <help-bison@gnu.org>.
1239
1240 ** Token numbers now start at 257 as previously documented, not 258.
1241
1242 ** Bison honors the TMPDIR environment variable.
1243
1244 ** A couple of buffer overruns have been fixed.
1245
1246 ** Problems when closing files should now be reported.
1247
1248 ** Generated parsers should now work even on operating systems which do
1249 not provide alloca().
1250 \f
1251 * Changes in version 1.25, 1995-10-16:
1252
1253 ** Errors in the input grammar are not fatal; Bison keeps reading
1254 the grammar file, and reports all the errors found in it.
1255
1256 ** Tokens can now be specified as multiple-character strings: for
1257 example, you could use "<=" for a token which looks like <=, instead
1258 of chosing a name like LESSEQ.
1259
1260 ** The %token_table declaration says to write a table of tokens (names
1261 and numbers) into the parser file. The yylex function can use this
1262 table to recognize multiple-character string tokens, or for other
1263 purposes.
1264
1265 ** The %no_lines declaration says not to generate any #line preprocessor
1266 directives in the parser file.
1267
1268 ** The %raw declaration says to use internal Bison token numbers, not
1269 Yacc-compatible token numbers, when token names are defined as macros.
1270
1271 ** The --no-parser option produces the parser tables without including
1272 the parser engine; a project can now use its own parser engine.
1273 The actions go into a separate file called NAME.act, in the form of
1274 a switch statement body.
1275 \f
1276 * Changes in version 1.23:
1277
1278 The user can define YYPARSE_PARAM as the name of an argument to be
1279 passed into yyparse. The argument should have type void *. It should
1280 actually point to an object. Grammar actions can access the variable
1281 by casting it to the proper pointer type.
1282
1283 Line numbers in output file corrected.
1284 \f
1285 * Changes in version 1.22:
1286
1287 --help option added.
1288 \f
1289 * Changes in version 1.20:
1290
1291 Output file does not redefine const for C++.
1292
1293 Local Variables:
1294 mode: outline
1295 End:
1296
1297 -----
1298
1299 Copyright (C) 1995, 1996, 1997, 1998, 1999, 2000, 2001, 2002, 2003,
1300 2004, 2005, 2006, 2007, 2008, 2009 Free Software Foundation, Inc.
1301
1302 This file is part of Bison, the GNU Parser Generator.
1303
1304 This program is free software: you can redistribute it and/or modify
1305 it under the terms of the GNU General Public License as published by
1306 the Free Software Foundation, either version 3 of the License, or
1307 (at your option) any later version.
1308
1309 This program is distributed in the hope that it will be useful,
1310 but WITHOUT ANY WARRANTY; without even the implied warranty of
1311 MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. See the
1312 GNU General Public License for more details.
1313
1314 You should have received a copy of the GNU General Public License
1315 along with this program. If not, see <http://www.gnu.org/licenses/>.