+2002-11-11 Paul Eggert <eggert@twinsun.com>
+
+ Revamp to fix many (but not all) of the C- and M4-related quoting
+ problems. Among other things, this fixes the Bison bug reported
+ by Jan Hubicka when processing the Bash grammar; see:
+ <http://mail.gnu.org/pipermail/bison-patches/2002-November/001329.html>
+
+ Use new @ escapes consistently. Represent brackets with @{ and @}
+ rather than @<:@ and @:>@, since this works a bit better with dumb
+ editors like vi. Represent @ with @@, since @ is now consistently
+ an escape. Use @oline@ and @ofile@ rather than __oline__ and
+ __ofile__, to avoid unexpected expansions. Similarly, use @output
+ rather than #output.
+
+ * data/c.m4 (b4_copyright): Omit file name from comment, since
+ the file name could contain "*/".
+ (b4_synclines_flag): Don't quote the 2nd argument; it should already
+ be quoted. All uses changed.
+
+ * data/glr.c: Use new @ escapes consistently.
+ (b4_input_suffix, b4_output_parser_suffix, b4_output_parser_name,
+ b4_output_header_suffix, b4_output_header_name, b4_header_guard):
+ Remove, since they couldn't handle arbitrary characters in file
+ names.
+ * data/lalr1.cc: Likewise.
+ * data/yacc.c: Likewise.
+
+ * src/files.c (output_infix): Remove; all uses removed.
+ * src/files.h: Likewise.
+
+ * data/glr.c: Remove use of "#ifdef b4_header_guard", since it
+ mishandled funny characters in file names, and anyway it isn't
+ needed any more.
+ * data/yacc.c: Likewise.
+ * data/lalr1.cc: Use YYSLP_NEEDED instead of b4_header_guard.
+
+ * data/glr.c (YYSTYPE_IS_TRIVIAL): Define when the .h file would.
+ * data/yacc.c: Likewise.
+
+ * src/muscle_tab.c: Include quotearg.h, since we need to quote C
+ strings now.
+ (muscle_init): Quote filename as a C string.
+ * src/muscle_tab.h (MUSCLE_GROW_STRING_PAIR): Remove; unused.
+ (MUSCLE_OBSTACK_SGROW, MUSCLE_INSERT_C_STRING): New macros.
+ * src/output.c (escaped_file_name_output): New function.
+ (prepare_symbols): Quote tokens for M4.
+ (prepare): Don't insert output_infix, output_prefix,
+ output_parser_name, output_header_name; this is now down by scan-skel.
+ Insert skeleton as a C string.
+
+ * src/output.c (user_actions_output, symbol_destructors_output,
+ symbol_printers_output): Quote filenames for C and M4.
+ * src/reader.c (prologue_augment, epilogue_set): Likewise.
+
+ * src/scan-gram.l (<SC_CHARACTER>): Don't worry about any backslash
+ escapes other than \\ and \'; this simplifies the code.
+ (<SC_STRING>): Likewise, for \\ and \".
+ (<SC_COMMENT,SC_LINE_COMMENT,SC_STRING,SC_CHARACTER,SC_BRACED_CODE,
+ SC_PROLOGUE,SC_EPILOGUE>): Escape $ and @, too.
+ Use new escapes @{ and @} for [ and ].
+
+ * src/scan-skel.l (yylineno, yyoutname): Remove static vars, replacing
+ them with auto vars.
+ Switch to new escape scheme, where @ is the escape character uniformly.
+ Abort if a stray escape character is found. Avoid unbounded input
+ buffer when parsing non-escaped text.
+
+ * tests/input.at (Torturing the Scanner): Add tests that @oline@,
+ __oline__, #output, $@, and @{ do not have unintended meanings.
+
+2002-11-09 Paul Eggert <eggert@twinsun.com>
+
+ Fix the test failure due to GCC warnings described in
+ <http://mail.gnu.org/pipermail/bug-bison/2002-November/001815.html>.
+ * data/glr.c (yyis_pact_ninf, yyis_table_ninf): New macros, which
+ evaluate to 0 if it's impossible for NINF to be in the respective
+ table.
+ (yygetLRActions, yyrecoverParseError): Use them.
+
+ * src/scan-gram.l (unexpected_end_of_file): Fix bug: columns were
+ counted in the token inserted at end of file. Now takes
+ location_t *, not location_t, so that the location can be
+ adjusted. All uses changed.
+
+ * tests/regression.at (Invalid inputs): Adjust wording in
+ diagnostic to match the new behavior.
+
+ * tests/torture.at (AT_DATA_TRIANGULAR_GRAMMAR,
+ AT_DATA_HORIZONTAL_GRAMMAR, AT_DATA_LOOKAHEADS_GRAMMAR,
+ AT_DATA_STACK_TORTURE): Replace `assert (x);' with `if (! (x))
+ abort ();'. This reduces the runtime of the "Many lookaheads"
+ test from 27.6 to 2.7 minutes on a 440 MHz Ultrasparc III running
+ GCC 3.2.
+
+2002-11-07 Paul Eggert <eggert@twinsun.com>
+
+ * src/parse-gram.y (CHARACTER): Remove unused token.
+ All uses removed.
+
+ * src/scan-gram.l: Remove stack option. We no longer use the
+ stack, since the stack was never deeper than 1; instead, use the
+ new auto var c_context to record the stacked value.
+
+ Remove nounput option. At an unexpected end of file, we now unput
+ the minimal input necessary to end cleanly; this simplifies the
+ code.
+
+ Avoid unbounded token sizes where this is easy.
+
+ (unexpected_end_of_file): New function.
+ Use it to systematize the error message on unexpected EOF.
+ (last-string): Now auto, not static.
+ (YY_OBS_FREE): Remove unnecessary do while (0) wrapper.
+ (scanner_last_string_free): Remove; not used.
+ (percent_percent_count): Move decl to just before use.
+ (SC_ESCAPED_CHARACTER): Return ID at unexpected end of file,
+ not the (never otherwised-used) CHARACTER.
+
+2002-11-07 Akim Demaille <akim@epita.fr>
+
+ Let yyerror always receive the msg as last argument, so that
+ yyerror can be variadic.
+
+ * data/yacc.c (b4_yyerror_args): New.
+ Use it when calling yyerror.
+ * data/glr.c (b4_yyerror_args, b4_lyyerror_args): New.
+ Use it when calling yyerror.
+ * doc/bison.texinfo (Error Reporting): Adjust.
+ * tests/calc.at (_AT_DATA_CALC_Y): Adjust.
+ * tests/cxx-type.at (_AT_TEST_GLR_CALC): Adjust.
+
+2002-11-06 Akim Demaille <akim@epita.fr>
+
+ #line should have quoted strings.
+ Ideally, this should be done by m4_quotearg.
+
+ * src/scan-skel.l: Include quotearg.h.
+ Quote __ofile__.
+ * src/output.c (symbol_printers_output)
+ (symbol_destructors_output): Quote the file name.
+
+2002-11-06 Akim Demaille <akim@epita.fr>
+
+ * tests/regression.at (Invalid inputs): Adjust to the recent
+ messages.
+
+2002-11-06 Akim Demaille <akim@epita.fr>
+
+ Restore --no-lines.
+ Reported by Jim Kent.
+
+ * data/c.m4 (b4_syncline): New.
+ * data/glr.c, data/yacc.c, data/lalr1.cc: Use it.
+ * src/reader.c (prologue_augment, epilogue_set): Use b4_syncline.
+ * src/output.c (user_actions_output): Likewise.
+ (prepare): Define 'b4_synclines_flag'.
+ * src/muscle_tab.c (muscle_init): Don't define b4_linef.
+
+2002-11-06 Akim Demaille <akim@epita.fr>
+
+ * src/main.c (main): Free `infile'.
+ * src/scan-gram.l (handle_syncline): New.
+ Recognize `#line'.
+ * src/output.c (user_actions_output, symbol_destructors_output)
+ (symbol_printers_output): Use the location's file name, not
+ infile.
+ * src/reader.c (prologue_augment, epilogue_set): Likewise.
+
+2002-11-05 Paul Hilfinger <Hilfinger@CS.Berkeley.EDU>
+
+ * src/tables.c (matching_state): Don't allow states to match if
+ either has GLR conflict entries.
+
+2002-11-05 Paul Eggert <eggert@twinsun.com>
+
+ * src/scan-gram.l: Use more accurate diagnostics, e.g.
+ "integer out of range" rather than "invalid value".
+ * tests/input.at (Invalid $n, Invalid @n): Change expected wording
+ accordingly.
+
+ Scan <% and %> digraphs in C code as POSIX 1003.1-2001 requires.
+ Also, remove one static variable in the scanner.
+
+ * src/scan-gram.l (braces_level): Now auto, not static.
+ Initialize to zero if the compiler is being picky.
+ (INITIAL): Clear braces_level instead of incrementing it.
+ (SC_BRACED_CODE): Treat <% and %> as { and } when inside C code,
+ as POSIX 1003.1-2001 requires.
+ * src/system.h (IF_LINT): New macro, taken from coreutils.
+ * configure.ac: Define "lint" if --enable-gcc-warnings.
+
+2002-11-05 Akim Demaille <akim@epita.fr>
+
+ * src/scan-gram.l: When it starts with `%', complain about the
+ whole directive, not just that `invalid character: %'.
+
+2002-11-04 Akim Demaille <akim@epita.fr>
+
+ * Makefile.maint: Update from Autoconf.
+ (update, cvs-update, po-update, do-po-update): New.
+
+2002-11-04 Akim Demaille <akim@epita.fr>
+
+ * tests/glr-regr1.at (Badly Collapsed GLR States): Prototype yylex
+ and yyerror.
+ Have yyerror `use' its arguments.
+ * tests/calc.at (AT_CHECK_PUSHDEFS): AT_YYERROR_SEES_LOC_IF
+ returns true when location & yacc & pure & parse-param.
+ (_AT_DATA_CALC_Y): Let yyerror ``use'' its arguments.
+
+2002-11-04 Akim Demaille <akim@epita.fr>
+
+ * src/location.h (LOCATION_PRINT): Use quotearg slot 3 to avoid
+ clashes.
+ * src/scan-gram.l: Use [\'] instead of ['] to pacify
+ font-lock-mode.
+ Use complain_at.
+ Use quote, not quote_n since LOCATION_PRINT no longer uses the
+ slot 0.
+
+2002-11-03 Paul Eggert <eggert@twinsun.com>
+
+ * src/reader.c (get_merge_function, grammar_current_rule_check):
+ Use consistent diagnostics for reporting type name clashes.
+ Quote the types with <>, for consistency with Yacc.
+ * tests/input.at (Type Clashes): Adjust to diagnostic changes.
+
+2002-11-03 Akim Demaille <akim@epita.fr>
+
+ * data/c.m4 (b4_identification, b4_user_args, b4_parse_param):
+ New.
+ * data/yacc.m4 (b4_pure_args, b4_Pure_args): New.
+ (b4_parse_param): Remove.
+ Use b4_identification.
+ Propagate b4_pure_args where needed to pass them to yyerror.
+ * data/glr.m4 (b4_parse_param): Remove.
+ (b4_user_formals, b4_pure_args, b4_pure_formals, b4_lpure_args)
+ (b4_lpure_formals): New.
+ Use b4_identification.
+ (YY_USER_FORMALS, YY_USER_ARGS): Remove, replaced by
+ b4_user_formals and b4_user_args.
+ (yyexpandGLRStack, yyFail, yyaddDeferredAction, yyglrShiftDefer)
+ (yyreportAmbiguity): When using a pure parser, also need
+ the location, and the parse-params.
+ Adjust callers.
+ (yyuserAction, yyglrShift, yyreportParseError, yyrecoverParseError):
+ When using a pure parser, also need the parse-params.
+ Adjust callers.
+ * tests/calc.at: Test pure (%pure-parser) and absolutely pure
+ (%pure-parser + %parse-param) LALR and GLR parsers.
+ (AT_CHECK_PUSHDEFS, AT_CHECK_POPDEFS): New, define AT_PARAM_IF,
+ AT_LOCATION_IF, AT_PURE_IF, AT_GLR_IF, AAT_PURE_AND_LOC_IF,
+ AT_GLR_OR_PARAM_IF, AT_YYERROR_ARG_LOC_IF, AT_YYERROR_SEES_LOC_IF.
+ (_AT_DATA_CALC_Y): Equip for purity of yyerror.
+ (_AT_CHECK_CALC_ERROR): Use AT_YYERROR_SEES_LOC_IF.
+ * tests/cxx-type.at (_AT_TEST_GLR_CALC): Equip for yyerror purity.
+ * doc/bison.texinfo: Untabify the whole file.
+ (Parser Function): Document %parse-param, deprecate YYPARSE_PARAM.
+ (Pure Calling): Document %lex-param, deprecate YYLEX_PARAM.
+ (Error Reporting): Adjust to these new directives.
+ Document %error-verbose, deprecate YYERROR_VERBOSE.
+
+2002-11-03 Akim Demaille <akim@epita.fr>
+
+ * tests/calc.at: Change all the AT_CHECK_CALC_LALR and
+ AT_CHECK_CALC_GLR invocations to use % directives, instead of
+ command line options.
+ * tests/cxx-type.at: Formatting changes.
+
+2002-11-03 Paul Eggert <eggert@twinsun.com>
+
+ * src/scan-gram.l: Revamp to fix POSIX incompatibilities,
+ to count columns correctly, and to check for invalid inputs.
+
+ Use mbsnwidth to count columns correctly. Account for tabs, too.
+ Include mbswidth.h.
+ (YY_USER_ACTION): Invoke extend_location rather than LOCATION_COLUMNS.
+ (extend_location): New function.
+ (YY_LINES): Remove.
+
+ Handle CRLF in C code rather than in Lex code.
+ (YY_INPUT): New macro.
+ (no_cr_read): New function.
+
+ Scan UCNs, even though we don't fully handle them yet.
+ (convert_ucn_to_byte): New function.
+
+ Handle backslash-newline correctly in C code.
+ (SC_LINE_COMMENT, SC_YACC_COMMENT): New states.
+ (eols, blanks): Remove. YY_USER_ACTION now counts newlines etc.;
+ all uses changed.
+ (tag, splice): New EREs. Do not allow NUL or newline in tags.
+ Use {splice} wherever C allows backslash-newline.
+ YY_STEP after space, newline, vertical-tab.
+ ("/*"): BEGIN SC_YACC_COMMENT, not yy_push_state (SC_COMMENT).
+
+ (letter, id): Don't assume ASCII; e.g., spell out a-z.
+
+ ({int}, handle_action_dollar, handle_action_at): Check for integer
+ overflow.
+
+ (YY_STEP): Omit trailing semicolon, so that it's more like C.
+
+ (<SC_ESCAPED_STRING,SC_ESCAPED_CHARACTER>): Allow \0 and \00
+ as well as \000. Check for UCHAR_MAX, not 255.
+ Allow \x with an arbitrary positive number of digits, as in C.
+ Check for overflow here.
+ Allow \? and UCNs, for compatibility with C.
+
+ (handle_symbol_code_dollar): Use quote_n slot 1 to avoid collision
+ with quote slot used by complain_at.
+
+ * tests/input.at: Add tests for backslash-newline, m4 quotes
+ in symbols, long literals, and funny escapes in strings.
+
+ * configure.ac (jm_PREREQ_MBSWIDTH): Add.
+ * lib/Makefile.am (libbison_a_SOURCES): Add mbswidth.h, mbswidth.c.
+ * lib/mbswidth.h, lib/mbswidth.c: New files, from GNU gettext.
+ * m4/Makefile.am (EXTRA_DIST): Add mbswidth.m4.
+ * m4/mbswidth.m4: New file, from GNU coreutils.
+
+ * doc/bison.texinfo (Grammar Outline): Document // comments.
+ (Symbols): Document that trigraphs have no special meaning in Bison,
+ nor is backslash-newline allowed.
+ (Actions): Document that trigraphs have no special meaning.
+
+ * src/location.h (LOCATION_COLUMNS, LOCATION_LINES): Remove;
+ no longer used.
+
+2002-11-02 Paul Eggert <eggert@twinsun.com>
+
+ * src/reader.c: Don't include quote.h; not needed.
+ (get_merge_function): Reword warning to be consistent with
+ type clash diagnostic in grammar_current_rule_check.
+
+ * lib/quotearg.c (quotearg_buffer_restyled): Fix off-by-two
+ bug in trigraph handling.
+
+ * src/output.c (prepare_symbols): When printing token names,
+ escape "[" as "@<:@" and likewise for "]".
+
+ * src/system.h (errno): Remove declaration, as we are now
+ assuming C89 or better, and C89 guarantees errno.
+
+2002-10-30 Paul Eggert <eggert@twinsun.com>
+
+ * lib/bitset_stats.c (bitset_stats_read, bitset_stats_write):
+ Check for close failures.
+ * src/files.h (xfclose): Return void, not int, since it always
+ returned zero.
+ * src/files.c (xfclose): Likewise. Report I/O error if ferror
+ indicates one.
+ * src/output.c (output_skeleton): Use xfclose rather than fclose
+ and ferror. xfclose now checks ferror.
+
+ * data/glr.c (YYLEFTMOST_STATE): Remove.
+ (yyreportTree): Use a stack-based leftmost state. This avoids
+ our continuing battles with bogus warnings about initializers.
+
+2002-10-30 Akim Demaille <akim@epita.fr>
+
+ * src/system.h: Don't use #ifdef/#ifndef on HAVE_ values, only
+ #if.
+
+2002-10-29 Paul Hilfinger <Hilfinger@CS.Berkeley.EDU>
+
+ * tests/glr-regr1.at: New test for reported regressions.
+ * tests/testsuite.at: Add glr-regr1.at test.
+ * tests/Makefile.am: Add glr-regr1.at test.
+
projects / bison.git / blobdiff