Home | History | Annotate | Download | only in nawk-20071023
      1 /****************************************************************
      2 Copyright (C) Lucent Technologies 1997
      3 All Rights Reserved
      4 
      5 Permission to use, copy, modify, and distribute this software and
      6 its documentation for any purpose and without fee is hereby
      7 granted, provided that the above copyright notice appear in all
      8 copies and that both that the copyright notice and this
      9 permission notice and warranty disclaimer appear in supporting
     10 documentation, and that the name Lucent Technologies or any of
     11 its entities not be used in advertising or publicity pertaining
     12 to distribution of the software without specific, written prior
     13 permission.
     14 
     15 LUCENT DISCLAIMS ALL WARRANTIES WITH REGARD TO THIS SOFTWARE,
     16 INCLUDING ALL IMPLIED WARRANTIES OF MERCHANTABILITY AND FITNESS.
     17 IN NO EVENT SHALL LUCENT OR ANY OF ITS ENTITIES BE LIABLE FOR ANY
     18 SPECIAL, INDIRECT OR CONSEQUENTIAL DAMAGES OR ANY DAMAGES
     19 WHATSOEVER RESULTING FROM LOSS OF USE, DATA OR PROFITS, WHETHER
     20 IN AN ACTION OF CONTRACT, NEGLIGENCE OR OTHER TORTIOUS ACTION,
     21 ARISING OUT OF OR IN CONNECTION WITH THE USE OR PERFORMANCE OF
     22 THIS SOFTWARE.
     23 ****************************************************************/
     24 
     25 This file lists all bug fixes, changes, etc., made since the AWK book
     26 was sent to the printers in August, 1987.
     27 
     28 Oct 23, 2007:
     29 	minor fix in lib.c: increase inputFS to 100, change malloc
     30 	for fields to n+1.
     31 
     32 	fixed memory fault caused by out of order test in setsval.
     33 
     34 	thanks to david o'brien, freebsd, for both fixes.
     35 
     36 May 1, 2007:
     37 	fiddle in makefile to fix for BSD make; thanks to igor sobrado.
     38 
     39 Mar 31, 2007:
     40 	fixed some null pointer refs calling adjbuf.
     41 
     42 Feb 21, 2007:
     43 	fixed a bug in matching the null RE in sub and gsub.  thanks to al aho
     44 	who actually did the fix (in b.c), and to wolfgang seeberg for finding
     45 	it and providing a very compact test case.
     46 
     47 	fixed quotation in b.c; thanks to Hal Pratt and the Princeton Dante
     48 	Project.
     49 
     50 	removed some no-effect asserts in run.c.
     51 
     52 	fiddled maketab.c to not complain about bison-generated values.
     53 
     54 	removed the obsolete -V argument; fixed --version to print the
     55 	version and exit.
     56 
     57 	fixed wording and an outright error in the usage message; thanks to igor
     58 	sobrado and jason mcintyre.
     59 
     60 	fixed a bug in -d that caused core dump if no program followed.
     61 
     62 Jan 1, 2007:
     63 	dropped mac.code from makefile; there are few non-MacOSX
     64 	mac's these days.
     65 
     66 Jan 17, 2006:
     67 	system() not flagged as unsafe in the unadvertised -safe option.
     68 	found it while enhancing tests before shipping the ;login: article.
     69 	practice what you preach.
     70 
     71 	removed the 9-years-obsolete -mr and -mf flags.
     72 
     73 	added -version and --version options.
     74 
     75 	core dump on linux with BEGIN {nextfile}, now fixed.
     76 
     77 	removed some #ifdef's in run.c and lex.c that appear to no
     78 	longer be necessary.
     79 
     80 Apr 24, 2005:
     81 	modified lib.c so that values of $0 et al are preserved in the END
     82 	block, apparently as required by posix.  thanks to havard eidnes
     83 	for the report and code.
     84 
     85 Jan 14, 2005:
     86 	fixed infinite loop in parsing, originally found by brian tsang.
     87 	thanks to arnold robbins for a suggestion that started me
     88 	rethinking it.
     89 
     90 Dec 31, 2004:
     91 	prevent overflow of -f array in main, head off potential error in
     92 	call of SYNTAX(), test malloc return in lib.c, all with thanks to
     93 	todd miller.
     94 
     95 Dec 22, 2004:
     96 	cranked up size of NCHARS; coverity thinks it can be overrun with
     97 	smaller size, and i think that's right.  added some assertions to b.c
     98 	to catch places where it might overrun.  the RE code is still fragile.
     99 
    100 Dec 5, 2004:
    101 	fixed a couple of overflow problems with ridiculous field numbers:
    102 	e.g., print $(2^32-1).  thanks to ruslan ermilov, giorgos keramidas
    103 	and david o'brien at freebsd.org for patches.  this really should
    104 	be re-done from scratch.
    105 
    106 Nov 21, 2004:
    107 	fixed another 25-year-old RE bug, in split.  it's another failure
    108 	to (re-)initialize.  thanks to steve fisher for spotting this and
    109 	providing a good test case.
    110 
    111 Nov 22, 2003:
    112 	fixed a bug in regular expressions that dates (so help me) from 1977;
    113 	it's been there from the beginning.  an anchored longest match that
    114 	was longer than the number of states triggered a failure to initialize
    115 	the machine properly.  many thanks to moinak ghosh for not only finding
    116 	this one but for providing a fix, in some of the most mysterious
    117 	code known to man.
    118 
    119 	fixed a storage leak in call() that appears to have been there since
    120 	1983 or so -- a function without an explicit return that assigns a
    121 	string to a parameter leaked a Cell.  thanks to moinak ghosh for
    122 	spotting this very subtle one.
    123 
    124 Jul 31, 2003:
    125 	fixed, thanks to andrey chernov and ruslan ermilov, a bug in lex.c
    126 	that mis-handled the character 255 in input.  (it was being compared
    127 	to EOF with a signed comparison.)
    128 
    129 Jul 29, 2003:
    130 	fixed (i think) the long-standing botch that included the beginning of
    131 	line state ^ for RE's in the set of valid characters; this led to a
    132 	variety of odd problems, including failure to properly match certain
    133 	regular expressions in non-US locales.  thanks to ruslan for keeping
    134 	at this one.
    135 
    136 Jul 28, 2003:
    137 	n-th try at getting internationalization right, with thanks to volker
    138 	kiefel, arnold robbins and ruslan ermilov for advice, though they
    139 	should not be blamed for the outcome.  according to posix, "."  is the
    140 	radix character in programs and command line arguments regardless of
    141 	the locale; otherwise, the locale should prevail for input and output
    142 	of numbers.  so it's intended to work that way.
    143 
    144 	i have rescinded the attempt to use strcoll in expanding shorthands in
    145 	regular expressions (cclenter).  its properties are much too
    146 	surprising; for example [a-c] matches aAbBc in locale en_US but abBcC
    147 	in locale fr_CA.  i can see how this might arise by implementation
    148 	but i cannot explain it to a human user.  (this behavior can be seen
    149 	in gawk as well; we're leaning on the same library.)
    150 
    151 	the issue appears to be that strcoll is meant for sorting, where
    152 	merging upper and lower case may make sense (though note that unix
    153 	sort does not do this by default either).  it is not appropriate
    154 	for regular expressions, where the goal is to match specific
    155 	patterns of characters.  in any case, the notations [:lower:], etc.,
    156 	are available in awk, and they are more likely to work correctly in
    157 	most locales.
    158 
    159 	a moratorium is hereby declared on internationalization changes.
    160 	i apologize to friends and colleagues in other parts of the world.
    161 	i would truly like to get this "right", but i don't know what
    162 	that is, and i do not want to keep making changes until it's clear.
    163 
    164 Jul 4, 2003:
    165 	fixed bug that permitted non-terminated RE, as in "awk /x".
    166 
    167 Jun 1, 2003:
    168 	subtle change to split: if source is empty, number of elems
    169 	is always 0 and the array is not set.
    170 
    171 Mar 21, 2003:
    172 	added some parens to isblank, in another attempt to make things
    173 	internationally portable.
    174 
    175 Mar 14, 2003:
    176 	the internationalization changes, somewhat modified, are now
    177 	reinstated.  in theory awk will now do character comparisons
    178 	and case conversions in national language, but "." will always
    179 	be the decimal point separator on input and output regardless
    180 	of national language.  isblank(){} has an #ifndef.
    181 
    182 	this no longer compiles on windows: LC_MESSAGES isn't defined
    183 	in vc6++.
    184 
    185 	fixed subtle behavior in field and record splitting: if FS is
    186 	a single character and RS is not empty, \n is NOT a separator.
    187 	this tortuous reading is found in the awk book; behavior now
    188 	matches gawk and mawk.
    189 
    190 Dec 13, 2002:
    191 	for the moment, the internationalization changes of nov 29 are
    192 	rolled back -- programs like x = 1.2 don't work in some locales,
    193 	because the parser is expecting x = 1,2.  until i understand this
    194 	better, this will have to wait.
    195 
    196 Nov 29, 2002:
    197 	modified b.c (with tiny changes in main and run) to support
    198 	locales, using strcoll and iswhatever tests for posix character
    199 	classes.  thanks to ruslan ermilov (ru@freebsd.org) for code.
    200 	the function isblank doesn't seem to have propagated to any
    201 	header file near me, so it's there explicitly.  not properly
    202 	tested on non-ascii character sets by me.
    203 
    204 Jun 28, 2002:
    205 	modified run/format() and tran/getsval() to do a slightly better
    206 	job on using OFMT for output from print and CONVFMT for other
    207 	number->string conversions, as promised by posix and done by
    208 	gawk and mawk.  there are still places where it doesn't work
    209 	right if CONVFMT is changed; by then the STR attribute of the
    210 	variable has been irrevocably set.  thanks to arnold robbins for
    211 	code and examples.
    212 
    213 	fixed subtle bug in format that could get core dump.  thanks to
    214 	Jaromir Dolecek <jdolecek (at) NetBSD.org> for finding and fixing.
    215 	minor cleanup in run.c / format() at the same time.
    216 
    217 	added some tests for null pointers to debugging printf's, which
    218 	were never intended for external consumption.  thanks to dave
    219 	kerns (dkerns@lucent.com) for pointing this out.
    220 
    221 	GNU compatibility: an empty regexp matches anything (thanks to
    222 	dag-erling smorgrav, des@ofug.org).  subject to reversion if
    223 	this does more harm than good.
    224 
    225 	pervasive small changes to make things more const-correct, as
    226 	reported by gcc's -Wwrite-strings.  as it says in the gcc manual,
    227 	this may be more nuisance than useful.  provoked by a suggestion
    228 	and code from arnaud desitter, arnaud (at) nimbus.geog.ox.ac.uk
    229 
    230 	minor documentation changes to note that this now compiles out
    231 	of the box on Mac OS X.
    232 
    233 Feb 10, 2002:
    234 	changed types in posix chars structure to quiet solaris cc.
    235 
    236 Jan 1, 2002:
    237 	fflush() or fflush("") flushes all files and pipes.
    238 
    239 	length(arrayname) returns number of elements; thanks to
    240 	arnold robbins for suggestion.
    241 
    242 	added a makefile.win to make it easier to build on windows.
    243 	based on dan allen's buildwin.bat.
    244 
    245 Nov 16, 2001:
    246 	added support for posix character class names like [:digit:],
    247 	which are not exactly shorter than [0-9] and perhaps no more
    248 	portable.  thanks to dag-erling smorgrav for code.
    249 
    250 Feb 16, 2001:
    251 	removed -m option; no longer needed, and it was actually
    252 	broken (noted thanks to volker kiefel).
    253 
    254 Feb 10, 2001:
    255 	fixed an appalling bug in gettok: any sequence of digits, +,-, E, e,
    256 	and period was accepted as a valid number if it started with a period.
    257 	this would never have happened with the lex version.
    258 
    259 	other 1-character botches, now fixed, include a bare $ and a
    260 	bare " at the end of the input.
    261 
    262 Feb 7, 2001:
    263 	more (const char *) casts in b.c and tran.c to silence warnings.
    264 
    265 Nov 15, 2000:
    266 	fixed a bug introduced in august 1997 that caused expressions
    267 	like $f[1] to be syntax errors.  thanks to arnold robbins for
    268 	noticing this and providing a fix.
    269 
    270 Oct 30, 2000:
    271 	fixed some nextfile bugs: not handling all cases.  thanks to
    272 	arnold robbins for pointing this out.  new regressions added.
    273 
    274 	close() is now a function.  it returns whatever the library
    275 	fclose returns, and -1 for closing a file or pipe that wasn't
    276 	opened.
    277 
    278 Sep 24, 2000:
    279 	permit \n explicitly in character classes; won't work right
    280 	if comes in as "[\n]" but ok as /[\n]/, because of multiple
    281 	processing of \'s.  thanks to arnold robbins.
    282 
    283 July 5, 2000:
    284 	minor fiddles in tran.c to keep compilers happy about uschar.
    285 	thanks to norman wilson.
    286 
    287 May 25, 2000:
    288 	yet another attempt at making 8-bit input work, with another
    289 	band-aid in b.c (member()), and some (uschar) casts to head
    290 	off potential errors in subscripts (like isdigit).  also
    291 	changed HAT to NCHARS-2.  thanks again to santiago vila.
    292 
    293 	changed maketab.c to ignore apparently out of range definitions
    294 	instead of halting; new freeBSD generates one.  thanks to
    295 	jon snader <jsnader (at) ix.netcom.com> for pointing out the problem.
    296 
    297 May 2, 2000:
    298 	fixed an 8-bit problem in b.c by making several char*'s into
    299 	unsigned char*'s.  not clear i have them all yet.  thanks to
    300 	Santiago Vila <sanvila (at) unex.es> for the bug report.
    301 
    302 Apr 21, 2000:
    303 	finally found and fixed a memory leak in function call; it's
    304 	been there since functions were added ~1983.  thanks to
    305 	jon bentley for the test case that found it.
    306 
    307 	added test in envinit to catch environment "variables" with
    308 	names beginning with '='; thanks to Berend Hasselman.
    309 
    310 Jul 28, 1999:
    311 	added test in defn() to catch function foo(foo), which
    312 	otherwise recurses until core dump.  thanks to arnold
    313 	robbins for noticing this.
    314 
    315 Jun 20, 1999:
    316 	added *bp in gettok in lex.c; appears possible to exit function
    317 	without terminating the string.  thanks to russ cox.
    318 
    319 Jun 2, 1999:
    320 	added function stdinit() to run to initialize files[] array,
    321 	in case stdin, etc., are not constants; some compilers care.
    322 
    323 May 10, 1999:
    324 	replaced the ERROR ... FATAL, etc., macros with functions
    325 	based on vprintf, to avoid problems caused by overrunning
    326 	fixed-size errbuf array.  thanks to ralph corderoy for the
    327 	impetus, and for pointing out a string termination bug in
    328 	qstring as well.
    329 
    330 Apr 21, 1999:
    331 	fixed bug that caused occasional core dumps with commandline
    332 	variable with value ending in \.  (thanks to nelson beebe for
    333 	the test case.)
    334 
    335 Apr 16, 1999:
    336 	with code kindly provided by Bruce Lilly, awk now parses
    337 	/=/ and similar constructs more sensibly in more places.
    338 	Bruce also provided some helpful test cases.
    339 
    340 Apr 5, 1999:
    341 	changed true/false to True/False in run.c to make it
    342 	easier to compile with C++.  Added some casts on malloc
    343 	and realloc to be honest about casts; ditto.  changed
    344 	ltype int to long in struct rrow to reduce some 64-bit
    345 	complaints; other changes scattered throughout for the
    346 	same purpose.  thanks to Nelson Beebe for these portability
    347 	improvements.
    348 
    349 	removed some horrible pointer-int casting in b.c and elsewhere
    350 	by adding ptoi and itonp to localize the casts, which are
    351 	all benign.  fixed one incipient bug that showed up on sgi
    352 	in 64-bit mode.
    353 
    354 	reset lineno for new source file; include filename in error
    355 	message.  also fixed line number error in continuation lines.
    356 	(thanks to Nelson Beebe for both of these.)
    357 
    358 Mar 24, 1999:
    359 	Nelson Beebe notes that irix 5.3 yacc dies with a bogus
    360 	error; use a newer version or switch to bison, since sgi
    361 	is unlikely to fix it.
    362 
    363 Mar 5, 1999:
    364 	changed isnumber to is_number to avoid the problem caused by
    365 	versions of ctype.h that include the name isnumber.
    366 
    367 	distribution now includes a script for building on a Mac,
    368 	thanks to Dan Allen.
    369 
    370 Feb 20, 1999:
    371 	fixed memory leaks in run.c (call) and tran.c (setfval).
    372 	thanks to Stephen Nutt for finding these and providing the fixes.
    373 
    374 Jan 13, 1999:
    375 	replaced srand argument by (unsigned int) in run.c;
    376 	avoids problem on Mac and potentially on Unix & Windows.
    377 	thanks to Dan Allen.
    378 
    379 	added a few (int) casts to silence useless compiler warnings.
    380 	e.g., errorflag= in run.c jump().
    381 
    382 	added proctab.c to the bundle outout; one less thing
    383 	to have to compile out of the box.
    384 
    385 	added calls to _popen and _pclose to the win95 stub for
    386 	pipes (thanks to Steve Adams for this helpful suggestion).
    387 	seems to work, though properties are not well understood
    388 	by me, and it appears that under some circumstances the
    389 	pipe output is truncated.  Be careful.
    390 
    391 Oct 19, 1998:
    392 	fixed a couple of bugs in getrec: could fail to update $0
    393 	after a getline var; because inputFS wasn't initialized,
    394 	could split $0 on every character, a misleading diversion.
    395 
    396 	fixed caching bug in makedfa: LRU was actually removing
    397 	least often used.
    398 
    399 	thanks to ross ridge for finding these, and for providing
    400 	great bug reports.
    401 
    402 May 12, 1998:
    403 	fixed potential bug in readrec: might fail to update record
    404 	pointer after growing.  thanks to dan levy for spotting this
    405 	and suggesting the fix.
    406 
    407 Mar 12, 1998:
    408 	added -V to print version number and die.
    409 
    410 Feb 11, 1998:
    411 	subtle silent bug in lex.c: if the program ended with a number
    412 	longer than 1 digit, part of the input would be pushed back and
    413 	parsed again because token buffer wasn't terminated right.
    414 	example:  awk 'length($0) > 10'.  blush.  at least i found it
    415 	myself.
    416 
    417 Aug 31, 1997:
    418 	s/adelete/awkdelete/: SGI uses this in malloc.h.
    419 	thanks to nelson beebe for pointing this one out.
    420 
    421 Aug 21, 1997:
    422 	fixed some bugs in sub and gsub when replacement includes \\.
    423 	this is a dark, horrible corner, but at least now i believe that
    424 	the behavior is the same as gawk and the intended posix standard.
    425 	thanks to arnold robbins for advice here.
    426 
    427 Aug 9, 1997:
    428 	somewhat regretfully, replaced the ancient lex-based lexical
    429 	analyzer with one written in C.  it's longer, generates less code,
    430 	and more portable; the old one depended too much on mysterious
    431 	properties of lex that were not preserved in other environments.
    432 	in theory these recognize the same language.
    433 
    434 	now using strtod to test whether a string is a number, instead of
    435 	the convoluted original function.  should be more portable and
    436 	reliable if strtod is implemented right.
    437 
    438 	removed now-pointless optimization in makefile that tries to avoid
    439 	recompilation when awkgram.y is changed but symbols are not.
    440 
    441 	removed most fixed-size arrays, though a handful remain, some
    442 	of which are unchecked.  you have been warned.
    443 
    444 Aug 4, 1997:
    445 	with some trepidation, replaced the ancient code that managed
    446 	fields and $0 in fixed-size arrays with arrays that grow on
    447 	demand.  there is still some tension between trying to make this
    448 	run fast and making it clean; not sure it's right yet.
    449 
    450 	the ill-conceived -mr and -mf arguments are now useful only
    451 	for debugging.  previous dynamic string code removed.
    452 
    453 	numerous other minor cleanups along the way.
    454 
    455 Jul 30, 1997:
    456 	using code provided by dan levy (to whom profuse thanks), replaced
    457 	fixed-size arrays and awkward kludges by a fairly uniform mechanism
    458 	to grow arrays as needed for printf, sub, gsub, etc.
    459 
    460 Jul 23, 1997:
    461 	falling off the end of a function returns "" and 0, not 0.
    462 	thanks to arnold robbins.
    463 
    464 Jun 17, 1997:
    465 	replaced several fixed-size arrays by dynamically-created ones
    466 	in run.c; added overflow tests to some previously unchecked cases.
    467 	getline, toupper, tolower.
    468 
    469 	getline code is still broken in that recursive calls may wind
    470 	up using the same space.  [fixed later]
    471 
    472 	increased RECSIZE to 8192 to push problems further over the horizon.
    473 
    474 	added \r to \n as input line separator for programs, not data.
    475 	damn CRLFs.
    476 
    477 	modified format() to permit explicit printf("%c", 0) to include
    478 	a null byte in output.  thanks to ken stailey for the fix.
    479 
    480 	added a "-safe" argument that disables file output (print >,
    481 	print >>), process creation (cmd|getline, print |, system), and
    482 	access to the environment (ENVIRON).  this is a first approximation
    483 	to a "safe" version of awk, but don't rely on it too much.  thanks
    484 	to joan feigenbaum and matt blaze for the inspiration long ago.
    485 
    486 Jul 8, 1996:
    487 	fixed long-standing bug in sub, gsub(/a/, "\\\\&"); thanks to
    488 	ralph corderoy.
    489 
    490 Jun 29, 1996:
    491 	fixed awful bug in new field splitting; didn't get all the places
    492 	where input was done.
    493 
    494 Jun 28, 1996:
    495 	changed field-splitting to conform to posix definition: fields are
    496 	split using the value of FS at the time of input; it used to be
    497 	the value when the field or NF was first referred to, a much less
    498 	predictable definition.  thanks to arnold robbins for encouragement
    499 	to do the right thing.
    500 
    501 May 28, 1996:
    502 	fixed appalling but apparently unimportant bug in parsing octal
    503 	numbers in reg exprs.
    504 
    505 	explicit hex in reg exprs now limited to 2 chars: \xa, \xaa.
    506 
    507 May 27, 1996:
    508 	cleaned up some declarations so gcc -Wall is now almost silent.
    509 
    510 	makefile now includes backup copies of ytab.c and lexyy.c in case
    511 	one makes before looking; it also avoids recreating lexyy.c unless
    512 	really needed.
    513 
    514 	s/aprintf/awkprint, s/asprintf/awksprintf/ to avoid some name clashes
    515 	with unwisely-written header files.
    516 
    517 	thanks to jeffrey friedl for several of these.
    518 
    519 May 26, 1996:
    520 	an attempt to rationalize the (unsigned) char issue.  almost all
    521 	instances of unsigned char have been removed; the handful of places
    522 	in b.c where chars are used as table indices have been hand-crafted.
    523 	added some latin-1 tests to the regression, but i'm not confident;
    524 	none of my compilers seem to care much.  thanks to nelson beebe for
    525 	pointing out some others that do care.
    526 
    527 May 2, 1996:
    528 	removed all register declarations.
    529 
    530 	enhanced split(), as in gawk, etc:  split(s, a, "") splits s into
    531 	a[1]...a[length(s)] with each character a single element.
    532 
    533 	made the same changes for field-splitting if FS is "".
    534 
    535 	added nextfile, as in gawk: causes immediate advance to next
    536 	input file. (thanks to arnold robbins for inspiration and code).
    537 
    538 	small fixes to regexpr code:  can now handle []], [[], and
    539 	variants;  [] is now a syntax error, rather than matching
    540 	everything;  [z-a] is now empty, not z.  far from complete
    541 	or correct, however.  (thanks to jeffrey friedl for pointing out
    542 	some awful behaviors.)
    543 
    544 Apr 29, 1996:
    545 	replaced uchar by uschar everywhere; apparently some compilers
    546 	usurp this name and this causes conflicts.
    547 
    548 	fixed call to time in run.c (bltin); arg is time_t *.
    549 
    550 	replaced horrible pointer/long punning in b.c by a legitimate
    551 	union.  should be safer on 64-bit machines and cleaner everywhere.
    552 	(thanks to nelson beebe for pointing out some of these problems.)
    553 
    554 	replaced nested comments by #if 0...#endif in run.c, lib.c.
    555 
    556 	removed getsval, setsval, execute macros from run.c and lib.c.
    557 	machines are 100x faster than they were when these macros were
    558 	first used.
    559 
    560 	revised filenames: awk.g.y => awkgram.y, awk.lx.l => awklex.l,
    561 	y.tab.[ch] => ytab.[ch], lex.yy.c => lexyy.c, all in the aid of
    562 	portability to nameless systems.
    563 
    564 	"make bundle" now includes yacc and lex output files for recipients
    565 	who don't have yacc or lex.
    566 
    567 Aug 15, 1995:
    568 	initialized Cells in setsymtab more carefully; some fields
    569 	were not set.  (thanks to purify, all of whose complaints i
    570 	think i now understand.)
    571 
    572 	fixed at least one error in gsub that looked at -1-th element
    573 	of an array when substituting for a null match (e.g., $).
    574 
    575 	delete arrayname is now legal; it clears the elements but leaves
    576 	the array, which may not be the right behavior.
    577 
    578 	modified makefile: my current make can't cope with the test used
    579 	to avoid unnecessary yacc invocations.
    580 
    581 Jul 17, 1995:
    582 	added dynamically growing strings to awk.lx.l and b.c
    583 	to permit regular expressions to be much bigger.
    584 	the state arrays can still overflow.
    585 
    586 Aug 24, 1994:
    587 	detect duplicate arguments in function definitions (mdm).
    588 
    589 May 11, 1994:
    590 	trivial fix to printf to limit string size in sub().
    591 
    592 Apr 22, 1994:
    593 	fixed yet another subtle self-assignment problem:
    594 	$1 = $2; $1 = $1 clobbered $1.
    595 
    596 	Regression tests now use private echo, to avoid quoting problems.
    597 
    598 Feb 2, 1994:
    599 	changed error() to print line number as %d, not %g.
    600 
    601 Jul 23, 1993:
    602 	cosmetic changes: increased sizes of some arrays,
    603 	reworded some error messages.
    604 
    605 	added CONVFMT as in posix (just replaced OFMT in getsval)
    606 
    607 	FILENAME is now "" until the first thing that causes a file
    608 	to be opened.
    609 
    610 Nov 28, 1992:
    611 	deleted yyunput and yyoutput from proto.h;
    612 	different versions of lex give these different declarations.
    613 
    614 May 31, 1992:
    615 	added -mr N and -mf N options: more record and fields.
    616 	these really ought to adjust automatically.
    617 
    618 	cleaned up some error messages; "out of space" now means
    619 	malloc returned NULL in all cases.
    620 
    621 	changed rehash so that if it runs out, it just returns;
    622 	things will continue to run slow, but maybe a bit longer.
    623 
    624 Apr 24, 1992:
    625 	remove redundant close of stdin when using -f -.
    626 
    627 	got rid of core dump with -d; awk -d just prints date.
    628 
    629 Apr 12, 1992:
    630 	added explicit check for /dev/std(in,out,err) in redirection.
    631 	unlike gawk, no /dev/fd/n yet.
    632 
    633 	added (file/pipe) builtin.  hard to test satisfactorily.
    634 	not posix.
    635 
    636 Feb 20, 1992:
    637 	recompile after abortive changes;  should be unchanged.
    638 
    639 Dec 2, 1991:
    640 	die-casting time:  converted to ansi C, installed that.
    641 
    642 Nov 30, 1991:
    643 	fixed storage leak in freefa, failing to recover [N]CCL.
    644 	thanks to Bill Jones (jones (at) cs.usask.ca)
    645 
    646 Nov 19, 1991:
    647 	use RAND_MAX instead of literal in builtin().
    648 
    649 Nov 12, 1991:
    650 	cranked up some fixed-size arrays in b.c, and added a test for
    651 	overflow in penter.  thanks to mark larsen.
    652 
    653 Sep 24, 1991:
    654 	increased buffer in gsub.  a very crude fix to a general problem.
    655 	and again on Sep 26.
    656 
    657 Aug 18, 1991:
    658 	enforce variable name syntax for commandline variables: has to
    659 	start with letter or _.
    660 
    661 Jul 27, 1991:
    662 	allow newline after ; in for statements.
    663 
    664 Jul 21, 1991:
    665 	fixed so that in self-assignment like $1=$1, side effects
    666 	like recomputing $0 take place.  (this is getting subtle.)
    667 
    668 Jun 30, 1991:
    669 	better test for detecting too-long output record.
    670 
    671 Jun 2, 1991:
    672 	better defense against very long printf strings.
    673 	made break and continue illegal outside of loops.
    674 
    675 May 13, 1991:
    676 	removed extra arg on gettemp, tempfree.  minor error message rewording.
    677 
    678 May 6, 1991:
    679 	fixed silly bug in hex parsing in hexstr().
    680 	removed an apparently unnecessary test in isnumber().
    681 	warn about weird printf conversions.
    682 	fixed unchecked array overwrite in relex().
    683 
    684 	changed for (i in array) to access elements in sorted order.
    685 	then unchanged it -- it really does run slower in too many cases.
    686 	left the code in place, commented out.
    687 
    688 Feb 10, 1991:
    689 	check error status on all writes, to avoid banging on full disks.
    690 
    691 Jan 28, 1991:
    692 	awk -f - reads the program from stdin.
    693 
    694 Jan 11, 1991:
    695 	failed to set numeric state on $0 in cmd|getline context in run.c.
    696 
    697 Nov 2, 1990:
    698 	fixed sleazy test for integrality in getsval;  use modf.
    699 
    700 Oct 29, 1990:
    701 	fixed sleazy buggy code in lib.c that looked (incorrectly) for
    702 	too long input lines.
    703 
    704 Oct 14, 1990:
    705 	fixed the bug on p. 198 in which it couldn't deduce that an
    706 	argument was an array in some contexts.  replaced the error
    707 	message in intest() by code that damn well makes it an array.
    708 
    709 Oct 8, 1990:
    710 	fixed horrible bug:  types and values were not preserved in
    711 	some kinds of self-assignment. (in assign().)
    712 
    713 Aug 24, 1990:
    714 	changed NCHARS to 256 to handle 8-bit characters in strings
    715 	presented to match(), etc.
    716 
    717 Jun 26, 1990:
    718 	changed struct rrow (awk.h) to use long instead of int for lval,
    719 	since cfoll() stores a pointer in it.  now works better when int's
    720 	are smaller than pointers!
    721 
    722 May 6, 1990:
    723 	AVA fixed the grammar so that ! is uniformly of the same precedence as
    724 	unary + and -.  This renders illegal some constructs like !x=y, which
    725 	now has to be parenthesized as !(x=y), and makes others work properly:
    726 	!x+y is (!x)+y, and x!y is x !y, not two pattern-action statements.
    727 	(These problems were pointed out by Bob Lenk of Posix.)
    728 
    729 	Added \x to regular expressions (already in strings).
    730 	Limited octal to octal digits; \8 and \9 are not octal.
    731 	Centralized the code for parsing escapes in regular expressions.
    732 	Added a bunch of tests to T.re and T.sub to verify some of this.
    733 
    734 Feb 9, 1990:
    735 	fixed null pointer dereference bug in main.c:  -F[nothing].  sigh.
    736 
    737 	restored srand behavior:  it returns the current seed.
    738 
    739 Jan 18, 1990:
    740 	srand now returns previous seed value (0 to start).
    741 
    742 Jan 5, 1990:
    743 	fix potential problem in tran.c -- something was freed,
    744 	then used in freesymtab.
    745 
    746 Oct 18, 1989:
    747 	another try to get the max number of open files set with
    748 	relatively machine-independent code.
    749 
    750 	small fix to input() in case of multiple reads after EOF.
    751 
    752 Oct 11, 1989:
    753 	FILENAME is now defined in the BEGIN block -- too many old
    754 	programs broke.
    755 
    756 	"-" means stdin in getline as well as on the commandline.
    757 
    758 	added a bunch of casts to the code to tell the truth about
    759 	char * vs. unsigned char *, a right royal pain.  added a
    760 	setlocale call to the front of main, though probably no one
    761 	has it usefully implemented yet.
    762 
    763 Aug 24, 1989:
    764 	removed redundant relational tests against nullnode if parse
    765 	tree already had a relational at that point.
    766 
    767 Aug 11, 1989:
    768 	fixed bug:  commandline variable assignment has to look like
    769 	var=something.  (consider the man page for =, in file =.1)
    770 
    771 	changed number of arguments to functions to static arrays
    772 	to avoid repeated malloc calls.
    773 
    774 Aug 2, 1989:
    775 	restored -F (space) separator
    776 
    777 Jul 30, 1989:
    778 	added -v x=1 y=2 ... for immediate commandline variable assignment;
    779 	done before the BEGIN block for sure.  they have to precede the
    780 	program if the program is on the commandline.
    781 	Modified Aug 2 to require a separate -v for each assignment.
    782 
    783 Jul 10, 1989:
    784 	fixed ref-thru-zero bug in environment code in tran.c
    785 
    786 Jun 23, 1989:
    787 	add newline to usage message.
    788 
    789 Jun 14, 1989:
    790 	added some missing ansi printf conversion letters: %i %X %E %G.
    791 	no sensible meaning for h or L, so they may not do what one expects.
    792 
    793 	made %* conversions work.
    794 
    795 	changed x^y so that if n is a positive integer, it's done
    796 	by explicit multiplication, thus achieving maximum accuracy.
    797 	(this should be done by pow() but it seems not to be locally.)
    798 	done to x ^= y as well.
    799 
    800 Jun 4, 1989:
    801 	ENVIRON array contains environment: if shell variable V=thing,
    802 		ENVIRON["V"] is "thing"
    803 
    804 	multiple -f arguments permitted.  error reporting is naive.
    805 	(they were permitted before, but only the last was used.)
    806 
    807 	fixed a really stupid botch in the debugging macro dprintf
    808 
    809 	fixed order of evaluation of commandline assignments to match
    810 	what the book claims:  an argument of the form x=e is evaluated
    811 	at the time it would have been opened if it were a filename (p 63).
    812 	this invalidates the suggested answer to ex 4-1 (p 195).
    813 
    814 	removed some code that permitted -F (space) fieldseparator,
    815 	since it didn't quite work right anyway.  (restored aug 2)
    816 
    817 Apr 27, 1989:
    818 	Line number now accumulated correctly for comment lines.
    819 
    820 Apr 26, 1989:
    821 	Debugging output now includes a version date,
    822 	if one compiles it into the source each time.
    823 
    824 Apr 9, 1989:
    825 	Changed grammar to prohibit constants as 3rd arg of sub and gsub;
    826 	prevents class of overwriting-a-constant errors.  (Last one?)
    827 	This invalidates the "banana" example on page 43 of the book.
    828 
    829 	Added \a ("alert"), \v (vertical tab), \xhhh (hexadecimal),
    830 	as in ANSI, for strings.  Rescinded the sloppiness that permitted
    831 	non-octal digits in \ooo.  Warning:  not all compilers and libraries
    832 	will be able to deal with \x correctly.
    833 
    834 Jan 9, 1989:
    835 	Fixed bug that caused tempcell list to contain a duplicate.
    836 	The fix is kludgy.
    837 
    838 Dec 17, 1988:
    839 	Catches some more commandline errors in main.
    840 	Removed redundant decl of modf in run.c (confuses some compilers).
    841 	Warning:  there's no single declaration of malloc, etc., in awk.h
    842 	that seems to satisfy all compilers.
    843 
    844 Dec 7, 1988:
    845 	Added a bit of code to error printing to avoid printing nulls.
    846 	(Not clear that it actually would.)
    847 
    848 Nov 27, 1988:
    849 	With fear and trembling, modified the grammar to permit
    850 	multiple pattern-action statements on one line without
    851 	an explicit separator.  By definition, this capitulation
    852 	to the ghost of ancient implementations remains undefined
    853 	and thus subject to change without notice or apology.
    854 	DO NOT COUNT ON IT.
    855 
    856 Oct 30, 1988:
    857 	Fixed bug in call() that failed to recover storage.
    858 
    859 	A warning is now generated if there are more arguments
    860 	in the call than in the definition (in lieu of fixing
    861 	another storage leak).
    862 
    863 Oct 20, 1988:
    864 	Fixed %c:  if expr is numeric, use numeric value;
    865 	otherwise print 1st char of string value.  still
    866 	doesn't work if the value is 0 -- won't print \0.
    867 
    868 	Added a few more checks for running out of malloc.
    869 
    870 Oct 12, 1988:
    871 	Fixed bug in call() that freed local arrays twice.
    872 
    873 	Fixed to handle deletion of non-existent array right;
    874 	complains about attempt to delete non-array element.
    875 
    876 Sep 30, 1988:
    877 	Now guarantees to evaluate all arguments of built-in
    878 	functions, as in C;  the appearance is that arguments
    879 	are evaluated before the function is called.  Places
    880 	affected are sub (gsub was ok), substr, printf, and
    881 	all the built-in arithmetic functions in bltin().
    882 	A warning is generated if a bltin() is called with
    883 	the wrong number of arguments.
    884 
    885 	This requires changing makeprof on p167 of the book.
    886 
    887 Aug 23, 1988:
    888 	setting FILENAME in BEGIN caused core dump, apparently
    889 	because it was freeing space not allocated by malloc.
    890 
    891 July 24, 1988:
    892 	fixed egregious error in toupper/tolower functions.
    893 	still subject to rescinding, however.
    894 
    895 July 2, 1988:
    896 	flush stdout before opening file or pipe
    897 
    898 July 2, 1988:
    899 	performance bug in b.c/cgoto(): not freeing some sets of states.
    900 	partial fix only right now, and the number of states increased
    901 	to make it less obvious.
    902 
    903 June 1, 1988:
    904 	check error status on close
    905 
    906 May 28, 1988:
    907 	srand returns seed value it's using.
    908 	see 1/18/90
    909 
    910 May 22, 1988:
    911 	Removed limit on depth of function calls.
    912 
    913 May 10, 1988:
    914 	Fixed lib.c to permit _ in commandline variable names.
    915 
    916 Mar 25, 1988:
    917 	main.c fixed to recognize -- as terminator of command-
    918 	line options.  Illegal options flagged.
    919 	Error reporting slightly cleaned up.
    920 
    921 Dec 2, 1987:
    922 	Newer C compilers apply a strict scope rule to extern
    923 	declarations within functions.  Two extern declarations in
    924 	lib.c and tran.c have been moved to obviate this problem.
    925 
    926 Oct xx, 1987:
    927 	Reluctantly added toupper and tolower functions.
    928 	Subject to rescinding without notice.
    929 
    930 Sep 17, 1987:
    931 	Error-message printer had printf(s) instead of
    932 	printf("%s",s);  got core dumps when the message
    933 	included a %.
    934 
    935 Sep 12, 1987:
    936 	Very long printf strings caused core dump;
    937 	fixed aprintf, asprintf, format to catch them.
    938 	Can still get a core dump in printf itself.
    939 
    940 
    941