Home | History | Annotate | Download | only in www
      1 <html><head><title>toybox news</title>
      2 <!--#include file="header.html" -->
      3 
      4 <p>Toybox combines common Linux command line utilities together
      5 into a single BSD-licensed executable that's simple, small, fast,
      6 reasonably standards-compliant, and powerful enough to turn Android into
      7 a development environment. See the links on the left for details.</p>
      8 
      9 <h2>News</h2>
     10 
     11 <a name="02-02-2016" /><a href="#02-02-2016"><hr><h2><b>February 2, 2016</b></h2></a>
     12 <blockquote><p>"I checked it very thoroughly," said the computer, "and that
     13 quite definitely is the answer. I think the problem, to be quite honest with
     14 you, is that you've never actually known what the question is."
     15 - The Hitchhiker's Guide to the Galaxy.</p></blockquote>
     16 
     17 <p><a href=downloads/toybox-0.7.0.tar.gz>Toybox 0.7.0</a>
     18 (<a href=https://github.com/landley/toybox/releases/tag/0.7.0>git commit</a>)
     19 is out.</p>
     20 
     21 <p>The new commands in defconfig are <b>iotop</b>, <b>top</b>, <b>pgrep</b>,
     22 and <b>pkill</b>
     23 (most replacing corresponding versions from pending). Added grep -ABC,
     24 swapon -d (discard), mkswap -L (label) and UUID support, and find -delete.
     25 Izabera added free -h and unshare -f. Josh Gao implemented tail -f.
     26 Jose Bollo submitted cp --preserve=context,attr. Kylie McClain added
     27 mktemp -u.</p>
     28 
     29 <p>In pending there's the start of a vi command, and Sameer Pradhan contributed
     30 a new dhcp6. This cycle saw several rounds of route cleanup and a little dhcp
     31 cleanup, but neither are complete yet. Lipi Lee did some cleanup to netstat.c
     32 and Elliott Hughes removed warnings from traceroute.</p>
     33 
     34 <p>Lots of updates to ps: several new -o options, -k (--sort) -O and -M,
     35 improved compatibility with Android's historical behavior, and
     36 extensive internal code cleanup (including the removal of all
     37 the magic constants).</p>
     38 
     39 <h3><b>Website</b></h3>
     40 
     41 <p>Dreamhost restored the <a href="#12-21-2015">missing 11 months</a>
     42 to the mailing list archive, in the process deleting the month after
     43 that. Now they've asked if I have mbox files archiving the new
     44 gap (between December 20, 2015 to January 21, 2016, and presumably they
     45 could also fill in the gap from December 14, 2014 to January 3, 2015 that's
     46 been there since the last time they did this),
     47 but due to some gmail filtering I've
     48 <a href=http://landley.net/notes-2012.html#15-10-2012>never
     49 been able to disable</a>, my copy of those files is spread among 3 different
     50 mbox files I'd have to sort/filter/collate. (It's on the todo list.)</p>
     51 
     52 <p>Added a code of conduct to the README (we're
     53 <a href=https://engineering.twitter.com/opensource/code-of-conduct>borrowing twitter's</a>) because somebody
     54 made it necessary.</p>
     55 
     56 <h3><b>Bugfixes</b></h3>
     57 <p>Fixed another sed bug where any ] right after [ was skipped (not just the
     58 first one in the range, so [[] didn't terminate). Fixed sort -f and added test cases.
     59 Assume 80 columns in "ls -m | cat", ls -L is no longer backwards,
     60 and ls of files with no paths no longer uses an uninitialized (zero) dirfd.
     61 Several bugfixes
     62 to find (Gilad Arnold fixed -perm, Daniel K. Levy fixed "find . -exec echo {}",
     63 and while we're there I fixed find --prune, made "find . -execdir
     64 echo {} + -execdir ls {} +" work, and ripped out the environment size
     65 measuring code that checked for a 128k limit removed back in linux 2.6.22).
     66 Elliott Hughes fixed the date command's parsing of 4 digit
     67 years and documented the %s escape, fixed hwclock -u, and pointed out
     68 that runcon needs to exec to do its job (not recursively call another
     69 command_main() in the same process). Tom Marshall reported that blkid was
     70 handling ext2 wrong. Mike Moreton corrected cpio extraction's uid and gid
     71 values, and added a --no-preserve-owner option. Fixed the SUID permission
     72 dropping logic (which was a bit over-zealous, preventing some commands from
     73 running at all).</p>
     74 
     75 <p>I'm told that debian-testing broke its libc so the nsenter build breaks,
     76 but my attempts to install the debian-testing network cd image under
     77 qemu keep breaking. Maybe someday they'll fix it enough I can actually
     78 reproduce the problem. (Debootstrap under unbuntu builds an ubuntu-flavored
     79 chroot in which toybox builds fine.)</p>
     80 
     81 <h3><b>Documentation</b></h3>
     82 <p>Rewrite of the about.html page, tweaks to design.html, and a re-triage of
     83 sbase in roadmap.html. Update to mkstatus.py to collate multiple span
     84 tags with the same id, resulting in a larger status.html page (which
     85 was previously ignoring some commands in the roadmap).</p>
     86 
     87 <p>Expanded the defconfig/allyesconfig/allnoconfighelp text in "make help"
     88 to explain what they're for.</p>
     89 
     90 <h3><b>infrastructure</b></h3>
     91 <ul>
     92 <li><p>Expanded toys.optargs to 64 bits so a command can have more than 32 options.</p></li>
     93 <li><p>Added NOEXIT() wrapper to turn xwrap() functions into warning versions
     94 using the existing longjump(toys.rebound) infrastructure.</p></li>
     95 <li><p>Renamed dirtree->data to dirfd and stopped storing symlink length
     96 into it (this fixed a bug where following symlinks to directories
     97 didn't give a valid directory filehandle, noticeable with ls -Z).</p></li>
     98 <li><p>New TAGGED_ARRAY() infrastructure generates index and bitmask macros
     99 for arrays of structures starting with a name string.</p></li>
    100 <li><p>New lib/linestack.c for utf8 fontmetrics (draw_str() and utf8len()
    101 and so on), and for tracking multiple lines of text
    102 (vi, less, shell history) that need wordwrapping and scrolling up/down.</p></li>
    103 <li><p>Upgrades to lib/interestingtimes.c: scan_key() now has a timeout
    104 in miliseconds and recognizes more sequences including ANSI
    105 window size probes. New utf8 test files in tests/files/utf8 including
    106 sequence reversing, stacked combining chars, and all three types of
    107 unprintable sequences (low ascii <32 ala ^X, invalid utf8 sequences ala
    108 <AB><CD>, and invalid unicode code points ala U+1234).</p></li>
    109 <li><p>More comma handling code in lib.c: comma_args()</p></li>
    110 <li><p>Added error_msg_raw() to shut up fortify's endless static checking false
    111 positives.</p></li>
    112 <li><p>readfileat() can now realloc() in a loop to read long files
    113 ("zcat | insmod" needed it).</p></li>
    114 </ul>
    115 
    116 <h3><b>Roadmap</b></h3>
    117 <p>We're getting close to having a self-hosting development environment
    118 using toybox for the command line. The remaining busybox commands in
    119 <a href=http://landley.net/aboriginal/about.html>Aboriginal Linux</a> are:</p>
    120 
    121 <blockquote><p><b>
    122 awk bunzip2 bzcat bzip2 dd diff expr fdisk ftpd ftpget ftpput gunzip gzip
    123 less ping route sh sha512sum tar test tr unxz vi wget xzcat zcat
    124 </b></p></blockquote>
    125 
    126 <p>And the remaining non-busybox commands in Aboriginal Linux's build/host
    127 directory (from the distcc, genext2fs, e2fsprogs, zlib, and squashfs packagesi)
    128 are:</p>
    129 
    130 <blockquote><p><b>
    131 mke2fs fsck.ext2 resize2fs distcc genext2fs unsquashfs distccd mksquashfs tune2fs
    132 </b></p></blockquote>
    133 
    134 <p>Squashfs and distcc are probably out of scope for toybox, but mke2fs,
    135 fsck.ext2, resize2fs, genext2fs, and tune2fs should all be added to the
    136 above "busybox" replacement list.</p>
    137 
    138 <p>Remind me to include this countdown in future releases. Once they've all
    139 been replaced, the next goal is <a href=http://landley.net/aboriginal/about.html#selfhost>building AOSP under itself</a>.</p>
    140 
    141 <p>See the full <a href=roadmap.html>roadmap</a> and <a href=status.html>status</a>
    142 pages for more details.</p>
    143 
    144 <a name="12-21-2015" /><a href="#12-21-2015"><hr><h2><b>December 21, 2015</b></h2></a>
    145 
    146 <p>Yes, 11 months have gone missing from the mailing list web archive.</p>
    147 
    148 <p>Yesterday evening Dreamhost's mailman server went down (timing out trying
    149 to connect). I poked them about it, they
    150 <a href=https://twitter.com/landley/status/678781271670149121>blamed
    151 DNS</a>, I explained that the hang was _after_ the DNS lookup and
    152 entered the dig info into the trouble ticket showing the IPs the DNS
    153 queries were returning, they reinstalled the server at that IP from what I
    154 assume was their most recent backup, and that's how 11 months of messages
    155 vanished out of the archive.</p>
    156 
    157 <p>I've <a href=https://twitter.com/landley/status/679114451975467008>continued to poke them about it</a> but I honestly believe that's the best they
    158 can do. <a href=http://landley.net/dreamhost.txt>Last time</a>
    159 this sort of thing <a href=http://landley.net/dreamhost2.txt>happened</a>
    160 we went back and forth for months, so I added a link to a backup web
    161 archive (in the nav bar on the left) that isn't controlled by dreamhost,
    162 and thus doesn't gratuitously lose data on a regular basis. (I note
    163 the earlier hole in Dreamhost's archive was never fixed either. That
    164 was data never getting archived, this is a year's worth of data that
    165 was in the archive until yesterday vanishing after the fact.)</p>
    166 
    167 <p>If you're wondering why the <a href=http://lists.landley.net>top level</a>
    168 list page has been "temporarily disabled" for multiple years now... you'd have
    169 to ask Dreamhost. I know I have. More than a dozen times.</p>
    170 
    171 <a name="03-11-2015" /><a href="#03-11-2015"><hr><h2><b>November 3, 2015</b></h2></a>
    172 <blockquote><p>"Alright," said Ford. "How would you react if I said that I'm
    173 not from Guildford after all, but from a small planet somewhere in the vicinity
    174 of Betelgeuse?" Arthur shrugged in a so-so sort of way. "I don't know," he
    175 said, taking a pull of beer. "Why - do you think it's the sort of thing you're
    176 likely to say?" - The Hitchhiker's Guide to the Galaxy.</p></blockquote>
    177 
    178 <p><a href=downloads/toybox-0.6.1.tar.gz>Toybox 0.6.1</a>
    179 (<a href=https://github.com/landley/toybox/releases/tag/0.6.1>git commit</a>)
    180 is out.</p>
    181 
    182 <p>We have a new <b>ps</b> command with all the -o fields posix wants (although
    183 it doesn't accept BSD non-dash option syntax yet), and <b>bunzip2</b> (not just
    184 bzcat but the proper extract-in-place command).
    185 Sameer Pradhan added <b>hostid</b> and <b>fsync</b>.
    186 Elliott Hughes added <b>flock</b>.
    187 
    188 <p>The people waiting for <b>human readable number support</b> (du -hH, ls -h,
    189 and so on) can thank Elliott Hughes for implementing it. (Our output doesn't
    190 exactly match others' because we our "binary" mode will say 1.0G instead of
    191 1024M, which is a bug in the other one we didn't emulate.)</p>
    192 
    193 <p>The other big news is <b>nommu support</b>, tested on the new
    194 <a href=http://nommu.org/jcore>jcore</a> processor but presumaby working
    195 on any nommu system. A few commands don't support nommu yet, but those
    196 are disabled by dependencies on TOYBOX_FORK in menuconfig when building
    197 for nommu. The roadmap now has a large section analyzing the uClinux
    198 project (note that <a href=http://nommu.org>nommu.org</a> is slowly replacing
    199 <a href=http://uclinux.org>uclinux.org</a> as the standard repository of
    200 all knowledge and wisdom about nommu. The old site <a href=#12-02-2012>contains
    201 much that is apocryphal</a>, or at least wildly inaccurate, and the new one
    202 is trying to improve on that).</p>
    203 
    204 <p>Both "make change" and scripts/single.sh (for building standalone commands
    205 without the multiplexer logic) now use the top level .config
    206 for toybox global settings such as Linux Security Blanket Module selection,
    207 (so make defconfig before change now).</p>
    208 
    209 <p>Documentation updates to the <a href=code.html>code</a> and
    210 <a href=roadmap.html>roadmap</a> pages.</p>
    211 
    212 <h3>pending</h3>
    213 
    214 <p>In the pending directory Sameer Pradhan added tftp,
    215 and Elliott Hughes sent lsof. Isaac Dunham upgraded mdev,
    216 reboot, init, login, and modprobe, and fixed a distro-specific build break in
    217 scripts/mkflags.h. Elliott Hughes and Lipi Lee made netstat -p handle
    218 command lines longer than 21 characters, and Elliott fixed netstat -e and
    219 some build warnings. Yeongdeok Suh fixed a warning in dhcpd.
    220 I started cleanup on pgrep/pkill.</p>
    221 
    222 <h3>Command updates, bugfixes, and infrastructure</h3>
    223 
    224 <p>The multiplexer's "command not found" error exit is now 127, so now you can't
    225 distinguish between a command not being found in the multiplexer and
    226 the multiplexer itself not being found by the shell, because people wanted
    227 that for some reason.</p>
    228 
    229 <p>Elliott Hughes made date reject invalid dates rather
    230 than set the clock to something weird (setting the clock 100 years into the
    231 future makes most Linux desktops surprisingly unhappy, and ntpdate won't fix it
    232 either), fixed several ls -l display issues (user/group field ordering,
    233 make user/group/lsmcontext left aligned), did the aforementioned
    234 extensive work on human readable number output, fixed ionice's default
    235 class, fixed a mv overwrite bug, made df's columns auto-size, added
    236 --ppid and -Z to ps, and teamed up with Daniel K. Levy to fix
    237 a segfault in find's handling of -newer -group or -user.</p>
    238 
    239 <p>Hyejin Kim added stat -c %T support. Colin Cross worked
    240 on vmstat fixing
    241 a header printing bug and calculating the bi and bo columns in the right
    242 units. Isabella Parakiss reported that sed -e "/x/c\" -e "y" added an extra
    243 newline and that grep -w '\(x\)\1' didn't work, both now fixed.
    244 Alistair Strachan fixed several problems with switch_root. Kylie McClain
    245 pointed out env should be able to clear variables via NAME= syntax.
    246 Dima Krasner added support for running blkid without a partition (so it shows
    247 all partitions). Hyejin Kim sent in a bunch of static analysis bug reports.</p>
    248 
    249 <p>Isabella Parakiss reported that sed -e "/x/c\" -e "y" added an extra
    250 newline and that grep -w '\(x\)\1' didn't work, both now fixed.
    251 Alistair Strachan fixed several problems with switch_root. Kylie McClain
    252 pointed out env should be able to clear variables via NAME= syntax.
    253 Dima Krasner added support for running blkid without a partition (so it shows
    254 all partitions). Hyejin Kim sent in a bunch of static analysis bug reports.</p>
    255 
    256 <p>Two large thinko fixes in oneit: -3 was always enabled (which would
    257 eventually block if the child never read the exiting PID numbers from its file
    258 descriptor #3 until the pipe filled up), and the signal handlers weren't
    259 set up right (for requesting semi-graceful halt/poweroff/reboot).
    260 Calling install without a mode is now 0755, and install -g 0 no longer clashes
    261 with cp --preserve. Better error message for ls -r on unreadable
    262 directories, and ls -Z now uses O_PATH (with the /proc/self/fd/%d
    263 workaround for kernel stupidity as necessary).</p>
    264 
    265 <p>Date now understands @unixtime[.fraction] and uses -D for
    266 the set-side format (matching busybox's extension for this). The seq -f
    267 string now checks that it's got exactly one %f escape with the correct
    268 attributes (and a whole bunch of test cases for it). Fixed a bug
    269 in od that screwed up the position indicator on arm and mips.
    270 In stat the d/h units moved from %d %D to the default string.
    271 And patch can now correctly apply hunks with trailing context to the start of
    272 the file.</p>
    273 
    274 <p>The prompt argument moved out of yesno() (the caller can print the prompt
    275 themselves). Replaced toys.exithelp with help_exit(). Added new
    276 XVFORK() macro, and xpopen_both() calls /proc/self/exe when passed
    277 a NULL argv (see cpio -p for example usage). Replaced toys.recurse
    278 with toys.stacktop so the recurse or re-exec decision is now based
    279 on bytes of stack space used. Marked a bunch of command-local functions
    280 static.</p>
    281 
    282 <p>New additions to lib/ include strlower(), xconnect(), and the
    283 aforementioned help_exit().
    284 The testsuite now has some infrastructure tests based on "example"
    285 commands such as toys/examples/test_human_readable.c.
    286 The login command finally got a long-overdue cleanup (it's one of the
    287 commands that predate the "pending" directory but were part of the reason
    288 for it). Hexedit had an
    289 uninitialized variable (of course gcc didn't spot it, it was too busy
    290 warning about "may be used uninitialized but never actually is" variables).</p>
    291 
    292 <p>Tweaked makefile so
    293 "make CROSS_COMPILE=prefix-" (as well as "CROSS_COMPILE=prefix- make",
    294 which still works). Toybox is now installed chmod -w so broken installers
    295 (like the bunzip2 package's) that try to overwrite existing binaries won't
    296 knock out the whole of toybox.
    297 GCC 5.2.0 stopped being able to compile Linux 2.6.12's kconfig, but
    298 we added a workaround. You can now build uptime without utmpx.h.
    299 Alejandro Joya pointed out that enabling smack required smack on the host
    300 as well as target when cross compiling, which is now fixed.</p>
    301 
    302 <p>Note: toybox can autodetect nommu support when building with a uClibc
    303 toolchain such as <a href=http://landley.net/aboriginal/downloads/binaries/old/1.4.3/cross-compiler-sh2eb.tar.gz>the one from Aboriginal Linux</a>,
    304 but <a href=http://github.com/richfelker/musl-cross-make>with musl-libc</a>
    305 you'll have to enable CONFIG_TOYBOX_MUSL_NOMMU_IS_BROKEN to work around the
    306 fact they provide a non-functional fork() implementation that always returns
    307 -ENOSYS, to prevent you from compile-time probing for nommu support when
    308 cross-compiling. Unfortunately "preventing you from probing" seems to be
    309 an explicit policy with musl, they also don't provide an "#ifdef __MUSL__"
    310 because their library is perfect and you're only ever allowed to work around
    311 other people's bugs, not theirs. So we have to use menuconfig to manually
    312 enable musl-specific bug workarounds.</p>
    313 
    314 <a name="23-07-2015" /><a href="#23-07-2015"><hr><h2><b>July 23, 2015</b></h2></a>
    315 <p>I recreated the <a href=downloads/toybox-0.6.0.tar.gz>0.6.0 source tarball</a>
    316 (new sha1sum 08fb1c23f520c25a15f262a8a95ea5b676a98d54)
    317 because I forgot to add --prefix to the git archive command when I updated
    318 my release script from mercurial, so the files weren't in an enclosing
    319 directory. (Ooops.)</p>
    320 
    321 <a name="19-07-2015" /><a href="#19-07-2015"><hr><h2><b>July 19, 2015</b></h2></a>
    322 <blockquote><p>
    323 The reason why it was published in the form of a micro sub meson electronic
    324 component is that if it were printed in normal book form, an interstellar
    325 hitchhiker would require several inconveniently large buildings to carry it
    326 around in." - The Hitchhiker's Guide to the Galaxy </p></blockquote>
    327 
    328 <p><a href=downloads/toybox-0.6.0.tar.gz>Toybox 0.6.0</a>
    329 (<a href=https://github.com/landley/toybox/releases/tag/0.6.0>git commit</a>)
    330 is out. (Yes, git. See the <a href=#05-04-2015>previous news entry</a>.)</p>
    331 
    332 <p>Sorry for the unusually long gap between releases. Since last release Ye
    333 Olde Project Maintainer traveled to japan twice and had two more "once
    334 a century" floods at home. (Probably a coincidence.) Still catching up.</p>
    335 
    336 <h3><b>CELF/ELC talk and Wikipedia[citation needed] article</b></h3>
    337 
    338 <p>I gave another State Of The Toybox talk
    339 (<a href=https://www.youtube.com/watch?v=04XwAbtPmAg>video</a>
    340 <a href=http://landley.net/talks/celf-2015.txt>outline</a>), in which I
    341 repeat my <a href=http://landley.net/notes-2013.html#07-11-2013>perennial</a>
    342 <a href=https://twitter.com/landley/status/557309224535851009>complaint</a>
    343 that Wikipedia[citation needed]
    344 <a href=http://en.wikipedia.org/wiki/Toybox>still</a>
    345 <a href=https://en.wikipedia.org/wiki/BusyBox#Controversy_over_Toybox>says</a>
    346 toybox was relicensed before its hiatus, when relicensing was why
    347 the hiatus ended.</p>
    348 
    349 <p>Since Wikipedia[citation needed] seems unable to do the
    350 <a href=#15-11-2011>most</a>
    351 <a href=http://landley.net/hg/toybox/log/tip/LICENSE>basic</a>
    352 <a href=http://landley.net/notes-2011.html#13-11-2011>research</a> on
    353 this point, and has stuck to an incorrect sequence of events for years,
    354 I've been gradually escalating my attempts to correct them. Toybox
    355 came out of mothballs in November 2011 <b>because</b> it could be
    356 relicensed. That's what opened up a new niche busybox wasn't already
    357 filling with a 10 year headstart.</p>
    358 
    359 <a name="asterisk_back" />
    360 <p>The article has plenty of smaller issues<a href=#asterisk>*</a>, but
    361 given that I gave an entire talk at Ohio LinuxFest in 2013
    362 (<a href=http://landley.net/talks/ohio-2013.txt>outline</a>,
    363 <a href=https://archive.org/download/OhioLinuxfest2013/24-Rob_Landley-The_Rise_and_Fall_of_Copyleft.mp3>audio</a>) on why I switched away from GPL for
    364 my projects, that one bugs me.</p>
    365 
    366 <h3><b>New stuff this release</b></h3>
    367 
    368 <p>There's a new android menu in menuconfig, and rather a lot of Linux
    369 Security Module support (Smack for Tizen from Xavier Roche and Jos Bollo,
    370 and SELinux for Android from Elliott Hughes; see
    371 the Security Blanket menu under global settings in menuconfig) has
    372 trickled in, although there's still more to come.</p>
    373 
    374 <p><b>New commands:</b> Added reset, nproc, ionice, and iorenice.
    375 Elliott Hughes contributed xxd, runcon,
    376 restorecon, load_policy, getenforce, setenforce, getprop, and setprop.
    377 Promoted shred, nsenter, and hwclock.</p>
    378 
    379 <p>You can once again build catv now the flag infrastructure's been updated to
    380 let it coexist with cat -v.
    381 And on a long plane flight I wrote
    382 hexedit, an interactive hex editor that implements the start of
    383 cursor control infrastructure (for eventual use by less and vi and shell
    384 command history and so on).</p>
    385 
    386 <p><b>New options:</b> Added sed -E as a BSD-compatible synonym for -r.
    387 Upgraded oneit with -r (restart), -3 (send exiting PID values to child),
    388 and signal handling. Added -v option to timeout, -m to mknod, -u to shred,
    389 -t to dmesg, and -123 to head and tail. Added implicit "." to grep -r without
    390 any files to work on. Hyejin Kim requested prefix support for truncate -s.
    391 Greg Hackman added -inum to find.
    392 Jan Cybulski added the smack side of ls -Z support. Various patches also
    393 added -Z to mkdir, mknod, and mkfifo.
    394 Basic cp --preserve support went in, but not yet the xattr/LSM parts.</p>
    395 
    396 <p>The toybox command now has a --version option,
    397 which uses "git describe" if available.</p>
    398 
    399 <p><b>Build infrastructure:</b>
    400 The "make change" target now saves the output of each failed standalone
    401 command build in a .bad file, and "make defconfig" is quieter now.</p>
    402 
    403 <p>Paul Barker submitted a large patch changing command install paths so
    404 "toybox can be installed alongside busybox without confusing
    405 update-alternatives". (There's some argument over
    406 what the right paths should be, and I'm waiting for
    407 people to tell me what else needs fixing because I have no idea. I've
    408 been symlinking /bin to /usr/bin since 2002
    409 <a href=http://landley.net/writing/hackermonthly-issue022-pg33.pdf>for
    410 historical reasons</a>.)</p>
    411 
    412 <p><b>Docs:</b> The repository link now goes to github, with another link
    413 to the commit rss feed.</p>
    414 
    415 <p>Elliott Hughes updated the Android section of the roadmap
    416 (and he would know). Redid bits of scripts/mkstatus.py to make updating
    417 status.html easier, and the README is larger.</p>
    418 
    419 <p>More description of option parsing in code.html, which now describes the
    420 FLAG_x macros, switching flag macro sets with FOR_newcommand, how
    421 configuration zeroes flag macros and using FORCE_FLAGS to suppress the
    422 zeroing of options shared between commands. Also added description of ";"
    423 to make --longopts take an optional =value part, and more about TOYBOX_DEBUG
    424 to check NEWTOY() option strings (otherwise a bad option string makes
    425 lib/args.c obviously segfault, but doesn't explain why).</p>
    426 
    427 <p>Added a "Why 0BSD?" section to license.html when submitting zero clause bsd
    428 to SPDX (according to the pending license spreadsheet, it's been approved for
    429 SPDX 2.2).</p>
    430 
    431 <p>The old list of commands needing cleanup but not in pending was
    432 removed from toys/pending/README and instead the issues were added
    433 as TODO comments in the individual commands.</p>
    434 
    435 <p><b>Bugfixes:</b>
    436 Fixed mount -a segfaulting without -O (reported by Janus Troelsen),
    437 and made it try a "become rw" ioctl() on the block device before falling
    438 back to mounting read only (because Android expects that).
    439 Fixed printf -- and printf ---. Lots of tweaks to ls -l spacing with
    440 different options. Make touch -d and -t actually set time when you don't
    441 specify nanoseconds.
    442 Fixed a subtle bug where recursive calls (toybox commands that run other
    443 toybox commands) weren't resetting all their state. (This manifested as
    444 a "no }" error from "find | xargs sed", but could cause other problems.)
    445 And David Halls reported another sed bug trying to compile libiconv (which
    446 left extra \ at the start of lines in a generated shell script, breaking
    447 the build). Output an error message for "cat /mnt".</p>
    448 
    449 <p>Kylie McClain reported that mktemp broke when $TMPDIR was set to an empty
    450 string (which is not the same as unset), that install/find didn't support
    451 numeric uid/gids, and that sort -z affects both input and output.
    452 Isabella Parakiss fixed a printf.c bug.
    453 David Halls fixed bugs in install -D and find -exec. Samuel Holland
    454 fixed unshare -r. Hyejin Kim fixed makedevs with a count of 1, fold -w
    455 range checking, an error path in scripts/mkflags.c, added -i to dhcpd,
    456 and stopped su from prompting the root user for the new user's password.
    457 Jan Cybulski spotted wrong indentation when combining ls -s and -i with -C and
    458 -x. Jos Bollo fixed stat %G. Sameer Pradhan fixed a bug in mkfifo -Z.</p>
    459 
    460 <p>Elliott Hughes asked for a default SIGPIPE handler to disable
    461 the signal handler bionic's dynamic loader installs (yes really). Still not
    462 100% sure what the correct behavior is there. (Posix is
    463 (<a href=http://permalink.gmane.org/gmane.comp.standards.posix.austin.general/10915>actively unhelpful</a>, but at least they're taking
    464 <a href=http://austingroupbugs.net/view.php?id=789#c1976>years to
    465 make up their mind</a>. Elliott also sent patches to fix a typo in
    466 useradd.test, add missing arguments to error_exit() calls and clean up
    467 printf() format strings, fix an off by one error in human_readable(),
    468 fix dmesg -c error reporting, fix a segfault in comma_scan where the option
    469 was the last item in optlist (triggered by mount -o ro,remount), fix
    470 hwclock -w, made ifconfig print lowercase MAC addresses (it was bothering
    471 him), and make terminal_size() read the right environment variable
    472 (LINES, not ROWS). And he suggested the test suite notice high command exit
    473 values (corresponding to segfault or other signals).</p>
    474 
    475 <p>People are apparently using toys/pending commands, despite the police tape
    476 and flashing lights, so added louder warnings to toys/pending/README.
    477 Elliott Hughes fixed various problems with tar, dd, more, and top.
    478 Hyejin Kim cleaned up syslogd and dumpleases. Isaac Dunham added hotplug
    479 support to mdev. Yeongdeok Suh added RFC-3315 ipv6 support to dhcpd.</p>
    480 
    481 <p>I rewrote ps.c from scratch (in pending), but it's not ready for real use
    482 yet.</p>
    483 
    484 <p><b>Portability:</b>
    485 On the portability front Bernhard Rosenkranzer fixed a problem where the
    486 menuconfig code wouldn't compile in C99 mode. (This led to me documenting
    487 the craptacular nature of kconfig in a README, and the plan to replace it
    488 sometime before 1.0.) Some extra flags to shut up overzealous llvm warnings
    489 were added (and have to be probed for because gcc complains about
    490 arguments it doesn't recognize even when they switch stuff _off_ using
    491 a standard syntax). Don't depend on malloc(0) to return non-null in ls.
    492 David Halls fixed some mac/ios portability issues,
    493 implying somebody's built at least part of toybox on a mac.</p>
    494 
    495 <p>Added basename_r() to lib/lib.c because the posix semantics for basename()
    496 are stupid but what the gnu guys did to it was appalling.
    497 Turns out bionic already had a basename_r(), but posix still doesn't.
    498 Fixed it up in portability.h, but this
    499 could break more stuff in future. (Correct fix is to lobby posix to add it,
    500 which would probably take about 15 years...)</p>
    501 
    502 <p><b>Infrastructure:</b>
    503 The build now checks $LDFLAGS for linker-only flags, and allows the strip
    504 command to fail (binflt toolchains provide a strip that doesn't work).
    505 Since time.c uses floating point, added TOYBOX_FLOAT dependency in config.</p>
    506 
    507 <p>There's a lib/lsm.h defining varous inline functions for linux
    508 security modules stuff, if (lsm_enabled()) should turn into a compile-time
    509 constant 0 and let code drop out when TOYBOX_LSM_NONE selected, but
    510 testing against CFG_TOYBOX_LSM_NONE or derived symbols is still useful
    511 becuase when it _is_ enabled the probe turns into a system call you
    512 don't want to repeat too much.</p>
    513 
    514 <p>Switched a bunch of commands from signal() to xsignal(). Factored out
    515 xgetgrnamid() and xgetpwnamid() into xwrap.c. Make time.c depend on
    516 TOYBOX_FLOAT (since it always uses float so shouldn't be available on
    517 build targets without even software float). Added readfileat() to lib/lib.c.</p>
    518 
    519 <p>The dirtree infrastructure now passes in full flags for the old symlink
    520 field, and the new DIRTREE_SHUTUP flag disables warnings if a file vanishes
    521 out from under you during traverse. New dirtree_start() wrapper to
    522 create dirtree root with only two arguments.</p>
    523 
    524 <p>The not-curses infrastructure introduced by hexedit mostly moved to
    525 lib/interestingtimes.c.</p>
    526 
    527 <a name="asterisk" />
    528 <a href="#asterisk_back" />Asterisk:</a> such when
    529 Tim contacted me (my blog says a couple days before nov 13, 2011, I.E.
    530 11/11/11 not some specific day 2 months later) to ask if I wanted to work
    531 on a new project he was proposing called
    532 <a href=http://www.elinux.org/Busybox_replacement_project>BentoBox</a>
    533 (because I used to do busybox, he'd forgotten toybox existed
    534 until I brought it up). And don't ask me what "focuses not on compatibility
    535 with its GNU counterparts" means when CP_MORE adds 7 non-posix options
    536 and toys/other has 84 commands in neither posix nor LSB. I think they're
    537 struggling to explain the difference having dismissed "licensing" as being
    538 the reason it started up again after a long hiatus? The reason I don't think
    539 GNU is special is there are a half-dozen other independent
    540 implementations of the same unix command tools out there (AT&amp;T,
    541 BSD, Coherent, Minix, plan 9, busybox, toybox, and several more analyzed in
    542 the <a href=roadmap.html>roadmap</a>, and that's ignoring the implementations
    543 written for DOS or in assembly over the years). But I do care what
    544 Linux From Scratch expects, and if it's
    545 <a href=http://archive.linuxfromscratch.org/lfs-museum/7.6/LFS-BOOK-7.6-NOCHUNKS.html#ch-tools-gcc-pass1>calling mv -v</a>
    546 then I impelement mv -v
    547 even if <a href=http://landley.net/toybox/roadmap.html>posix hasn't got
    548 it</a>. And I don't know why "gnu counterparts" would describe this when
    549 util-linux isn't a gnu package, nor are info-zip, e2fsprogs, kmod, less,
    550 procps, shadow, sysklogd, vim, zlib, sudo, dhcpcd...</p>
    551 
    552 <a name="05-04-2015" /><a href="#05-04-2015"><hr><h2><b>April 5, 2015</b></h2></a>
    553 <p>Since <a href=https://android.googlesource.com/platform/external/toybox/>android</a> and
    554 <a href=https://git.tizen.org/cgit/platform/upstream/toybox.git>tizen</a>
    555 and <a href=https://github.com/kraj/meta-musl/tree/master/recipes-core/toybox>openembedded</a>
    556 and <a href=https://packages.gentoo.org/package/sys-apps/toybox>gentoo</a>
    557 and so on have all been using Georgi Chorbadzhiyski's git mirror rather
    558 than the mercurial repository, I bit the bullet and switched the project's repo
    559 <a href=https://github.com/landley/toybox>to git</a>. Georgi's
    560 <a href=https://github.com/gfto/toybox>mirror</a> is now pulling from that.</p>
    561 
    562 <a name="25-02-2015" /><a href="#25-02-2015"><hr><h2><b>February 25, 2015</b></h2></a>
    563 <blockquote><p>"A common mistake that people make when trying to design
    564 something completely foolproof is to underestimate the ingenuity of
    565 complete fools."</p><p>- The Hitchhiker's Guide to the Galaxy.</p></blockquote>
    566 
    567 <p><a href=downloads/toybox-0.5.2.tar.gz>Toybox 0.5.2</a>
    568 (<a href=/hg/toybox/shortlog/1702>commit 1702</a>) is out.</p>
    569 
    570 <p>New promoted commands: sed (finally fixed enough it builds Linux From
    571 Scratch), printf (cleaned up and promoted), shred and
    572 base64 (the Tizen guys wanted them), getenforce, setenforce, and chcon (android),
    573 mix (promoted with fixes from Isaac Dunham), nsenter (from
    574 Andy Lutomirski, merged into unshare).</p>
    575 
    576 <p>Elliott Hughes submited a bunch of patches to support Android (to
    577 both toybox and Bionic libc, which he maintains). On toybox's end this
    578 involved a lot of fixups to portability.[ch] and fixes to over a dozen
    579 commands, plus several new ones. Other portability fixes included working
    580 with buildroot's uclibc fork and building for nommu targets.</p>
    581 
    582 <p>The new "make change" target builds each toybox command as a standalone
    583 binary. Rather a lot of commands that didn't build by themselves (mv depending
    584 on cp and so on) were hit with a large rock until they built standalone.
    585 This involved rewriting bits of option parsing, more elaborate dependency
    586 generation, making each command have its own config
    587 symbol and main() function (even when it's just a wrapper calling another
    588 command's main()), and so on. Also, some commands can't be built standalone
    589 at a conceptual level: "help" describes other enabled commands and "sh"
    590 has a number of bulitin commands (cd, exit, set) that require the
    591 multiplexer infrastructure, so "make change" filters them out.</p>
    592 
    593 <p>The mailing list's web archive is still screwed up. Dreamhost has
    594 been trying to fix it since approximately September. There are
    595 <a href=http://www.mail-archive.com/toybox@lists.landley.net/>two</a>
    596 <a href=http://news.gmane.org/gmane.linux.toybox>other</a> less broken
    597 archives, but neither has quite the same UI as mailman.</p>
    598 
    599 <h3>Bugfixes and tweaks</h3>
    600 
    601 <p>Cynt Rynt sent in tests for ifconfig,
    602 Robert Thompson taught factor to accept whitespace separated arguments,
    603 Hyejin Kim pointed out that some of mktemp's longopts were attached to
    604 the wrong short options,
    605 Luis Felipe Strano Moraes fixed a wrong free() call in bootchartd in pending.
    606 Patches from Ashwini Sharma to make "df /dev/node" work, prevent du from
    607 looping endlessly following symlinks, and to make expr.c
    608 (in pending) understand == and regex matches. (Speaking of expr, it gets
    609 priority groupings wrong but the bug was actually in the posix spec's
    610 HTML conversion. They fixed the posix spec upstream for us. Still need
    611 to fix the expr code, but it's in pending for a reason...)</p>
    612 
    613 <p>Some commands grew new option flags, such as cp --remove-destination
    614 and touch -h.</p>
    615 
    616 <p>The parallel build has better error reporting now. When toybox needs to
    617 re-exec itself to regain suid root permissions and hasn't got the suid bit,
    618 it now gives the right error message ("not root" instead of "no such command").
    619 
    620 <p>Added a test to "mount" to not mount the same device/directory combination
    621 over itself (the OS catches this for block devices, but not for tmpfs).
    622 Make blkid distinguish ext3 from ext4. Added catv back into cat (because
    623 the Android guys wanted it, and they have historical usage on their side,
    624 so...). Handle nanoseconds in touch.</p>
    625 
    626 <p>Fixed a segfault when CP_MORE was disabled (the resulting option flag list
    627 no longer defined -d but still had it in option groups at the end).
    628 Workaround for glibc redefining dirname() and basename() to random non-posix
    629 semantics because gnu. (They could have created dirname_r() but didn't want
    630 to.)</p>
    631 
    632 <p>Fix an ifconfig test that was preventing assigning an ipv4 address to
    633 interface aliases. Several cleanup passes on hwclock but not quite
    634 promoted out of pending yet.<p>
    635 
    636 <p>Fixed a wrong error message in rm (if you had a chmod 000 directory and
    637 did rm -r on it without -f, after the prompt it would complain it was a
    638 directory, which was not the problem).</p>
    639 
    640 <p>The gzip compression code now does "store only" output to stdout, for
    641 what that's worth.</p>
    642 
    643 <p>Cleanup mountpoint and expand, and remove them from toys/pending/README
    644 (a list of commands that predate the toys/pending directory but needed
    645 another pass).</p>
    646 
    647 <h3>Library and infrastructure:</h3>
    648 
    649 <p>Reworked the option parsing infrastructure so more commands build
    650 standalone (via scripts/single.sh or "make change"). The option flag bit
    651 values are no longer packed, it leaves spaces where currently disabled
    652 flags go, and you can #define FORCE_FLAGS so disabled flags aren't zeroed.
    653 This allows multiple commands to more easily share infrastructure, even if
    654 your current flag context is for a disabled command (switched off in config),
    655 you can force them to stay on and as long as the flags read the same right
    656 to left they'll have the same values.</p>
    657 
    658 <p>We've started removing use of strncpy() because it's a hugely broken
    659 standard C function: the length is the maximum length to _append_, not
    660 the size of the destination buffer. It memsets the remaining space it didn't
    661 copy ala "memset(dest+strlen(dest), 0, len);" so
    662 if you think len is the size of dest you're guaranteed to stomp memory off the
    663 end). And if it runs out of space it won't null terminate because reasons.
    664 (Meanwhile sprintf("%*s", len, str) is counting wide characters in your current
    665 locale, so if you set a locale other than "C" it will also go past your
    666 allocated buffer size. Whoever is maintining the C library standards is really
    667 bad at strings.)
    668 Instead we have xstrncat() which will error_exit() if src+dest+1 doesn't
    669 fit in the buffer. (Because randomly truncating input data isn't necessarily
    670 an improvement.) And there's always xmprintf().</p>
    671 
    672 <p>Similarly, strtol() doesn't return an error indicator on overflow,
    673 you have to clear and then check errno. So new xstrtol() that cares
    674 about overflow.</p>
    675 
    676 <p>The bionic and musl guys agree faccessat(AT_SYMLINK_NOFOLLOW) is not
    677 supported, so stop using it.</p>
    678 
    679 <p>Fixed toy_exec() to detect when argc is in optargs, so we don't
    680 need a separate xexec_optargs().</p>
    681 
    682 <a name="18-02-2015" /><a href="#18-02-2015"><hr><h2><b>February 18, 2015</b></h2></a>
    683 <p>Dreamhost continues to be unable to make mailing list archives work, so
    684 here's <a href=http://www.mail-archive.com/toybox@lists.landley.net/>another
    685 list archive</a> with a less awkward interface than gmane.</p>
    686 
    687 <p>(Neither gives you the convenient historical monthly views of mailman,
    688 but I still have hopes dreamhost will someday figure out what they're doing
    689 wrong. They've only been trying since October. Last month they did a
    690 <a href=http://www.dreamhoststatus.com/2015/01/14/discussion-list-hardware-maintenance/>hardware upgrade to fix a software problem</a>, and the stale
    691 data loads much faster now, so that's something.)</p>
    692 
    693 <p>Update (Feb 19): the archive started updating again, by discarding
    694 all the pending data. So there are now _two_ giant holes in Dreamhost's
    695 web archive, from Dec 15-Jan 3, and then another hole from Jan 16-Feb 18.
    696 The relevant messages are in both of the other archives. Here's hoping
    697 the chronic archive constipation problem won't happen a sixth time.</p>
    698 
    699 <a name="30-12-2014" /><a href="#30-12-2014"><hr><h2><b>December 30, 2014</b></h2></a>
    700 <p>Due to Dreamhost's <a href=http://landley.net/dreamhost.txt>ongoing</a>
    701 <a href=http://landley.net/dreamhost2.txt>inability</a> to make mailman
    702 work reliably, I've added a link to a backup web archive at
    703 <a href=http://news.gmane.org/gmane.linux.toybox>gmane</a> to the nav bar
    704 on the left.</p>
    705 
    706 <p>You still subscribe to the list through
    707 <a href=http://lists.landley.net/listinfo.cgi/toybox-landley.net>the first link</a>.</p>
    708 
    709 <p>Update (January 27, 2015): they're <a href=https://twitter.com/landley/status/558428839462703104>still working on it</a>.</p>
    710 
    711 <a name="19-11-2014" /><a href="#19-11-2014"><hr><h2><b>November 19, 2014</b></h2></a>
    712 
    713 <blockquote><p>"This time it was right, it would work, and no one would have to get nailed to anything." - The Hitchhiker's Guide to the Galaxy.</p></blockquote>
    714 
    715 <p><a href=downloads/toybox-0.5.1.tar.bz2>Toybox 0.5.1</a>
    716 (<a href=/hg/toybox/shortlog/1566>commit 1566</a>) is out.</p>
    717 
    718 <p>It's an interim release, mostly bugfixes. There are several new commands,
    719 but they're all in pending.</p>
    720 
    721 <h3>Development</h3>
    722 
    723 <p>Finally implemented sed, which is still in pending because although
    724 it's feature complete according to posix, and even passes the parts of
    725 Busybox's sed test suite that aren't explicitly testing for gnu bugs we
    726 don't want to copy, it's not yet good enough to build Linux From Scratch.
    727 (The ./configure stages use very long sed scripts. 20 commits worth of
    728 implementation and debugging, just under 1000 lines of code, and there's
    729 still more to do. We're definitely up to some of the "fiddly" commands now.
    730 Did you know "echo hello | sed p - -" segfaults gnu sed in Ubuntu 12.04?
    731 Yeah...)</p>
    732 
    733 <p>Talked with the Tizen developers to follow up on their desire to
    734 make toybox a part of the base Tizen system, and got a list of commands
    735 to add to the roadmap. The tizen todo list is:</p>
    736 
    737 <blockquote><p>
    738 wget, sha256*, gzip, gunzip, bunzip2, rsync, zdiff*,
    739 less, ar, arch, base64, csplit, dir, fmt, join, 
    740 nproc, shred, shuf, stdbuf, stty, test, tr, unexpand,
    741 users, vdir, diff3, sdiff, dosfsck (fsck.vfat), awk, fdisk
    742 </p></blockquote>
    743 
    744 <p>(Most of which was already on the todo list, but it helps prioritize.)</p>
    745 
    746 <p>Fixed md5sum and sha1sum on big endian systems (reported by James McMechan).
    747 Andy Lutomirski fixed unshare's help text and option parsing,
    748 and submitted nsenter (a tool to use setns(2)) to pending.
    749 Isaac Dunham implemented acpi -ctV options, and spotted the bug that ls -d
    750 was inappropraitely following command line symlinks without -H or -L (it
    751 should act like ls -l does), and ls -F handles symlinks wrong too.
    752 Lukasz Szpakowski sent in two bugfixes to tail.c. Cynt Rynt spotted an
    753 unnecessary assignment in lib/password.c.</p>
    754 
    755 <p>Ashwini Sharma's team was as busy as usual, submitting tr, crontab, and
    756 ipcrm, and hwclock to pending, more features to the pending ip.c, and a
    757 pile of bugfixes (to chgrp, killall, ifconfig, insmod,
    758 losetup, comm, cp, id, xwrap, netcat, modprobe, nohup...) mostly found by
    759 static analysis. (These fixes are mostly to seldom-used codepaths like the
    760 TOYBOX_FREE config option, but test coverage is always appreciated.) Ashwini
    761 also suggested upgrading ln -f to leave the original target alone if link
    762 creation fails, and reported that mv -f and -i weren't implemented (now fixed).</p>
    763 
    764 <p>New config option: TOYBOX_NORECURSE prevents xexec() from making internal
    765 function calls (for nommu systems with a finite stack).</p>
    766 
    767 <p>The "toybox" multiplexer command no longer adds a trailing space to each
    768 line of command names, so things like "./toybox | tr ' \n' '|'" to create
    769 a grep pattern snippet are easier to do. (Why you'd want to is your business,
    770 but the output is tidier now.)</p>
    771 
    772 <h3>Infrastructure</h3>
    773 
    774 <p>Isaac Dunham added Android support to portability.h, including compile
    775 probes for functions missing from bionic-libc, and annotated the commands that
    776 use those functions. We haven't really tested building against bionic,
    777 but in theory it's possible now.</p>
    778 
    779 <p>Running the test suite now color codes the PASS/SKIP/FAIL notifications
    780 if output is to a tty. (And in case you missed it last time, VERBOSE=fail
    781 to stop at the first failure is really useful.)</p>
    782 
    783 <p>In loopfiles_rw() use O_CLOEXEC instead of O_RDONLY to request the loop
    784 function close filehandles for us. (Otherwise the callback function must
    785 close each supplied filehandle itself.)</p>
    786 
    787 <p>The printf-style escape parsing ("\n" and friends) got factored out into
    788 a new unescape() function.</p>
    789 
    790 <a name="02-10-2014" /><a href="#02-10-2014"><hr><h2><b>October 2, 2014</b></h2></a>
    791 <blockquote><p>"There is an art, it says, or rather, a knack to flying.
    792 The knack lies in learning how to throw yourself at the ground and miss...
    793 Clearly, it is this second part, the missing, which presents the
    794 difficulties." - The Hitchhiker's Guide to the Galaxy.<p></blockquote>
    795 
    796 <p><a href=downloads/toybox-0.5.0.tar.bz2>Toybox 0.5.0</a>
    797 (<a href=/hg/toybox/shortlog/1512>commit 1512</a>) is out.</p>
    798 
    799 <h3>New commands</h3>
    800 
    801 <p>The new commands are find, install, factor, and mount. Promoted commands
    802 (cleaned up and moved out of "pending") are lspci, inotifyd, and blockdev.</p>
    803 
    804 <p>cp now implements -HL and -F to force delete of pending files, cpio now
    805 ignores -m and implements -p, ls -C now has utf8 support (using wcwidth
    806 instead of strlen), and umount got a number of upgrades involving
    807 looking things up in /proc/mounts. Other minor cleanups happend to
    808 cut, touch, free, and id.</p>
    809 
    810 <p>In pending: Bradley Controy submitted mix (adjusts OSS sound volume). Ashwini
    811 Sharma submitted diff, userdel, blockdev, ipcs, and crond, upgraded
    812 fdisk, fsck, and ftpget, and ran a static analyzer on a lot of other code.
    813 Partial cleanup was done to useradd, userdel, groupadd, and groupdel.</p>
    814 
    815 <h3>Build infrastructure</h3>
    816 
    817 <p><b>Parallel builds</b></p>
    818 
    819 <p>The build now takes advantage of SMP, autodetecting the number of
    820 processors. (Export the environment variable CPUS to pick a specific number.)
    821 Other build changes: split out $LDOPTIMIZE because old compilers complain
    822 about linker options passed with -c, and the entire "generated" directory now
    823 gets deleted by clean (the README that was in there got merged into code.html).</p>
    824 
    825 <p><b>Standalone builds</b></p>
    826 
    827 <p>The standalone build infrastructure (scripts/single.sh) got upgraded to
    828 build more commands as standalone executables. In make.sh the source file
    829 selection uses a regex to find the source files with the NEWTOY/OLDTOY macro
    830 for the command. It enables each command's
    831 sub-options (so CP has CP_MORE), enables I18N and FLOAT support to build
    832 full-featured commands, and includes --help text (at least when
    833 the command doesn't use another command's help). The OLDTOY() macro
    834 now produces (redundant) function prototypes so you can build an OLDTOY
    835 without the NEWTOY</p>
    836 
    837 <p>It doesn't quite have complete coverage yet, the defconfig entries that
    838 aren't building standalone yet are:</p>
    839 
    840 <blockquote><p>chown, egrep, fgrep, fstype, halt, mv, nc, poweroff, unix2dos,
    841 whoami</p></blockquote>
    842 
    843 <p>The main reason for standalone build failures is NEWTOY() or OLDTOY()
    844 entries that don't have their own config symbol. Another problem is entries
    845 that depend on another entry in kconfig, usually because common infrastructure
    846 is using one command's flags (which the other commands copy): if that command
    847 is disabled, the FLAG macros become 0 so dead code elimination can remove the
    848 code. It's <a href=http://landley.net/hg/toybox/rev/1503>possible
    849 to untangle</a> this, but a bit awkward. (It boils down to conflicting
    850 design goals in the two contexts.)</p>
    851 
    852 <p>Standalone builds are used by the test suite when testing individual
    853 commands.
    854 
    855 <p><b>Snapshot builds</b></p>
    856 
    857 <p>A new addition to the "generated" directory is generated/build.sh
    858 containing a single compiler command line to build toybox in its current
    859 configuration. Combined with the generated/*.{h,sh} files from an
    860 exisiting build, this may let you build on a new system that hasn't quite
    861 got enough OS bits working to run a full configureand make.</p>
    862 
    863 <h3>Internals</h3>
    864 
    865 <p>Library code: xcreate/xopen now O_CLOEXEC by default to avoid leaking
    866 filehandles to child processes. DIRTREE_COMEAGAIN's second callback is now
    867 done with the directory filehandle still open (new dir->again variable added
    868 to distinguish first from second callback, and requesting DIRTREE_RECURSE now
    869 requires passing in the specific macro value, not just a true/false).
    870 Use daemon() out of libc instead of hand-rolled daemonize() in various
    871 pending commands. string_to_mode() now passes through type bits so you can
    872 use it to more easily modify a file's existing mode.
    873 Split xpopen() into xpopen_both(), xopen(), and xrun() depending on whether
    874 we want to redirect both, one, or neither of stdin/stdout.</p>
    875 
    876 <p>Bugfixes: Better error message when TOYBOX_SUID option can't drop priviliges
    877 (which happens when you suid something _other_ than root).
    878 The old pending version of nbd_client.c wasn't deleted when the
    879 command was promoted (and the build would break if both were enabled),
    880 toy_exec() sometimes needs to re-exec from $PATH rather than recurse
    881 internally (to gain dropped root permissions or limit stack depth),
    882 always call setlocale() when I18N is enabled to switch it back _off_ when
    883 we run commands that expect sscanf("%n") to return bytes,
    884 dirtree() had a memory leak in an error path, patch.c had some bugs in
    885 error paths (didn't report problem clearly). Ashwini Sharma spotted an
    886 option parsing bug where [-abc] would forget _all_ command line arguments
    887 saved in the GLOBALS() block (not just the ones for options being switched
    888 off), plus various minor fixes to nbd_client and cpio.
    889 Lukasz Szpakowski fixed rm -f on a broken symlink (failed), and killall
    890 with no arguments (segfaulted).</p>
    891 
    892 <p><b>Portability</b></p>
    893 
    894 <p>A somewhat fiddly fix to rm -rf (which needs to chmod directories to u+rwx
    895 to descend into them) which hit a musl bug in faccessat() which the musl
    896 maintainer refuses to fix. (He literally wants the man page changed
    897 instead, despite other libcs working.) Added an #ifdef __MUSL__ section
    898 to portability.h with a workaround, you may need CFLAGS=-D__MUSL__ in your
    899 build if your musl build's features.h doesn't #define that. (I may do
    900 a different workaround in future, but sometimes you've just got to make
    901 it work so you can ship. Also, toybox grep with multiple patterns
    902 requires <a href=http://landley.net/hg/aboriginal/rev/1692>a patch
    903 to musl's regex engine</a>, which applies to 1.1.4 but not to the current
    904 musl source control.)</p>
    905 
    906 <p>More portability.h fixes for uClibc too. (I don't expect that to ever have
    907 another release, so locally patching around posix-2008 violations is silly).</p>
    908 
    909 <p><b>Change to username filtering</b></p>
    910 
    911 <p>Posix recommends the username creation logic filter usernames to a small
    912 allowed set of characters (which even Red Hat breaks by explicitly allowing
    913 "$" at the end), but this prevents UTF-8 usernames. Posix' stated logic
    914 is to allow filesystems to create the user's home directory, but Linux
    915 filesystems can accept any character but NUL and "/". The only characters
    916 we actually _need_ to filter out are ":" (field separator in passwd),
    917 newline (line separator in passwd), and "/" (directory separator in
    918 filesystem).</p>
    919 
    920 <h3>Documentation</h3>
    921 
    922 <p>Web pages updated: cleanup.html documents more cleanup, code.html
    923 documents more code, and about.html now capitalizes "toybox" consistently
    924 (it's just a word, capitalize at start of sentence).</p>
    925 
    926 <p>The pending/README file now lists commands that needed review/cleanup
    927 before the pending directory was added.</p>
    928 
    929 <h3>Test Suite</h3>
    930 
    931 <p>Moved out of scripts/test into top level "tests" directory, and the
    932 testing.sh script is now in scripts rather than mixed into the *.test files.</p>
    933 
    934 <p>Johan Bergstrm requested VERBOSE=fail to make tests (telling it to
    935 stop at the first failure), and spotted a build bug where using gnu
    936 sort on the host broke in non-C locales.</p>
    937 
    938 <p>Divya Kothari submitted tests for chmod, link, tar, bzcat, xzcat, zcat,
    939 and hostname. (And more, but that's all that's merged so far.)</p>
    940 
    941 <a name="07-07-2014" /><a href="#07-07-2014"><hr><h2><b>July 7, 2014</b></h2></a>
    942 <blockquote><p>"This planet has - or rather had - a problem, which was this:
    943 most of the people living on it were unhappy for pretty much of the time. Many
    944 solutions were suggested for this problem, but most of these were largely
    945 concerned with the movement of small green pieces of paper, which was odd
    946 because on the whole it wasn't the small green pieces of paper that were
    947 unhappy." - The Hitchhiker's Guide to the Galaxy.</p></blockquote>
    948 
    949 <p><a href=downloads/toybox-0.4.9.tar.bz2>Toybox 0.4.9</a> (<a href=/hg/toybox/shortlog/1385>commit 1385</a>) is out.</p>
    950 
    951 <p><b>New commands</b> added to pending include:
    952 lsattr, chattr, inotifyd, rfkill, sulogin, strings, makedevs,
    953 killall5, and tar from Ashwini Sharma, arp from Kyungwan Han,
    954 sysctl by Bilal Qureshi, partprobe from Bertold Van den Bergh,
    955 host from Rich felker, and I did nbd-client and the first 2/3 of mount.</p>
    956 
    957 <p>Finished cleanups (commands promoted out of pending):
    958 sysctl, rfkill, strings, mkpasswd, makedevs, partprobe, killall5,
    959 fallocate, and nbd-client.</p>
    960 
    961 <p>(Along the way partial cleanups got made to: last, fold, lspci, ps,
    962 bootchartd, init, fsck, telnetd, telnet, vconfig, toysh, iconv, useradd,
    963 login, host, openvt, deallocvt, getty, tftpd, and modprobe. But there's
    964 still more to do on all of those.)</p>
    965 
    966 <p>This time around the <a href=bin>static binaries</a> are linked against
    967 musl instead of uClibc. (That's why there's no sparc version, musl doesn't
    968 support that target yet.)</p>
    969 
    970 <p><b>Documentation:</b></p>
    971 
    972 <p>The help text parser expects lower case "usage:" lines with
    973 a blank line after them, so go through and regularize those. Expand the
    974 "coding style" section in the docs and move it to design.html. (Not a show
    975 stopper for incoming
    976 contributions, just an explanation of some of the things I'll do to them
    977 during cleanup.) The help text for the "toybox" command now includes
    978 the shell script snippet to install symlinks to the toybox binary.</p>
    979 
    980 <p>The <a href=cleanup.html>cleanup page</a> now has descriptions for the
    981 full ifconfig cleanup series, among others.</p>
    982 
    983 <p>The new toys/examples directory contains hello.c and skeleton.c. The first is
    984 a simple hello world program in toybox style, the second is a much more
    985 elaborate example program using showing how to use the command line option
    986 parsing and how to provide multiple commands in the same C file.</p>
    987 
    988 <p><b>Fixes</b>:</p>
    989 
    990 <p>Fix od bug reported by Samuel Holland ("od -v -b" was appending the default
    991 output type even though an output type was specified). Ashwini Sharma reported
    992 bugs where readfile() was incorrectly freeing its buffer, and where toy_init()
    993 was zeroing the wrong data because the field it was using to measure (rebound)
    994 had moved (when I moved it back I added a comment why the field needs to be
    995 there), fixed a segfault in the dhcp client, and made a 0 length read at
    996 the start of password entry count as EOF. Make the "we are not root" test
    997 in the init code show the help text. Posix implies that fflush() can return
    998 success even when the stream's error bit is set, so call both fflush() and
    999 ferror() from xprintf().</p>
   1000 
   1001 <p>Isaac Dunham pointed out that bloatcheck couldn't deal with diff
   1002 implementations that only implement "unified diff" format, and that some
   1003 diff implementations can't handle nonseekable input (I.E. reading from
   1004 a pipe). Bugfix so "help -a" works again. Option parsing on nohup now stops
   1005 at first nonoption argument. Fix segfault in "which" if PATH wasn't set,
   1006 which was actually a bug in lib function find_in_path(). Made rm -rf of
   1007 chmod 000 directories actually remove them.</p>
   1008 
   1009 <p>The build now passes the same $CFLAGS to the library probe as the final
   1010 build, because arch linux is so broken it provides different sets of
   1011 libraries for static and dynamic linking.</p>
   1012 
   1013 <p>It turns out sprintf("%.123s", str) is counting characters, not bytes,
   1014 so globally enabling locale support opens stack smashing vulnerabilities.
   1015 So there's a new TOYFLAGS_LOCALE you set in toyflags when you want the
   1016 setup code to setlocale().</p>
   1017 
   1018 <p><b>Upgrades:</b></p>
   1019 
   1020 <p>Isaac Dunham extended cpio to archive unreadable empty files, and I taught it
   1021 to set uid/gid and timestamp when extracting archives. Isaac also
   1022 added tests for cpio, link, and du, added lspci -i, made the pci database
   1023 parsing skip # comment lines, merged logname and whoami into id.</p>
   1024 
   1025 <p>Daniel Verkamp sped up md5sum about 30% with some loop unrolling, making
   1026 it actually smaller in the process. I added -b flags to md5sum and sha1sum
   1027 for "brief" output that's just the hash with no filename. (I'm aware other
   1028 implementations use that for MSDOS "binary" mode, and don't care.)</p>
   1029 
   1030 <p>When building standalone commands (scripts/singleconfig.sh commandname),
   1031 the build now switches on all the sub-options of the command so we get
   1032 a standalone version with all the bells and whistles enabled.</p>
   1033 
   1034 <p>Add -ds flags to date and document +FORMAT escapes. Add the shell NOP
   1035 command ":" as an alias for true (for toysh).</p>
   1036 
   1037 <p>Add uClibc probe for iconv() and fallocate. (The fact it didn't always
   1038 build against uClibc is why fallocate wasn't enabled in defconfig before.)</p>
   1039 
   1040 <p>The umount command now does an losetup -d on the device by default, so
   1041 we don't leak loopback devices. Bugfix to losetup so "losetup /dev/loop0
   1042 filename" actually works again.</p>
   1043 
   1044 <p>Divya Kothari sent in test suite entries for ls, ln, rm, mv, printf, dd,
   1045 and renice. Then a second round for lsattr/chattr, mount, chmod, pgrep/pkill,
   1046 groupadd, groupdel, and useradd. Several of these uncovered bugs, still
   1047 working to fix them.</p>
   1048 
   1049 <p>There are now free() functions for the predefined llist types and a
   1050 dlist_terminate() function to break doubly linked lists. The new
   1051 generic_signal() handler either sets "toys.signal" or writes a byte
   1052 to toys.signalfd with the signal number if signalfd isn't -1 (which it's
   1053 initialized to in toy_init).</p>
   1054 
   1055 <p>The option parsing logic can now detect when a double fits in a long and
   1056 use the more precise type for floating point arguments (the FLOAT macro
   1057 contains the type used). The human_readable() function now just outputs
   1058 decimal kilo/mega/gigabytes (so when du -u says 5.0G it means 5.0 billion
   1059 bytes). The build infrastructure now notices duplicate commands (so if you
   1060 cp toys/pending/command.c toys/other/command.c and forget to delete the
   1061 first one, the build break is now more informative).</p>
   1062 
   1063 <a name="20-04-2014" /><a href="#20-04-2014"><hr><h2><b>April 20, 2014</b></h2></a>
   1064 <blockquote><p>And to this end they built themselves a stupendous supercomputer
   1065 which was so amazingly intelligent that even before the data banks
   1066 had been connected up it had started from "I think therefore I am" and got as
   1067 far as the existence of rice pudding and income tax before anyone managed to
   1068 turn it off. - The Hitchhiker's Guide to the Galaxy.</p></blockquote>
   1069 
   1070 <p><a href=downloads/toybox-0.4.8.tar.bz2>Toybox 0.4.8</a> is based on
   1071 <a href=http://landley.net/hg/toybox/shortlog/1262>commit 1262</a>. And
   1072 about time too.</p>
   1073 
   1074 <p>The big news is that the build no longer needs python to generate help.h,
   1075 that's now done in C. The help text generation is also collating help text
   1076 from multiple options, merging command line option blocks and usage: lines.
   1077 There's even a new <a href=help.html>help web page</a>.</p>
   1078 
   1079 <p><b>New commands:</b> Ifconfig, cpio, and su were cleaned up the rest of the
   1080 way and promoted out of pending. That saga is mostly explained on the
   1081 <a href=cleanup.html>cleanup page</a>. Vivek Bhagat's freeramdisk,
   1082 Isaac Dunham's fsfreeze, and Felix Janda's iconv are also new.</p>
   1083 
   1084 <p><b>In pending:</b>
   1085 Ashwini Sharma's team submitted tcpsvd, udpsvd, telnet, telnetd, last, more,
   1086 groupdel/delgroup, arping, brctl, ftpget, ftpput, printf, reset, and added
   1087 ipv6 support to traceroute. Kyungwan Han's team submitted modprobe and getty.
   1088 Vivek Bhagat submitted openvt and deacllocvt. Samuel Holland submitted fold.
   1089 I wrote a new inflate (zip/zlib/gzip decompression) implementation in
   1090 compress.c, and still  need to do a corresponding deflate (compression-side)
   1091 and plug them into gzip and zip and so on. (Right now it does zcat.)</p>
   1092 
   1093 <p>Several commands (vmstat, login, du, vconfig, mountpoint, free, chroot,
   1094 cut, touch, modinfo, expand) predate the "pending" directory, and are thus
   1095 in other directories but still need cleanup. Of these, vmstat got some
   1096 work this time (which would be much easier other vmstat implementations
   1097 documented what their output actually meant).</p>
   1098 
   1099 <p><b>Upgrades:</b> Ifconfig grew /prefix netmask support (ala 1.2.3.4/24). Grep now has -zZ to
   1100 handle null terminated data, cksum grew -H for hex output. Upgraded od so the
   1101 fields align better when producing multiple output types. Help has -a and -h
   1102 options (all commands, html output).
   1103 Bugfix to blkid building for a 32 bit target. The date command can actually
   1104 set dates now. The O_NOFOLLOW compile time probe didn't work with cross
   1105 compiling, so it's back to an #ifdef test in portability.h. Nathan McSween
   1106 sent in a bugfix to od and a portability fix in the common library code.
   1107 Ashwini Sharma spotted a bug in pidof -o, and added verbose (-v) options
   1108 to mkdir and ln, and suggested killall should have an -s option and
   1109 allow -l to take zero arguments. Ashwini Sharma and Felix Janda upgraded
   1110 tftpd.  Fixed dumpleases still using toynet.h after
   1111 that was removed. Corrected killall return code and error reporting.
   1112 Isacc Dunham fixed bugs all over the tree, did cleanup on a bunch of
   1113 pending commands (getty, ftpget, init, openvt, modprobe...), and clarified
   1114 find's help text. Tom Sparrow ran three different static analyzers on
   1115 the code, which resulted in a few cleanups. The peek()/poke() functions
   1116 now use "volatile" to prevent broken compiler "optimizations" to do with
   1117 aliasing.</p>
   1118 
   1119 <p><b>Build stuff:</b> Each FOR_xxxx macro now has a complementary CLEANUP_xxxx macro, so you
   1120 can put multiple commands with different command line options in the same
   1121 .c file, so they can share infrastructure outside of lib. (This let the
   1122 bunzip logic move out of lib into bzcat.c.) See XXX for example.
   1123 i
   1124 <p>The headers #included in toys.h are now grouped by standard, and headers
   1125 not listed in Posix or LSB were moved to portability.h. The old xregcomp.h
   1126 was folded into lib.h because it's posix (and supporting oddball uClibc
   1127 configurations isn't as important as it once was).</p>
   1128 
   1129 <p>Regression tested against Ubuntu 8.04 to fix up bit-rot in defconfig
   1130 build on older systems. (We depend on Posix-2008, but not necessarily
   1131 the absolute latest build environment.)</p>
   1132 
   1133 <p><b>In lib</b>: lib/xwrap.c added xgetpwnam(), xchroot(), and lib/lib.c now has names_to_pid().
   1134 xsetuid() was replaced with xsetuser() which takes a struct passwd
   1135 and sets both gid and uid, mkpathat() got factored out into a library command,
   1136 get_int_value() became atolx_range(), and
   1137 xmsprintf() is now just xmprintf(). The bunzip2 logic moved from lib into
   1138 bzcat.c.</p>
   1139 
   1140 <p><b>Documentation</b>: new <a href=help.html>help page</a> with the
   1141 help text for all the defconfig commands, using the new help -ah output.
   1142 The <a href=code.html>source code walkthrough</a> now says more about
   1143 #including header files, and how the generated/* directory works. The
   1144 <a href=design.html>design page</a> has some new paragraphs about trading
   1145 of different kinds of simplicity, and why comments aren't a substitute for
   1146 good code. The README no longer trails off into obvious unfinished confusion
   1147 at the end. Each page on the website should now have its own title.</p>
   1148 
   1149 <a name="18-11-2013" /><a href="#18-11-2013"><hr><h2><b>November 18, 2013</b></h2></a>
   1150 <blockquote><p>"Space," it says, "is big. Really big. You just won't believe how vastly, hugely, mindbogglingly big it is. I mean, you may think it's a long way down the street to the chemist's, but that's just peanuts to space." -
   1151 The Hitchhiker's Guide to the Galaxy.</p></blockquote>
   1152 
   1153 <p><a href=downloads/toybox-0.4.7.tar.bz2>Toybox 0.4.7</a> is based on
   1154 <a href=http://landley.net/hg/toybox/shortlog/1122>commit 1122</a>.</p>
   1155 
   1156 <p>New commands: Brad Conroy submitted blkid. Elie De Brauwer submitted
   1157 reboot, halt, and poweroff. Strake's nl got cleaned up and promoted from
   1158 pending to posix. In addition, the existing chvt and vconfig got some
   1159 cleanup.</p>
   1160 
   1161 <p>That said, I haven't nearly kept up with the flood of new commands going
   1162 into pending: Ashwini Sharma's team submitted
   1163 dd, dumpleases, traceroute, top, useradd, groupadd, mkpasswd, tftpd, and
   1164 an fsck wrapper (with no filesystem drivers yet). Isaac Dunham sent in cpio.</p>
   1165 
   1166 <p>Bugfixes: Jeroen van Rijn added a user count to uptime. Elie De Brauwer
   1167 added -e to watch, removed a memory leak, and fixed a terminal size problem.
   1168 William Haddon made xargs call its command line once even with blank input
   1169 (the standard is vague, but builds expect it), and fixed an off by one bug
   1170 where grep didn't malloc enough space with -E (leading to a segfault).
   1171 I fixed a glitch in bunzip2 (same one as went into busybox since they're using
   1172 the code I wrote), in od to fix -t co, -J, and -c options. Add uname -o as a
   1173 synonym for -s. Build fix to never use $CC without prefixing it with
   1174 $CROSS_COMPILE (since $HOSTCC could be different). Anca Emanuel spotted
   1175 a typo in the web page.</p>
   1176 
   1177 <p>The compile-time command line option parsing got rewritten (ported from
   1178 bash to C), which should speed up builds a bit and allow code controlled by
   1179 --longopts to drop out properly when disabled in the configuration. Terminal
   1180 querying got refactored. Patch's -x option is now more informative (a
   1181 debug thing if you're trying to figure out why a patch didn't apply).
   1182 The "toynet.h" file got folded into toys.h since musl supports it and
   1183 micromanging uClibc options isn't very interesting anymore. The test suite
   1184 now uses scripts/single.sh when testing a single command.</p>
   1185 
   1186 <a name="17-09-2013" /><a href="#17-09-2013"><hr><h2><b>September 17, 2013</b></h2></a>
   1187 <blockquote><p>"Think of a number," said the computer, "any number."
   1188 Arthur told the computer the telephone number of King's Cross railway
   1189 station passenger inquiries, on the grounds that it must have some function,
   1190 and this might turn out to be it. - The Hitchhiker's Guide to the Galaxy</p>
   1191 </blockquote>
   1192 
   1193 <p><a href=downloads/toybox-0.4.6.tar.bz2>Toybox 0.4.6</a> is based on
   1194 <a href=http://landley.net/hg/toybox/shortlog/1068>commit 1068</a>.</p>
   1195 
   1196 <p>This release adds
   1197 several new commands: Felix Janda wrote paste and fallocate, Kyungwan Han
   1198 submitted eject, Strake contributed grep, Ashwini Sharma added pmap (and
   1199 a testsuite entry for grep), Lukasz Skalski sent pwdx, Isaac Dunham posted
   1200 acpi, and I did timeout and umount.</p>
   1201 
   1202 <p>The ls command now has a --color=auto option (suggested by Rich Felker).
   1203 The multiplexer now has a --help option so you can say "./toybox --help blah"
   1204 instead of using the built-in "help" command. (Which is a shell built-in.
   1205 Try it on your command line, it's like man for shell builtins. But a certain
   1206 other project has conditioned people to expect --help, so...) I forget who
   1207 heehooman at gmail is but they pointed out unshare needed PID and UID
   1208 namespace support.</p>
   1209 
   1210 <h3>Pending</h3>
   1211 
   1212 <p>A lot of new commands in toys/pending, to the point the next release should
   1213 probably just focus on cleanup and review of this backlog. We've got klogd,
   1214 dhcp, dhcpd, watch, route, and ps from
   1215 Ashwini Sharma (and an fsck wrapper but no fsck.fstype engines yet),
   1216 syslogd, pgrep, and pkill from Madhur Verma, netstat by Ranjan Kumar,
   1217 test by Felix Janda, lspci by Isaac Dunham, nl, su, and renice by strake (I.E.
   1218 M. Farkas-Dyck), and sysvinit by Kyungwan Han.</p>
   1219 
   1220 <p>Some cleanup work on existing pending commands that aren't
   1221 ready to promote yet: I did a few more rounds on ifconfig
   1222 and Isaac Dunham's did several cleanups to xzcat, Felix Janda cleaned up
   1223 logger and syslogd...</p>
   1224 
   1225 <p>Also some cleanup work on commands that predate the pending directory,
   1226 but weren't quite polished when they went in, most prominently du,
   1227 expand, and touch.</p> 
   1228 
   1229 <h3>Infrastructure</h3>
   1230 
   1231 <p>The new scripts/single.sh builds a standalone command without the
   1232 multiplexer, although not all commands can be built that way yet (NEWTOY yes,
   1233 OLDTOY no) and the space savings aren't anything to write home about. (If a
   1234 command needs the option parsing logic at all, it needs all of it.) If
   1235 you're curious, you can do:</p>
   1236 
   1237 <blockquote><pre>
   1238 make defconfig
   1239 make
   1240 mkdir singles
   1241 for i in $(./toybox)
   1242 do
   1243   echo $i
   1244   PREFIX=singles/ scripts/single.sh $i || break
   1245 done
   1246 </pre>
   1247 <p>(And then wait a long time and watch almost half the builds fail.)</p>
   1248 </blockquote>
   1249 
   1250 <p>There is now libbuf analogous to toybuf, another global 4k buffer this
   1251 time for use by lib/ code instead of command code.</p>
   1252 
   1253 <p>The lib directory got split up a bit, lib/pending.c contains functions
   1254 not yet used by anything outside of toys/pending/*, and lib/xwrap.c contains
   1255 functions that wrap other functions and handle failures (via error_exit).
   1256 This leaves lib/lib.c containing actual new functions.</p>
   1257 
   1258 <p>General improvements and bug fixes to argument parsing. The [-abc] exclude
   1259 logic should now clear arguments slots when disabling options. Bare --longopts
   1260 should work now and be able to report errors using their name, the new ;
   1261 option allows optional arguments to longopts only suppliable with = (I.E.
   1262 --color and --color=auto but not --color auto).</p>
   1263 
   1264 <p>I'm gradually weaning the code off of itoa()/utoa() because sprintf
   1265 does this already. In this case "simple" probably means "let libc do it
   1266 for us".</p>
   1267 
   1268 <p>Rewrote for_each_pid_with_name_in() and renamed it to just names_to_pid().
   1269 It shouldn't get confused trying to compare absolute and relative paths quite
   1270 so much anymore.</p>
   1271 
   1272 <p>lib/llist.c grew a new dlist_pop() function for removing a doubly
   1273 linked list entry while maintaining a circular list; tail and patch are
   1274 using it now.</p>
   1275 
   1276 <p>The musl guys suggested a new optimization flag
   1277 (-fno-asynchronous-unwind-tables)
   1278 that shaves about 10% off the binary size by removing a C++ism that crept
   1279 into gcc's idea of C. While I don't normally try to micromanage the compiler,
   1280 "-fstop-being-stupid" is a thing you have to hit gcc with from time to time.</p>
   1281 
   1282 <h3>Bugfixes</h3>
   1283 
   1284 <p>Felix Janda and I did a largeish rewrite of tail to
   1285 finally make it work right (we think). Still need to implement tail -f
   1286 someday (the tricky bit is making -f follow multiple files at once).
   1287 Felix also reported a bug in xpidfile.</p>
   1288 
   1289 <p>Juhani Haverinen pointed out that
   1290 python 3 doesn't work with config2help.py, so the detection logic looks
   1291 for python2 (until I get around to rewriting that in C). Elie De Brauwer
   1292 then fixed our first attempt at this, and also fixed uname's help string.</p>
   1293 
   1294 <p>Ashwini Sharma
   1295 pointed out the build was making a FLAG_ macro for " " which broke some
   1296 configurations. (That's a control character, not a command line option.)</p>
   1297 
   1298 <p>Jacek Bukarewicz pointed out a bug in chdir permission handling, and
   1299 a way to make env segfault. Both should be fixed now.</p> 
   1300 
   1301 <p>The new function xexec_optargs()
   1302 replaces calls to xexec(toys.optargs) to avoid freeing and reusing optargs
   1303 during option parsing screwing stuff up (such as netcat's exec mode).</p>
   1304 
   1305 <p>The stat command's %a output was padded with leading zeroes, which
   1306 didn't match anybody else's behavior and thus made the test suite hiccup
   1307 between TEST_HOST and testing toybox. (If you go "TEST_HOST=1 scripts/test.sh
   1308 command" it sanity checks the tests against the host implementation.)</p>
   1309 
   1310 <p>Last release, "mkdir sub/sub && chmod 007 sub/sub && rm -rf sub" didn't
   1311 delete sub and didn't exit with an error either. Neither was correct, rm
   1312 should now be fixed.</p>
   1313 
   1314 <p>
   1315 <a name="26-07-2013" /><a href="#26-07-2013"><hr><h2><b>July 26, 2013</b></h2></a>
   1316 <p>Georgi Chorbadzhiyski maintains a <a href=https://github.com/gfto/toybox>git
   1317 mirror</a> of the repository on github, automatically updated from the
   1318 mercurial every 6 hours. The mirror is read only, but you can generate patches
   1319 against it and post them to the list.</p>
   1320 
   1321 <a name="02-07-2013" /><a href="#02-07-2013"><hr><h2><b>July 2, 2013</b></h2></a>
   1322 <blockquote><p>"Time is an illusion. Lunchtime doubly so." "Very deep. You
   1323 should send that in to the Reader's Digest. They've got a page for people
   1324 like you." -
   1325 The Hitchhiker's Guide to the Galaxy.</p></blockquote>
   1326 
   1327 <p><a href=downloads/toybox-0.4.5.tar.bz2>Toybox 0.4.5</a> is based on
   1328 <a href=http://landley.net/hg/toybox/shortlog/941>commit 941</a>. It adds
   1329 uuencode and uudecode from Erich Plondke, and enables Luis Morales' "who" by
   1330 default. Felix Janda and I cleaned up last year's "stat" submission and
   1331 enabled it. Ivo van Poorten added "groups".
   1332 Andre Renaud added "lsusb". I implemented "split", "pivot_root", and "mv".
   1333 </p>
   1334 
   1335 <p>The "help" command is implemented differently now (lib/help.c) and
   1336 each command can now understand --help (including both "toybox --help"
   1337 and "toybox --help command" in the multiplexer).</p>
   1338 
   1339 <p>The "pending" directory has several commands (find, xzcat, nbd-client,
   1340 logger, expr) which work but are not enabled by default pending further cleanup.
   1341 Ifconfig is enabled, but still in pending because it's only 2/3 cleaned up.
   1342 (It's an awkward halfway state but I'm not holding up the release for it.)</p>
   1343 
   1344 <p>I'm <a href=cleanup.html>documenting the cleanups</a> to teach
   1345 more people to do it, but the writeups aren't caught up yet. The
   1346 <a href=roadmap.html>roadmap</a> also got updated a bit with further analysis
   1347 of other projects, and the README and about pages got updated.</p>
   1348 
   1349 <p>Fixed _another_ "ls -C" segfault when terminal size can't be detected,
   1350 condensed the ls help text to fit on one page, implented --color, and taught
   1351 -l to print the major, minor numbers when showing block/char devices.
   1352 Argument parsing now handles "--" properly (to end option checking),
   1353 and the infrastructure can now handle bare --longopts that have no
   1354 corresponding short option (both were implemented before but didn't work).
   1355 Fixed an old bug in "patch", chmod grew -f, who grew -a. Isaac Dunham
   1356 fixed "-" vs "_" handling in modinfo, added a "firmware" output
   1357 field, added -b and -k support, and taught it that the ".ko" extension means
   1358 to look for the file at the specified path instead of under /lib. Felix Janda
   1359 moved file permission display code to lib so ls and
   1360 stat could share it. Ashwini Sharma spotted a bug in xabspath when the
   1361 last path component exists but we haven't got permissions to open it
   1362 (ala readlink -f /dev/sda as a normal user).
   1363 </p>
   1364 
   1365 <p>In the build infrastructure, scripts/findglobals.sh finds leaked global
   1366 variables. (Leaked means they aren't part of the global union: Other than glibc
   1367 debris, toybox should define "this", "toy_list", "toybuf", and "toys", and
   1368 that's it; the rest add memory footprint to every command for the benefit of
   1369 just one command; use GLOBALS() to stick 'em in the union.) Static linking
   1370 against libraries other than the host's libc now applies to feature probes
   1371 for unshare and such. Neuter stupid internationalization support that makes
   1372 various host "sort" commands put things in an order other than alphabetical
   1373 (breaking the multiplexer's binary search on command names).
   1374 
   1375 <p>You should now be able to build from a source control snapshot on a build
   1376 system that hasn't got python: if you disable CONFIG_TOYBOX_HELP. (The
   1377 release tarballs ship generated/help.h, but it's not in source control.
   1378 Eventually I should rewrite that python script in C.)</p>
   1379 </p>
   1380 
   1381 <p><b>LICENSE TWEAK</b>: After <a href=http://lists.landley.net/pipermail/toybox-landley.net/2013-March/000794.html>discussion</a> on the mailing list the "2 clause
   1382 BSD" <a href=license.html>license</a> got slightly simplified so the first
   1383 paragraph now says:</p>
   1384 
   1385 <blockquote><p>Permission to use, copy, modify, and/or distribute this
   1386 software for any purpose with or without fee is hereby granted.</p></blockquote>
   1387 
   1388 <p>It used to continue "provided that the above copyright notice and this
   1389 permission notice appear in all copies", but A) what's the point? B) does "all
   1390 copies" mean binaries, or just source code, or what? C) lots of projects
   1391 that consider BSD and GPL compatible have <a href=https://git.kernel.org/cgit/linux/kernel/git/torvalds/linux.git/tree/crypto/aes_generic.c>files with
   1392 both license notices</a> on them (sometimes at <a href=http://git.busybox.net/busybox/tree/shell/ash.c>opposite ends of the file</a> to make the conflict
   1393 less obvious) because "all copies must include this function" would violate
   1394 the GPL but "all copies must include this magic text blob" somehow don't?</p>
   1395 
   1396 <p>I don't want to have to care about this anymore. The tweaked version is more
   1397 or less public domain with a liability disclaimer, but we're still calling it
   1398 BSD (sometimes "0 clause BSD") to avoid explaining.</p>
   1399 
   1400 <a name="21-03-2013" /><a href="#21-03-2013"><hr><h2><b>March 21, 2013</b></h2></a>
   1401 <p>Video of my ELC talk
   1402 "<a href=http://youtu.be/SGmtP5Lg_t0>Why is Toybox?</a>"
   1403 is up on youtube. Related materials include the
   1404 <a href=http://landley.net/talks/celf-2013.txt>talk outline</a> and an
   1405 <a href=/aboriginal/about.html#selfhost>android self-hosting writeup</a>.</p>
   1406 
   1407 <p>[Updated June 4] The following links jump to specific topics in the video. (Sorry about
   1408 the ads, it's The Linux Foundation.)</p>
   1409 
   1410 <ul>
   1411 <li>0m29s <a href=http://www.youtube.com/watch?v=SGmtP5Lg_t0#t=0m29s>The smartphone is replacing the PC</a></li>
   1412   <ul>
   1413   <li>4m22s <a href=http://www.youtube.com/watch?v=SGmtP5Lg_t0#t=4m22s>Software needed to become self-hosting</a></li>
   1414   <li>6m20s <a href=http://www.youtube.com/watch?v=SGmtP5Lg_t0#t=6m20s>Do we care if android or iphone wins?</a></li>
   1415   </ul>
   1416 <li>9m45s <a href=http://www.youtube.com/watch?v=SGmtP5Lg_t0#t=9m45s>Android not vanilla: oppose or accept?</a></li>
   1417   <ul>
   1418   <li>11m30s <a href=http://www.youtube.com/watch?v=SGmtP5Lg_t0#t=11m30s>Open source can't do User Interfaces</a></li>
   1419   </ul>
   1420 <li>15m09s <a href=http://www.youtube.com/watch?v=SGmtP5Lg_t0#t=15m09s>Android is not copyleft: oppose or accept?</a></li>
   1421 <li>18m23s <a href=http://www.youtube.com/watch?v=SGmtP5Lg_t0#t=18m23s>Security issues</a></li>
   1422 <li>21m15s <a href=http://www.youtube.com/watch?v=SGmtP5Lg_t0#t=21m15s>Solutions to the software problems</a></li>
   1423   <ul>
   1424   <li>22m55s <a href=http://www.youtube.com/watch?v=SGmtP5Lg_t0#t=22m55s>What toybox needs to be/do</a></li>
   1425   <li>28m17s <a href=http://www.youtube.com/watch?v=SGmtP5Lg_t0#t=28m17s>What is toybox?</a></li>
   1426     <ul>
   1427     <li>28m58s <a href=http://www.youtube.com/watch?v=SGmtP5Lg_t0#t=28m58s>Why toybox started...</a></li>
   1428     <li>37m50s <a href=http://www.youtube.com/watch?v=SGmtP5Lg_t0#t=37m50s>What does toybox actually implement?</a></li>
   1429     </ul>
   1430   </ul>
   1431 </ul>
   1432 </span>
   1433 
   1434 
   1435 <a name="14-03-2013" /><a href="#14-03-2013"><hr><h2><b>March 14, 2013</b></h2></a>
   1436 <blockquote><p>"Ford, you're turning into a penguin. Stop it." -
   1437 The Hitchhiker's Guide to the Galaxy.</p></blockquote>
   1438 
   1439 <p><a href=downloads/toybox-0.4.4.tar.bz2>Toybox 0.4.4</a> is based on
   1440 <a href=http://landley.net/hg/toybox/shortlog/813>commit 813</a>, adding
   1441 the "time" and "readahead" commands, plus some bugfixes.</p>
   1442 
   1443 <p>The "cp" command now implements the -s symlink option, plus bugfixes
   1444 getting various corner cases right as used in actual package builds.
   1445 "id -Gn root" should now print root's groups
   1446 instead of the current user's. Several build fixes so toybox builds under
   1447 Ubuntu 8.04 again (which is about as old a build environment as you
   1448 can expect to find posix-2008 features in).</p>
   1449 
   1450 <p>Unfinished commands have generally been moved to "toys/pending".
   1451 Everything else should "default y" to participate in make defconfig.
   1452 Several of those pending commands got some basic cleanup so allyesconfig
   1453 should at least compile (although defconfig is still what's useful).</p>
   1454 
   1455 <p>Significant roadmap updates, checking several other multicall binaries
   1456 (klibc, sash, sbase, s6...) to see what commands they include.</p>
   1457 
   1458 <a name="18-01-2013" /><a href="#18-01-2013"><hr><h2><b>January 18, 2013</b></h2></a>
   1459 <blockquote><p>This must be Thursday. I never could get the hang of Thursdays. - The Hitchhiker's Guide to the Galaxy.</p></blockquote>
   1460 
   1461 <p><a href=downloads/toybox-0.4.3.tar.bz2>Toybox 0.4.3</a> is based on
   1462 <a href=http://landley.net/hg/toybox/shortlog/793>commit 793</a>. There
   1463 are now exactly 100 commands in defconfig (of a little over 220 on the
   1464 <a href=roadmap.html>todo list</a>).</p>
   1465 
   1466 <p>Elie De Brauwer added the rev command, cleaned up tac, implemented the -s
   1467 and -f flags for seq, added -v and -i to killall (and fixed killall not to
   1468 kill itself before finishing its pid list), and added to the test suite.
   1469 Felix Janda added -m to mkdir, pwd -L and -P, and more test suite entries.</p>
   1470 
   1471 <p>Rob Landley added the losetup command, and fixed the existing ls, cp, and
   1472 readlink commands. The segfault in ls
   1473 happened when it couldn't determine the screen size (last release changed the
   1474 default to -C and a screen size of 0 made column view unhappy), and cp got an
   1475 extensive rewrite bringing it up to date with the dirtree changes and fixing
   1476 a number of things it never did right in the first place. The xabspath()
   1477 code in the library now handles a symlink after ".." properly (and the test
   1478 suite checks for it).</p>
   1479 
   1480 <p>Infrastructure-wise the code is better about automatically setting the
   1481 error return code properly. Now error_msg() sets the exit code to 1 if it's
   1482 still defaulting to 0, and the global exit path does a fflush(NULL) with error
   1483 bit check rather than trying to be quite so granular about flushing. (That
   1484 means if we use printf() instead of xprintf() it still exits with the right
   1485 error code, it just doesn't end the program early on an output error.)
   1486 Minor bugfix so TOYBOX_DEBUG
   1487 doesn't always warn about the lack of suid bit when toybox is built with
   1488 at least one STAYROOT command. Bugfix for the option [grouping] logic
   1489 (and then further fixes to the error reporting pointed out by Ashwini Sharma).
   1490 dirtree_handle_callback() now has a prefix like the rest of the dirtree
   1491 functions. A lot of stuff doing manual path handling was switched to using
   1492 libc basename() (including, embarassingly, the basename command), which means
   1493 it now correctly detects "/trailing/slash/" which the previous code didn't.</p>
   1494 
   1495 <p>Also, last release included some accidentally checked in debug code that
   1496 disabled compiler optimization, so the binary size bloated a bit. It's back
   1497 to -Os by default now.</p>
   1498 
   1499 <a name="15-12-2012" /><a href="#15-12-2012"><hr><h2><b>December 15, 2012</b></h2></a>
   1500 <blockquote><p>"The major difference between a thing that might go wrong and a
   1501 thing that cannot possibly go wrong is that when a thing that cannot possibly
   1502 go wrong goes wrong it usually turns out to be impossible to get at or repair."
   1503 </p><p>- The Hitchhiker's Guide to the Galaxy.</p></blockquote>
   1504 
   1505 <p><a href=downloads/toybox-0.4.2.tar.bz2>Toybox 0.4.2</a> is based on
   1506 <a href=http://landley.net/hg/toybox/shortlog/749>commit 749</a> and is
   1507 just a resync. Linux 3.7 came out, meaning it's time to do an Aboriginal
   1508 Linux release, and that should use a stable version of toybox. So here's
   1509 a new stable version.</p>
   1510 
   1511 <p>The new commands are cut (from Jason Kyungwan Han), touch
   1512 (from Choubey Ji), expand (from Jonathan Clairembault, and he fixed a
   1513 bug in login), and rm (from Rob Landley). Felix Janda added UTF-8
   1514 support infrastructure (for non-ascii character sets) with a config option.
   1515 Elie De Brauwer added tests for cat and sha1sum, and -so options to pidof.
   1516 The "ls" command defaults to -C (column view) now, and "readlink" now supports
   1517 -fenq.</p>
   1518 
   1519 <p>Portability work: toybox should now build against the musl C library,
   1520 and against older glibc versions (circa 2008, much before that and kernel
   1521 features we depend on start to drop out).</p>
   1522 
   1523 <p>The whole codebase got reindented from "one tab" to "two spaces" per
   1524 level. The option parsing logic now understands [groups] of commands (when more
   1525 than one in a group is selected it can switch the others off, or error out,
   1526 or other things). The error_exit() infrastructure can now longjmp back to an
   1527 earlier point instead of exiting. Each toys/* directory now has a README,
   1528 the first line of which is the fancy name menuconfig uses for the directory
   1529 (so no more hardwired directory list in scripts/genconfig.sh).</p>
   1530 
   1531 <p>Fixed a filehandle leak in getmountlist().
   1532 Pass parent pointer to dirtree_add_node() so it can give error messages with
   1533 full path. The yesno() function now always reads from stdin and writes to
   1534 stderr (we can retry tty checking complexity once we've got commands needing
   1535 it).</p>
   1536 
   1537 <p>The open group broke their website so the
   1538 <a href=http://opengroup.org/onlinepubs/9699919799>old links</a> to POSIX 2008
   1539 now <a href=http://pubs.opengroup.org/onlinepubs/9699919799>need to start with
   1540 pubs</a>. Some of the links in the tree have been updated, others haven't while
   1541 I wait to see if their webmaster notices and fixes it.</p>
   1542 
   1543 <p>(I note that the current rm implementation is not technically posix compliant
   1544 because the standard requires infinite recursion depth and the current
   1545 implementation uses one filehandle per level. I can add a config option
   1546 to do it Posix's way, which is more brittle and needs extra security checks,
   1547 but am waiting for somebody to complain first. The default "ulimit -n" is 1024
   1548 filehandles, so drilling down over 1000 nested subdirectories).</p>
   1549 
   1550 <a name="13-11-2012" /><a href="#13-11-2012"><hr><h2><b>November 13, 2012</b></h2></a>
   1551 <blockquote><p>"Rule Six: The winning team shall be the first team that wins."
   1552 - The Hitchhiker's Guide to the Galaxy.</p></blockquote>
   1553 
   1554 <p><a href=downloads/toybox-0.4.1.tar.bz2>Toybox 0.4.1</a> is based on
   1555 <a href=http://landley.net/hg/toybox/shortlog/691>commit 691</a>.</p>
   1556 
   1557 <p>Elie De Brauwer contributed usleep, Ashwini Kumar contributed du, and
   1558 Kyungwan Han contributed vconfig. Other new commands include switch_root and
   1559 md5sum, and the remaining shell wrappers are now proper commands (dos2unix,
   1560 unix2dos).</p>
   1561 
   1562 <p>The patch command now supports -l, and gethostname is now enabled by
   1563 default. The df command follows symlinks to get the actual device name.
   1564 Felix Janda added -m support to wc (for utf8).</p>
   1565 
   1566 <p>On the infrastructure side, the commands have now been grouped into
   1567 "posix", "lsb", and "other" subdirectories (for things required by Posix-2008,
   1568 the Linux Standard Base 4.1, and commands in neither). This affects menuconfig
   1569 and the actual source layout (toys/cp.c is now toys/posix/cp.c, and so on).
   1570 An android directory is planned (see the updated
   1571 <a href=roadmap.html#android>android roadmap analysis</a>).</p>
   1572 
   1573 <p>The FLAG_ macros for command option parsing and TT alias for the command's
   1574 global block are now automatically generated, commands should
   1575 #define FOR_commandname before #including <toys.h> to get the macros for that
   1576 command.</p>
   1577 
   1578 <p>An upgrade to the build infrastructure now allows commands with _ and -
   1579 in them, such as switch_root.</p>
   1580 
   1581 <p>Bugfixes: Avery Pennarun spotted a case where ls showed uid twice instead of
   1582 uid and gid, and that nice was using the wrong range of numbers.
   1583 The ls command also recursed inappropriately last time (not quite
   1584 properly converted for the dirtree changes last release), and now it's
   1585 fixed. Roy Tam pointed out a glitch in sh, and fixed df's percentage
   1586 calculation to match the POSIX spec. The kernel build didn't like our mktemp
   1587 and it does now. The wc command wasn't quite posix compliant (trailing spaces
   1588 break stuff). The ls command recursed inappropriately last time (not quite
   1589 properly converted for the dirtree changes last release), and now it's
   1590 fixed. The catv command wasn't displaying byte 255 correctly. Some lib
   1591 fixes (thinko in xpidfile). Fixed uname -m when running a 32 bit x86 binary
   1592 on an x86-64 host (it lies and says the system is i686, i586, or i486 depending
   1593 on what the toolchain that built the binary supported. This makes builds in
   1594 a 32 bit chroot on a 64 bit kernel break less.) The df command was checking
   1595 partitions in the wrong order (displaying undermounts instead of overmounts:
   1596 this used to work but some library code changed out from under it and it
   1597 wasn't updated to match until now). Felix Janda filled out the test suite
   1598 some more. The patch file creation logic got tweaked several times to
   1599 successfully apply more patches. Support for older (pre 2.10) glibc
   1600 versions was added to portability.h.</p>
   1601 
   1602 <p>Miscelaneous cleanups all around (mknod, sha1sum, logname), including a
   1603 rewrite of taskset to be less dependent on libc getting the headers right. All
   1604 the command headers should now point to the current relevant standards
   1605 document, where applicable.</p>
   1606 
   1607 <p>This news page had old news entries from before the relaunch moved into
   1608 a separate <a href=oldnews.html>oldnews</a> page.</p>
   1609 
   1610 <p>I forgot to create <a href=bin>static binaries</a> last time, but they're
   1611 back now.</p>
   1612 </span>
   1613 
   1614 <a name="23-07-2012" /><a href="#23-07-2012"><hr><h2><b>July 23, 2012</b></h2></a>
   1615 <blockquote><p>"Ford", Arthur said. "There's an infinite number of monkeys
   1616 out here who want to talk to us about this script for Hamlet they've worked
   1617 out." - The Hitchhiker's Guide to the Galaxy.</p></blockquote>
   1618 
   1619 <p><a href=downloads/toybox-0.4.0.tar.bz2>Toybox 0.4.0</a> is based on
   1620 <a href=http://landley.net/hg/toybox/shortlog/640>commit 640</a>.</p>
   1621 
   1622 <p>The new <a href=status.html>status page</a> is calculated from
   1623 the roadmap info, and should be easier to keep up to date in future.</p>
   1624 
   1625 <p>Andre Renaud contributed od and modinfo. Elie De Brauwer contributed
   1626 taskset, bugfixes to cmp and tail, and tests for sort and tail. Kyungwan Han
   1627 contributed passwd. Gaurang Shastri contributed w. Ashwini Sharma spotted a
   1628 case where dirtree was adding extra slashes to a path.</p>
   1629 
   1630 <p>I rewrote od, cleaned up comm, documented the
   1631 <a href=code.html#lib_llist>llist</a> and
   1632 <a href=code.html#lib_dirtree>dirtree</a> infrastructure, added an -r option
   1633 to date (and fixed a bug where -u wouldn't override /etc/localtime),
   1634 fixed bugs in chmod +stw, fixed ls to show suid bits properly when the
   1635 corresponding executable bit wasn't set, and worked around a longstanding
   1636 glibc bug where static linking prevents stdout from automatically flushing
   1637 pending output on exit.</p>
   1638 
   1639 <a name="25-06-2012" /><a href="#25-06-2012"><hr><h2><b>June 25, 2012</b></h2></a>
   1640 <blockquote><p>"For a moment, nothing happened. Then, after a second or so, nothing continued to happen." - The Hitchhiker's Guide to the Galaxy.</p></blockquote>
   1641 
   1642 <p><a href=downloads/toybox-0.3.1.tar.bz2>Toybox 0.3.1</a> is based on commit
   1643 <a href=http://landley.net/hg/toybox/shortlog/607>commit 607</a>. It's
   1644 mostly a bugfix release for ls -l (which was unhappy on targets other than
   1645 x86-64), plus a new "date" from Andre Renaud and rewritten chgrp/chown which
   1646 now support the full set of posix flags, plus a little work on the test
   1647 suite and some more header tweaks towards eventual compatability with the
   1648 musl libc.</p>
   1649 
   1650 <p>The todo list runneth over, but "release early, release often", so here
   1651 it is. The roadmap and documentation are a bit behind, and I've got ~40
   1652 pending submissions to review. I need to catch up...</p>
   1653 </span>
   1654 
   1655 <a name="12-06-2012" /><a href="#12-06-2012"><hr><h2><b>June 12, 2012</b></h2></a>
   1656 <blockquote><p>"For instance, on the planet Earth, man had always assumed that
   1657 he was more intelligent than dolphins because he had achieved so much - the
   1658 wheel, New York, wars and so on - whilst all the dolphins had ever done was
   1659 muck about in the water having a good time. But conversely, the dolphins had
   1660 always believed that they were far more intelligent than man - for precisely
   1661 the same reasons." - The Hitchhiker's Guide to the Galaxy.</p></blockquote>
   1662 
   1663 <p>It's well past time for <a href=downloads/toybox-0.3.0.tar.bz2>toybox 0.3.0</a>,
   1664 so here it is, based
   1665 on <a href=http://landley.net/hg/toybox/shortlog/595>commit 595</a>, and the
   1666 statically linked <a href=downloads/binaries>prebuilt binaries</a> should
   1667 actually be statically linked this time (thanks Ashwini Sharma for spotting
   1668 that).</p>
   1669 
   1670 <p>It's hard to figure out where to cut a release, because development
   1671 doesn't stop. "Long before now" is the obviuos answer, of course.
   1672 The project's maintainer also moved house during this development cycle, which
   1673 threw things off for a bit (so many boxes). Releases should hopefully be a bit
   1674 more frequent from here on.</p>
   1675 
   1676 <p>The big things Rob worked on this time were the new dirtree (directory
   1677 tree traversal) infrastructure, and a complete rewrite of ls using that
   1678 which should now implement all 26 posix options.</p>
   1679 
   1680 <p>Georgi Chorbadzhiyski added printenv, whoami, mkdir, mkfifo, chmod, chown,
   1681 chgrp, and uniq. He also added fraction and extension support to sleep (so if
   1682 you need a quarter-second sleep, it can do that now), and fixed a build bug
   1683 on slackware.</p>
   1684 
   1685 <p>Daniel Walter contributed a string to mode_t parser (in use by chmod and
   1686 mkdir -m).  Ilya Kuzmich contributed comm. Elie De Brauwer added mountpoint,
   1687 vmstat, logname, login, and mktemp. Kevin Chase did some portability cleanups.
   1688 Pere Orga fixed some documentation.</p>
   1689 
   1690 <p>The "tac" and "clear" commands are now normal commands instead of shell
   1691 wrappers, and the header #includes have been cleaned up a bit to remove
   1692 deprecated functions and attempt to increase compatability with the bionic and
   1693 musl C libraries, "tail" should now use lseek() for large files, and "id" got
   1694 some cleanups and bugfixes.</p>
   1695 
   1696 <p>The new TOYBOX_FLOAT configuration option selects whether or not
   1697 to include floating point support (for embedded targets where that's
   1698 problematic).</p>
   1699 
   1700 <p>Several random bugfixes: unshare() might actually build portably now,
   1701 yes 'n' | cp -i should no longer bypass stdin and prompt via the tty, the
   1702 SUID support no longer drops permissions going through the toybox
   1703 multiplexer command, and a bugfix to xargs -0 means it should no longer
   1704 segfault. (I have a pending bug report about xargs not doing the full
   1705 posix whitespace handling that -0 obsoleted, but I'll deal with that next
   1706 release.)</p>
   1707 
   1708 <p>The build infrastructure is now automatically generating FLAG_ macros
   1709 for the options, but currently with the wrong names. Some more macro glue
   1710 is necessary, which I haven't quite figured out how to do yet.</p>
   1711 
   1712 <p>A defconfig toybox at the start of the $PATH has successfully built
   1713 Linux From Scratch (in my Aboriginal Linux project). The commands that
   1714 'default n' in the config are often still broken, cleanup is ongoing.
   1715 (The new dirtree stuff broke several of them that haven't been converted
   1716 yet, but if I wait until everything works we won't have a release before
   1717 1.0, so here's a checkpoint.)</p>
   1718 
   1719 
   1720 <a name="03-03-2012" /><a href="#03-03-2012"><hr><h2><b>March 3, 2012</b></h2></a>
   1721 
   1722 <blockquote><p>"They went unnoticed at Goonhilly, passed over Cape Canaveral
   1723 without a blip, and Woomera and Jodrell Bank looked straight through them.
   1724 Which was a pity, because it was exactly the sort of thing they'd been looking
   1725 for all these years."</p></p>- The Hitchhiker's Guide to the Galaxy.</p>
   1726 </p></blockquote>
   1727 
   1728 <p>Here's <a href=downloads/toybox-0.2.1.tar.bz2>toybox 0.2.1</a> based
   1729 on <a href=http://landley.net/hg/toybox/shortlog/512>commit 512</a>.  This
   1730 time around, there are statically linked <a href=downloads/binaries>prebuilt
   1731 binaries</a> for various embedded targets.</p>
   1732 
   1733 <p>It's been a busy few weeks, almost entirely due to new contributors. (I
   1734 have not quite been keeping up.)</p>
   1735 
   1736 <p>Elie De Brauwer contributed free, uptime, swapon, swapoff, lsmod, mknod,
   1737 insmod, rmmod, and fixed a bug in basename.  Andre Renaud contributed ls, ln,
   1738 realpath, and hostname. Andres Heck contributed pidof and killall.  Daniel
   1739 Walter wrote kill and extended id. Timothy Elliott contributed tail and tests
   1740 for cmp. Frank Bergmann sent a warning fix. Bryce Fricke added -i to cp.
   1741 Nathan McSween pointed out an optimization. Georgi Chorbadzhiyski fixed
   1742 cross compiling to work more reliably.</p>
   1743 
   1744 <p>(My own contribution this time around was just tightening up other people's
   1745 code, a build fix to unshare, some random bugfixes, and so on. My only new
   1746 code this time around was writing a bash replacement for the existing python
   1747 bloat-o-meter.)</p>
   1748 
   1749 <p>Last time (the 0.2.0 release) included the first pass at an id command from
   1750 Tim Bird, env and basename from Tryn Mirell, cmp and head from Timothy Elliott,
   1751 more bugfixes from Nathan McSween and Elie De Brauwer, and Luis Felipe Strano
   1752 Moraes did a first pass at the who command plus other bugfixes and
   1753 optimizations.</p>
   1754 
   1755 <p>(For that release I did xargs, cal, truncate, unlink, nohup, tty, wc, link,
   1756 dirname, unshare, and various infrastructure tweaks, but it took me 3 months
   1757 and those guys did their stuff in a week or so.)</p>
   1758 
   1759 
   1760 <a name="12-02-2012" /><a href="#12-02-2012"><hr><h2><b>February 12, 2012</b></h2></a>
   1761 <blockquote><p>
   1762 "for though it has many omissions and contains much that is apocryphal, or at
   1763 least wildly inaccurate, it scores over the older, more pedestrian work in two
   1764 important respects..."</p>
   1765 <p> - The Hitchhiker's Guide to the Galaxy</p></blockquote>
   1766 
   1767 <p>Here's the first BSD licensed release,
   1768 <a href=downloads/toybox-0.2.0.tar.bz2>toybox-0.2.0</a>, more a synchronization
   1769 point than anything particularly useful.  47 commands in a reasonably
   1770 ready-to-use state (what "make defconfig" builds), another ten or so partially
   1771 finished stubs ("make allyesconfig"), and several
   1772 patches pending on the mailing list I need to review and merge.</p>
   1773 
   1774 <p>More to come...</p>
   1775 
   1776 <hr>
   1777 <a name="15-11-2011" /><a href="#15-11-2011"><hr><h2><b>November 15, 2011</b></h2></a>
   1778 - Back from the dead, Toybox is now under a 2
   1779 clause BSD license, and aiming to become the default command line
   1780 implementation of Android systems everywhere.</p>
   1781 
   1782 <p>More to come...</p>
   1783 
   1784 <hr>
   1785 
   1786 <p><a href=oldnews.html>Old news</a> from before the relaunch.</p>
   1787 
   1788 <!--#include file="footer.html" -->
   1789