1 <!--{ 2 "Title": "Effective Go", 3 "Template": true 4 }--> 5 6 <h2 id="introduction">Introduction</h2> 7 8 <p> 9 Go is a new language. Although it borrows ideas from 10 existing languages, 11 it has unusual properties that make effective Go programs 12 different in character from programs written in its relatives. 13 A straightforward translation of a C++ or Java program into Go 14 is unlikely to produce a satisfactory result—Java programs 15 are written in Java, not Go. 16 On the other hand, thinking about the problem from a Go 17 perspective could produce a successful but quite different 18 program. 19 In other words, 20 to write Go well, it's important to understand its properties 21 and idioms. 22 It's also important to know the established conventions for 23 programming in Go, such as naming, formatting, program 24 construction, and so on, so that programs you write 25 will be easy for other Go programmers to understand. 26 </p> 27 28 <p> 29 This document gives tips for writing clear, idiomatic Go code. 30 It augments the <a href="/ref/spec">language specification</a>, 31 the <a href="//tour.golang.org/">Tour of Go</a>, 32 and <a href="/doc/code.html">How to Write Go Code</a>, 33 all of which you 34 should read first. 35 </p> 36 37 <h3 id="examples">Examples</h3> 38 39 <p> 40 The <a href="/src/">Go package sources</a> 41 are intended to serve not 42 only as the core library but also as examples of how to 43 use the language. 44 Moreover, many of the packages contain working, self-contained 45 executable examples you can run directly from the 46 <a href="//golang.org">golang.org</a> web site, such as 47 <a href="//golang.org/pkg/strings/#example_Map">this one</a> (if 48 necessary, click on the word "Example" to open it up). 49 If you have a question about how to approach a problem or how something 50 might be implemented, the documentation, code and examples in the 51 library can provide answers, ideas and 52 background. 53 </p> 54 55 56 <h2 id="formatting">Formatting</h2> 57 58 <p> 59 Formatting issues are the most contentious 60 but the least consequential. 61 People can adapt to different formatting styles 62 but it's better if they don't have to, and 63 less time is devoted to the topic 64 if everyone adheres to the same style. 65 The problem is how to approach this Utopia without a long 66 prescriptive style guide. 67 </p> 68 69 <p> 70 With Go we take an unusual 71 approach and let the machine 72 take care of most formatting issues. 73 The <code>gofmt</code> program 74 (also available as <code>go fmt</code>, which 75 operates at the package level rather than source file level) 76 reads a Go program 77 and emits the source in a standard style of indentation 78 and vertical alignment, retaining and if necessary 79 reformatting comments. 80 If you want to know how to handle some new layout 81 situation, run <code>gofmt</code>; if the answer doesn't 82 seem right, rearrange your program (or file a bug about <code>gofmt</code>), 83 don't work around it. 84 </p> 85 86 <p> 87 As an example, there's no need to spend time lining up 88 the comments on the fields of a structure. 89 <code>Gofmt</code> will do that for you. Given the 90 declaration 91 </p> 92 93 <pre> 94 type T struct { 95 name string // name of the object 96 value int // its value 97 } 98 </pre> 99 100 <p> 101 <code>gofmt</code> will line up the columns: 102 </p> 103 104 <pre> 105 type T struct { 106 name string // name of the object 107 value int // its value 108 } 109 </pre> 110 111 <p> 112 All Go code in the standard packages has been formatted with <code>gofmt</code>. 113 </p> 114 115 116 <p> 117 Some formatting details remain. Very briefly: 118 </p> 119 120 <dl> 121 <dt>Indentation</dt> 122 <dd>We use tabs for indentation and <code>gofmt</code> emits them by default. 123 Use spaces only if you must. 124 </dd> 125 <dt>Line length</dt> 126 <dd> 127 Go has no line length limit. Don't worry about overflowing a punched card. 128 If a line feels too long, wrap it and indent with an extra tab. 129 </dd> 130 <dt>Parentheses</dt> 131 <dd> 132 Go needs fewer parentheses than C and Java: control structures (<code>if</code>, 133 <code>for</code>, <code>switch</code>) do not have parentheses in 134 their syntax. 135 Also, the operator precedence hierarchy is shorter and clearer, so 136 <pre> 137 x<<8 + y<<16 138 </pre> 139 means what the spacing implies, unlike in the other languages. 140 </dd> 141 </dl> 142 143 <h2 id="commentary">Commentary</h2> 144 145 <p> 146 Go provides C-style <code>/* */</code> block comments 147 and C++-style <code>//</code> line comments. 148 Line comments are the norm; 149 block comments appear mostly as package comments, but 150 are useful within an expression or to disable large swaths of code. 151 </p> 152 153 <p> 154 The programand web server<code>godoc</code> processes 155 Go source files to extract documentation about the contents of the 156 package. 157 Comments that appear before top-level declarations, with no intervening newlines, 158 are extracted along with the declaration to serve as explanatory text for the item. 159 The nature and style of these comments determines the 160 quality of the documentation <code>godoc</code> produces. 161 </p> 162 163 <p> 164 Every package should have a <i>package comment</i>, a block 165 comment preceding the package clause. 166 For multi-file packages, the package comment only needs to be 167 present in one file, and any one will do. 168 The package comment should introduce the package and 169 provide information relevant to the package as a whole. 170 It will appear first on the <code>godoc</code> page and 171 should set up the detailed documentation that follows. 172 </p> 173 174 <pre> 175 /* 176 Package regexp implements a simple library for regular expressions. 177 178 The syntax of the regular expressions accepted is: 179 180 regexp: 181 concatenation { '|' concatenation } 182 concatenation: 183 { closure } 184 closure: 185 term [ '*' | '+' | '?' ] 186 term: 187 '^' 188 '$' 189 '.' 190 character 191 '[' [ '^' ] character-ranges ']' 192 '(' regexp ')' 193 */ 194 package regexp 195 </pre> 196 197 <p> 198 If the package is simple, the package comment can be brief. 199 </p> 200 201 <pre> 202 // Package path implements utility routines for 203 // manipulating slash-separated filename paths. 204 </pre> 205 206 <p> 207 Comments do not need extra formatting such as banners of stars. 208 The generated output may not even be presented in a fixed-width font, so don't depend 209 on spacing for alignment—<code>godoc</code>, like <code>gofmt</code>, 210 takes care of that. 211 The comments are uninterpreted plain text, so HTML and other 212 annotations such as <code>_this_</code> will reproduce <i>verbatim</i> and should 213 not be used. 214 One adjustment <code>godoc</code> does do is to display indented 215 text in a fixed-width font, suitable for program snippets. 216 The package comment for the 217 <a href="/pkg/fmt/"><code>fmt</code> package</a> uses this to good effect. 218 </p> 219 220 <p> 221 Depending on the context, <code>godoc</code> might not even 222 reformat comments, so make sure they look good straight up: 223 use correct spelling, punctuation, and sentence structure, 224 fold long lines, and so on. 225 </p> 226 227 <p> 228 Inside a package, any comment immediately preceding a top-level declaration 229 serves as a <i>doc comment</i> for that declaration. 230 Every exported (capitalized) name in a program should 231 have a doc comment. 232 </p> 233 234 <p> 235 Doc comments work best as complete sentences, which allow 236 a wide variety of automated presentations. 237 The first sentence should be a one-sentence summary that 238 starts with the name being declared. 239 </p> 240 241 <pre> 242 // Compile parses a regular expression and returns, if successful, a Regexp 243 // object that can be used to match against text. 244 func Compile(str string) (regexp *Regexp, err error) { 245 </pre> 246 247 <p> 248 If the name always begins the comment, the output of <code>godoc</code> 249 can usefully be run through <code>grep</code>. 250 Imagine you couldn't remember the name "Compile" but were looking for 251 the parsing function for regular expressions, so you ran 252 the command, 253 </p> 254 255 <pre> 256 $ godoc regexp | grep parse 257 </pre> 258 259 <p> 260 If all the doc comments in the package began, "This function...", <code>grep</code> 261 wouldn't help you remember the name. But because the package starts each 262 doc comment with the name, you'd see something like this, 263 which recalls the word you're looking for. 264 </p> 265 266 <pre> 267 $ godoc regexp | grep parse 268 Compile parses a regular expression and returns, if successful, a Regexp 269 parsed. It simplifies safe initialization of global variables holding 270 cannot be parsed. It simplifies safe initialization of global variables 271 $ 272 </pre> 273 274 <p> 275 Go's declaration syntax allows grouping of declarations. 276 A single doc comment can introduce a group of related constants or variables. 277 Since the whole declaration is presented, such a comment can often be perfunctory. 278 </p> 279 280 <pre> 281 // Error codes returned by failures to parse an expression. 282 var ( 283 ErrInternal = errors.New("regexp: internal error") 284 ErrUnmatchedLpar = errors.New("regexp: unmatched '('") 285 ErrUnmatchedRpar = errors.New("regexp: unmatched ')'") 286 ... 287 ) 288 </pre> 289 290 <p> 291 Grouping can also indicate relationships between items, 292 such as the fact that a set of variables is protected by a mutex. 293 </p> 294 295 <pre> 296 var ( 297 countLock sync.Mutex 298 inputCount uint32 299 outputCount uint32 300 errorCount uint32 301 ) 302 </pre> 303 304 <h2 id="names">Names</h2> 305 306 <p> 307 Names are as important in Go as in any other language. 308 They even have semantic effect: 309 the visibility of a name outside a package is determined by whether its 310 first character is upper case. 311 It's therefore worth spending a little time talking about naming conventions 312 in Go programs. 313 </p> 314 315 316 <h3 id="package-names">Package names</h3> 317 318 <p> 319 When a package is imported, the package name becomes an accessor for the 320 contents. After 321 </p> 322 323 <pre> 324 import "bytes" 325 </pre> 326 327 <p> 328 the importing package can talk about <code>bytes.Buffer</code>. It's 329 helpful if everyone using the package can use the same name to refer to 330 its contents, which implies that the package name should be good: 331 short, concise, evocative. By convention, packages are given 332 lower case, single-word names; there should be no need for underscores 333 or mixedCaps. 334 Err on the side of brevity, since everyone using your 335 package will be typing that name. 336 And don't worry about collisions <i>a priori</i>. 337 The package name is only the default name for imports; it need not be unique 338 across all source code, and in the rare case of a collision the 339 importing package can choose a different name to use locally. 340 In any case, confusion is rare because the file name in the import 341 determines just which package is being used. 342 </p> 343 344 <p> 345 Another convention is that the package name is the base name of 346 its source directory; 347 the package in <code>src/encoding/base64</code> 348 is imported as <code>"encoding/base64"</code> but has name <code>base64</code>, 349 not <code>encoding_base64</code> and not <code>encodingBase64</code>. 350 </p> 351 352 <p> 353 The importer of a package will use the name to refer to its contents, 354 so exported names in the package can use that fact 355 to avoid stutter. 356 (Don't use the <code>import .</code> notation, which can simplify 357 tests that must run outside the package they are testing, but should otherwise be avoided.) 358 For instance, the buffered reader type in the <code>bufio</code> package is called <code>Reader</code>, 359 not <code>BufReader</code>, because users see it as <code>bufio.Reader</code>, 360 which is a clear, concise name. 361 Moreover, 362 because imported entities are always addressed with their package name, <code>bufio.Reader</code> 363 does not conflict with <code>io.Reader</code>. 364 Similarly, the function to make new instances of <code>ring.Ring</code>—which 365 is the definition of a <em>constructor</em> in Go—would 366 normally be called <code>NewRing</code>, but since 367 <code>Ring</code> is the only type exported by the package, and since the 368 package is called <code>ring</code>, it's called just <code>New</code>, 369 which clients of the package see as <code>ring.New</code>. 370 Use the package structure to help you choose good names. 371 </p> 372 373 <p> 374 Another short example is <code>once.Do</code>; 375 <code>once.Do(setup)</code> reads well and would not be improved by 376 writing <code>once.DoOrWaitUntilDone(setup)</code>. 377 Long names don't automatically make things more readable. 378 A helpful doc comment can often be more valuable than an extra long name. 379 </p> 380 381 <h3 id="Getters">Getters</h3> 382 383 <p> 384 Go doesn't provide automatic support for getters and setters. 385 There's nothing wrong with providing getters and setters yourself, 386 and it's often appropriate to do so, but it's neither idiomatic nor necessary 387 to put <code>Get</code> into the getter's name. If you have a field called 388 <code>owner</code> (lower case, unexported), the getter method should be 389 called <code>Owner</code> (upper case, exported), not <code>GetOwner</code>. 390 The use of upper-case names for export provides the hook to discriminate 391 the field from the method. 392 A setter function, if needed, will likely be called <code>SetOwner</code>. 393 Both names read well in practice: 394 </p> 395 <pre> 396 owner := obj.Owner() 397 if owner != user { 398 obj.SetOwner(user) 399 } 400 </pre> 401 402 <h3 id="interface-names">Interface names</h3> 403 404 <p> 405 By convention, one-method interfaces are named by 406 the method name plus an -er suffix or similar modification 407 to construct an agent noun: <code>Reader</code>, 408 <code>Writer</code>, <code>Formatter</code>, 409 <code>CloseNotifier</code> etc. 410 </p> 411 412 <p> 413 There are a number of such names and it's productive to honor them and the function 414 names they capture. 415 <code>Read</code>, <code>Write</code>, <code>Close</code>, <code>Flush</code>, 416 <code>String</code> and so on have 417 canonical signatures and meanings. To avoid confusion, 418 don't give your method one of those names unless it 419 has the same signature and meaning. 420 Conversely, if your type implements a method with the 421 same meaning as a method on a well-known type, 422 give it the same name and signature; 423 call your string-converter method <code>String</code> not <code>ToString</code>. 424 </p> 425 426 <h3 id="mixed-caps">MixedCaps</h3> 427 428 <p> 429 Finally, the convention in Go is to use <code>MixedCaps</code> 430 or <code>mixedCaps</code> rather than underscores to write 431 multiword names. 432 </p> 433 434 <h2 id="semicolons">Semicolons</h2> 435 436 <p> 437 Like C, Go's formal grammar uses semicolons to terminate statements, 438 but unlike in C, those semicolons do not appear in the source. 439 Instead the lexer uses a simple rule to insert semicolons automatically 440 as it scans, so the input text is mostly free of them. 441 </p> 442 443 <p> 444 The rule is this. If the last token before a newline is an identifier 445 (which includes words like <code>int</code> and <code>float64</code>), 446 a basic literal such as a number or string constant, or one of the 447 tokens 448 </p> 449 <pre> 450 break continue fallthrough return ++ -- ) } 451 </pre> 452 <p> 453 the lexer always inserts a semicolon after the token. 454 This could be summarized as, “if the newline comes 455 after a token that could end a statement, insert a semicolon”. 456 </p> 457 458 <p> 459 A semicolon can also be omitted immediately before a closing brace, 460 so a statement such as 461 </p> 462 <pre> 463 go func() { for { dst <- <-src } }() 464 </pre> 465 <p> 466 needs no semicolons. 467 Idiomatic Go programs have semicolons only in places such as 468 <code>for</code> loop clauses, to separate the initializer, condition, and 469 continuation elements. They are also necessary to separate multiple 470 statements on a line, should you write code that way. 471 </p> 472 473 <p> 474 One consequence of the semicolon insertion rules 475 is that you cannot put the opening brace of a 476 control structure (<code>if</code>, <code>for</code>, <code>switch</code>, 477 or <code>select</code>) on the next line. If you do, a semicolon 478 will be inserted before the brace, which could cause unwanted 479 effects. Write them like this 480 </p> 481 482 <pre> 483 if i < f() { 484 g() 485 } 486 </pre> 487 <p> 488 not like this 489 </p> 490 <pre> 491 if i < f() // wrong! 492 { // wrong! 493 g() 494 } 495 </pre> 496 497 498 <h2 id="control-structures">Control structures</h2> 499 500 <p> 501 The control structures of Go are related to those of C but differ 502 in important ways. 503 There is no <code>do</code> or <code>while</code> loop, only a 504 slightly generalized 505 <code>for</code>; 506 <code>switch</code> is more flexible; 507 <code>if</code> and <code>switch</code> accept an optional 508 initialization statement like that of <code>for</code>; 509 <code>break</code> and <code>continue</code> statements 510 take an optional label to identify what to break or continue; 511 and there are new control structures including a type switch and a 512 multiway communications multiplexer, <code>select</code>. 513 The syntax is also slightly different: 514 there are no parentheses 515 and the bodies must always be brace-delimited. 516 </p> 517 518 <h3 id="if">If</h3> 519 520 <p> 521 In Go a simple <code>if</code> looks like this: 522 </p> 523 <pre> 524 if x > 0 { 525 return y 526 } 527 </pre> 528 529 <p> 530 Mandatory braces encourage writing simple <code>if</code> statements 531 on multiple lines. It's good style to do so anyway, 532 especially when the body contains a control statement such as a 533 <code>return</code> or <code>break</code>. 534 </p> 535 536 <p> 537 Since <code>if</code> and <code>switch</code> accept an initialization 538 statement, it's common to see one used to set up a local variable. 539 </p> 540 541 <pre> 542 if err := file.Chmod(0664); err != nil { 543 log.Print(err) 544 return err 545 } 546 </pre> 547 548 <p id="else"> 549 In the Go libraries, you'll find that 550 when an <code>if</code> statement doesn't flow into the next statementthat is, 551 the body ends in <code>break</code>, <code>continue</code>, 552 <code>goto</code>, or <code>return</code>the unnecessary 553 <code>else</code> is omitted. 554 </p> 555 556 <pre> 557 f, err := os.Open(name) 558 if err != nil { 559 return err 560 } 561 codeUsing(f) 562 </pre> 563 564 <p> 565 This is an example of a common situation where code must guard against a 566 sequence of error conditions. The code reads well if the 567 successful flow of control runs down the page, eliminating error cases 568 as they arise. Since error cases tend to end in <code>return</code> 569 statements, the resulting code needs no <code>else</code> statements. 570 </p> 571 572 <pre> 573 f, err := os.Open(name) 574 if err != nil { 575 return err 576 } 577 d, err := f.Stat() 578 if err != nil { 579 f.Close() 580 return err 581 } 582 codeUsing(f, d) 583 </pre> 584 585 586 <h3 id="redeclaration">Redeclaration and reassignment</h3> 587 588 <p> 589 An aside: The last example in the previous section demonstrates a detail of how the 590 <code>:=</code> short declaration form works. 591 The declaration that calls <code>os.Open</code> reads, 592 </p> 593 594 <pre> 595 f, err := os.Open(name) 596 </pre> 597 598 <p> 599 This statement declares two variables, <code>f</code> and <code>err</code>. 600 A few lines later, the call to <code>f.Stat</code> reads, 601 </p> 602 603 <pre> 604 d, err := f.Stat() 605 </pre> 606 607 <p> 608 which looks as if it declares <code>d</code> and <code>err</code>. 609 Notice, though, that <code>err</code> appears in both statements. 610 This duplication is legal: <code>err</code> is declared by the first statement, 611 but only <em>re-assigned</em> in the second. 612 This means that the call to <code>f.Stat</code> uses the existing 613 <code>err</code> variable declared above, and just gives it a new value. 614 </p> 615 616 <p> 617 In a <code>:=</code> declaration a variable <code>v</code> may appear even 618 if it has already been declared, provided: 619 </p> 620 621 <ul> 622 <li>this declaration is in the same scope as the existing declaration of <code>v</code> 623 (if <code>v</code> is already declared in an outer scope, the declaration will create a new variable ),</li> 624 <li>the corresponding value in the initialization is assignable to <code>v</code>, and</li> 625 <li>there is at least one other variable in the declaration that is being declared anew.</li> 626 </ul> 627 628 <p> 629 This unusual property is pure pragmatism, 630 making it easy to use a single <code>err</code> value, for example, 631 in a long <code>if-else</code> chain. 632 You'll see it used often. 633 </p> 634 635 <p> 636 It's worth noting here that in Go the scope of function parameters and return values 637 is the same as the function body, even though they appear lexically outside the braces 638 that enclose the body. 639 </p> 640 641 <h3 id="for">For</h3> 642 643 <p> 644 The Go <code>for</code> loop is similar to—but not the same as—C's. 645 It unifies <code>for</code> 646 and <code>while</code> and there is no <code>do-while</code>. 647 There are three forms, only one of which has semicolons. 648 </p> 649 <pre> 650 // Like a C for 651 for init; condition; post { } 652 653 // Like a C while 654 for condition { } 655 656 // Like a C for(;;) 657 for { } 658 </pre> 659 660 <p> 661 Short declarations make it easy to declare the index variable right in the loop. 662 </p> 663 <pre> 664 sum := 0 665 for i := 0; i < 10; i++ { 666 sum += i 667 } 668 </pre> 669 670 <p> 671 If you're looping over an array, slice, string, or map, 672 or reading from a channel, a <code>range</code> clause can 673 manage the loop. 674 </p> 675 <pre> 676 for key, value := range oldMap { 677 newMap[key] = value 678 } 679 </pre> 680 681 <p> 682 If you only need the first item in the range (the key or index), drop the second: 683 </p> 684 <pre> 685 for key := range m { 686 if key.expired() { 687 delete(m, key) 688 } 689 } 690 </pre> 691 692 <p> 693 If you only need the second item in the range (the value), use the <em>blank identifier</em>, an underscore, to discard the first: 694 </p> 695 <pre> 696 sum := 0 697 for _, value := range array { 698 sum += value 699 } 700 </pre> 701 702 <p> 703 The blank identifier has many uses, as described in <a href="#blank">a later section</a>. 704 </p> 705 706 <p> 707 For strings, the <code>range</code> does more work for you, breaking out individual 708 Unicode code points by parsing the UTF-8. 709 Erroneous encodings consume one byte and produce the 710 replacement rune U+FFFD. 711 (The name (with associated builtin type) <code>rune</code> is Go terminology for a 712 single Unicode code point. 713 See <a href="/ref/spec#Rune_literals">the language specification</a> 714 for details.) 715 The loop 716 </p> 717 <pre> 718 for pos, char := range "\x80" { // \x80 is an illegal UTF-8 encoding 719 fmt.Printf("character %#U starts at byte position %d\n", char, pos) 720 } 721 </pre> 722 <p> 723 prints 724 </p> 725 <pre> 726 character U+65E5 '' starts at byte position 0 727 character U+672C '' starts at byte position 3 728 character U+FFFD '' starts at byte position 6 729 character U+8A9E '' starts at byte position 7 730 </pre> 731 732 <p> 733 Finally, Go has no comma operator and <code>++</code> and <code>--</code> 734 are statements not expressions. 735 Thus if you want to run multiple variables in a <code>for</code> 736 you should use parallel assignment (although that precludes <code>++</code> and <code>--</code>). 737 </p> 738 <pre> 739 // Reverse a 740 for i, j := 0, len(a)-1; i < j; i, j = i+1, j-1 { 741 a[i], a[j] = a[j], a[i] 742 } 743 </pre> 744 745 <h3 id="switch">Switch</h3> 746 747 <p> 748 Go's <code>switch</code> is more general than C's. 749 The expressions need not be constants or even integers, 750 the cases are evaluated top to bottom until a match is found, 751 and if the <code>switch</code> has no expression it switches on 752 <code>true</code>. 753 It's therefore possible—and idiomatic—to write an 754 <code>if</code>-<code>else</code>-<code>if</code>-<code>else</code> 755 chain as a <code>switch</code>. 756 </p> 757 758 <pre> 759 func unhex(c byte) byte { 760 switch { 761 case '0' <= c && c <= '9': 762 return c - '0' 763 case 'a' <= c && c <= 'f': 764 return c - 'a' + 10 765 case 'A' <= c && c <= 'F': 766 return c - 'A' + 10 767 } 768 return 0 769 } 770 </pre> 771 772 <p> 773 There is no automatic fall through, but cases can be presented 774 in comma-separated lists. 775 </p> 776 <pre> 777 func shouldEscape(c byte) bool { 778 switch c { 779 case ' ', '?', '&', '=', '#', '+', '%': 780 return true 781 } 782 return false 783 } 784 </pre> 785 786 <p> 787 Although they are not nearly as common in Go as some other C-like 788 languages, <code>break</code> statements can be used to terminate 789 a <code>switch</code> early. 790 Sometimes, though, it's necessary to break out of a surrounding loop, 791 not the switch, and in Go that can be accomplished by putting a label 792 on the loop and "breaking" to that label. 793 This example shows both uses. 794 </p> 795 796 <pre> 797 Loop: 798 for n := 0; n < len(src); n += size { 799 switch { 800 case src[n] < sizeOne: 801 if validateOnly { 802 break 803 } 804 size = 1 805 update(src[n]) 806 807 case src[n] < sizeTwo: 808 if n+1 >= len(src) { 809 err = errShortInput 810 break Loop 811 } 812 if validateOnly { 813 break 814 } 815 size = 2 816 update(src[n] + src[n+1]<<shift) 817 } 818 } 819 </pre> 820 821 <p> 822 Of course, the <code>continue</code> statement also accepts an optional label 823 but it applies only to loops. 824 </p> 825 826 <p> 827 To close this section, here's a comparison routine for byte slices that uses two 828 <code>switch</code> statements: 829 </p> 830 <pre> 831 // Compare returns an integer comparing the two byte slices, 832 // lexicographically. 833 // The result will be 0 if a == b, -1 if a < b, and +1 if a > b 834 func Compare(a, b []byte) int { 835 for i := 0; i < len(a) && i < len(b); i++ { 836 switch { 837 case a[i] > b[i]: 838 return 1 839 case a[i] < b[i]: 840 return -1 841 } 842 } 843 switch { 844 case len(a) > len(b): 845 return 1 846 case len(a) < len(b): 847 return -1 848 } 849 return 0 850 } 851 </pre> 852 853 <h3 id="type_switch">Type switch</h3> 854 855 <p> 856 A switch can also be used to discover the dynamic type of an interface 857 variable. Such a <em>type switch</em> uses the syntax of a type 858 assertion with the keyword <code>type</code> inside the parentheses. 859 If the switch declares a variable in the expression, the variable will 860 have the corresponding type in each clause. 861 It's also idiomatic to reuse the name in such cases, in effect declaring 862 a new variable with the same name but a different type in each case. 863 </p> 864 <pre> 865 var t interface{} 866 t = functionOfSomeType() 867 switch t := t.(type) { 868 default: 869 fmt.Printf("unexpected type %T\n", t) // %T prints whatever type t has 870 case bool: 871 fmt.Printf("boolean %t\n", t) // t has type bool 872 case int: 873 fmt.Printf("integer %d\n", t) // t has type int 874 case *bool: 875 fmt.Printf("pointer to boolean %t\n", *t) // t has type *bool 876 case *int: 877 fmt.Printf("pointer to integer %d\n", *t) // t has type *int 878 } 879 </pre> 880 881 <h2 id="functions">Functions</h2> 882 883 <h3 id="multiple-returns">Multiple return values</h3> 884 885 <p> 886 One of Go's unusual features is that functions and methods 887 can return multiple values. This form can be used to 888 improve on a couple of clumsy idioms in C programs: in-band 889 error returns such as <code>-1</code> for <code>EOF</code> 890 and modifying an argument passed by address. 891 </p> 892 893 <p> 894 In C, a write error is signaled by a negative count with the 895 error code secreted away in a volatile location. 896 In Go, <code>Write</code> 897 can return a count <i>and</i> an error: “Yes, you wrote some 898 bytes but not all of them because you filled the device”. 899 The signature of the <code>Write</code> method on files from 900 package <code>os</code> is: 901 </p> 902 903 <pre> 904 func (file *File) Write(b []byte) (n int, err error) 905 </pre> 906 907 <p> 908 and as the documentation says, it returns the number of bytes 909 written and a non-nil <code>error</code> when <code>n</code> 910 <code>!=</code> <code>len(b)</code>. 911 This is a common style; see the section on error handling for more examples. 912 </p> 913 914 <p> 915 A similar approach obviates the need to pass a pointer to a return 916 value to simulate a reference parameter. 917 Here's a simple-minded function to 918 grab a number from a position in a byte slice, returning the number 919 and the next position. 920 </p> 921 922 <pre> 923 func nextInt(b []byte, i int) (int, int) { 924 for ; i < len(b) && !isDigit(b[i]); i++ { 925 } 926 x := 0 927 for ; i < len(b) && isDigit(b[i]); i++ { 928 x = x*10 + int(b[i]) - '0' 929 } 930 return x, i 931 } 932 </pre> 933 934 <p> 935 You could use it to scan the numbers in an input slice <code>b</code> like this: 936 </p> 937 938 <pre> 939 for i := 0; i < len(b); { 940 x, i = nextInt(b, i) 941 fmt.Println(x) 942 } 943 </pre> 944 945 <h3 id="named-results">Named result parameters</h3> 946 947 <p> 948 The return or result "parameters" of a Go function can be given names and 949 used as regular variables, just like the incoming parameters. 950 When named, they are initialized to the zero values for their types when 951 the function begins; if the function executes a <code>return</code> statement 952 with no arguments, the current values of the result parameters are 953 used as the returned values. 954 </p> 955 956 <p> 957 The names are not mandatory but they can make code shorter and clearer: 958 they're documentation. 959 If we name the results of <code>nextInt</code> it becomes 960 obvious which returned <code>int</code> 961 is which. 962 </p> 963 964 <pre> 965 func nextInt(b []byte, pos int) (value, nextPos int) { 966 </pre> 967 968 <p> 969 Because named results are initialized and tied to an unadorned return, they can simplify 970 as well as clarify. Here's a version 971 of <code>io.ReadFull</code> that uses them well: 972 </p> 973 974 <pre> 975 func ReadFull(r Reader, buf []byte) (n int, err error) { 976 for len(buf) > 0 && err == nil { 977 var nr int 978 nr, err = r.Read(buf) 979 n += nr 980 buf = buf[nr:] 981 } 982 return 983 } 984 </pre> 985 986 <h3 id="defer">Defer</h3> 987 988 <p> 989 Go's <code>defer</code> statement schedules a function call (the 990 <i>deferred</i> function) to be run immediately before the function 991 executing the <code>defer</code> returns. It's an unusual but 992 effective way to deal with situations such as resources that must be 993 released regardless of which path a function takes to return. The 994 canonical examples are unlocking a mutex or closing a file. 995 </p> 996 997 <pre> 998 // Contents returns the file's contents as a string. 999 func Contents(filename string) (string, error) { 1000 f, err := os.Open(filename) 1001 if err != nil { 1002 return "", err 1003 } 1004 defer f.Close() // f.Close will run when we're finished. 1005 1006 var result []byte 1007 buf := make([]byte, 100) 1008 for { 1009 n, err := f.Read(buf[0:]) 1010 result = append(result, buf[0:n]...) // append is discussed later. 1011 if err != nil { 1012 if err == io.EOF { 1013 break 1014 } 1015 return "", err // f will be closed if we return here. 1016 } 1017 } 1018 return string(result), nil // f will be closed if we return here. 1019 } 1020 </pre> 1021 1022 <p> 1023 Deferring a call to a function such as <code>Close</code> has two advantages. First, it 1024 guarantees that you will never forget to close the file, a mistake 1025 that's easy to make if you later edit the function to add a new return 1026 path. Second, it means that the close sits near the open, 1027 which is much clearer than placing it at the end of the function. 1028 </p> 1029 1030 <p> 1031 The arguments to the deferred function (which include the receiver if 1032 the function is a method) are evaluated when the <i>defer</i> 1033 executes, not when the <i>call</i> executes. Besides avoiding worries 1034 about variables changing values as the function executes, this means 1035 that a single deferred call site can defer multiple function 1036 executions. Here's a silly example. 1037 </p> 1038 1039 <pre> 1040 for i := 0; i < 5; i++ { 1041 defer fmt.Printf("%d ", i) 1042 } 1043 </pre> 1044 1045 <p> 1046 Deferred functions are executed in LIFO order, so this code will cause 1047 <code>4 3 2 1 0</code> to be printed when the function returns. A 1048 more plausible example is a simple way to trace function execution 1049 through the program. We could write a couple of simple tracing 1050 routines like this: 1051 </p> 1052 1053 <pre> 1054 func trace(s string) { fmt.Println("entering:", s) } 1055 func untrace(s string) { fmt.Println("leaving:", s) } 1056 1057 // Use them like this: 1058 func a() { 1059 trace("a") 1060 defer untrace("a") 1061 // do something.... 1062 } 1063 </pre> 1064 1065 <p> 1066 We can do better by exploiting the fact that arguments to deferred 1067 functions are evaluated when the <code>defer</code> executes. The 1068 tracing routine can set up the argument to the untracing routine. 1069 This example: 1070 </p> 1071 1072 <pre> 1073 func trace(s string) string { 1074 fmt.Println("entering:", s) 1075 return s 1076 } 1077 1078 func un(s string) { 1079 fmt.Println("leaving:", s) 1080 } 1081 1082 func a() { 1083 defer un(trace("a")) 1084 fmt.Println("in a") 1085 } 1086 1087 func b() { 1088 defer un(trace("b")) 1089 fmt.Println("in b") 1090 a() 1091 } 1092 1093 func main() { 1094 b() 1095 } 1096 </pre> 1097 1098 <p> 1099 prints 1100 </p> 1101 1102 <pre> 1103 entering: b 1104 in b 1105 entering: a 1106 in a 1107 leaving: a 1108 leaving: b 1109 </pre> 1110 1111 <p> 1112 For programmers accustomed to block-level resource management from 1113 other languages, <code>defer</code> may seem peculiar, but its most 1114 interesting and powerful applications come precisely from the fact 1115 that it's not block-based but function-based. In the section on 1116 <code>panic</code> and <code>recover</code> we'll see another 1117 example of its possibilities. 1118 </p> 1119 1120 <h2 id="data">Data</h2> 1121 1122 <h3 id="allocation_new">Allocation with <code>new</code></h3> 1123 1124 <p> 1125 Go has two allocation primitives, the built-in functions 1126 <code>new</code> and <code>make</code>. 1127 They do different things and apply to different types, which can be confusing, 1128 but the rules are simple. 1129 Let's talk about <code>new</code> first. 1130 It's a built-in function that allocates memory, but unlike its namesakes 1131 in some other languages it does not <em>initialize</em> the memory, 1132 it only <em>zeros</em> it. 1133 That is, 1134 <code>new(T)</code> allocates zeroed storage for a new item of type 1135 <code>T</code> and returns its address, a value of type <code>*T</code>. 1136 In Go terminology, it returns a pointer to a newly allocated zero value of type 1137 <code>T</code>. 1138 </p> 1139 1140 <p> 1141 Since the memory returned by <code>new</code> is zeroed, it's helpful to arrange 1142 when designing your data structures that the 1143 zero value of each type can be used without further initialization. This means a user of 1144 the data structure can create one with <code>new</code> and get right to 1145 work. 1146 For example, the documentation for <code>bytes.Buffer</code> states that 1147 "the zero value for <code>Buffer</code> is an empty buffer ready to use." 1148 Similarly, <code>sync.Mutex</code> does not 1149 have an explicit constructor or <code>Init</code> method. 1150 Instead, the zero value for a <code>sync.Mutex</code> 1151 is defined to be an unlocked mutex. 1152 </p> 1153 1154 <p> 1155 The zero-value-is-useful property works transitively. Consider this type declaration. 1156 </p> 1157 1158 <pre> 1159 type SyncedBuffer struct { 1160 lock sync.Mutex 1161 buffer bytes.Buffer 1162 } 1163 </pre> 1164 1165 <p> 1166 Values of type <code>SyncedBuffer</code> are also ready to use immediately upon allocation 1167 or just declaration. In the next snippet, both <code>p</code> and <code>v</code> will work 1168 correctly without further arrangement. 1169 </p> 1170 1171 <pre> 1172 p := new(SyncedBuffer) // type *SyncedBuffer 1173 var v SyncedBuffer // type SyncedBuffer 1174 </pre> 1175 1176 <h3 id="composite_literals">Constructors and composite literals</h3> 1177 1178 <p> 1179 Sometimes the zero value isn't good enough and an initializing 1180 constructor is necessary, as in this example derived from 1181 package <code>os</code>. 1182 </p> 1183 1184 <pre> 1185 func NewFile(fd int, name string) *File { 1186 if fd < 0 { 1187 return nil 1188 } 1189 f := new(File) 1190 f.fd = fd 1191 f.name = name 1192 f.dirinfo = nil 1193 f.nepipe = 0 1194 return f 1195 } 1196 </pre> 1197 1198 <p> 1199 There's a lot of boiler plate in there. We can simplify it 1200 using a <i>composite literal</i>, which is 1201 an expression that creates a 1202 new instance each time it is evaluated. 1203 </p> 1204 1205 <pre> 1206 func NewFile(fd int, name string) *File { 1207 if fd < 0 { 1208 return nil 1209 } 1210 f := File{fd, name, nil, 0} 1211 return &f 1212 } 1213 </pre> 1214 1215 <p> 1216 Note that, unlike in C, it's perfectly OK to return the address of a local variable; 1217 the storage associated with the variable survives after the function 1218 returns. 1219 In fact, taking the address of a composite literal 1220 allocates a fresh instance each time it is evaluated, 1221 so we can combine these last two lines. 1222 </p> 1223 1224 <pre> 1225 return &File{fd, name, nil, 0} 1226 </pre> 1227 1228 <p> 1229 The fields of a composite literal are laid out in order and must all be present. 1230 However, by labeling the elements explicitly as <i>field</i><code>:</code><i>value</i> 1231 pairs, the initializers can appear in any 1232 order, with the missing ones left as their respective zero values. Thus we could say 1233 </p> 1234 1235 <pre> 1236 return &File{fd: fd, name: name} 1237 </pre> 1238 1239 <p> 1240 As a limiting case, if a composite literal contains no fields at all, it creates 1241 a zero value for the type. The expressions <code>new(File)</code> and <code>&File{}</code> are equivalent. 1242 </p> 1243 1244 <p> 1245 Composite literals can also be created for arrays, slices, and maps, 1246 with the field labels being indices or map keys as appropriate. 1247 In these examples, the initializations work regardless of the values of <code>Enone</code>, 1248 <code>Eio</code>, and <code>Einval</code>, as long as they are distinct. 1249 </p> 1250 1251 <pre> 1252 a := [...]string {Enone: "no error", Eio: "Eio", Einval: "invalid argument"} 1253 s := []string {Enone: "no error", Eio: "Eio", Einval: "invalid argument"} 1254 m := map[int]string{Enone: "no error", Eio: "Eio", Einval: "invalid argument"} 1255 </pre> 1256 1257 <h3 id="allocation_make">Allocation with <code>make</code></h3> 1258 1259 <p> 1260 Back to allocation. 1261 The built-in function <code>make(T, </code><i>args</i><code>)</code> serves 1262 a purpose different from <code>new(T)</code>. 1263 It creates slices, maps, and channels only, and it returns an <em>initialized</em> 1264 (not <em>zeroed</em>) 1265 value of type <code>T</code> (not <code>*T</code>). 1266 The reason for the distinction 1267 is that these three types represent, under the covers, references to data structures that 1268 must be initialized before use. 1269 A slice, for example, is a three-item descriptor 1270 containing a pointer to the data (inside an array), the length, and the 1271 capacity, and until those items are initialized, the slice is <code>nil</code>. 1272 For slices, maps, and channels, 1273 <code>make</code> initializes the internal data structure and prepares 1274 the value for use. 1275 For instance, 1276 </p> 1277 1278 <pre> 1279 make([]int, 10, 100) 1280 </pre> 1281 1282 <p> 1283 allocates an array of 100 ints and then creates a slice 1284 structure with length 10 and a capacity of 100 pointing at the first 1285 10 elements of the array. 1286 (When making a slice, the capacity can be omitted; see the section on slices 1287 for more information.) 1288 In contrast, <code>new([]int)</code> returns a pointer to a newly allocated, zeroed slice 1289 structure, that is, a pointer to a <code>nil</code> slice value. 1290 </p> 1291 1292 <p> 1293 These examples illustrate the difference between <code>new</code> and 1294 <code>make</code>. 1295 </p> 1296 1297 <pre> 1298 var p *[]int = new([]int) // allocates slice structure; *p == nil; rarely useful 1299 var v []int = make([]int, 100) // the slice v now refers to a new array of 100 ints 1300 1301 // Unnecessarily complex: 1302 var p *[]int = new([]int) 1303 *p = make([]int, 100, 100) 1304 1305 // Idiomatic: 1306 v := make([]int, 100) 1307 </pre> 1308 1309 <p> 1310 Remember that <code>make</code> applies only to maps, slices and channels 1311 and does not return a pointer. 1312 To obtain an explicit pointer allocate with <code>new</code> or take the address 1313 of a variable explicitly. 1314 </p> 1315 1316 <h3 id="arrays">Arrays</h3> 1317 1318 <p> 1319 Arrays are useful when planning the detailed layout of memory and sometimes 1320 can help avoid allocation, but primarily 1321 they are a building block for slices, the subject of the next section. 1322 To lay the foundation for that topic, here are a few words about arrays. 1323 </p> 1324 1325 <p> 1326 There are major differences between the ways arrays work in Go and C. 1327 In Go, 1328 </p> 1329 <ul> 1330 <li> 1331 Arrays are values. Assigning one array to another copies all the elements. 1332 </li> 1333 <li> 1334 In particular, if you pass an array to a function, it 1335 will receive a <i>copy</i> of the array, not a pointer to it. 1336 <li> 1337 The size of an array is part of its type. The types <code>[10]int</code> 1338 and <code>[20]int</code> are distinct. 1339 </li> 1340 </ul> 1341 1342 <p> 1343 The value property can be useful but also expensive; if you want C-like behavior and efficiency, 1344 you can pass a pointer to the array. 1345 </p> 1346 1347 <pre> 1348 func Sum(a *[3]float64) (sum float64) { 1349 for _, v := range *a { 1350 sum += v 1351 } 1352 return 1353 } 1354 1355 array := [...]float64{7.0, 8.5, 9.1} 1356 x := Sum(&array) // Note the explicit address-of operator 1357 </pre> 1358 1359 <p> 1360 But even this style isn't idiomatic Go. 1361 Use slices instead. 1362 </p> 1363 1364 <h3 id="slices">Slices</h3> 1365 1366 <p> 1367 Slices wrap arrays to give a more general, powerful, and convenient 1368 interface to sequences of data. Except for items with explicit 1369 dimension such as transformation matrices, most array programming in 1370 Go is done with slices rather than simple arrays. 1371 </p> 1372 <p> 1373 Slices hold references to an underlying array, and if you assign one 1374 slice to another, both refer to the same array. 1375 If a function takes a slice argument, changes it makes to 1376 the elements of the slice will be visible to the caller, analogous to 1377 passing a pointer to the underlying array. A <code>Read</code> 1378 function can therefore accept a slice argument rather than a pointer 1379 and a count; the length within the slice sets an upper 1380 limit of how much data to read. Here is the signature of the 1381 <code>Read</code> method of the <code>File</code> type in package 1382 <code>os</code>: 1383 </p> 1384 <pre> 1385 func (f *File) Read(buf []byte) (n int, err error) 1386 </pre> 1387 <p> 1388 The method returns the number of bytes read and an error value, if 1389 any. 1390 To read into the first 32 bytes of a larger buffer 1391 <code>buf</code>, <i>slice</i> (here used as a verb) the buffer. 1392 </p> 1393 <pre> 1394 n, err := f.Read(buf[0:32]) 1395 </pre> 1396 <p> 1397 Such slicing is common and efficient. In fact, leaving efficiency aside for 1398 the moment, the following snippet would also read the first 32 bytes of the buffer. 1399 </p> 1400 <pre> 1401 var n int 1402 var err error 1403 for i := 0; i < 32; i++ { 1404 nbytes, e := f.Read(buf[i:i+1]) // Read one byte. 1405 if nbytes == 0 || e != nil { 1406 err = e 1407 break 1408 } 1409 n += nbytes 1410 } 1411 </pre> 1412 <p> 1413 The length of a slice may be changed as long as it still fits within 1414 the limits of the underlying array; just assign it to a slice of 1415 itself. The <i>capacity</i> of a slice, accessible by the built-in 1416 function <code>cap</code>, reports the maximum length the slice may 1417 assume. Here is a function to append data to a slice. If the data 1418 exceeds the capacity, the slice is reallocated. The 1419 resulting slice is returned. The function uses the fact that 1420 <code>len</code> and <code>cap</code> are legal when applied to the 1421 <code>nil</code> slice, and return 0. 1422 </p> 1423 <pre> 1424 func Append(slice, data []byte) []byte { 1425 l := len(slice) 1426 if l + len(data) > cap(slice) { // reallocate 1427 // Allocate double what's needed, for future growth. 1428 newSlice := make([]byte, (l+len(data))*2) 1429 // The copy function is predeclared and works for any slice type. 1430 copy(newSlice, slice) 1431 slice = newSlice 1432 } 1433 slice = slice[0:l+len(data)] 1434 for i, c := range data { 1435 slice[l+i] = c 1436 } 1437 return slice 1438 } 1439 </pre> 1440 <p> 1441 We must return the slice afterwards because, although <code>Append</code> 1442 can modify the elements of <code>slice</code>, the slice itself (the run-time data 1443 structure holding the pointer, length, and capacity) is passed by value. 1444 </p> 1445 1446 <p> 1447 The idea of appending to a slice is so useful it's captured by the 1448 <code>append</code> built-in function. To understand that function's 1449 design, though, we need a little more information, so we'll return 1450 to it later. 1451 </p> 1452 1453 <h3 id="two_dimensional_slices">Two-dimensional slices</h3> 1454 1455 <p> 1456 Go's arrays and slices are one-dimensional. 1457 To create the equivalent of a 2D array or slice, it is necessary to define an array-of-arrays 1458 or slice-of-slices, like this: 1459 </p> 1460 1461 <pre> 1462 type Transform [3][3]float64 // A 3x3 array, really an array of arrays. 1463 type LinesOfText [][]byte // A slice of byte slices. 1464 </pre> 1465 1466 <p> 1467 Because slices are variable-length, it is possible to have each inner 1468 slice be a different length. 1469 That can be a common situation, as in our <code>LinesOfText</code> 1470 example: each line has an independent length. 1471 </p> 1472 1473 <pre> 1474 text := LinesOfText{ 1475 []byte("Now is the time"), 1476 []byte("for all good gophers"), 1477 []byte("to bring some fun to the party."), 1478 } 1479 </pre> 1480 1481 <p> 1482 Sometimes it's necessary to allocate a 2D slice, a situation that can arise when 1483 processing scan lines of pixels, for instance. 1484 There are two ways to achieve this. 1485 One is to allocate each slice independently; the other 1486 is to allocate a single array and point the individual slices into it. 1487 Which to use depends on your application. 1488 If the slices might grow or shrink, they should be allocated independently 1489 to avoid overwriting the next line; if not, it can be more efficient to construct 1490 the object with a single allocation. 1491 For reference, here are sketches of the two methods. 1492 First, a line at a time: 1493 </p> 1494 1495 <pre> 1496 // Allocate the top-level slice. 1497 picture := make([][]uint8, YSize) // One row per unit of y. 1498 // Loop over the rows, allocating the slice for each row. 1499 for i := range picture { 1500 picture[i] = make([]uint8, XSize) 1501 } 1502 </pre> 1503 1504 <p> 1505 And now as one allocation, sliced into lines: 1506 </p> 1507 1508 <pre> 1509 // Allocate the top-level slice, the same as before. 1510 picture := make([][]uint8, YSize) // One row per unit of y. 1511 // Allocate one large slice to hold all the pixels. 1512 pixels := make([]uint8, XSize*YSize) // Has type []uint8 even though picture is [][]uint8. 1513 // Loop over the rows, slicing each row from the front of the remaining pixels slice. 1514 for i := range picture { 1515 picture[i], pixels = pixels[:XSize], pixels[XSize:] 1516 } 1517 </pre> 1518 1519 <h3 id="maps">Maps</h3> 1520 1521 <p> 1522 Maps are a convenient and powerful built-in data structure that associate 1523 values of one type (the <em>key</em>) with values of another type 1524 (the <em>element</em> or <em>value</em>) 1525 The key can be of any type for which the equality operator is defined, 1526 such as integers, 1527 floating point and complex numbers, 1528 strings, pointers, interfaces (as long as the dynamic type 1529 supports equality), structs and arrays. 1530 Slices cannot be used as map keys, 1531 because equality is not defined on them. 1532 Like slices, maps hold references to an underlying data structure. 1533 If you pass a map to a function 1534 that changes the contents of the map, the changes will be visible 1535 in the caller. 1536 </p> 1537 <p> 1538 Maps can be constructed using the usual composite literal syntax 1539 with colon-separated key-value pairs, 1540 so it's easy to build them during initialization. 1541 </p> 1542 <pre> 1543 var timeZone = map[string]int{ 1544 "UTC": 0*60*60, 1545 "EST": -5*60*60, 1546 "CST": -6*60*60, 1547 "MST": -7*60*60, 1548 "PST": -8*60*60, 1549 } 1550 </pre> 1551 <p> 1552 Assigning and fetching map values looks syntactically just like 1553 doing the same for arrays and slices except that the index doesn't 1554 need to be an integer. 1555 </p> 1556 <pre> 1557 offset := timeZone["EST"] 1558 </pre> 1559 <p> 1560 An attempt to fetch a map value with a key that 1561 is not present in the map will return the zero value for the type 1562 of the entries 1563 in the map. For instance, if the map contains integers, looking 1564 up a non-existent key will return <code>0</code>. 1565 A set can be implemented as a map with value type <code>bool</code>. 1566 Set the map entry to <code>true</code> to put the value in the set, and then 1567 test it by simple indexing. 1568 </p> 1569 <pre> 1570 attended := map[string]bool{ 1571 "Ann": true, 1572 "Joe": true, 1573 ... 1574 } 1575 1576 if attended[person] { // will be false if person is not in the map 1577 fmt.Println(person, "was at the meeting") 1578 } 1579 </pre> 1580 <p> 1581 Sometimes you need to distinguish a missing entry from 1582 a zero value. Is there an entry for <code>"UTC"</code> 1583 or is that the empty string because it's not in the map at all? 1584 You can discriminate with a form of multiple assignment. 1585 </p> 1586 <pre> 1587 var seconds int 1588 var ok bool 1589 seconds, ok = timeZone[tz] 1590 </pre> 1591 <p> 1592 For obvious reasons this is called the “comma ok” idiom. 1593 In this example, if <code>tz</code> is present, <code>seconds</code> 1594 will be set appropriately and <code>ok</code> will be true; if not, 1595 <code>seconds</code> will be set to zero and <code>ok</code> will 1596 be false. 1597 Here's a function that puts it together with a nice error report: 1598 </p> 1599 <pre> 1600 func offset(tz string) int { 1601 if seconds, ok := timeZone[tz]; ok { 1602 return seconds 1603 } 1604 log.Println("unknown time zone:", tz) 1605 return 0 1606 } 1607 </pre> 1608 <p> 1609 To test for presence in the map without worrying about the actual value, 1610 you can use the <a href="#blank">blank identifier</a> (<code>_</code>) 1611 in place of the usual variable for the value. 1612 </p> 1613 <pre> 1614 _, present := timeZone[tz] 1615 </pre> 1616 <p> 1617 To delete a map entry, use the <code>delete</code> 1618 built-in function, whose arguments are the map and the key to be deleted. 1619 It's safe to do this even if the key is already absent 1620 from the map. 1621 </p> 1622 <pre> 1623 delete(timeZone, "PDT") // Now on Standard Time 1624 </pre> 1625 1626 <h3 id="printing">Printing</h3> 1627 1628 <p> 1629 Formatted printing in Go uses a style similar to C's <code>printf</code> 1630 family but is richer and more general. The functions live in the <code>fmt</code> 1631 package and have capitalized names: <code>fmt.Printf</code>, <code>fmt.Fprintf</code>, 1632 <code>fmt.Sprintf</code> and so on. The string functions (<code>Sprintf</code> etc.) 1633 return a string rather than filling in a provided buffer. 1634 </p> 1635 <p> 1636 You don't need to provide a format string. For each of <code>Printf</code>, 1637 <code>Fprintf</code> and <code>Sprintf</code> there is another pair 1638 of functions, for instance <code>Print</code> and <code>Println</code>. 1639 These functions do not take a format string but instead generate a default 1640 format for each argument. The <code>Println</code> versions also insert a blank 1641 between arguments and append a newline to the output while 1642 the <code>Print</code> versions add blanks only if the operand on neither side is a string. 1643 In this example each line produces the same output. 1644 </p> 1645 <pre> 1646 fmt.Printf("Hello %d\n", 23) 1647 fmt.Fprint(os.Stdout, "Hello ", 23, "\n") 1648 fmt.Println("Hello", 23) 1649 fmt.Println(fmt.Sprint("Hello ", 23)) 1650 </pre> 1651 <p> 1652 The formatted print functions <code>fmt.Fprint</code> 1653 and friends take as a first argument any object 1654 that implements the <code>io.Writer</code> interface; the variables <code>os.Stdout</code> 1655 and <code>os.Stderr</code> are familiar instances. 1656 </p> 1657 <p> 1658 Here things start to diverge from C. First, the numeric formats such as <code>%d</code> 1659 do not take flags for signedness or size; instead, the printing routines use the 1660 type of the argument to decide these properties. 1661 </p> 1662 <pre> 1663 var x uint64 = 1<<64 - 1 1664 fmt.Printf("%d %x; %d %x\n", x, x, int64(x), int64(x)) 1665 </pre> 1666 <p> 1667 prints 1668 </p> 1669 <pre> 1670 18446744073709551615 ffffffffffffffff; -1 -1 1671 </pre> 1672 <p> 1673 If you just want the default conversion, such as decimal for integers, you can use 1674 the catchall format <code>%v</code> (for “value”); the result is exactly 1675 what <code>Print</code> and <code>Println</code> would produce. 1676 Moreover, that format can print <em>any</em> value, even arrays, slices, structs, and 1677 maps. Here is a print statement for the time zone map defined in the previous section. 1678 </p> 1679 <pre> 1680 fmt.Printf("%v\n", timeZone) // or just fmt.Println(timeZone) 1681 </pre> 1682 <p> 1683 which gives output 1684 </p> 1685 <pre> 1686 map[CST:-21600 PST:-28800 EST:-18000 UTC:0 MST:-25200] 1687 </pre> 1688 <p> 1689 For maps the keys may be output in any order, of course. 1690 When printing a struct, the modified format <code>%+v</code> annotates the 1691 fields of the structure with their names, and for any value the alternate 1692 format <code>%#v</code> prints the value in full Go syntax. 1693 </p> 1694 <pre> 1695 type T struct { 1696 a int 1697 b float64 1698 c string 1699 } 1700 t := &T{ 7, -2.35, "abc\tdef" } 1701 fmt.Printf("%v\n", t) 1702 fmt.Printf("%+v\n", t) 1703 fmt.Printf("%#v\n", t) 1704 fmt.Printf("%#v\n", timeZone) 1705 </pre> 1706 <p> 1707 prints 1708 </p> 1709 <pre> 1710 &{7 -2.35 abc def} 1711 &{a:7 b:-2.35 c:abc def} 1712 &main.T{a:7, b:-2.35, c:"abc\tdef"} 1713 map[string] int{"CST":-21600, "PST":-28800, "EST":-18000, "UTC":0, "MST":-25200} 1714 </pre> 1715 <p> 1716 (Note the ampersands.) 1717 That quoted string format is also available through <code>%q</code> when 1718 applied to a value of type <code>string</code> or <code>[]byte</code>. 1719 The alternate format <code>%#q</code> will use backquotes instead if possible. 1720 (The <code>%q</code> format also applies to integers and runes, producing a 1721 single-quoted rune constant.) 1722 Also, <code>%x</code> works on strings, byte arrays and byte slices as well as 1723 on integers, generating a long hexadecimal string, and with 1724 a space in the format (<code>% x</code>) it puts spaces between the bytes. 1725 </p> 1726 <p> 1727 Another handy format is <code>%T</code>, which prints the <em>type</em> of a value. 1728 </p> 1729 <pre> 1730 fmt.Printf("%T\n", timeZone) 1731 </pre> 1732 <p> 1733 prints 1734 </p> 1735 <pre> 1736 map[string] int 1737 </pre> 1738 <p> 1739 If you want to control the default format for a custom type, all that's required is to define 1740 a method with the signature <code>String() string</code> on the type. 1741 For our simple type <code>T</code>, that might look like this. 1742 </p> 1743 <pre> 1744 func (t *T) String() string { 1745 return fmt.Sprintf("%d/%g/%q", t.a, t.b, t.c) 1746 } 1747 fmt.Printf("%v\n", t) 1748 </pre> 1749 <p> 1750 to print in the format 1751 </p> 1752 <pre> 1753 7/-2.35/"abc\tdef" 1754 </pre> 1755 <p> 1756 (If you need to print <em>values</em> of type <code>T</code> as well as pointers to <code>T</code>, 1757 the receiver for <code>String</code> must be of value type; this example used a pointer because 1758 that's more efficient and idiomatic for struct types. 1759 See the section below on <a href="#pointers_vs_values">pointers vs. value receivers</a> for more information.) 1760 </p> 1761 1762 <p> 1763 Our <code>String</code> method is able to call <code>Sprintf</code> because the 1764 print routines are fully reentrant and can be wrapped this way. 1765 There is one important detail to understand about this approach, 1766 however: don't construct a <code>String</code> method by calling 1767 <code>Sprintf</code> in a way that will recur into your <code>String</code> 1768 method indefinitely. This can happen if the <code>Sprintf</code> 1769 call attempts to print the receiver directly as a string, which in 1770 turn will invoke the method again. It's a common and easy mistake 1771 to make, as this example shows. 1772 </p> 1773 1774 <pre> 1775 type MyString string 1776 1777 func (m MyString) String() string { 1778 return fmt.Sprintf("MyString=%s", m) // Error: will recur forever. 1779 } 1780 </pre> 1781 1782 <p> 1783 It's also easy to fix: convert the argument to the basic string type, which does not have the 1784 method. 1785 </p> 1786 1787 <pre> 1788 type MyString string 1789 func (m MyString) String() string { 1790 return fmt.Sprintf("MyString=%s", string(m)) // OK: note conversion. 1791 } 1792 </pre> 1793 1794 <p> 1795 In the <a href="#initialization">initialization section</a> we'll see another technique that avoids this recursion. 1796 </p> 1797 1798 <p> 1799 Another printing technique is to pass a print routine's arguments directly to another such routine. 1800 The signature of <code>Printf</code> uses the type <code>...interface{}</code> 1801 for its final argument to specify that an arbitrary number of parameters (of arbitrary type) 1802 can appear after the format. 1803 </p> 1804 <pre> 1805 func Printf(format string, v ...interface{}) (n int, err error) { 1806 </pre> 1807 <p> 1808 Within the function <code>Printf</code>, <code>v</code> acts like a variable of type 1809 <code>[]interface{}</code> but if it is passed to another variadic function, it acts like 1810 a regular list of arguments. 1811 Here is the implementation of the 1812 function <code>log.Println</code> we used above. It passes its arguments directly to 1813 <code>fmt.Sprintln</code> for the actual formatting. 1814 </p> 1815 <pre> 1816 // Println prints to the standard logger in the manner of fmt.Println. 1817 func Println(v ...interface{}) { 1818 std.Output(2, fmt.Sprintln(v...)) // Output takes parameters (int, string) 1819 } 1820 </pre> 1821 <p> 1822 We write <code>...</code> after <code>v</code> in the nested call to <code>Sprintln</code> to tell the 1823 compiler to treat <code>v</code> as a list of arguments; otherwise it would just pass 1824 <code>v</code> as a single slice argument. 1825 </p> 1826 <p> 1827 There's even more to printing than we've covered here. See the <code>godoc</code> documentation 1828 for package <code>fmt</code> for the details. 1829 </p> 1830 <p> 1831 By the way, a <code>...</code> parameter can be of a specific type, for instance <code>...int</code> 1832 for a min function that chooses the least of a list of integers: 1833 </p> 1834 <pre> 1835 func Min(a ...int) int { 1836 min := int(^uint(0) >> 1) // largest int 1837 for _, i := range a { 1838 if i < min { 1839 min = i 1840 } 1841 } 1842 return min 1843 } 1844 </pre> 1845 1846 <h3 id="append">Append</h3> 1847 <p> 1848 Now we have the missing piece we needed to explain the design of 1849 the <code>append</code> built-in function. The signature of <code>append</code> 1850 is different from our custom <code>Append</code> function above. 1851 Schematically, it's like this: 1852 </p> 1853 <pre> 1854 func append(slice []<i>T</i>, elements ...<i>T</i>) []<i>T</i> 1855 </pre> 1856 <p> 1857 where <i>T</i> is a placeholder for any given type. You can't 1858 actually write a function in Go where the type <code>T</code> 1859 is determined by the caller. 1860 That's why <code>append</code> is built in: it needs support from the 1861 compiler. 1862 </p> 1863 <p> 1864 What <code>append</code> does is append the elements to the end of 1865 the slice and return the result. The result needs to be returned 1866 because, as with our hand-written <code>Append</code>, the underlying 1867 array may change. This simple example 1868 </p> 1869 <pre> 1870 x := []int{1,2,3} 1871 x = append(x, 4, 5, 6) 1872 fmt.Println(x) 1873 </pre> 1874 <p> 1875 prints <code>[1 2 3 4 5 6]</code>. So <code>append</code> works a 1876 little like <code>Printf</code>, collecting an arbitrary number of 1877 arguments. 1878 </p> 1879 <p> 1880 But what if we wanted to do what our <code>Append</code> does and 1881 append a slice to a slice? Easy: use <code>...</code> at the call 1882 site, just as we did in the call to <code>Output</code> above. This 1883 snippet produces identical output to the one above. 1884 </p> 1885 <pre> 1886 x := []int{1,2,3} 1887 y := []int{4,5,6} 1888 x = append(x, y...) 1889 fmt.Println(x) 1890 </pre> 1891 <p> 1892 Without that <code>...</code>, it wouldn't compile because the types 1893 would be wrong; <code>y</code> is not of type <code>int</code>. 1894 </p> 1895 1896 <h2 id="initialization">Initialization</h2> 1897 1898 <p> 1899 Although it doesn't look superficially very different from 1900 initialization in C or C++, initialization in Go is more powerful. 1901 Complex structures can be built during initialization and the ordering 1902 issues among initialized objects, even among different packages, are handled 1903 correctly. 1904 </p> 1905 1906 <h3 id="constants">Constants</h3> 1907 1908 <p> 1909 Constants in Go are just that—constant. 1910 They are created at compile time, even when defined as 1911 locals in functions, 1912 and can only be numbers, characters (runes), strings or booleans. 1913 Because of the compile-time restriction, the expressions 1914 that define them must be constant expressions, 1915 evaluatable by the compiler. For instance, 1916 <code>1<<3</code> is a constant expression, while 1917 <code>math.Sin(math.Pi/4)</code> is not because 1918 the function call to <code>math.Sin</code> needs 1919 to happen at run time. 1920 </p> 1921 1922 <p> 1923 In Go, enumerated constants are created using the <code>iota</code> 1924 enumerator. Since <code>iota</code> can be part of an expression and 1925 expressions can be implicitly repeated, it is easy to build intricate 1926 sets of values. 1927 </p> 1928 {{code "/doc/progs/eff_bytesize.go" `/^type ByteSize/` `/^\)/`}} 1929 <p> 1930 The ability to attach a method such as <code>String</code> to any 1931 user-defined type makes it possible for arbitrary values to format themselves 1932 automatically for printing. 1933 Although you'll see it most often applied to structs, this technique is also useful for 1934 scalar types such as floating-point types like <code>ByteSize</code>. 1935 </p> 1936 {{code "/doc/progs/eff_bytesize.go" `/^func.*ByteSize.*String/` `/^}/`}} 1937 <p> 1938 The expression <code>YB</code> prints as <code>1.00YB</code>, 1939 while <code>ByteSize(1e13)</code> prints as <code>9.09TB</code>. 1940 </p> 1941 1942 <p> 1943 The use here of <code>Sprintf</code> 1944 to implement <code>ByteSize</code>'s <code>String</code> method is safe 1945 (avoids recurring indefinitely) not because of a conversion but 1946 because it calls <code>Sprintf</code> with <code>%f</code>, 1947 which is not a string format: <code>Sprintf</code> will only call 1948 the <code>String</code> method when it wants a string, and <code>%f</code> 1949 wants a floating-point value. 1950 </p> 1951 1952 <h3 id="variables">Variables</h3> 1953 1954 <p> 1955 Variables can be initialized just like constants but the 1956 initializer can be a general expression computed at run time. 1957 </p> 1958 <pre> 1959 var ( 1960 home = os.Getenv("HOME") 1961 user = os.Getenv("USER") 1962 gopath = os.Getenv("GOPATH") 1963 ) 1964 </pre> 1965 1966 <h3 id="init">The init function</h3> 1967 1968 <p> 1969 Finally, each source file can define its own niladic <code>init</code> function to 1970 set up whatever state is required. (Actually each file can have multiple 1971 <code>init</code> functions.) 1972 And finally means finally: <code>init</code> is called after all the 1973 variable declarations in the package have evaluated their initializers, 1974 and those are evaluated only after all the imported packages have been 1975 initialized. 1976 </p> 1977 <p> 1978 Besides initializations that cannot be expressed as declarations, 1979 a common use of <code>init</code> functions is to verify or repair 1980 correctness of the program state before real execution begins. 1981 </p> 1982 1983 <pre> 1984 func init() { 1985 if user == "" { 1986 log.Fatal("$USER not set") 1987 } 1988 if home == "" { 1989 home = "/home/" + user 1990 } 1991 if gopath == "" { 1992 gopath = home + "/go" 1993 } 1994 // gopath may be overridden by --gopath flag on command line. 1995 flag.StringVar(&gopath, "gopath", gopath, "override default GOPATH") 1996 } 1997 </pre> 1998 1999 <h2 id="methods">Methods</h2> 2000 2001 <h3 id="pointers_vs_values">Pointers vs. Values</h3> 2002 <p> 2003 As we saw with <code>ByteSize</code>, 2004 methods can be defined for any named type (except a pointer or an interface); 2005 the receiver does not have to be a struct. 2006 </p> 2007 <p> 2008 In the discussion of slices above, we wrote an <code>Append</code> 2009 function. We can define it as a method on slices instead. To do 2010 this, we first declare a named type to which we can bind the method, and 2011 then make the receiver for the method a value of that type. 2012 </p> 2013 <pre> 2014 type ByteSlice []byte 2015 2016 func (slice ByteSlice) Append(data []byte) []byte { 2017 // Body exactly the same as above 2018 } 2019 </pre> 2020 <p> 2021 This still requires the method to return the updated slice. We can 2022 eliminate that clumsiness by redefining the method to take a 2023 <i>pointer</i> to a <code>ByteSlice</code> as its receiver, so the 2024 method can overwrite the caller's slice. 2025 </p> 2026 <pre> 2027 func (p *ByteSlice) Append(data []byte) { 2028 slice := *p 2029 // Body as above, without the return. 2030 *p = slice 2031 } 2032 </pre> 2033 <p> 2034 In fact, we can do even better. If we modify our function so it looks 2035 like a standard <code>Write</code> method, like this, 2036 </p> 2037 <pre> 2038 func (p *ByteSlice) Write(data []byte) (n int, err error) { 2039 slice := *p 2040 // Again as above. 2041 *p = slice 2042 return len(data), nil 2043 } 2044 </pre> 2045 <p> 2046 then the type <code>*ByteSlice</code> satisfies the standard interface 2047 <code>io.Writer</code>, which is handy. For instance, we can 2048 print into one. 2049 </p> 2050 <pre> 2051 var b ByteSlice 2052 fmt.Fprintf(&b, "This hour has %d days\n", 7) 2053 </pre> 2054 <p> 2055 We pass the address of a <code>ByteSlice</code> 2056 because only <code>*ByteSlice</code> satisfies <code>io.Writer</code>. 2057 The rule about pointers vs. values for receivers is that value methods 2058 can be invoked on pointers and values, but pointer methods can only be 2059 invoked on pointers. 2060 </p> 2061 2062 <p> 2063 This rule arises because pointer methods can modify the receiver; invoking 2064 them on a value would cause the method to receive a copy of the value, so 2065 any modifications would be discarded. 2066 The language therefore disallows this mistake. 2067 There is a handy exception, though. When the value is addressable, the 2068 language takes care of the common case of invoking a pointer method on a 2069 value by inserting the address operator automatically. 2070 In our example, the variable <code>b</code> is addressable, so we can call 2071 its <code>Write</code> method with just <code>b.Write</code>. The compiler 2072 will rewrite that to <code>(&b).Write</code> for us. 2073 </p> 2074 2075 <p> 2076 By the way, the idea of using <code>Write</code> on a slice of bytes 2077 is central to the implementation of <code>bytes.Buffer</code>. 2078 </p> 2079 2080 <h2 id="interfaces_and_types">Interfaces and other types</h2> 2081 2082 <h3 id="interfaces">Interfaces</h3> 2083 <p> 2084 Interfaces in Go provide a way to specify the behavior of an 2085 object: if something can do <em>this</em>, then it can be used 2086 <em>here</em>. We've seen a couple of simple examples already; 2087 custom printers can be implemented by a <code>String</code> method 2088 while <code>Fprintf</code> can generate output to anything 2089 with a <code>Write</code> method. 2090 Interfaces with only one or two methods are common in Go code, and are 2091 usually given a name derived from the method, such as <code>io.Writer</code> 2092 for something that implements <code>Write</code>. 2093 </p> 2094 <p> 2095 A type can implement multiple interfaces. 2096 For instance, a collection can be sorted 2097 by the routines in package <code>sort</code> if it implements 2098 <code>sort.Interface</code>, which contains <code>Len()</code>, 2099 <code>Less(i, j int) bool</code>, and <code>Swap(i, j int)</code>, 2100 and it could also have a custom formatter. 2101 In this contrived example <code>Sequence</code> satisfies both. 2102 </p> 2103 {{code "/doc/progs/eff_sequence.go" `/^type/` "$"}} 2104 2105 <h3 id="conversions">Conversions</h3> 2106 2107 <p> 2108 The <code>String</code> method of <code>Sequence</code> is recreating the 2109 work that <code>Sprint</code> already does for slices. We can share the 2110 effort if we convert the <code>Sequence</code> to a plain 2111 <code>[]int</code> before calling <code>Sprint</code>. 2112 </p> 2113 <pre> 2114 func (s Sequence) String() string { 2115 sort.Sort(s) 2116 return fmt.Sprint([]int(s)) 2117 } 2118 </pre> 2119 <p> 2120 This method is another example of the conversion technique for calling 2121 <code>Sprintf</code> safely from a <code>String</code> method. 2122 Because the two types (<code>Sequence</code> and <code>[]int</code>) 2123 are the same if we ignore the type name, it's legal to convert between them. 2124 The conversion doesn't create a new value, it just temporarily acts 2125 as though the existing value has a new type. 2126 (There are other legal conversions, such as from integer to floating point, that 2127 do create a new value.) 2128 </p> 2129 <p> 2130 It's an idiom in Go programs to convert the 2131 type of an expression to access a different 2132 set of methods. As an example, we could use the existing 2133 type <code>sort.IntSlice</code> to reduce the entire example 2134 to this: 2135 </p> 2136 <pre> 2137 type Sequence []int 2138 2139 // Method for printing - sorts the elements before printing 2140 func (s Sequence) String() string { 2141 sort.IntSlice(s).Sort() 2142 return fmt.Sprint([]int(s)) 2143 } 2144 </pre> 2145 <p> 2146 Now, instead of having <code>Sequence</code> implement multiple 2147 interfaces (sorting and printing), we're using the ability of a data item to be 2148 converted to multiple types (<code>Sequence</code>, <code>sort.IntSlice</code> 2149 and <code>[]int</code>), each of which does some part of the job. 2150 That's more unusual in practice but can be effective. 2151 </p> 2152 2153 <h3 id="interface_conversions">Interface conversions and type assertions</h3> 2154 2155 <p> 2156 <a href="#type_switch">Type switches</a> are a form of conversion: they take an interface and, for 2157 each case in the switch, in a sense convert it to the type of that case. 2158 Here's a simplified version of how the code under <code>fmt.Printf</code> turns a value into 2159 a string using a type switch. 2160 If it's already a string, we want the actual string value held by the interface, while if it has a 2161 <code>String</code> method we want the result of calling the method. 2162 </p> 2163 2164 <pre> 2165 type Stringer interface { 2166 String() string 2167 } 2168 2169 var value interface{} // Value provided by caller. 2170 switch str := value.(type) { 2171 case string: 2172 return str 2173 case Stringer: 2174 return str.String() 2175 } 2176 </pre> 2177 2178 <p> 2179 The first case finds a concrete value; the second converts the interface into another interface. 2180 It's perfectly fine to mix types this way. 2181 </p> 2182 2183 <p> 2184 What if there's only one type we care about? If we know the value holds a <code>string</code> 2185 and we just want to extract it? 2186 A one-case type switch would do, but so would a <em>type assertion</em>. 2187 A type assertion takes an interface value and extracts from it a value of the specified explicit type. 2188 The syntax borrows from the clause opening a type switch, but with an explicit 2189 type rather than the <code>type</code> keyword: 2190 </p> 2191 2192 <pre> 2193 value.(typeName) 2194 </pre> 2195 2196 <p> 2197 and the result is a new value with the static type <code>typeName</code>. 2198 That type must either be the concrete type held by the interface, or a second interface 2199 type that the value can be converted to. 2200 To extract the string we know is in the value, we could write: 2201 </p> 2202 2203 <pre> 2204 str := value.(string) 2205 </pre> 2206 2207 <p> 2208 But if it turns out that the value does not contain a string, the program will crash with a run-time error. 2209 To guard against that, use the "comma, ok" idiom to test, safely, whether the value is a string: 2210 </p> 2211 2212 <pre> 2213 str, ok := value.(string) 2214 if ok { 2215 fmt.Printf("string value is: %q\n", str) 2216 } else { 2217 fmt.Printf("value is not a string\n") 2218 } 2219 </pre> 2220 2221 <p> 2222 If the type assertion fails, <code>str</code> will still exist and be of type string, but it will have 2223 the zero value, an empty string. 2224 </p> 2225 2226 <p> 2227 As an illustration of the capability, here's an <code>if</code>-<code>else</code> 2228 statement that's equivalent to the type switch that opened this section. 2229 </p> 2230 2231 <pre> 2232 if str, ok := value.(string); ok { 2233 return str 2234 } else if str, ok := value.(Stringer); ok { 2235 return str.String() 2236 } 2237 </pre> 2238 2239 <h3 id="generality">Generality</h3> 2240 <p> 2241 If a type exists only to implement an interface 2242 and has no exported methods beyond that interface, 2243 there is no need to export the type itself. 2244 Exporting just the interface makes it clear that 2245 it's the behavior that matters, not the implementation, 2246 and that other implementations with different properties 2247 can mirror the behavior of the original type. 2248 It also avoids the need to repeat the documentation 2249 on every instance of a common method. 2250 </p> 2251 <p> 2252 In such cases, the constructor should return an interface value 2253 rather than the implementing type. 2254 As an example, in the hash libraries 2255 both <code>crc32.NewIEEE</code> and <code>adler32.New</code> 2256 return the interface type <code>hash.Hash32</code>. 2257 Substituting the CRC-32 algorithm for Adler-32 in a Go program 2258 requires only changing the constructor call; 2259 the rest of the code is unaffected by the change of algorithm. 2260 </p> 2261 <p> 2262 A similar approach allows the streaming cipher algorithms 2263 in the various <code>crypto</code> packages to be 2264 separated from the block ciphers they chain together. 2265 The <code>Block</code> interface 2266 in the <code>crypto/cipher</code> package specifies the 2267 behavior of a block cipher, which provides encryption 2268 of a single block of data. 2269 Then, by analogy with the <code>bufio</code> package, 2270 cipher packages that implement this interface 2271 can be used to construct streaming ciphers, represented 2272 by the <code>Stream</code> interface, without 2273 knowing the details of the block encryption. 2274 </p> 2275 <p> 2276 The <code>crypto/cipher</code> interfaces look like this: 2277 </p> 2278 <pre> 2279 type Block interface { 2280 BlockSize() int 2281 Encrypt(src, dst []byte) 2282 Decrypt(src, dst []byte) 2283 } 2284 2285 type Stream interface { 2286 XORKeyStream(dst, src []byte) 2287 } 2288 </pre> 2289 2290 <p> 2291 Here's the definition of the counter mode (CTR) stream, 2292 which turns a block cipher into a streaming cipher; notice 2293 that the block cipher's details are abstracted away: 2294 </p> 2295 2296 <pre> 2297 // NewCTR returns a Stream that encrypts/decrypts using the given Block in 2298 // counter mode. The length of iv must be the same as the Block's block size. 2299 func NewCTR(block Block, iv []byte) Stream 2300 </pre> 2301 <p> 2302 <code>NewCTR</code> applies not 2303 just to one specific encryption algorithm and data source but to any 2304 implementation of the <code>Block</code> interface and any 2305 <code>Stream</code>. Because they return 2306 interface values, replacing CTR 2307 encryption with other encryption modes is a localized change. The constructor 2308 calls must be edited, but because the surrounding code must treat the result only 2309 as a <code>Stream</code>, it won't notice the difference. 2310 </p> 2311 2312 <h3 id="interface_methods">Interfaces and methods</h3> 2313 <p> 2314 Since almost anything can have methods attached, almost anything can 2315 satisfy an interface. One illustrative example is in the <code>http</code> 2316 package, which defines the <code>Handler</code> interface. Any object 2317 that implements <code>Handler</code> can serve HTTP requests. 2318 </p> 2319 <pre> 2320 type Handler interface { 2321 ServeHTTP(ResponseWriter, *Request) 2322 } 2323 </pre> 2324 <p> 2325 <code>ResponseWriter</code> is itself an interface that provides access 2326 to the methods needed to return the response to the client. 2327 Those methods include the standard <code>Write</code> method, so an 2328 <code>http.ResponseWriter</code> can be used wherever an <code>io.Writer</code> 2329 can be used. 2330 <code>Request</code> is a struct containing a parsed representation 2331 of the request from the client. 2332 </p> 2333 <p> 2334 For brevity, let's ignore POSTs and assume HTTP requests are always 2335 GETs; that simplification does not affect the way the handlers are 2336 set up. Here's a trivial but complete implementation of a handler to 2337 count the number of times the 2338 page is visited. 2339 </p> 2340 <pre> 2341 // Simple counter server. 2342 type Counter struct { 2343 n int 2344 } 2345 2346 func (ctr *Counter) ServeHTTP(w http.ResponseWriter, req *http.Request) { 2347 ctr.n++ 2348 fmt.Fprintf(w, "counter = %d\n", ctr.n) 2349 } 2350 </pre> 2351 <p> 2352 (Keeping with our theme, note how <code>Fprintf</code> can print to an 2353 <code>http.ResponseWriter</code>.) 2354 For reference, here's how to attach such a server to a node on the URL tree. 2355 </p> 2356 <pre> 2357 import "net/http" 2358 ... 2359 ctr := new(Counter) 2360 http.Handle("/counter", ctr) 2361 </pre> 2362 <p> 2363 But why make <code>Counter</code> a struct? An integer is all that's needed. 2364 (The receiver needs to be a pointer so the increment is visible to the caller.) 2365 </p> 2366 <pre> 2367 // Simpler counter server. 2368 type Counter int 2369 2370 func (ctr *Counter) ServeHTTP(w http.ResponseWriter, req *http.Request) { 2371 *ctr++ 2372 fmt.Fprintf(w, "counter = %d\n", *ctr) 2373 } 2374 </pre> 2375 <p> 2376 What if your program has some internal state that needs to be notified that a page 2377 has been visited? Tie a channel to the web page. 2378 </p> 2379 <pre> 2380 // A channel that sends a notification on each visit. 2381 // (Probably want the channel to be buffered.) 2382 type Chan chan *http.Request 2383 2384 func (ch Chan) ServeHTTP(w http.ResponseWriter, req *http.Request) { 2385 ch <- req 2386 fmt.Fprint(w, "notification sent") 2387 } 2388 </pre> 2389 <p> 2390 Finally, let's say we wanted to present on <code>/args</code> the arguments 2391 used when invoking the server binary. 2392 It's easy to write a function to print the arguments. 2393 </p> 2394 <pre> 2395 func ArgServer() { 2396 fmt.Println(os.Args) 2397 } 2398 </pre> 2399 <p> 2400 How do we turn that into an HTTP server? We could make <code>ArgServer</code> 2401 a method of some type whose value we ignore, but there's a cleaner way. 2402 Since we can define a method for any type except pointers and interfaces, 2403 we can write a method for a function. 2404 The <code>http</code> package contains this code: 2405 </p> 2406 <pre> 2407 // The HandlerFunc type is an adapter to allow the use of 2408 // ordinary functions as HTTP handlers. If f is a function 2409 // with the appropriate signature, HandlerFunc(f) is a 2410 // Handler object that calls f. 2411 type HandlerFunc func(ResponseWriter, *Request) 2412 2413 // ServeHTTP calls f(c, req). 2414 func (f HandlerFunc) ServeHTTP(w ResponseWriter, req *Request) { 2415 f(w, req) 2416 } 2417 </pre> 2418 <p> 2419 <code>HandlerFunc</code> is a type with a method, <code>ServeHTTP</code>, 2420 so values of that type can serve HTTP requests. Look at the implementation 2421 of the method: the receiver is a function, <code>f</code>, and the method 2422 calls <code>f</code>. That may seem odd but it's not that different from, say, 2423 the receiver being a channel and the method sending on the channel. 2424 </p> 2425 <p> 2426 To make <code>ArgServer</code> into an HTTP server, we first modify it 2427 to have the right signature. 2428 </p> 2429 <pre> 2430 // Argument server. 2431 func ArgServer(w http.ResponseWriter, req *http.Request) { 2432 fmt.Fprintln(w, os.Args) 2433 } 2434 </pre> 2435 <p> 2436 <code>ArgServer</code> now has same signature as <code>HandlerFunc</code>, 2437 so it can be converted to that type to access its methods, 2438 just as we converted <code>Sequence</code> to <code>IntSlice</code> 2439 to access <code>IntSlice.Sort</code>. 2440 The code to set it up is concise: 2441 </p> 2442 <pre> 2443 http.Handle("/args", http.HandlerFunc(ArgServer)) 2444 </pre> 2445 <p> 2446 When someone visits the page <code>/args</code>, 2447 the handler installed at that page has value <code>ArgServer</code> 2448 and type <code>HandlerFunc</code>. 2449 The HTTP server will invoke the method <code>ServeHTTP</code> 2450 of that type, with <code>ArgServer</code> as the receiver, which will in turn call 2451 <code>ArgServer</code> (via the invocation <code>f(c, req)</code> 2452 inside <code>HandlerFunc.ServeHTTP</code>). 2453 The arguments will then be displayed. 2454 </p> 2455 <p> 2456 In this section we have made an HTTP server from a struct, an integer, 2457 a channel, and a function, all because interfaces are just sets of 2458 methods, which can be defined for (almost) any type. 2459 </p> 2460 2461 <h2 id="blank">The blank identifier</h2> 2462 2463 <p> 2464 We've mentioned the blank identifier a couple of times now, in the context of 2465 <a href="#for"><code>for</code> <code>range</code> loops</a> 2466 and <a href="#maps">maps</a>. 2467 The blank identifier can be assigned or declared with any value of any type, with the 2468 value discarded harmlessly. 2469 It's a bit like writing to the Unix <code>/dev/null</code> file: 2470 it represents a write-only value 2471 to be used as a place-holder 2472 where a variable is needed but the actual value is irrelevant. 2473 It has uses beyond those we've seen already. 2474 </p> 2475 2476 <h3 id="blank_assign">The blank identifier in multiple assignment</h3> 2477 2478 <p> 2479 The use of a blank identifier in a <code>for</code> <code>range</code> loop is a 2480 special case of a general situation: multiple assignment. 2481 </p> 2482 2483 <p> 2484 If an assignment requires multiple values on the left side, 2485 but one of the values will not be used by the program, 2486 a blank identifier on the left-hand-side of 2487 the assignment avoids the need 2488 to create a dummy variable and makes it clear that the 2489 value is to be discarded. 2490 For instance, when calling a function that returns 2491 a value and an error, but only the error is important, 2492 use the blank identifier to discard the irrelevant value. 2493 </p> 2494 2495 <pre> 2496 if _, err := os.Stat(path); os.IsNotExist(err) { 2497 fmt.Printf("%s does not exist\n", path) 2498 } 2499 </pre> 2500 2501 <p> 2502 Occasionally you'll see code that discards the error value in order 2503 to ignore the error; this is terrible practice. Always check error returns; 2504 they're provided for a reason. 2505 </p> 2506 2507 <pre> 2508 // Bad! This code will crash if path does not exist. 2509 fi, _ := os.Stat(path) 2510 if fi.IsDir() { 2511 fmt.Printf("%s is a directory\n", path) 2512 } 2513 </pre> 2514 2515 <h3 id="blank_unused">Unused imports and variables</h3> 2516 2517 <p> 2518 It is an error to import a package or to declare a variable without using it. 2519 Unused imports bloat the program and slow compilation, 2520 while a variable that is initialized but not used is at least 2521 a wasted computation and perhaps indicative of a 2522 larger bug. 2523 When a program is under active development, however, 2524 unused imports and variables often arise and it can 2525 be annoying to delete them just to have the compilation proceed, 2526 only to have them be needed again later. 2527 The blank identifier provides a workaround. 2528 </p> 2529 <p> 2530 This half-written program has two unused imports 2531 (<code>fmt</code> and <code>io</code>) 2532 and an unused variable (<code>fd</code>), 2533 so it will not compile, but it would be nice to see if the 2534 code so far is correct. 2535 </p> 2536 {{code "/doc/progs/eff_unused1.go" `/package/` `$`}} 2537 <p> 2538 To silence complaints about the unused imports, use a 2539 blank identifier to refer to a symbol from the imported package. 2540 Similarly, assigning the unused variable <code>fd</code> 2541 to the blank identifier will silence the unused variable error. 2542 This version of the program does compile. 2543 </p> 2544 {{code "/doc/progs/eff_unused2.go" `/package/` `$`}} 2545 2546 <p> 2547 By convention, the global declarations to silence import errors 2548 should come right after the imports and be commented, 2549 both to make them easy to find and as a reminder to clean things up later. 2550 </p> 2551 2552 <h3 id="blank_import">Import for side effect</h3> 2553 2554 <p> 2555 An unused import like <code>fmt</code> or <code>io</code> in the 2556 previous example should eventually be used or removed: 2557 blank assignments identify code as a work in progress. 2558 But sometimes it is useful to import a package only for its 2559 side effects, without any explicit use. 2560 For example, during its <code>init</code> function, 2561 the <code><a href="/pkg/net/http/pprof/">net/http/pprof</a></code> 2562 package registers HTTP handlers that provide 2563 debugging information. It has an exported API, but 2564 most clients need only the handler registration and 2565 access the data through a web page. 2566 To import the package only for its side effects, rename the package 2567 to the blank identifier: 2568 </p> 2569 <pre> 2570 import _ "net/http/pprof" 2571 </pre> 2572 <p> 2573 This form of import makes clear that the package is being 2574 imported for its side effects, because there is no other possible 2575 use of the package: in this file, it doesn't have a name. 2576 (If it did, and we didn't use that name, the compiler would reject the program.) 2577 </p> 2578 2579 <h3 id="blank_implements">Interface checks</h3> 2580 2581 <p> 2582 As we saw in the discussion of <a href="#interfaces_and_types">interfaces</a> above, 2583 a type need not declare explicitly that it implements an interface. 2584 Instead, a type implements the interface just by implementing the interface's methods. 2585 In practice, most interface conversions are static and therefore checked at compile time. 2586 For example, passing an <code>*os.File</code> to a function 2587 expecting an <code>io.Reader</code> will not compile unless 2588 <code>*os.File</code> implements the <code>io.Reader</code> interface. 2589 </p> 2590 2591 <p> 2592 Some interface checks do happen at run-time, though. 2593 One instance is in the <code><a href="/pkg/encoding/json/">encoding/json</a></code> 2594 package, which defines a <code><a href="/pkg/encoding/json/#Marshaler">Marshaler</a></code> 2595 interface. When the JSON encoder receives a value that implements that interface, 2596 the encoder invokes the value's marshaling method to convert it to JSON 2597 instead of doing the standard conversion. 2598 The encoder checks this property at run time with a <a href="#interface_conversions">type assertion</a> like: 2599 </p> 2600 2601 <pre> 2602 m, ok := val.(json.Marshaler) 2603 </pre> 2604 2605 <p> 2606 If it's necessary only to ask whether a type implements an interface, without 2607 actually using the interface itself, perhaps as part of an error check, use the blank 2608 identifier to ignore the type-asserted value: 2609 </p> 2610 2611 <pre> 2612 if _, ok := val.(json.Marshaler); ok { 2613 fmt.Printf("value %v of type %T implements json.Marshaler\n", val, val) 2614 } 2615 </pre> 2616 2617 <p> 2618 One place this situation arises is when it is necessary to guarantee within the package implementing the type that 2619 it actually satisfies the interface. 2620 If a typefor example, 2621 <code><a href="/pkg/encoding/json/#RawMessage">json.RawMessage</a></code>needs 2622 a custom JSON representation, it should implement 2623 <code>json.Marshaler</code>, but there are no static conversions that would 2624 cause the compiler to verify this automatically. 2625 If the type inadvertently fails to satisfy the interface, the JSON encoder will still work, 2626 but will not use the custom implementation. 2627 To guarantee that the implementation is correct, 2628 a global declaration using the blank identifier can be used in the package: 2629 </p> 2630 <pre> 2631 var _ json.Marshaler = (*RawMessage)(nil) 2632 </pre> 2633 <p> 2634 In this declaration, the assignment involving a conversion of a 2635 <code>*RawMessage</code> to a <code>Marshaler</code> 2636 requires that <code>*RawMessage</code> implements <code>Marshaler</code>, 2637 and that property will be checked at compile time. 2638 Should the <code>json.Marshaler</code> interface change, this package 2639 will no longer compile and we will be on notice that it needs to be updated. 2640 </p> 2641 2642 <p> 2643 The appearance of the blank identifier in this construct indicates that 2644 the declaration exists only for the type checking, 2645 not to create a variable. 2646 Don't do this for every type that satisfies an interface, though. 2647 By convention, such declarations are only used 2648 when there are no static conversions already present in the code, 2649 which is a rare event. 2650 </p> 2651 2652 2653 <h2 id="embedding">Embedding</h2> 2654 2655 <p> 2656 Go does not provide the typical, type-driven notion of subclassing, 2657 but it does have the ability to “borrow” pieces of an 2658 implementation by <em>embedding</em> types within a struct or 2659 interface. 2660 </p> 2661 <p> 2662 Interface embedding is very simple. 2663 We've mentioned the <code>io.Reader</code> and <code>io.Writer</code> interfaces before; 2664 here are their definitions. 2665 </p> 2666 <pre> 2667 type Reader interface { 2668 Read(p []byte) (n int, err error) 2669 } 2670 2671 type Writer interface { 2672 Write(p []byte) (n int, err error) 2673 } 2674 </pre> 2675 <p> 2676 The <code>io</code> package also exports several other interfaces 2677 that specify objects that can implement several such methods. 2678 For instance, there is <code>io.ReadWriter</code>, an interface 2679 containing both <code>Read</code> and <code>Write</code>. 2680 We could specify <code>io.ReadWriter</code> by listing the 2681 two methods explicitly, but it's easier and more evocative 2682 to embed the two interfaces to form the new one, like this: 2683 </p> 2684 <pre> 2685 // ReadWriter is the interface that combines the Reader and Writer interfaces. 2686 type ReadWriter interface { 2687 Reader 2688 Writer 2689 } 2690 </pre> 2691 <p> 2692 This says just what it looks like: A <code>ReadWriter</code> can do 2693 what a <code>Reader</code> does <em>and</em> what a <code>Writer</code> 2694 does; it is a union of the embedded interfaces (which must be disjoint 2695 sets of methods). 2696 Only interfaces can be embedded within interfaces. 2697 </p> 2698 <p> 2699 The same basic idea applies to structs, but with more far-reaching 2700 implications. The <code>bufio</code> package has two struct types, 2701 <code>bufio.Reader</code> and <code>bufio.Writer</code>, each of 2702 which of course implements the analogous interfaces from package 2703 <code>io</code>. 2704 And <code>bufio</code> also implements a buffered reader/writer, 2705 which it does by combining a reader and a writer into one struct 2706 using embedding: it lists the types within the struct 2707 but does not give them field names. 2708 </p> 2709 <pre> 2710 // ReadWriter stores pointers to a Reader and a Writer. 2711 // It implements io.ReadWriter. 2712 type ReadWriter struct { 2713 *Reader // *bufio.Reader 2714 *Writer // *bufio.Writer 2715 } 2716 </pre> 2717 <p> 2718 The embedded elements are pointers to structs and of course 2719 must be initialized to point to valid structs before they 2720 can be used. 2721 The <code>ReadWriter</code> struct could be written as 2722 </p> 2723 <pre> 2724 type ReadWriter struct { 2725 reader *Reader 2726 writer *Writer 2727 } 2728 </pre> 2729 <p> 2730 but then to promote the methods of the fields and to 2731 satisfy the <code>io</code> interfaces, we would also need 2732 to provide forwarding methods, like this: 2733 </p> 2734 <pre> 2735 func (rw *ReadWriter) Read(p []byte) (n int, err error) { 2736 return rw.reader.Read(p) 2737 } 2738 </pre> 2739 <p> 2740 By embedding the structs directly, we avoid this bookkeeping. 2741 The methods of embedded types come along for free, which means that <code>bufio.ReadWriter</code> 2742 not only has the methods of <code>bufio.Reader</code> and <code>bufio.Writer</code>, 2743 it also satisfies all three interfaces: 2744 <code>io.Reader</code>, 2745 <code>io.Writer</code>, and 2746 <code>io.ReadWriter</code>. 2747 </p> 2748 <p> 2749 There's an important way in which embedding differs from subclassing. When we embed a type, 2750 the methods of that type become methods of the outer type, 2751 but when they are invoked the receiver of the method is the inner type, not the outer one. 2752 In our example, when the <code>Read</code> method of a <code>bufio.ReadWriter</code> is 2753 invoked, it has exactly the same effect as the forwarding method written out above; 2754 the receiver is the <code>reader</code> field of the <code>ReadWriter</code>, not the 2755 <code>ReadWriter</code> itself. 2756 </p> 2757 <p> 2758 Embedding can also be a simple convenience. 2759 This example shows an embedded field alongside a regular, named field. 2760 </p> 2761 <pre> 2762 type Job struct { 2763 Command string 2764 *log.Logger 2765 } 2766 </pre> 2767 <p> 2768 The <code>Job</code> type now has the <code>Log</code>, <code>Logf</code> 2769 and other 2770 methods of <code>*log.Logger</code>. We could have given the <code>Logger</code> 2771 a field name, of course, but it's not necessary to do so. And now, once 2772 initialized, we can 2773 log to the <code>Job</code>: 2774 </p> 2775 <pre> 2776 job.Log("starting now...") 2777 </pre> 2778 <p> 2779 The <code>Logger</code> is a regular field of the <code>Job</code> struct, 2780 so we can initialize it in the usual way inside the constructor for <code>Job</code>, like this, 2781 </p> 2782 <pre> 2783 func NewJob(command string, logger *log.Logger) *Job { 2784 return &Job{command, logger} 2785 } 2786 </pre> 2787 <p> 2788 or with a composite literal, 2789 </p> 2790 <pre> 2791 job := &Job{command, log.New(os.Stderr, "Job: ", log.Ldate)} 2792 </pre> 2793 <p> 2794 If we need to refer to an embedded field directly, the type name of the field, 2795 ignoring the package qualifier, serves as a field name, as it did 2796 in the <code>Read</code> method of our <code>ReaderWriter</code> struct. 2797 Here, if we needed to access the 2798 <code>*log.Logger</code> of a <code>Job</code> variable <code>job</code>, 2799 we would write <code>job.Logger</code>, 2800 which would be useful if we wanted to refine the methods of <code>Logger</code>. 2801 </p> 2802 <pre> 2803 func (job *Job) Logf(format string, args ...interface{}) { 2804 job.Logger.Logf("%q: %s", job.Command, fmt.Sprintf(format, args...)) 2805 } 2806 </pre> 2807 <p> 2808 Embedding types introduces the problem of name conflicts but the rules to resolve 2809 them are simple. 2810 First, a field or method <code>X</code> hides any other item <code>X</code> in a more deeply 2811 nested part of the type. 2812 If <code>log.Logger</code> contained a field or method called <code>Command</code>, the <code>Command</code> field 2813 of <code>Job</code> would dominate it. 2814 </p> 2815 <p> 2816 Second, if the same name appears at the same nesting level, it is usually an error; 2817 it would be erroneous to embed <code>log.Logger</code> if the <code>Job</code> struct 2818 contained another field or method called <code>Logger</code>. 2819 However, if the duplicate name is never mentioned in the program outside the type definition, it is OK. 2820 This qualification provides some protection against changes made to types embedded from outside; there 2821 is no problem if a field is added that conflicts with another field in another subtype if neither field 2822 is ever used. 2823 </p> 2824 2825 2826 <h2 id="concurrency">Concurrency</h2> 2827 2828 <h3 id="sharing">Share by communicating</h3> 2829 2830 <p> 2831 Concurrent programming is a large topic and there is space only for some 2832 Go-specific highlights here. 2833 </p> 2834 <p> 2835 Concurrent programming in many environments is made difficult by the 2836 subtleties required to implement correct access to shared variables. Go encourages 2837 a different approach in which shared values are passed around on channels 2838 and, in fact, never actively shared by separate threads of execution. 2839 Only one goroutine has access to the value at any given time. 2840 Data races cannot occur, by design. 2841 To encourage this way of thinking we have reduced it to a slogan: 2842 </p> 2843 <blockquote> 2844 Do not communicate by sharing memory; 2845 instead, share memory by communicating. 2846 </blockquote> 2847 <p> 2848 This approach can be taken too far. Reference counts may be best done 2849 by putting a mutex around an integer variable, for instance. But as a 2850 high-level approach, using channels to control access makes it easier 2851 to write clear, correct programs. 2852 </p> 2853 <p> 2854 One way to think about this model is to consider a typical single-threaded 2855 program running on one CPU. It has no need for synchronization primitives. 2856 Now run another such instance; it too needs no synchronization. Now let those 2857 two communicate; if the communication is the synchronizer, there's still no need 2858 for other synchronization. Unix pipelines, for example, fit this model 2859 perfectly. Although Go's approach to concurrency originates in Hoare's 2860 Communicating Sequential Processes (CSP), 2861 it can also be seen as a type-safe generalization of Unix pipes. 2862 </p> 2863 2864 <h3 id="goroutines">Goroutines</h3> 2865 2866 <p> 2867 They're called <em>goroutines</em> because the existing 2868 terms—threads, coroutines, processes, and so on—convey 2869 inaccurate connotations. A goroutine has a simple model: it is a 2870 function executing concurrently with other goroutines in the same 2871 address space. It is lightweight, costing little more than the 2872 allocation of stack space. 2873 And the stacks start small, so they are cheap, and grow 2874 by allocating (and freeing) heap storage as required. 2875 </p> 2876 <p> 2877 Goroutines are multiplexed onto multiple OS threads so if one should 2878 block, such as while waiting for I/O, others continue to run. Their 2879 design hides many of the complexities of thread creation and 2880 management. 2881 </p> 2882 <p> 2883 Prefix a function or method call with the <code>go</code> 2884 keyword to run the call in a new goroutine. 2885 When the call completes, the goroutine 2886 exits, silently. (The effect is similar to the Unix shell's 2887 <code>&</code> notation for running a command in the 2888 background.) 2889 </p> 2890 <pre> 2891 go list.Sort() // run list.Sort concurrently; don't wait for it. 2892 </pre> 2893 <p> 2894 A function literal can be handy in a goroutine invocation. 2895 </p> 2896 <pre> 2897 func Announce(message string, delay time.Duration) { 2898 go func() { 2899 time.Sleep(delay) 2900 fmt.Println(message) 2901 }() // Note the parentheses - must call the function. 2902 } 2903 </pre> 2904 <p> 2905 In Go, function literals are closures: the implementation makes 2906 sure the variables referred to by the function survive as long as they are active. 2907 </p> 2908 <p> 2909 These examples aren't too practical because the functions have no way of signaling 2910 completion. For that, we need channels. 2911 </p> 2912 2913 <h3 id="channels">Channels</h3> 2914 2915 <p> 2916 Like maps, channels are allocated with <code>make</code>, and 2917 the resulting value acts as a reference to an underlying data structure. 2918 If an optional integer parameter is provided, it sets the buffer size for the channel. 2919 The default is zero, for an unbuffered or synchronous channel. 2920 </p> 2921 <pre> 2922 ci := make(chan int) // unbuffered channel of integers 2923 cj := make(chan int, 0) // unbuffered channel of integers 2924 cs := make(chan *os.File, 100) // buffered channel of pointers to Files 2925 </pre> 2926 <p> 2927 Unbuffered channels combine communication—the exchange of a value—with 2928 synchronization—guaranteeing that two calculations (goroutines) are in 2929 a known state. 2930 </p> 2931 <p> 2932 There are lots of nice idioms using channels. Here's one to get us started. 2933 In the previous section we launched a sort in the background. A channel 2934 can allow the launching goroutine to wait for the sort to complete. 2935 </p> 2936 <pre> 2937 c := make(chan int) // Allocate a channel. 2938 // Start the sort in a goroutine; when it completes, signal on the channel. 2939 go func() { 2940 list.Sort() 2941 c <- 1 // Send a signal; value does not matter. 2942 }() 2943 doSomethingForAWhile() 2944 <-c // Wait for sort to finish; discard sent value. 2945 </pre> 2946 <p> 2947 Receivers always block until there is data to receive. 2948 If the channel is unbuffered, the sender blocks until the receiver has 2949 received the value. 2950 If the channel has a buffer, the sender blocks only until the 2951 value has been copied to the buffer; if the buffer is full, this 2952 means waiting until some receiver has retrieved a value. 2953 </p> 2954 <p> 2955 A buffered channel can be used like a semaphore, for instance to 2956 limit throughput. In this example, incoming requests are passed 2957 to <code>handle</code>, which sends a value into the channel, processes 2958 the request, and then receives a value from the channel 2959 to ready the “semaphore” for the next consumer. 2960 The capacity of the channel buffer limits the number of 2961 simultaneous calls to <code>process</code>. 2962 </p> 2963 <pre> 2964 var sem = make(chan int, MaxOutstanding) 2965 2966 func handle(r *Request) { 2967 sem <- 1 // Wait for active queue to drain. 2968 process(r) // May take a long time. 2969 <-sem // Done; enable next request to run. 2970 } 2971 2972 func Serve(queue chan *Request) { 2973 for { 2974 req := <-queue 2975 go handle(req) // Don't wait for handle to finish. 2976 } 2977 } 2978 </pre> 2979 2980 <p> 2981 Once <code>MaxOutstanding</code> handlers are executing <code>process</code>, 2982 any more will block trying to send into the filled channel buffer, 2983 until one of the existing handlers finishes and receives from the buffer. 2984 </p> 2985 2986 <p> 2987 This design has a problem, though: <code>Serve</code> 2988 creates a new goroutine for 2989 every incoming request, even though only <code>MaxOutstanding</code> 2990 of them can run at any moment. 2991 As a result, the program can consume unlimited resources if the requests come in too fast. 2992 We can address that deficiency by changing <code>Serve</code> to 2993 gate the creation of the goroutines. 2994 Here's an obvious solution, but beware it has a bug we'll fix subsequently: 2995 </p> 2996 2997 <pre> 2998 func Serve(queue chan *Request) { 2999 for req := range queue { 3000 sem <- 1 3001 go func() { 3002 process(req) // Buggy; see explanation below. 3003 <-sem 3004 }() 3005 } 3006 }</pre> 3007 3008 <p> 3009 The bug is that in a Go <code>for</code> loop, the loop variable 3010 is reused for each iteration, so the <code>req</code> 3011 variable is shared across all goroutines. 3012 That's not what we want. 3013 We need to make sure that <code>req</code> is unique for each goroutine. 3014 Here's one way to do that, passing the value of <code>req</code> as an argument 3015 to the closure in the goroutine: 3016 </p> 3017 3018 <pre> 3019 func Serve(queue chan *Request) { 3020 for req := range queue { 3021 sem <- 1 3022 go func(req *Request) { 3023 process(req) 3024 <-sem 3025 }(req) 3026 } 3027 }</pre> 3028 3029 <p> 3030 Compare this version with the previous to see the difference in how 3031 the closure is declared and run. 3032 Another solution is just to create a new variable with the same 3033 name, as in this example: 3034 </p> 3035 3036 <pre> 3037 func Serve(queue chan *Request) { 3038 for req := range queue { 3039 req := req // Create new instance of req for the goroutine. 3040 sem <- 1 3041 go func() { 3042 process(req) 3043 <-sem 3044 }() 3045 } 3046 }</pre> 3047 3048 <p> 3049 It may seem odd to write 3050 </p> 3051 3052 <pre> 3053 req := req 3054 </pre> 3055 3056 <p> 3057 but it's legal and idiomatic in Go to do this. 3058 You get a fresh version of the variable with the same name, deliberately 3059 shadowing the loop variable locally but unique to each goroutine. 3060 </p> 3061 3062 <p> 3063 Going back to the general problem of writing the server, 3064 another approach that manages resources well is to start a fixed 3065 number of <code>handle</code> goroutines all reading from the request 3066 channel. 3067 The number of goroutines limits the number of simultaneous 3068 calls to <code>process</code>. 3069 This <code>Serve</code> function also accepts a channel on which 3070 it will be told to exit; after launching the goroutines it blocks 3071 receiving from that channel. 3072 </p> 3073 3074 <pre> 3075 func handle(queue chan *Request) { 3076 for r := range queue { 3077 process(r) 3078 } 3079 } 3080 3081 func Serve(clientRequests chan *Request, quit chan bool) { 3082 // Start handlers 3083 for i := 0; i < MaxOutstanding; i++ { 3084 go handle(clientRequests) 3085 } 3086 <-quit // Wait to be told to exit. 3087 } 3088 </pre> 3089 3090 <h3 id="chan_of_chan">Channels of channels</h3> 3091 <p> 3092 One of the most important properties of Go is that 3093 a channel is a first-class value that can be allocated and passed 3094 around like any other. A common use of this property is 3095 to implement safe, parallel demultiplexing. 3096 </p> 3097 <p> 3098 In the example in the previous section, <code>handle</code> was 3099 an idealized handler for a request but we didn't define the 3100 type it was handling. If that type includes a channel on which 3101 to reply, each client can provide its own path for the answer. 3102 Here's a schematic definition of type <code>Request</code>. 3103 </p> 3104 <pre> 3105 type Request struct { 3106 args []int 3107 f func([]int) int 3108 resultChan chan int 3109 } 3110 </pre> 3111 <p> 3112 The client provides a function and its arguments, as well as 3113 a channel inside the request object on which to receive the answer. 3114 </p> 3115 <pre> 3116 func sum(a []int) (s int) { 3117 for _, v := range a { 3118 s += v 3119 } 3120 return 3121 } 3122 3123 request := &Request{[]int{3, 4, 5}, sum, make(chan int)} 3124 // Send request 3125 clientRequests <- request 3126 // Wait for response. 3127 fmt.Printf("answer: %d\n", <-request.resultChan) 3128 </pre> 3129 <p> 3130 On the server side, the handler function is the only thing that changes. 3131 </p> 3132 <pre> 3133 func handle(queue chan *Request) { 3134 for req := range queue { 3135 req.resultChan <- req.f(req.args) 3136 } 3137 } 3138 </pre> 3139 <p> 3140 There's clearly a lot more to do to make it realistic, but this 3141 code is a framework for a rate-limited, parallel, non-blocking RPC 3142 system, and there's not a mutex in sight. 3143 </p> 3144 3145 <h3 id="parallel">Parallelization</h3> 3146 <p> 3147 Another application of these ideas is to parallelize a calculation 3148 across multiple CPU cores. If the calculation can be broken into 3149 separate pieces that can execute independently, it can be parallelized, 3150 with a channel to signal when each piece completes. 3151 </p> 3152 <p> 3153 Let's say we have an expensive operation to perform on a vector of items, 3154 and that the value of the operation on each item is independent, 3155 as in this idealized example. 3156 </p> 3157 <pre> 3158 type Vector []float64 3159 3160 // Apply the operation to v[i], v[i+1] ... up to v[n-1]. 3161 func (v Vector) DoSome(i, n int, u Vector, c chan int) { 3162 for ; i < n; i++ { 3163 v[i] += u.Op(v[i]) 3164 } 3165 c <- 1 // signal that this piece is done 3166 } 3167 </pre> 3168 <p> 3169 We launch the pieces independently in a loop, one per CPU. 3170 They can complete in any order but it doesn't matter; we just 3171 count the completion signals by draining the channel after 3172 launching all the goroutines. 3173 </p> 3174 <pre> 3175 const numCPU = 4 // number of CPU cores 3176 3177 func (v Vector) DoAll(u Vector) { 3178 c := make(chan int, numCPU) // Buffering optional but sensible. 3179 for i := 0; i < numCPU; i++ { 3180 go v.DoSome(i*len(v)/numCPU, (i+1)*len(v)/numCPU, u, c) 3181 } 3182 // Drain the channel. 3183 for i := 0; i < numCPU; i++ { 3184 <-c // wait for one task to complete 3185 } 3186 // All done. 3187 } 3188 </pre> 3189 <p> 3190 Rather than create a constant value for numCPU, we can ask the runtime what 3191 value is appropriate. 3192 The function <code><a href="/pkg/runtime#NumCPU">runtime.NumCPU</a></code> 3193 returns the number of hardware CPU cores in the machine, so we could write 3194 </p> 3195 <pre> 3196 var numCPU = runtime.NumCPU() 3197 </pre> 3198 <p> 3199 There is also a function 3200 <code><a href="/pkg/runtime#GOMAXPROCS">runtime.GOMAXPROCS</a></code>, 3201 which reports (or sets) 3202 the user-specified number of cores that a Go program can have running 3203 simultaneously. 3204 It defaults to the value of <code>runtime.NumCPU</code> but can be 3205 overridden by setting the similarly named shell environment variable 3206 or by calling the function with a positive number. Calling it with 3207 zero just queries the value. 3208 Therefore if we want to honor the user's resource request, we should write 3209 </p> 3210 <pre> 3211 var numCPU = runtime.GOMAXPROCS(0) 3212 </pre> 3213 <p> 3214 Be sure not to confuse the ideas of concurrencystructuring a program 3215 as independently executing componentsand parallelismexecuting 3216 calculations in parallel for efficiency on multiple CPUs. 3217 Although the concurrency features of Go can make some problems easy 3218 to structure as parallel computations, Go is a concurrent language, 3219 not a parallel one, and not all parallelization problems fit Go's model. 3220 For a discussion of the distinction, see the talk cited in 3221 <a href="//blog.golang.org/2013/01/concurrency-is-not-parallelism.html">this 3222 blog post</a>. 3223 3224 <h3 id="leaky_buffer">A leaky buffer</h3> 3225 3226 <p> 3227 The tools of concurrent programming can even make non-concurrent 3228 ideas easier to express. Here's an example abstracted from an RPC 3229 package. The client goroutine loops receiving data from some source, 3230 perhaps a network. To avoid allocating and freeing buffers, it keeps 3231 a free list, and uses a buffered channel to represent it. If the 3232 channel is empty, a new buffer gets allocated. 3233 Once the message buffer is ready, it's sent to the server on 3234 <code>serverChan</code>. 3235 </p> 3236 <pre> 3237 var freeList = make(chan *Buffer, 100) 3238 var serverChan = make(chan *Buffer) 3239 3240 func client() { 3241 for { 3242 var b *Buffer 3243 // Grab a buffer if available; allocate if not. 3244 select { 3245 case b = <-freeList: 3246 // Got one; nothing more to do. 3247 default: 3248 // None free, so allocate a new one. 3249 b = new(Buffer) 3250 } 3251 load(b) // Read next message from the net. 3252 serverChan <- b // Send to server. 3253 } 3254 } 3255 </pre> 3256 <p> 3257 The server loop receives each message from the client, processes it, 3258 and returns the buffer to the free list. 3259 </p> 3260 <pre> 3261 func server() { 3262 for { 3263 b := <-serverChan // Wait for work. 3264 process(b) 3265 // Reuse buffer if there's room. 3266 select { 3267 case freeList <- b: 3268 // Buffer on free list; nothing more to do. 3269 default: 3270 // Free list full, just carry on. 3271 } 3272 } 3273 } 3274 </pre> 3275 <p> 3276 The client attempts to retrieve a buffer from <code>freeList</code>; 3277 if none is available, it allocates a fresh one. 3278 The server's send to <code>freeList</code> puts <code>b</code> back 3279 on the free list unless the list is full, in which case the 3280 buffer is dropped on the floor to be reclaimed by 3281 the garbage collector. 3282 (The <code>default</code> clauses in the <code>select</code> 3283 statements execute when no other case is ready, 3284 meaning that the <code>selects</code> never block.) 3285 This implementation builds a leaky bucket free list 3286 in just a few lines, relying on the buffered channel and 3287 the garbage collector for bookkeeping. 3288 </p> 3289 3290 <h2 id="errors">Errors</h2> 3291 3292 <p> 3293 Library routines must often return some sort of error indication to 3294 the caller. 3295 As mentioned earlier, Go's multivalue return makes it 3296 easy to return a detailed error description alongside the normal 3297 return value. 3298 It is good style to use this feature to provide detailed error information. 3299 For example, as we'll see, <code>os.Open</code> doesn't 3300 just return a <code>nil</code> pointer on failure, it also returns an 3301 error value that describes what went wrong. 3302 </p> 3303 3304 <p> 3305 By convention, errors have type <code>error</code>, 3306 a simple built-in interface. 3307 </p> 3308 <pre> 3309 type error interface { 3310 Error() string 3311 } 3312 </pre> 3313 <p> 3314 A library writer is free to implement this interface with a 3315 richer model under the covers, making it possible not only 3316 to see the error but also to provide some context. 3317 As mentioned, alongside the usual <code>*os.File</code> 3318 return value, <code>os.Open</code> also returns an 3319 error value. 3320 If the file is opened successfully, the error will be <code>nil</code>, 3321 but when there is a problem, it will hold an 3322 <code>os.PathError</code>: 3323 </p> 3324 <pre> 3325 // PathError records an error and the operation and 3326 // file path that caused it. 3327 type PathError struct { 3328 Op string // "open", "unlink", etc. 3329 Path string // The associated file. 3330 Err error // Returned by the system call. 3331 } 3332 3333 func (e *PathError) Error() string { 3334 return e.Op + " " + e.Path + ": " + e.Err.Error() 3335 } 3336 </pre> 3337 <p> 3338 <code>PathError</code>'s <code>Error</code> generates 3339 a string like this: 3340 </p> 3341 <pre> 3342 open /etc/passwx: no such file or directory 3343 </pre> 3344 <p> 3345 Such an error, which includes the problematic file name, the 3346 operation, and the operating system error it triggered, is useful even 3347 if printed far from the call that caused it; 3348 it is much more informative than the plain 3349 "no such file or directory". 3350 </p> 3351 3352 <p> 3353 When feasible, error strings should identify their origin, such as by having 3354 a prefix naming the operation or package that generated the error. For example, in package 3355 <code>image</code>, the string representation for a decoding error due to an 3356 unknown format is "image: unknown format". 3357 </p> 3358 3359 <p> 3360 Callers that care about the precise error details can 3361 use a type switch or a type assertion to look for specific 3362 errors and extract details. For <code>PathErrors</code> 3363 this might include examining the internal <code>Err</code> 3364 field for recoverable failures. 3365 </p> 3366 3367 <pre> 3368 for try := 0; try < 2; try++ { 3369 file, err = os.Create(filename) 3370 if err == nil { 3371 return 3372 } 3373 if e, ok := err.(*os.PathError); ok && e.Err == syscall.ENOSPC { 3374 deleteTempFiles() // Recover some space. 3375 continue 3376 } 3377 return 3378 } 3379 </pre> 3380 3381 <p> 3382 The second <code>if</code> statement here is another <a href="#interface_conversions">type assertion</a>. 3383 If it fails, <code>ok</code> will be false, and <code>e</code> 3384 will be <code>nil</code>. 3385 If it succeeds, <code>ok</code> will be true, which means the 3386 error was of type <code>*os.PathError</code>, and then so is <code>e</code>, 3387 which we can examine for more information about the error. 3388 </p> 3389 3390 <h3 id="panic">Panic</h3> 3391 3392 <p> 3393 The usual way to report an error to a caller is to return an 3394 <code>error</code> as an extra return value. The canonical 3395 <code>Read</code> method is a well-known instance; it returns a byte 3396 count and an <code>error</code>. But what if the error is 3397 unrecoverable? Sometimes the program simply cannot continue. 3398 </p> 3399 3400 <p> 3401 For this purpose, there is a built-in function <code>panic</code> 3402 that in effect creates a run-time error that will stop the program 3403 (but see the next section). The function takes a single argument 3404 of arbitrary type—often a string—to be printed as the 3405 program dies. It's also a way to indicate that something impossible has 3406 happened, such as exiting an infinite loop. 3407 </p> 3408 3409 3410 <pre> 3411 // A toy implementation of cube root using Newton's method. 3412 func CubeRoot(x float64) float64 { 3413 z := x/3 // Arbitrary initial value 3414 for i := 0; i < 1e6; i++ { 3415 prevz := z 3416 z -= (z*z*z-x) / (3*z*z) 3417 if veryClose(z, prevz) { 3418 return z 3419 } 3420 } 3421 // A million iterations has not converged; something is wrong. 3422 panic(fmt.Sprintf("CubeRoot(%g) did not converge", x)) 3423 } 3424 </pre> 3425 3426 <p> 3427 This is only an example but real library functions should 3428 avoid <code>panic</code>. If the problem can be masked or worked 3429 around, it's always better to let things continue to run rather 3430 than taking down the whole program. One possible counterexample 3431 is during initialization: if the library truly cannot set itself up, 3432 it might be reasonable to panic, so to speak. 3433 </p> 3434 3435 <pre> 3436 var user = os.Getenv("USER") 3437 3438 func init() { 3439 if user == "" { 3440 panic("no value for $USER") 3441 } 3442 } 3443 </pre> 3444 3445 <h3 id="recover">Recover</h3> 3446 3447 <p> 3448 When <code>panic</code> is called, including implicitly for run-time 3449 errors such as indexing a slice out of bounds or failing a type 3450 assertion, it immediately stops execution of the current function 3451 and begins unwinding the stack of the goroutine, running any deferred 3452 functions along the way. If that unwinding reaches the top of the 3453 goroutine's stack, the program dies. However, it is possible to 3454 use the built-in function <code>recover</code> to regain control 3455 of the goroutine and resume normal execution. 3456 </p> 3457 3458 <p> 3459 A call to <code>recover</code> stops the unwinding and returns the 3460 argument passed to <code>panic</code>. Because the only code that 3461 runs while unwinding is inside deferred functions, <code>recover</code> 3462 is only useful inside deferred functions. 3463 </p> 3464 3465 <p> 3466 One application of <code>recover</code> is to shut down a failing goroutine 3467 inside a server without killing the other executing goroutines. 3468 </p> 3469 3470 <pre> 3471 func server(workChan <-chan *Work) { 3472 for work := range workChan { 3473 go safelyDo(work) 3474 } 3475 } 3476 3477 func safelyDo(work *Work) { 3478 defer func() { 3479 if err := recover(); err != nil { 3480 log.Println("work failed:", err) 3481 } 3482 }() 3483 do(work) 3484 } 3485 </pre> 3486 3487 <p> 3488 In this example, if <code>do(work)</code> panics, the result will be 3489 logged and the goroutine will exit cleanly without disturbing the 3490 others. There's no need to do anything else in the deferred closure; 3491 calling <code>recover</code> handles the condition completely. 3492 </p> 3493 3494 <p> 3495 Because <code>recover</code> always returns <code>nil</code> unless called directly 3496 from a deferred function, deferred code can call library routines that themselves 3497 use <code>panic</code> and <code>recover</code> without failing. As an example, 3498 the deferred function in <code>safelyDo</code> might call a logging function before 3499 calling <code>recover</code>, and that logging code would run unaffected 3500 by the panicking state. 3501 </p> 3502 3503 <p> 3504 With our recovery pattern in place, the <code>do</code> 3505 function (and anything it calls) can get out of any bad situation 3506 cleanly by calling <code>panic</code>. We can use that idea to 3507 simplify error handling in complex software. Let's look at an 3508 idealized version of a <code>regexp</code> package, which reports 3509 parsing errors by calling <code>panic</code> with a local 3510 error type. Here's the definition of <code>Error</code>, 3511 an <code>error</code> method, and the <code>Compile</code> function. 3512 </p> 3513 3514 <pre> 3515 // Error is the type of a parse error; it satisfies the error interface. 3516 type Error string 3517 func (e Error) Error() string { 3518 return string(e) 3519 } 3520 3521 // error is a method of *Regexp that reports parsing errors by 3522 // panicking with an Error. 3523 func (regexp *Regexp) error(err string) { 3524 panic(Error(err)) 3525 } 3526 3527 // Compile returns a parsed representation of the regular expression. 3528 func Compile(str string) (regexp *Regexp, err error) { 3529 regexp = new(Regexp) 3530 // doParse will panic if there is a parse error. 3531 defer func() { 3532 if e := recover(); e != nil { 3533 regexp = nil // Clear return value. 3534 err = e.(Error) // Will re-panic if not a parse error. 3535 } 3536 }() 3537 return regexp.doParse(str), nil 3538 } 3539 </pre> 3540 3541 <p> 3542 If <code>doParse</code> panics, the recovery block will set the 3543 return value to <code>nil</code>—deferred functions can modify 3544 named return values. It will then check, in the assignment 3545 to <code>err</code>, that the problem was a parse error by asserting 3546 that it has the local type <code>Error</code>. 3547 If it does not, the type assertion will fail, causing a run-time error 3548 that continues the stack unwinding as though nothing had interrupted 3549 it. 3550 This check means that if something unexpected happens, such 3551 as an index out of bounds, the code will fail even though we 3552 are using <code>panic</code> and <code>recover</code> to handle 3553 parse errors. 3554 </p> 3555 3556 <p> 3557 With error handling in place, the <code>error</code> method (because it's a 3558 method bound to a type, it's fine, even natural, for it to have the same name 3559 as the builtin <code>error</code> type) 3560 makes it easy to report parse errors without worrying about unwinding 3561 the parse stack by hand: 3562 </p> 3563 3564 <pre> 3565 if pos == 0 { 3566 re.error("'*' illegal at start of expression") 3567 } 3568 </pre> 3569 3570 <p> 3571 Useful though this pattern is, it should be used only within a package. 3572 <code>Parse</code> turns its internal <code>panic</code> calls into 3573 <code>error</code> values; it does not expose <code>panics</code> 3574 to its client. That is a good rule to follow. 3575 </p> 3576 3577 <p> 3578 By the way, this re-panic idiom changes the panic value if an actual 3579 error occurs. However, both the original and new failures will be 3580 presented in the crash report, so the root cause of the problem will 3581 still be visible. Thus this simple re-panic approach is usually 3582 sufficient—it's a crash after all—but if you want to 3583 display only the original value, you can write a little more code to 3584 filter unexpected problems and re-panic with the original error. 3585 That's left as an exercise for the reader. 3586 </p> 3587 3588 3589 <h2 id="web_server">A web server</h2> 3590 3591 <p> 3592 Let's finish with a complete Go program, a web server. 3593 This one is actually a kind of web re-server. 3594 Google provides a service at 3595 <a href="http://chart.apis.google.com">http://chart.apis.google.com</a> 3596 that does automatic formatting of data into charts and graphs. 3597 It's hard to use interactively, though, 3598 because you need to put the data into the URL as a query. 3599 The program here provides a nicer interface to one form of data: given a short piece of text, 3600 it calls on the chart server to produce a QR code, a matrix of boxes that encode the 3601 text. 3602 That image can be grabbed with your cell phone's camera and interpreted as, 3603 for instance, a URL, saving you typing the URL into the phone's tiny keyboard. 3604 </p> 3605 <p> 3606 Here's the complete program. 3607 An explanation follows. 3608 </p> 3609 {{code "/doc/progs/eff_qr.go" `/package/` `$`}} 3610 <p> 3611 The pieces up to <code>main</code> should be easy to follow. 3612 The one flag sets a default HTTP port for our server. The template 3613 variable <code>templ</code> is where the fun happens. It builds an HTML template 3614 that will be executed by the server to display the page; more about 3615 that in a moment. 3616 </p> 3617 <p> 3618 The <code>main</code> function parses the flags and, using the mechanism 3619 we talked about above, binds the function <code>QR</code> to the root path 3620 for the server. Then <code>http.ListenAndServe</code> is called to start the 3621 server; it blocks while the server runs. 3622 </p> 3623 <p> 3624 <code>QR</code> just receives the request, which contains form data, and 3625 executes the template on the data in the form value named <code>s</code>. 3626 </p> 3627 <p> 3628 The template package <code>html/template</code> is powerful; 3629 this program just touches on its capabilities. 3630 In essence, it rewrites a piece of HTML text on the fly by substituting elements derived 3631 from data items passed to <code>templ.Execute</code>, in this case the 3632 form value. 3633 Within the template text (<code>templateStr</code>), 3634 double-brace-delimited pieces denote template actions. 3635 The piece from <code>{{html "{{if .}}"}}</code> 3636 to <code>{{html "{{end}}"}}</code> executes only if the value of the current data item, called <code>.</code> (dot), 3637 is non-empty. 3638 That is, when the string is empty, this piece of the template is suppressed. 3639 </p> 3640 <p> 3641 The two snippets <code>{{html "{{.}}"}}</code> say to show the data presented to 3642 the templatethe query stringon the web page. 3643 The HTML template package automatically provides appropriate escaping so the 3644 text is safe to display. 3645 </p> 3646 <p> 3647 The rest of the template string is just the HTML to show when the page loads. 3648 If this is too quick an explanation, see the <a href="/pkg/html/template/">documentation</a> 3649 for the template package for a more thorough discussion. 3650 </p> 3651 <p> 3652 And there you have it: a useful web server in a few lines of code plus some 3653 data-driven HTML text. 3654 Go is powerful enough to make a lot happen in a few lines. 3655 </p> 3656 3657 <!-- 3658 TODO 3659 <pre> 3660 verifying implementation 3661 type Color uint32 3662 3663 // Check that Color implements image.Color and image.Image 3664 var _ image.Color = Black 3665 var _ image.Image = Black 3666 </pre> 3667 --> 3668 3669