1 <!DOCTYPE HTML PUBLIC "-//W3C//DTD HTML 4.01 Transitional//EN"> 2 <html><head><title>LLVM Test Results for $DateString</title></head> 3 4 <body bgcolor=white> 5 <center><font size=+3 face=Verdana><b>LLVM Test Results for $DateString</b></font></center> 6 <hr height=1> 7 8 <table width=100%> 9 <tr><td valign=top align=center> 10 11 <table border="0" cellspacing="0" cellpadding="2"><tr><td bgcolor="#000000"> 12 <table border="0" cellpadding="5" cellspacing="0"><tr><td bgcolor="#DDAA77"> 13 <font size=+1><b>Sections:</b></font><br> 14 </td></tr><tr><td bgcolor="#FFCC99" align=center> 15 <a href="#Overview">Overview</a><br> 16 <a href="#Changes">Changes</a><br> 17 <a href="#Dejagnu">Dejagnu Tests</a><br> 18 <a href="#Trends">Trends</a><br> 19 <a href="#Programs">Programs</a><br> 20 </td></tr></table></td></tr></table> 21 22 <p> 23 <table border="0" cellspacing="0" cellpadding="2"><tr><td bgcolor="#000000"> 24 <table border="0" cellpadding="5" cellspacing="0"><tr><td bgcolor="#DDAA77" 25 <font size=+1><b>Previous:</b></font><br> 26 </td></tr><tr><td bgcolor="#FFCC99"> 27 $PrevDaysList 28 </td></tr></table></td></tr></table> 29 <p> 30 31 <font size=+1><b>Back to:</b></font><br> 32 <a href="http://llvm.org/testresults/">Test Results</a><br> 33 <a href="http://llvm.org/">LLVM Page</a><p> 34 35 </td><td valign=top> 36 37 <center> 38 <table border="0" cellspacing="0" cellpadding="2"><tr><td bgcolor="#000000"> 39 <table border="0" cellpadding="10" cellspacing="0"><tr><td bgcolor="#DDAA77" 40 <font size=+2 face=Verdana><b><a name="Overview">Today's Test Results Overview</font></b> 41 </td></tr></table></td></tr></table></center><p> 42 43 <!-- Running LOC graph --> 44 <table align=right> 45 <tr><td> 46 <a href="running_loc_large.png" 47 ><img border=0 width=480 height=360 src="running_loc.png"></a> 48 </td></tr> 49 <tr><td align=center>Lines Of Code over Time<br> 50 <font size=-1><a href="running_loc_large.png">Click for larger view</a></font> 51 </td></tr> 52 </table> 53 54 <h2>Nightly Test Overview:</h2> 55 <ul> 56 <li>Start: <b>$TestStartTime</b></li> 57 <li>Finish: <b>$TestFinishTime</b></li> 58 <li>Platform: <b>$TestPlatform</b></li> 59 </ul> 60 <h2>CVS Tree Overview:</h2> 61 <ul> 62 <li><a href="$DATE-CVS-Log.txt">CVS Checkout Log</a> 63 <ul> 64 <b>$NumDirsInCVS</b> dirs, <b>$NumFilesInCVS</b> files, <b>$LOC</b> 65 lines of code, checked out in <b>$CVSCheckoutTime</b> seconds<br></ul> 66 <li><a href="$DATE-Build-Log.txt">Compilation Log</a> 67 <table> 68 <tr><td><b>Item</b></td><td><b>CPU Time</b></td><td><b>Wall Clock</b></td></tr> 69 <tr><td>Configure CVS Tree</td><td>$ConfigTime</td><td>$ConfigWallTime</td></tr> 70 <tr><td>Build CVS Tree</td><td>$BuildTime</td><td>$BuildWallTime</td></tr> 71 <tr><td>Run Dejagnu Tests</td><td>$DejagnuTime</td><td>$DejagnuWallTime</td></tr> 72 </table></li> 73 <li>Number of object files compiled: <b>$NumObjects</b></li> 74 <li>Number of libraries linked: <b>$NumLibraries</b></li> 75 <li>Number of executables linked:<b> $NumExecutables</b></li> 76 <li>Build Status: $BuildStatus</li> 77 </ul> 78 79 <h2>Warnings during the build:</h2> 80 $WarningsList 81 82 <br><br><center> 83 <table border="0" cellspacing="0" cellpadding="2"><tr><td bgcolor="#000000"> 84 <table border="0" cellpadding="10" cellspacing="0"><tr><td bgcolor="#DDAA77" 85 <font size=+2 face=Verdana><b><a name="Changes">Changes from Yesterday</font></b> 86 </td></tr></table></td></tr></table></center><p> 87 88 <h2>Changes to CVS:</h2> 89 <ul> 90 <li>Users who committed to CVS: <b>$UserCommitList</b> 91 <li>Users who updated from CVS: <b>$UserUpdateList</b> 92 <li>Added Files: $AddedFilesList 93 <li>Modified Files: $ModifiedFilesList 94 <li>Removed Files: $RemovedFilesList 95 </ul><p> 96 97 <h2>Changes to Warnings:</h2> 98 <p>Warnings Added:</p> 99 $WarningsAdded 100 <p>Warnings Removed:</p> 101 $WarningsRemoved 102 103 <h2>Changes in the test suite:</h2> 104 <ul> 105 <li>New Tests: $TestsAdded 106 <li>Removed Tests: $TestsRemoved 107 <li>Newly passing tests: $TestsFixed 108 <li>Newly failing tests: $TestsBroken 109 </ul> 110 </td></tr></tbody></table> 111 112 113 <br/><br/><center> 114 <table border="0" cellspacing="0" cellpadding="2"><tr><td bgcolor="#000000"> 115 <table border="0" cellpadding="10" cellspacing="0"><tr><td bgcolor="#DDAA77" 116 <font size=+2 face=Verdana><b><a name="Dejagnu">Dejagnu Test Results</font></b> 117 </td></tr></table></td></tr></table></center> 118 <br/> 119 $DejagnuTestResults 120 <p>A complete log of testing <a href="$DATE-Dejagnu-testrun.log">Feature and Regression</a> is available for further analysis.</p> 121 122 <br><br><center> 123 <table border="0" cellspacing="0" cellpadding="2"><tr><td bgcolor="#000000"> 124 <table border="0" cellpadding="10" cellspacing="0"><tr><td bgcolor="#DDAA77" 125 <font size=+2 face=Verdana><b><a name="Trends">Changes Over Time</font></b> 126 </td></tr></table></td></tr></table></center><p> 127 128 129 Here are some charts showing how the LLVM optimizer and code generators are 130 changing over time. For now we use the Olden benchmark suite to measure this, 131 but eventually we will switch to using SPEC CPU2000. All programs are run with 132 "LARGE_PROBLEM_SIZE" enabled. Click on any of the charts to get a larger 133 version.<p> 134 135 <h2>Compilation Measurements:</h2> 136 137 <table border="0" align=center> 138 <tr> 139 <td width=50% align=center> 140 <a href="running_Olden_bytecode_large.png"><img width=480 height=360 border=0 src="running_Olden_bytecode.png"></a><br> 141 Size of LLVM bytecode files 142 </td> 143 <td width=50% align=center> 144 <a href="running_Olden_opt_time_large.png"><img width=480 height=360 border=0 src="running_Olden_opt_time.png"></a><br> 145 Time to run the LLVM optimizer on each program 146 </td></tr> 147 </table> 148 149 <h2>Program Execution Measurements:</h2> 150 151 <table border="0" align=center> 152 <tr> 153 <td width=50% align=center> 154 <a href="running_Olden_cbe_time_large.png"><img width=480 height=360 border=0 src="running_Olden_cbe_time.png"></a><br> 155 Execution time for CBE generated executable 156 </td> 157 <td width=50% align=center> 158 <a href="running_Olden_llc_time_large.png"><img width=480 height=360 border=0 src="running_Olden_llc_time.png"></a><br> 159 Execution time for the LLC generated executable 160 </td></tr> 161 162 <tr> 163 <td align=center> 164 <a href="running_Olden_jit_time_large.png"><img width=480 height=360 border=0 src="running_Olden_jit_time.png"></a><br> 165 Execution time for program in the JIT 166 </td> 167 <td></td></tr> 168 </table> 169 170 171 172 173 <br><br><center> 174 <table border="0" cellspacing="0" cellpadding="2"><tr><td bgcolor="#000000"> 175 <table border="0" cellpadding="10" cellspacing="0"><tr><td bgcolor="#DDAA77" 176 <font size=+2 face=Verdana><b><a name="Programs">Program Tests</font></b> 177 </td></tr></table></td></tr></table></center><p> 178 179 This section tests LLVM on a variety of programs in the test suite. This 180 includes benchmark suites like the Olden, McCat, Ptrdist, and SPEC benchmarks as 181 well as a few random programs with test inputs. This section is meant to track 182 how stable LLVM is as a whole. A failure in the execution of any test is marked 183 with an asterisk: `*'. The columns of the tables are:<p> 184 185 <ol> 186 <li><a name="Program">Program</a> - The name of the program for that row.</li> 187 <li><a name="GCCAS">GCCAS</a> - Time to run LLVM optimizers on the program.</li> 188 <li><a name="Bytecode">Bytecode</a> - The size of the bytecode for the 189 program</li> 190 <li><a name="Instrs">Instrs</a> - The number of LLVM instructions in the 191 compiled bytecode</li> 192 <li><a name="LLC<br>compile">LLC compile</a> - The time taken compile with 193 LLC (the static backend)</li> 194 <li><a name="JIT<br>codegen">JIT codegen</a> - The amount of time spent in the 195 JIT itself, instead of executing the program.</li> 196 <li><a name="Machine<br>code">Machine code</a> - The number of bytes of machine 197 code generated by the JIT.</li> 198 <li><a name="GCC">GCC</a> - The time taken to execute the program when compiled 199 with GCC -O2.</li> 200 <li><a name="CBE">CBE</a> - The time taken to execute the program after 201 compilation through the C backend, compiled with -O2.</li> 202 <li><a name="LLC">LLC</a> - How long does the program generated by the static 203 backend LLC take to execute </li> 204 <li><a name="JIT">JIT</a> - The amount of time spent running the 205 program with the JIT; this includes the code generation phase (listed above) 206 and actually running the program.</li> 207 <li><a name="GCC/LLC">GCC/LLC</a> - The speed-up of the LLC output vs the native 208 GCC output: greater than 1 is a speedup, less than 1 is a slowdown.</li> 209 <li><a name="GCC/CBE">GCC/CBE</a> - The speed-up of the CBE output vs the native 210 GCC output: greater than 1 is a speedup, less than 1 is a slowdown.</li> 211 <li><a name="LLC-BETA">LLC-BETA</a> - How long does the program generated by the static 212 backend LLC take to execute the program, when compiled with new experimental 213 features. This is temporary, for tuning.</li> 214 </ol><p> 215 216 A complete log of testing 217 <a href="$DATE-SingleSource-ProgramTest.txt.gz">SingleSource</a>, 218 <a href="$DATE-MultiSource-ProgramTest.txt.gz">MultiSource</a>, and 219 <a href="$DATE-External-ProgramTest.txt.gz">External</a> programs are 220 available for further analysis. 221 222 <h2>Programs/External</h2> 223 224 <center> 225 <table border="0" cellspacing="0" cellpadding="2"><tr><td bgcolor="#000000"> 226 $ExternalProgramsTable 227 </td></tr></table></center> 228 229 <h2>Programs/MultiSource</h2> 230 231 <center> 232 <table border="0" cellspacing="0" cellpadding="2"><tr><td bgcolor="#000000"> 233 $MultiSourceProgramsTable 234 </td></tr></table></center> 235 236 <h2>Programs/SingleSource</h2> 237 238 <center> 239 <table border="0" cellspacing="0" cellpadding="2"><tr><td bgcolor="#000000"> 240 $SingleSourceProgramsTable 241 </td></tr></table></center> 242 243 </td></tr></html> 244 245
