Home | History | Annotate | Download | only in media
      1 HTML5 Media Performance/Functional Test
      2 =======================================
      3 
      4 Description
      5 -----------
      6 This directory contains suites for HTML5 media performance/functional tests.
      7 
      8 media_test_runner.py is the main module and it executes a media test
      9 class (a subclass of MediaTastBase class) with different configuration
     10 (parameters) which are passed in the form of environment variables
     11 (e.g., the number of runs). The location of the subclass is passed as
     12 one of the arguments. 
     13 
     14 An example invocation is 
     15   python media_test_runner.py -p ./media_perf.py
     16 
     17 In this example, media_perf.py will be invoked using the default set
     18 of parameters.  If the test class is not specified in the argument,
     19 whole AVPERF suite is executed, which is defined in
     20 src/chrome/test/functional/PYAUTO_TESTS.
     21 
     22 To Run Tests
     23 ------------
     24 0) Build pyauto (http://www.chromium.org/developers/testing/pyauto)
     25 
     26 1) Add the following in the .gclient and execute "gclient sync". This step is
     27 necessary to pull the test video/audio from deps.
     28 
     29 "custom_deps" : {
     30   "src/chrome/test/data/media/avperf": 
     31     "http://src.chromium.org/svn/trunk/deps/avperf",
     32 },
     33 
     34 2) Execute "python media_test_runner.py" from "src/chrome/test/functional" 
     35 directory. Available options can be obtained by "media_test_runner.py -h"
     36 
     37 3) The results are reported to the standard output. An example output is
     38 
     39 RESULT time: t= [0.01182, 0.00995, 2.02328, 2.02021] sec
     40 RESULT procutil: p= [14.10000, 15.20000, 9.10000, 9.00000] percent
     41 RESULT procuser: l= [0.54000, 0.88000, 0.74000, 1.08000] load
     42 RESULT procsystem: l= [0.06000, 0.11000, 0.09000, 0.13000] load
     43 RESULT memoryrss: m= [34.74637, 35.27885, 34.46374, 35.60243] MB
     44 RESULT memoryvms: m= [1001.08288, 1001.34502, 1001.08288, 1001.34502] MB
     45 RESULT memoryutil: p= [0.87187, 0.88523, 0.86478, 0.89335] percent
     46 
     47 This data is read by the perfbot and used for displaying perf graphs and 
     48 regression monitoring. The perfbot link is
     49 http://build.chromium.org/p/chromium.perf_av/console.
     50