xref: /external/toolchain-utils/android_bench_suite

This is a Android Toolchain benchmark suite.
===========================================
Where to find this suite:
	This suite locates at google3, please create a google3 branch first,
	then run:
		$cd experimental/users/zhizhouy/benchtoolchain
	Copy this directory to the place you want to put it.

To use this suite:
	1. Configure the basic envrionment in env_setting file.

	2. Run ./apply_patches.py, which will:
		1) Patch all the android benchmarks in the android tree.
		Benchmark Panorama does not exist in android tree, so perftests/
		gets copied into the top-level of android tree.

		2) Apply patch autotest.diff to android_root/external/autotest, which
		includes all the test scripts for benchmarks. Copy testcases to
		related autotest directory.

	   If you have applied the patch partially and hope to discard the
	   patch, just run discard_patches.py

	3. Build and run benchmark on the device using ./run.py. You can either
	use test configuration file (-t test_config), or set all the variables
	manually.

	4. The raw results locate at bench_result_* in bench suite home
	directory.

	5. The JSON format result will be generated for crosperf report.

Utility tools:
	1. Autotest is a test framework located in android exteranl/autotest
		Before first time running it, please run
		utils/build_externals.py first to ensure all the environments
		and tools needed are installed.

	2. Crosperf is a report generating tool in ChromeOS toolchain utilities.
		Please look for it in chromium source:
		src/third_party/toolchain-utils/crosperf.