Home | History | Annotate | Download | only in testing
      1 page.title=Activity Testing
      2 parent.title=Testing
      3 parent.link=index.html
      4 @jd:body
      5 
      6 <div id="qv-wrapper">
      7   <div id="qv">
      8   <h2>In this document</h2>
      9   <ol>
     10     <li>
     11       <a href="#ActivityTestAPI">The Activity Testing API</a>
     12       <ol>
     13         <li>
     14             <a href="#ActivityInstrumentationTestCase2">ActivityInstrumentationTestCase2</a>
     15         </li>
     16         <li>
     17             <a href="#ActivityUnitTestCase">ActivityUnitTestCase</a>
     18         </li>
     19         <li>
     20             <a href="#SingleLaunchActivityTestCase">SingleLaunchActivityTestCase</a>
     21         </li>
     22         <li>
     23             <a href="#MockObjectNotes">Mock objects and activity testing</a>
     24         </li>
     25         <li>
     26             <a href="#AssertionNotes">Assertions for activity testing</a>
     27         </li>
     28       </ol>
     29     </li>
     30     <li>
     31         <a href="#WhatToTest">What to Test</a>
     32     </li>
     33     <li>
     34         <a href="#NextSteps">Next Steps</a>
     35     </li>
     36     <li>
     37       <a href="#UITesting">Appendix: UI Testing Notes</a>
     38       <ol>
     39         <li>
     40           <a href="#RunOnUIThread">Testing on the UI thread</a>
     41         </li>
     42         <li>
     43           <a href="#NotouchMode">Turning off touch mode</a>
     44         </li>
     45         <li>
     46           <a href="#UnlockDevice">Unlocking the Emulator or Device</a>
     47         </li>
     48         <li>
     49           <a href="#UITestTroubleshooting">Troubleshooting UI tests</a>
     50         </li>
     51       </ol>
     52     </li>
     53     </ol>
     54 <h2>Key Classes</h2>
     55     <ol>
     56       <li>{@link android.test.InstrumentationTestRunner}</li>
     57       <li>{@link android.test.ActivityInstrumentationTestCase2}</li>
     58       <li>{@link android.test.ActivityUnitTestCase}</li>
     59     </ol>
     60 <h2>Related Tutorials</h2>
     61     <ol>
     62       <li>
     63          <a href="{@docRoot}tools/testing/activity_test.html">Activity Testing Tutorial</a>
     64       </li>
     65     </ol>
     66 <h2>See Also</h2>
     67       <ol>
     68         <li>
     69           <a href="{@docRoot}tools/testing/testing_eclipse.html">
     70           Testing from Eclipse with ADT</a>
     71         </li>
     72         <li>
     73           <a href="{@docRoot}tools/testing/testing_otheride.html">
     74           Testing from Other IDEs</a>
     75         </li>
     76       </ol>
     77   </div>
     78 </div>
     79 <p>
     80     Activity testing is particularly dependent on the Android instrumentation framework.
     81     Unlike other components, activities have a complex lifecycle based on callback methods; these
     82     can't be invoked directly except by instrumentation. Also, the only way to send events to the
     83     user interface from a program is through instrumentation.
     84 </p>
     85 <p>
     86     This document describes how to test activities using instrumentation and other test
     87     facilities. The document assumes you have already read
     88     <a href="{@docRoot}tools/testing/testing_android.html">Testing Fundamentals</a>,
     89     the introduction to the Android testing and instrumentation framework.
     90 </p>
     91 <h2 id="ActivityTestAPI">The Activity Testing API</h2>
     92 <p>
     93     The activity testing API base class is {@link android.test.InstrumentationTestCase},
     94     which provides instrumentation to the test case subclasses you use for Activities.
     95 </p>
     96 <p>
     97     For activity testing, this base class provides these functions:
     98 </p>
     99 <ul>
    100     <li>
    101         Lifecycle control: With instrumentation, you can start the activity under test, pause it,
    102         and destroy it, using methods provided by the test case classes.
    103     </li>
    104     <li>
    105         Dependency injection: Instrumentation allows you to create mock system objects such as
    106         Contexts or Applications and use them to run the activity under test. This
    107         helps you control the test environment and isolate it from production systems. You can
    108         also set up customized Intents and start an activity with them.
    109     </li>
    110     <li>
    111         User interface interaction: You use instrumentation to send keystrokes or touch events
    112         directly to the UI of the activity under test.
    113     </li>
    114 </ul>
    115 <p>
    116     The activity testing classes also provide the JUnit framework by extending
    117     {@link junit.framework.TestCase} and {@link junit.framework.Assert}.
    118 </p>
    119 <p>
    120     The two main testing subclasses are {@link android.test.ActivityInstrumentationTestCase2} and
    121     {@link android.test.ActivityUnitTestCase}. To test an Activity that is launched in a mode
    122     other than <code>standard</code>, you use {@link android.test.SingleLaunchActivityTestCase}.
    123 </p>
    124 <h3 id="ActivityInstrumentationTestCase2">ActivityInstrumentationTestCase2</h3>
    125 <p>
    126     The {@link android.test.ActivityInstrumentationTestCase2} test case class is designed to do
    127     functional testing of one or more Activities in an application, using a normal system
    128     infrastructure. It runs the Activities in a normal instance of the application under test,
    129     using a standard system Context. It allows you to send mock Intents to the activity under
    130     test, so you can use it to test an activity that responds to multiple types of intents, or
    131     an activity that expects a certain type of data in the intent, or both. Notice, though, that it
    132     does not allow mock Contexts or Applications, so you can not isolate the test from the rest of
    133     a production system.
    134 </p>
    135 <h3 id="ActivityUnitTestCase">ActivityUnitTestCase</h3>
    136 <p>
    137     The {@link android.test.ActivityUnitTestCase} test case class tests a single activity in
    138     isolation. Before you start the activity, you can inject a mock Context or Application, or both.
    139     You use it to run activity tests in isolation, and to do unit testing of methods
    140     that do not interact with Android. You can not send mock Intents to the activity under test,
    141     although you can call
    142     {@link android.app.Activity#startActivity(Intent) Activity.startActivity(Intent)} and then
    143     look at arguments that were received.
    144 </p>
    145 <h3 id="SingleLaunchActivityTestCase">SingleLaunchActivityTestCase</h3>
    146 <p>
    147     The {@link android.test.SingleLaunchActivityTestCase} class is a convenience class for
    148     testing a single activity in an environment that doesn't change from test to test.
    149     It invokes {@link junit.framework.TestCase#setUp() setUp()} and
    150     {@link junit.framework.TestCase#tearDown() tearDown()} only once, instead of once per
    151     method call. It does not allow you to inject any mock objects.
    152 </p>
    153 <p>
    154     This test case is useful for testing an activity that runs in a mode other than
    155     <code>standard</code>. It ensures that the test fixture is not reset between tests. You
    156     can then test that the activity handles multiple calls correctly.
    157 </p>
    158 <h3 id="MockObjectNotes">Mock objects and activity testing</h3>
    159 <p>
    160     This section contains notes about the use of the mock objects defined in
    161     {@link android.test.mock} with activity tests.
    162 </p>
    163 <p>
    164     The mock object {@link android.test.mock.MockApplication} is only available for activity
    165     testing if you use the {@link android.test.ActivityUnitTestCase} test case class.
    166     By default, <code>ActivityUnitTestCase</code>, creates a hidden <code>MockApplication</code>
    167     object that is used as the application under test. You can inject your own object using
    168     {@link android.test.ActivityUnitTestCase#setApplication(Application) setApplication()}.
    169 </p>
    170 <h3 id="AssertionNotes">Assertions for activity testing</h3>
    171 <p>
    172     {@link android.test.ViewAsserts} defines assertions for Views. You use it to verify the
    173     alignment and position of View objects, and to look at the state of ViewGroup objects.
    174 </p>
    175 <h2 id="WhatToTest">What To Test</h2>
    176 <ul>
    177     <li>
    178         Input validation: Test that an activity responds correctly to input values in an
    179         EditText View. Set up a keystroke sequence, send it to the activity, and then
    180         use {@link android.view.View#findViewById(int)} to examine the state of the View. You can
    181         verify that a valid keystroke sequence enables an OK button, while an invalid one leaves the
    182         button disabled. You can also verify that the Activity responds to invalid input by
    183         setting error messages in the View.
    184     </li>
    185     <li>
    186         Lifecycle events: Test that each of your application's activities handles lifecycle events
    187         correctly. In general, lifecycle events are actions, either from the system or from the
    188         user, that trigger a callback method such as <code>onCreate()</code> or
    189         <code>onClick()</code>. For example, an activity should respond to pause or destroy events
    190         by saving its state. Remember that even a change in screen orientation causes the current
    191         activity to be destroyed, so you should test that accidental device movements don't
    192         accidentally lose the application state.
    193     </li>
    194     <li>
    195         Intents: Test that each activity correctly handles the intents listed in the intent
    196         filter specified in its manifest. You can use
    197         {@link android.test.ActivityInstrumentationTestCase2} to send mock Intents to the
    198         activity under test.
    199     </li>
    200     <li>
    201         Runtime configuration changes: Test that each activity responds correctly to the
    202         possible changes in the device's configuration while your application is running. These
    203         include a change to the device's orientation, a change to the current language, and so
    204         forth. Handling these changes is described in detail in the topic
    205         <a href="{@docRoot}guide/topics/resources/runtime-changes.html">Handling Runtime
    206         Changes</a>.
    207     </li>
    208     <li>
    209         Screen sizes and resolutions: Before you publish your application, make sure to test it on
    210         all of the screen sizes and densities on which you want it to run. You can test the
    211         application on multiple sizes and densities using AVDs, or you can test your application
    212         directly on the devices that you are targeting. For more information, see the topic
    213         <a href="{@docRoot}guide/practices/screens_support.html">Supporting Multiple Screens</a>.
    214     </li>
    215 </ul>
    216 <h2 id="NextSteps">Next Steps</h2>
    217 <p>
    218     To learn how to set up and run tests in Eclipse, please refer to 
    219 <a href="{@docRoot}tools/testing/testing_eclipse.html">Testing from Eclipse with ADT</a>.
    220     If you're not working in Eclipse, refer to 
    221 <a href="{@docRoot}tools/testing/testing_otheride.html">Testing from Other IDEs</a>.
    222 </p>
    223 <p>
    224     If you want a step-by-step introduction to testing activities, try the 
    225     <a href="{@docRoot}tools/testing/activity_test.html">Activity Testing Tutorial</a>, which
    226     guides you through a testing scenario that you develop against an activity-oriented application.
    227 </p>
    228 <h2 id="UITesting">Appendix: UI Testing Notes</h2>
    229 <p>
    230     The following sections have tips for testing the UI of your Android application, specifically
    231     to help you handle actions that run in the UI thread, touch screen and keyboard events, and home
    232     screen unlock during testing.
    233 </p>
    234 <h3 id="RunOnUIThread">Testing on the UI thread</h3>
    235 <p>
    236     An application's activities run on the application's <strong>UI thread</strong>. Once the
    237     UI is instantiated, for example in the activity's <code>onCreate()</code> method, then all
    238     interactions with the UI must run in the UI thread. When you run the application normally, it
    239     has access to the thread and does not have to do anything special.
    240 </p>
    241 <p>
    242     This changes when you run tests against the application. With instrumentation-based classes,
    243     you can invoke methods against the UI of the application under test. The other test classes
    244     don't allow this. To run an entire test method on the UI thread, you can annotate the thread
    245     with <code>@UIThreadTest</code>. Notice that this will run <em>all</em> of the method statements
    246     on the UI thread.  Methods that do not interact with the UI are not allowed; for example, you
    247     can't invoke <code>Instrumentation.waitForIdleSync()</code>.
    248 </p>
    249 <p>
    250     To run a subset of a test method on the UI thread, create an anonymous class of type
    251     <code>Runnable</code>, put the statements you want in the <code>run()</code> method, and
    252     instantiate a new instance of the class as a parameter to the method
    253     <code><em>appActivity</em>.runOnUiThread()</code>, where <code><em>appActivity</em></code> is
    254     the instance of the application you are testing.
    255 </p>
    256 <p>
    257     For example, this code instantiates an activity to test, requests focus (a UI action) for the
    258     Spinner displayed by the activity, and then sends a key to it. Notice that the calls to
    259     <code>waitForIdleSync</code> and <code>sendKeys</code> aren't allowed to run on the UI thread:
    260 </p>
    261 <pre>
    262   private MyActivity mActivity; // MyActivity is the class name of the app under test
    263   private Spinner mSpinner;
    264 
    265   ...
    266 
    267   protected void setUp() throws Exception {
    268       super.setUp();
    269       mInstrumentation = getInstrumentation();
    270 
    271       mActivity = getActivity(); // get a references to the app under test
    272 
    273       /*
    274        * Get a reference to the main widget of the app under test, a Spinner
    275        */
    276       mSpinner = (Spinner) mActivity.findViewById(com.android.demo.myactivity.R.id.Spinner01);
    277 
    278   ...
    279 
    280   public void aTest() {
    281       /*
    282        * request focus for the Spinner, so that the test can send key events to it
    283        * This request must be run on the UI thread. To do this, use the runOnUiThread method
    284        * and pass it a Runnable that contains a call to requestFocus on the Spinner.
    285        */
    286       mActivity.runOnUiThread(new Runnable() {
    287           public void run() {
    288               mSpinner.requestFocus();
    289           }
    290       });
    291 
    292       mInstrumentation.waitForIdleSync();
    293 
    294       this.sendKeys(KeyEvent.KEYCODE_DPAD_CENTER);
    295 </pre>
    296 
    297 <h3 id="NotouchMode">Turning off touch mode</h3>
    298 <p>
    299     To control the emulator or a device with key events you send from your tests, you must turn off
    300     touch mode. If you do not do this, the key events are ignored.
    301 </p>
    302 <p>
    303     To turn off touch mode, you invoke
    304     <code>ActivityInstrumentationTestCase2.setActivityTouchMode(false)</code>
    305     <em>before</em> you call <code>getActivity()</code> to start the activity. You must invoke the
    306     method in a test method that is <em>not</em> running on the UI thread. For this reason, you
    307     can't invoke the touch mode method from a test method that is annotated with
    308     <code>@UIThread</code>. Instead, invoke the touch mode method from <code>setUp()</code>.
    309 </p>
    310 <h3 id="UnlockDevice">Unlocking the emulator or device</h3>
    311 <p>
    312     You may find that UI tests don't work if the emulator's or device's home screen is disabled with
    313     the keyguard pattern. This is because the application under test can't receive key events sent
    314     by <code>sendKeys()</code>. The best way to avoid this is to start your emulator or device
    315     first and then disable the keyguard for the home screen.
    316 </p>
    317 <p>
    318     You can also explicitly disable the keyguard. To do this,
    319     you need to add a permission in the manifest file (<code>AndroidManifest.xml</code>) and
    320     then disable the keyguard in your application under test. Note, though, that you either have to
    321     remove this before you publish your application, or you have to disable it with code in
    322     the published application.
    323 </p>
    324 <p>
    325     To add the permission, add the element
    326     <code>&lt;uses-permission android:name="android.permission.DISABLE_KEYGUARD"/&gt;</code>
    327     as a child of the <code>&lt;manifest&gt;</code> element. To disable the KeyGuard, add the
    328     following code to the <code>onCreate()</code> method of activities you intend to test:
    329 </p>
    330 <pre>
    331   mKeyGuardManager = (KeyguardManager) getSystemService(KEYGUARD_SERVICE);
    332   mLock = mKeyGuardManager.newKeyguardLock("<em>activity_classname</em>");
    333   mLock.disableKeyguard();
    334 </pre>
    335 <p>where <code><em>activity_classname</em></code> is the class name of the activity.</p>
    336 <h3 id="UITestTroubleshooting">Troubleshooting UI tests</h3>
    337 <p>
    338     This section lists some of the common test failures you may encounter in UI testing, and their
    339     causes:
    340 </p>
    341 <dl>
    342     <dt><code>WrongThreadException</code></dt>
    343     <dd>
    344       <p><strong>Problem:</strong></p>
    345       For a failed test, the Failure Trace contains the following error message:
    346       <code>
    347         android.view.ViewRoot$CalledFromWrongThreadException: Only the original thread that created
    348         a view hierarchy can touch its views.
    349       </code>
    350       <p><strong>Probable Cause:</strong></p>
    351         This error is common if you tried to send UI events to the UI thread from outside the UI
    352         thread. This commonly happens if you send UI events from the test application, but you don't
    353         use the <code>@UIThread</code> annotation or the <code>runOnUiThread()</code> method. The
    354         test method tried to interact with the UI outside the UI thread.
    355       <p><strong>Suggested Resolution:</strong></p>
    356         Run the interaction on the UI thread. Use a test class that provides instrumentation. See
    357         the previous section <a href="#RunOnUIThread">Testing on the UI Thread</a>
    358         for more details.
    359     </dd>
    360     <dt><code>java.lang.RuntimeException</code></dt>
    361     <dd>
    362       <p><strong>Problem:</strong></p>
    363         For a failed test, the Failure Trace contains the following error message:
    364       <code>
    365         java.lang.RuntimeException: This method can not be called from the main application thread
    366       </code>
    367       <p><strong>Probable Cause:</strong></p>
    368         This error is common if your test method is annotated with <code>@UiThreadTest</code> but
    369         then tries to do something outside the UI thread or tries to invoke
    370         <code>runOnUiThread()</code>.
    371       <p><strong>Suggested Resolution:</strong></p>
    372         Remove the <code>@UiThreadTest</code> annotation, remove the <code>runOnUiThread()</code>
    373         call, or re-factor your tests.
    374     </dd>
    375 </dl>
    376