Skip to content

Latest commit

 

History

History
158 lines (120 loc) · 5.93 KB

TESTING.md

File metadata and controls

158 lines (120 loc) · 5.93 KB

React-native CLI testing

The react-native CLI tests come in three parts:

  • CLI tests, that don't require any remote connections or special setup
  • Testing an app build, which requires your local machine to be set up for building iOS and Android applications
  • Testing the built app, which requires the built application from the previous test set to run

CLI tests

The CLI tests target the command line interface by providing a set of responses to expected queries, verifying that the CLI tool responds correctly and makes appropriate changes to the workspace.

Setting up
  1. Run through the initial setup in TESTING.md
  2. Run npm pack packages/react-native-cli/ to pack the react-native-cli package
  3. Copy the resulting package, bugsnag-react-native-cli-{VERSION}.tgz into the target fixture, e.g.: 
    cp bugsnag-react-native-cli-*.tgz test/react-native-cli/features/fixtures/rn0_64
Running
  1. Change directory into test/react-native-cli
  2. Check the contents of Gemfile to select the version of maze-runner to use
  3. Install maze-runner with bundle install
  4. Run the full set of cli tests targeting a specific react-native version (rn0_61 for example):
REACT_NATIVE_VERSION=rn0_64 bundle exec maze-runner features/cli-tests

Build tests

The build tests come in two flavours, Android and iOS, and are required to run the subsequent tests using the resulting .apk and .ipa artefacts. These tests ensure that the app can be built after Bugsnag is installed, and subsequent build messages are sent and contain the appropriate information.

Setup
  1. Change directory into test/react-native-cli
  2. Check the contents of Gemfile to select the version of maze-runner to use
  3. Install maze-runner with bundle install
Running the Android variant
  • Run maze-runner targeting the specific Android build feature for a specific react-native version (rn0_61 for example): 
    REACT_NATIVE_VERSION=rn0_61 bundle exec maze-runner features/build-app-tests/build-android-app.feature
Running the iOS variant (MacOS only)
  • Run the script to trigger the build for the specific react-native version (rn0_62 for example): 
    ./scripts/init-and-build-test.sh rn0_62

App tests

These tests ensure that Bugsnag has successfully been installed by the CLI, and errors and sessions are correctly reported.

Setup

Before running these tests the previous tests, Build Tests must be run for the test fixtures to be present.

  1. Change directory into test/react-native-cli
  2. Check the contents of Gemfile to select the version of maze-runner to use
  3. Install maze-runner with bundle install
Running

Ensure that the following environment variables are set:

  • BROWSER_STACK_USERNAME - Your BrowserStack App Automate Username
  • BROWSER_STACK_ACCESS_KEY - Your BrowserStack App Automate Access Key
  • MAZE_BS_LOCAL - Location of the BrowserStack local testing binary

See https://www.browserstack.com/local-testing/app-automate for details of the required local testing binary. In particular, these commands need the BrowserStackLocal binary (available here to reside in your home directory.

  1. To run on an Android device (rn0_63 for example): 
    bundle exec maze-runner --app=./build/rn0_63.apk \
                        --farm=bs \
                        --device=ANDROID_9_0 \
                        --bs-local=~/BrowserStackLocal \
                        features/run-app-tests
  2. Or on iOS: 
    bundle exec maze-runner --app=../../build/rn0_63.ipa \
                        --farm=bs \
                        --device=IOS_13 \
                        --bs-local=~/BrowserStackLocal \
                        features/run-app-tests

Creating a new test fixture

When each new version of React Native is released, a new test fixture project "shell" should be created. The inner workings of the app (that exercise the test scenarios) are then copied in dynamically by the build process. There are several steps to follow to create the project shell:

  1. Add a new service to docker-compose.yml for the new fixture

  2. Create a new React Native project of the desired version. E.g:

    npx react-native init rn0_64 --version 0.64

  3. Remove the following files/folders, if they exist:

    • __tests__
    • .eslintrc.js

  4. Create a .dockerignore file:

    # Ignore lockfiles as they can influence test runs
package-lock.json
yarn.lock

  5. Add the following to .gitignore:

    # Ignore lockfiles as they can influence test runs
package-lock.json
yarn.lock

  6. Copy App.js from an existing fixture (overwriting that created by React Native)

  7. For Android:

    1. In the application tag in app/src/main/AndroidManifest.xml, add:

      android:usesCleartextTraffic="true"

    2. Add CrashyModule.java and CrashyPackage.java from an existing test fixture, updating the package name

    3. In MainApplication.java, add:

      packages.add(new CrashyPackage());

  8. For iOS:

    1. Disable Flipper by removing the following from the Podfile and run pod install to regenerate Podfile.lock. Flipper doesn't benefit the test fixture and removing it significantly speeds up the build.

      use_flipper!()

    2. Copy the following files from an existing fixture:

      • ios/rn0_xx/CrashyCrashy.h
      • ios/rn0_xx/CrashyCrashy.m

    3. Add to rn_0_xx/Info.plist (to the same <dict> as NSExceptionDomains):

    <key>NSAllowsArbitraryLoads</key>
<true/>
    1. Open the workspace and add CrashyCrashy.h and CrashyCrashy.m to the project.
    2. Set the Bugsnag development team on the project.