fastlane pull request testing

Use this when a fastlane lane builds the iOS or Android binary for a pull request and you want a change review of that binary. To run a test plan against the build, use fastlane regression testing.

Set it up

Add the lane

Upload the pull request build, then start a change review pinned to it.

Post the review

Connect GitHub or GitLab so the agent can read the diff and post comments.

Get the results

Poll the conversation the same way as any other API-started review.

Store QATECH_API_TOKEN, QATECH_APP_ID, and, for org-scoped keys, QATECH_PROJECT_ID as described on fastlane regression testing. You do not need a test plan for a change review.

What works with fastlane

Capability	fastlane
Review on a preview URL, before merge	No. fastlane builds native apps; use your web CI guide for preview URLs.
Review a mobile build for that pull request	Yes, if the lane uploads the build and calls the change review API. fastlane does not post the review on its own.
Run a regression test plan	Not from this guide. See fastlane regression testing.
Block the lane until the review finishes	No documented blocking check for a change review. Blocking is documented for test plan runs.

Add the lane

Copy qatech_request and qatech_upload_build from fastlane regression testing into fastlane/Fastfile, then add:

fastlane/Fastfile

# Starts a change review of the pull request, pinned to the uploaded build.
def qatech_change_review(build_short_id:, pr_url:, vcs_provider_id: "github")
  review = qatech_request(:post, "/chat/change-review", {
    mode: "pr",
    prUrl: pr_url,
    vcsProviderId: vcs_provider_id,
    applicationOverrides: [{
      applicationShortId: ENV.fetch("QATECH_APP_ID"),
      environment: { applicationBuildShortId: build_short_id }
    }]
  })
  UI.success("Started QA.tech change review: #{review['url']}")
  review["shortId"]
end

platform :android do
  lane :qatech_review do |options|
    gradle(task: "assemble", build_type: "Debug")
    build_id = qatech_upload_build(
      file: lane_context[SharedValues::GRADLE_APK_OUTPUT_PATH],
      platform: "android"
    )
    qatech_change_review(build_short_id: build_id, pr_url: options.fetch(:pr_url))
  end
end

For iOS, build and zip the simulator .app as in the regression lane, upload it with platform: "ios", then call qatech_change_review. Pass the pull request URL from your CI. On GitHub Actions:

bundle exec fastlane android qatech_review pr_url:"https://github.com/$GITHUB_REPOSITORY/pull/$PR_NUMBER"

Set PR_NUMBER from github.event.pull_request.number. For a GitLab merge request, pass the merge request URL and vcs_provider_id: "gitlab".

Post the review

fastlane does not post the review by itself. Before the lane calls the change review API:

Connect the GitHub App with access to the repository, or connect GitLab MR reviews.
Pass a pr_url the agent can resolve (GitHub PR or GitLab MR).
The agent reads the diff and posts the review through that connection.

Without that connection, the conversation may start but nothing is posted on the request. Turn off GitHub App Auto-run on PRs when the lane owns the review, or a second review runs against the default environment instead of the PR build. Polling and dashboard links are the same as API pull request testing.

PR Testing

Agents

Choose your CI

fastlane pull request testing

Set it up

Add the lane

Post the review

Get the results

What works with fastlane

Add the lane

Post the review

​Set it up

Add the lane

Post the review

Get the results

​What works with fastlane

​Add the lane

​Post the review

Set it up

What works with fastlane

Add the lane

Post the review