Quick Start Examples
| What you want | Ask this | What happens |
|---|---|---|
| Create tests for a feature | ”Generate 5 tests for the checkout flow” | Shows suggestions you can review, edit, and add |
| Run tests | ”Run the login test” | Starts in background, notifies when complete |
| Edit a test | ”Add a logout step to the checkout test” | Shows visual diff for approval, then validates |
| Use existing tests as templates | ”Create tests for returns similar to my checkout tests” | Analyzes your checkout tests’ structure and applies the pattern |
| Crawl behind authentication | ”Crawl admin panel from the Login test” | Uses login test’s session - no re-authentication needed |
| Bulk edit multiple tests | ”Add logout step to all checkout tests” | Edits multiple tests at once, shows individual diffs to review |
| Skip repetitive setup | ”Make this test resume from Login” | Inherits browser state, cookies, and session from another test |
Core Workflows
Creating Tests
Ask the assistant to generate tests for specific flows or features. It will suggest test cases that you can review, edit, or accept.“Generate 5 tests for the checkout flow”
“Create a test that validates user registration with email verification”You can also provide the assistant with a set of test cases (as text, a document, or by referencing existing tests) and have it create new tests or update current ones based on those examples.
“Create tests for the returns flow similar to my checkout tests”
“Here are my test cases: [paste list]. Generate tests based on these patterns or update current ones”The assistant analyzes your application’s knowledge graph and any examples you provide to suggest relevant tests. Tests appear as interactive suggestions - click “Add Selected Tests” to commit them to your project.
Running Tests
Ask the assistant to run tests and you’ll be notified when they complete.“Run the login test”
“Execute all checkout tests against the staging environment”What happens: The assistant validates your test cases, starts execution in the background, and you’ll see results when the run completes. Test runs typically take a few minutes depending on complexity.
Accessing Test Run Results
The assistant can access detailed step-by-step results for test runs, but with an important limitation: What the assistant CAN access:- Detailed step-by-step results (screenshots, actions, step descriptions) for test runs it triggered in the current chat conversation
- Action logs showing what happened during test execution
- Visual evidence of test steps and outcomes
- Runs triggered from the UI dashboard
- Runs triggered via API
- Scheduled test plan runs
- Runs from previous chat conversations
- Runs by run ID or test case ID (only runs linked to the current conversation)
Editing Existing Tests
Describe changes to tests in natural language. The assistant shows a visual diff for you to review before applying.“Change step 3 to wait for the spinner first”
“Add verification that the success message appears”
“Make this test resume from my Login test”After you approve changes, the test runs automatically to validate the updates. See Creating Tests for more editing examples.
Analyzing Your Application
Ask the assistant to crawl and analyze your site to expand its knowledge of your application’s features.“Crawl my admin panel”
“Analyze the checkout flow to find features I should test”The assistant can start from a specific URL or resume from a test’s output state (useful for authenticated areas). Results include screenshots and discovered interactions. See Crawling Sessions for configuration details.
Make the Assistant More Effective
The assistant understands context and can handle follow-up questions, so you can have natural back-and-forth conversations about your testing needs. It relies on Crawling, tests, and Knowledge for context gathering.Add Knowledge to improve test creation: The Chat Assistant works best when it understands your application. Add documentation URLs, project context, and domain-specific information to your Knowledge Base so the assistant can provide more accurate test suggestions and better understand your unique workflows.The assistant automatically searches your knowledge base and knowledge graph when generating tests and answering questions, giving you context-aware responses tailored to your specific application.Note: Knowledge and the knowledge graph are used when creating tests through chat, but not during test execution. When tests run, the agent only uses the test’s goal, steps, and Global Context to navigate and verify results.
Uploading Files and Documents
You can upload files directly into chat to give the assistant additional context for test creation. Supported Formats:| Format | How It’s Processed |
|---|---|
| Text and images are both extracted and understood | |
| Images (PNG, JPEG, GIF, WebP) | Analyzed visually by the AI |
| Text files | Content is read and used as context |
- Product specifications with annotated screenshots
- Design documents with wireframes
- Requirements documents with flowcharts
- Bug reports with visual evidence
- Files remain available throughout your chat conversation
- You can reference uploaded content in follow-up messages
- Very long conversations may compress older file content to stay within limits, but recent uploads are always fully available
| Upload to Chat | Add to Project Knowledge |
|---|---|
| Experimental specs | Official documentation |
| PR descriptions | Stable requirements |
| One-time references | Compliance guidelines |
| Work in progress | Permanent product rules |
What Can You Do with the Chat Assistant
Test Management The assistant can list your existing tests, generate new test cases based on your requirements, run tests in the background, and fetch detailed information about specific tests including their steps, configurations, and dependencies. It understands test scenarios (grouping folders) and test plans, making it easy to organize and trigger your test suite. You can also edit existing tests through conversation - describe changes, review a visual diff, and apply with one click. Application Analysis It can crawl and analyze your website to discover features, search through the knowledge graph to find specific functionality from previous crawls, and search your project’s knowledge base. This helps the assistant provide context-aware suggestions tailored to your application. Configuration Management The assistant can show you what configurations are available in your project, help you create new configurations for credentials and test data, and display interactive forms right in the chat to collect configuration details. It supports config types like username/password, username/password with 2FA, file uploads, and API calls. Help & Support The assistant can search QA.tech’s documentation to answer questions about platform features and capabilities, and provide you with contact information for customer support when you need help beyond what the AI can provide. Safe Experimentation Tests generated in chat aren’t committed until you explicitly click “Add Selected Tests” - you can review, edit, or reject them without affecting your project. Files uploaded in chat are isolated to that conversation only, so you can experiment freely without impacting teammates. See How Knowledge Works for details on chat isolation and when to move knowledge to your project.How the Assistant Adapts
The Chat Assistant automatically adjusts its approach based on what you’re trying to accomplish:| When you ask to… | The assistant will… |
|---|---|
| Create or suggest tests | Prioritize revenue-critical flows first (checkout, payments, bookings), then secondary features |
| Run tests | Validate test cases, start execution in background, notify you when complete |
| Analyze your site | Crawl pages, discover features, build understanding of your application |
| Edit existing tests | Show visual diffs for approval, then run tests to validate changes |
What the Assistant Can Access
The assistant has access to your project’s data and can perform actions on your behalf:| Capability | What it can do |
|---|---|
| Tests | List, inspect, create, edit, and run your test cases |
| Site Analysis | Crawl pages, discover features, search what it learned |
| Configurations | View existing configs, create new ones, show forms for credential input |
| Knowledge | Search your project’s knowledge base and QA.tech documentation |
| Project Info | Access applications, environments, device presets, test plans |
| Support | Connect you with customer support when needed |
PR testing is not available through chat. For automatic PR reviews and testing, use the GitHub App or GitHub Actions.