Generation

Load Test

Load Testing

This guide explores Skyramp Core Library capabilities to generate load tests. We will be using CLI to access functionality but the same features can be activated in the Agentic Experience by including a reference in the natural language prompt. Throughout this guide, we will demonstrate key capabilities using Skyramp’s Demo Shop API, a simple e-commerce API for product and order management. Learn more about the Demo Shop API.

Overview

Load testing assesses a system’s performance by simulating real-world traffic and usage patterns. It helps identify bottlenecks, scalability limits, and stability issues by measuring how the software behaves under expected and peak loads. Ensuring a system can handle demand without degradation is key to maintaining reliability and a smooth user experience.

Unlike other types of Skyramp tests, load tests are run asynchronously. This means that all requests are packaged in a scenario, sent to a worker (component responsible for executing the test), and executed without any individual responses being communicated back to the program runtime.

Why would I want to execute a test async?

For load testing scenarios with multiple chained API calls and simulations of high volume traffic, async test execution enables significantly higher test performance and simulate more realistic load on the system through concurrent requests and defining varying degrees of load on the system.

Generate a load test for a single method

This section explains how you can use Skyramp to generate load tests for a single method of a REST endpoint.

To reliably generate single-method test cases, provide at least one of the following inputs:

  • OpenAPI schema (JSON or YAML file)

  • Sample request data (JSON blob or JSON file)

In this guide, we'll use the OpenAPI schema approach. If you want more control over the generated body values, you can also do test generation from sample data (Example 1).

Generate Load Test for a Single Method

To create a load test for a single method, specify the method and URL you want to test against in the command. In this example, we are using https://demoshop.skyramp.dev as the base URL to our service. When testing your service, replace it with the URL to the endpoint you want to test.

You can find the used API specification here.

Python

Java

skyramp generate load rest https://demoshop.skyramp.dev/api/v1/products \
-X POST \
--language python \
--framework pytest \
--api-schema

This command generates a fully executable Python file (products_POST_load_test.py). You can find additional information on the anatomy of Skyramp-generated tests here.

Explanation of Command

  • https://demoshop.skyramp.dev/api/v1/products: Defines the URL to the endpoint we aim to test.

  • -X (or --method): Specifies the API method to test.

  • --language: Specifies the test output language. For load testing, we currently support Python and Java.

  • --framework: Specifies the test execution framework of choice.

  • --api-schema: Points to the OpenAPI schema used to generate the test.

Adjustments

These flags will help you tune the basic load test. Additional flags are explained here.

Load Test Flags:

  • --default-count: Number of times Skyramp executes the defined request [default=None]; this flag needs to be set if load-duration is set to 0.

  • --default-duration: Duration of the load test execution in seconds; this flag cannot be used in combination with default-load-count[default=5]

  • --default-num-threads: Number of concurrent threads for load test [default=1]. Concurrent threads represent virtual users enabling you to test the vertical scalability of the service.

  • --default-rampup-duration: Specify the duration that Skyramp incrementally increases the requests per second (RPS) until the target RPS are reached [default=None]

  • --default-rampup-interval: Specify how often Skyramp increases the RPS until target RPS are reached [default=None]

  • --default-target-rps: Specify the maximum RPS of the load test [default=None]

  • --output: Specify the name of the generated test file.

  • --output-dir: Specify the directory to store the generated test file.

Execute the Load Test

You can execute the generated tests without any additional adjustments to the code. However, based on the application you want to test, you can pass your authentication token to Skyramp Tests via an environment variable.

Set environment variable for authentication (if applicable)

To test against an application that requires authentication, pass your token using our environment variable. By default, Skyramp expects a Bearer Token but we support additional authentication methods (Example 3). If your API does not require any authentication, you can skip this step and just run the test.

Skyramp’s sample application requires a session identifier. Quickly obtain your session_id via the Demo Shop UI and set it as your authentication header. Additional information and ways to obtain the session_id can be found here.

export SKYRAMP_TEST_TOKEN=$your_auth_token

Run the Test

For load testing, we run the test using Python directly, which allows us to display more meaningful test results.

Based on the load configuration, the test will execute as many POST requests as possible against the service within a 5 second duration, collect failure rates and latency metrics, and validate against the expected response status code.
NOTE: Async Test Execution Behavior
  • Unlike other types of Skyramp tests, load testing is asynchronous, and every command in the test scenario is executed without waiting for feedback from the program runtime. This allows for a more realistic simulation of load on the system.
  • If a load duration rather than a count is provided, the Skyramp worker tries to maximize RPS for the specified load test duration while collecting the latency and failure rate of those requests
Review Test Results
The output shows the overall results and performance of the load test. From the below output, we can see for this run the POST request was executed 9 times with 0 failures over the span of the default duration of 5 seconds.
Next Steps
Congratulations, you just generated your first load test using Skyramp! To learn more about how to adjust the the test file, please go to the Test File Anatomy page.
Related topics
Python
Java
skyramp generate load rest https://demoshop.skyramp.dev/api/v1/products \
-X POST \
--language python \
--framework pytest \
--api-schema


This command generates a fully executable Python file (products_POST_load_test.py). You can find additional information on the anatomy of Skyramp-generated tests here.
Explanation of Command
  • https://demoshop.skyramp.dev/api/v1/products: Defines the URL to the endpoint we aim to test.
  • -X (or --method): Specifies the API method to test.
  • --language: Specifies the test output language. For load testing, we currently support Python and Java.
  • --framework: Specifies the test execution framework of choice.
  • --api-schema: Points to the OpenAPI schema used to generate the test.
Adjustments
These flags will help you tune the basic load test. Additional flags are explained here.
Load Test Flags:
  • --default-count: Number of times Skyramp executes the defined request [default=None]; this flag needs to be set if load-duration is set to 0.
  • --default-duration: Duration of the load test execution in seconds; this flag cannot be used in combination with default-load-count[default=5]
  • --default-num-threads: Number of concurrent threads for load test [default=1]. Concurrent threads represent virtual users enabling you to test the vertical scalability of the service.
  • --default-rampup-duration: Specify the duration that Skyramp incrementally increases the requests per second (RPS) until the target RPS are reached [default=None]
  • --default-rampup-interval: Specify how often Skyramp increases the RPS until target RPS are reached [default=None]
  • --default-target-rps: Specify the maximum RPS of the load test [default=None]
  • --output: Specify the name of the generated test file.
  • --output-dir: Specify the directory to store the generated test file.
Execute the Load Test
You can execute the generated tests without any additional adjustments to the code. However, based on the application you want to test, you can pass your authentication token to Skyramp Tests via an environment variable.
Set environment variable for authentication (if applicable)
To test against an application that requires authentication, pass your token using our environment variable. By default, Skyramp expects a Bearer Token but we support additional authentication methods (Example 3). If your API does not require any authentication, you can skip this step and just run the test.
Skyramp’s sample application requires a session identifier. Quickly obtain your session_id via the Demo Shop UI and set it as your authentication header. Additional information and ways to obtain the session_id can be found here.
export SKYRAMP_TEST_TOKEN=$your_auth_token
Run the Test
For load testing, we run the test using Python directly, which allows us to display more meaningful test results.
Based on the load configuration, the test will execute as many POST requests as possible against the service within a 5 second duration, collect failure rates and latency metrics, and validate against the expected response status code.
NOTE: Async Test Execution Behavior
  • Unlike other types of Skyramp tests, load testing is asynchronous, and every command in the test scenario is executed without waiting for feedback from the program runtime. This allows for a more realistic simulation of load on the system.
  • If a load duration rather than a count is provided, the Skyramp worker tries to maximize RPS for the specified load test duration while collecting the latency and failure rate of those requests
Review Test Results
The output shows the overall results and performance of the load test. From the below output, we can see for this run the POST request was executed 9 times with 0 failures over the span of the default duration of 5 seconds.
Next Steps
Congratulations, you just generated your first load test using Skyramp! To learn more about how to adjust the the test file, please go to the Test File Anatomy page.
Related topics
Python
Java
skyramp generate load rest https://demoshop.skyramp.dev/api/v1/products \
-X POST \
--language python \
--framework pytest \
--api-schema


This command generates a fully executable Python file (products_POST_load_test.py). You can find additional information on the anatomy of Skyramp-generated tests here.
Explanation of Command
  • https://demoshop.skyramp.dev/api/v1/products: Defines the URL to the endpoint we aim to test.
  • -X (or --method): Specifies the API method to test.
  • --language: Specifies the test output language. For load testing, we currently support Python and Java.
  • --framework: Specifies the test execution framework of choice.
  • --api-schema: Points to the OpenAPI schema used to generate the test.
Adjustments
These flags will help you tune the basic load test. Additional flags are explained here.
Load Test Flags:
  • --default-count: Number of times Skyramp executes the defined request [default=None]; this flag needs to be set if load-duration is set to 0.
  • --default-duration: Duration of the load test execution in seconds; this flag cannot be used in combination with default-load-count[default=5]
  • --default-num-threads: Number of concurrent threads for load test [default=1]. Concurrent threads represent virtual users enabling you to test the vertical scalability of the service.
  • --default-rampup-duration: Specify the duration that Skyramp incrementally increases the requests per second (RPS) until the target RPS are reached [default=None]
  • --default-rampup-interval: Specify how often Skyramp increases the RPS until target RPS are reached [default=None]
  • --default-target-rps: Specify the maximum RPS of the load test [default=None]
  • --output: Specify the name of the generated test file.
  • --output-dir: Specify the directory to store the generated test file.
Execute the Load Test
You can execute the generated tests without any additional adjustments to the code. However, based on the application you want to test, you can pass your authentication token to Skyramp Tests via an environment variable.
Set environment variable for authentication (if applicable)
To test against an application that requires authentication, pass your token using our environment variable. By default, Skyramp expects a Bearer Token but we support additional authentication methods (Example 3). If your API does not require any authentication, you can skip this step and just run the test.
Skyramp’s sample application requires a session identifier. Quickly obtain your session_id via the Demo Shop UI and set it as your authentication header. Additional information and ways to obtain the session_id can be found here.
export SKYRAMP_TEST_TOKEN=$your_auth_token
Run the Test
For load testing, we run the test using Python directly, which allows us to display more meaningful test results.
Based on the load configuration, the test will execute as many POST requests as possible against the service within a 5 second duration, collect failure rates and latency metrics, and validate against the expected response status code.
NOTE: Async Test Execution Behavior
  • Unlike other types of Skyramp tests, load testing is asynchronous, and every command in the test scenario is executed without waiting for feedback from the program runtime. This allows for a more realistic simulation of load on the system.
  • If a load duration rather than a count is provided, the Skyramp worker tries to maximize RPS for the specified load test duration while collecting the latency and failure rate of those requests
Review Test Results
The output shows the overall results and performance of the load test. From the below output, we can see for this run the POST request was executed 9 times with 0 failures over the span of the default duration of 5 seconds.
Next Steps
Congratulations, you just generated your first load test using Skyramp! To learn more about how to adjust the the test file, please go to the Test File Anatomy page.
Related topics
© 2026 Skyramp, Inc. All rights reserved.
Privacy Policy
Terms of Service
© 2026 Skyramp, Inc. All rights reserved.
Privacy Policy
Terms of Service
© 2026 Skyramp, Inc. All rights reserved.
Privacy Policy
Terms of Service