Because of this particular point, these types of tools are mostly agnostic because some of them provide very platform-specific features like the JSR223<\/a> (a scripting language for Java apps) assertions that JMeter supplies<\/a>, for example.<\/p>\n In this article, you\u2019re going to dive into the universe of Apache JMeter<\/a>, one of the most used agnostic load test tools in the software development community by testing it against a REST application created in ASP.NET.<\/p>\n JMeter is made with Java 8+, so it requires the JDK (Java Developers Kit<\/em>) on your machine before using it. Be sure to download<\/a> and install it. The installation for JMeter is a little bit different from the usual installer approach. Instead, you must go to the JMeter Download page<\/a> and download the binary zipped file.<\/p>\n Unzip it and navigate to the bin<\/em> folder in which you will find a file called jmeter.bat<\/em>. Double-click it and the window shown in Figure 1 will show up.<\/p>\n Figure 1.<\/strong> Starting up Apache JMeter tool<\/strong><\/p>\n The GUI tool is going to load in the background until it pops up as shown in Figure 2.<\/p>\n Figure 2.<\/strong> Apache JMeter initial screen<\/strong><\/p>\n Take some time to look at the options and menus displayed on this screen.<\/p>\n For simplicity, this example will not create an API application from scratch since it\u2019s not the focus of the article. You can test whatever web application or live API on the web that you have handy. However, to get the feeling of local tests, use a CRUD API I\u2019ve developed before in another article: Creating ASP.NET Apps with React<\/a>.<\/p>\n You may find the source code here<\/a>. Please, clone it to your machine, cd<\/em> into the \\ReactASPNET\\ReactASPCrud\\ReactASPCrud\\<\/em> folder, and run the following command:<\/p>\n This command will start up the application at http:\/\/localhost:5000<\/a>. Leave it there and get back to the tests.<\/p>\n In JMeter, everything starts from a Test Plan<\/em>. That\u2019s the very definition of how JMeter groups things together as a composition of runnable tests. You can have as many test plans as you want for a single project.<\/p>\n JMeter loves groupings. Typically, since you\u2019re dealing with stress testing, you have to deal with loops. Loops are used to check if the given resource can handle all the concurrent load that you\u2019d eventually have in a real-world scenario. That\u2019s why you always start by adding a new Thread Group<\/em> to your Test Plan. Figure 3 demonstrates the menus you may access to add a Thread Group<\/em>.<\/p>\n Figure 3.<\/strong> Adding a new Thread Group to your Test Plan<\/strong><\/p>\n You may see a bunch of fields under the Thread Properties<\/em> section. Among all these fields, there are three of them that are more important:<\/p>\n Figure 4.<\/strong> Configuring the Thread Properties of your Thread Group<\/strong><\/p>\n Great! Now that you have your Thread Group set up, you need to determine what this group will iterate over. You can iterate over many different types of requests, such as JDBC, JMS, FTP, etc. However, since you\u2019re dealing with a REST API, the HTTP requests are the next elements to configure.<\/p>\n But first, take a shortcut through a very nice config called HTTP Request Defaults<\/em>. Figure 5 shows how to access this option.<\/p>\n Figure 5.<\/strong> Adding a new HTTP Request Defaults<\/strong><\/p>\n This option helps you globally configure HTTP properties that are most commonly used such as the URL root address of your API, HTTP Authentication settings, IP, port, etc. This is a great option when you have to test many API endpoints within the same Thread Group without having to explicitly duplicate the information.<\/p>\n Go ahead and fill in the options as shown in Figure 6.<\/p>\n Figure 6.<\/strong> Setting up HTTP Request Defaults options<\/strong><\/p>\n You may also notice that these configs are being stacked on top of each other on the left panel of the JMeter GUI tool. It stacks things in a nested way in order to keep the hierarchy of your settings, so pay attention to that.<\/p>\n Now that you have a default configuration for your HTTP requests, move on to add the first API endpoint to test. Start with the most simple one: the users\u2019 listing at https:\/\/localhost:5000\/api\/users<\/a>.<\/p>\n Figure 7 shows how to add a new HTTP Request Sampler<\/em> element.<\/p>\n Figure 7.<\/strong> Adding a new HTTP Request to the Thread Group<\/strong><\/p>\n Figure 8 demonstrates how you may fill in the fields. Remember that the Server Name\/IP<\/em> and Port Number<\/em> were already provided within the previous Defaults setting, so there\u2019s no need to set it again.<\/p>\n Figure 8.<\/strong> Setting the HTTP Request endpoint details<\/strong><\/p>\n This is basically everything you need as a minimum setup for an HTTP request suite. However, in order for you to check the results of the stress test, you need to ask JMeter to measure the right metrics. JMeter can deal with a bunch of different and useful result listeners. Take a look at the two most used ones.<\/p>\n Figure 9 and 10 shows how to add a new Summary Report<\/em> and a new Graph Results<\/em> listeners, respectively. Go ahead and do that to your Test Plan as well.<\/p>\n Figure 9.<\/strong> Adding a new Summary Report to the Test Plan<\/strong><\/p>\n Figure 10.<\/strong> Adding a new Graph Results to the Test Plan<\/strong><\/p>\n There\u2019s no better way to see what these two listeners can rather than run the Test Plan. Before that, make sure to save your current test settings by hitting Ctrl+S on the keyboard. It\u2019ll trigger a new window (Figure 11) for you to select the directory to save the tests as a file with a .jmx extension.<\/p>\n Figure 11.<\/strong> Saving the current test suite<\/strong><\/p>\n You can then add this file to your project repository, and other members of your team can load it on their own JMeter tools as well.<\/p>\n Now, click the Start<\/em> button on the top bar or hit the Ctrl+R keyboard shortcut to execute the Test Plan. As the logs start to show up on the terminal window where you started the local API application, you\u2019ll get to see the summary of the execution when you click the Summary Report<\/em> item on the left panel. That\u2019ll display the screen shown in Figure 12.<\/p>\n Figure 12.<\/strong> Displaying the Summary Report whilst running the tests<\/strong><\/p>\n That is useful information since you can see not only the number of samples running at the time but also the average of users, the maximum number of samples at any time during the execution, the error rate, and more.<\/p>\n If you open the Graph Results<\/em> item, that may show similar results as in Figure 13.<\/p>\n Figure 13.<\/strong> Animated results from the Graph Results whilst running the tests<\/strong><\/p>\n This graph not only brings important information about the number of executed samples, but also graphically displays the throughput<\/em> vs the deviation<\/em> of the tests. The higher the throughput, the more the application can deal with heavy loads of requests. The opposite is true for the deviation. In this example, the average was around 650 requests\/minute.<\/p>\n There are a couple more nice listeners to consider when developing your JMeter tests. Take some time to explore them as well. The first one is the View Results Tree<\/em>. You can add it the same way you added the previous ones, via Add > Listener > View Results Tree<\/em>.<\/p>\n Before you rerun the tests, make sure to clean up the previous execution. You can do that by clicking the “gear and two brooms” icon on the top bar. Then, rerun the tests. You may see a similar result to the one shown in Figure 14.<\/p>\n Figure 14.<\/strong> Displaying the View Results Tree results<\/strong><\/p>\n Here, JMeter is going very granular by displaying each one of the request\u2019s information as well as HTTP headers, body size, response code and message, and many more. This is great when you need to search for a very explicit error in specific scenarios.<\/p>\n Another significant measure can be displayed by the Response Time Graph<\/em> as shown in Figure 15. It works by plotting a graph with two axes: the time vs the number of requests. This graph shows the request\/response throughput through the time execution.<\/p>\n Figure 15.<\/strong> Displaying the Response Time Graph results<\/strong><\/p>\n Again, you can add this type of listener via the same steps as before.<\/p>\n During the tests, it is common to have scenarios where you\u2019d like to check for a specific HTTP response status or even if the response body attends to a specific condition. For situations like that, JMeter provides you with the Assertions<\/em>. Start with the HTTP response status assertion configuration.<\/p>\n Figure 16 shows how to add a new one to your Thread Group<\/em>.<\/p>\n Figure 16.<\/strong> Adding a new Response Assertion checker<\/strong><\/p>\n Make sure to check the Response Code<\/em> option in the Field to Test<\/em> config. The Pattern Matching Results<\/em> must be set as Equals<\/em> as shown in Figure 17.<\/p>\n To add a new pattern click the Add<\/em> button on the bottom side of the screen and add the 200 as the value for the Patterns to Test<\/em> option.<\/p>\n Figure 17.<\/strong> Setting up the Response Assertion<\/strong><\/p>\n That\u2019s it! Whenever you receive an HTTP status code other than 200 the View Results Tree<\/em> listener will show the error.<\/p>\n Another interesting assertion available for APIs that make extensive use of JSON is the JSON Assertion<\/em>. To add it, go to the same menu Add > Assertion > JSON Assertion<\/em> and configure it as shown in Figure 18.<\/p>\n Figure 18.<\/strong> Setting up the JSON Assertion<\/strong><\/p>\n The Assert JSON Path exists<\/em> field receives an expression to catch a specific value from the JSON response.<\/p>\n Listing 1 shows an example of the users\u2019 list currently returned by the API. Since the data is always randomly generated at start-up, your test would fail. Make use of this to test the failing assertion. The JSON Assertion states that JMeter must check if the name<\/em> property of the first list item is equal to \u201cSusan MacDonald\u201d. Don\u2019t forget to check the Additionally assert value<\/em> checkbox.<\/p>\n Listing 1.<\/strong> JSON response from the users API<\/strong><\/p>\n Figure 19 shows the View Results Tree execution results.<\/p>\n Figure 19.<\/strong> Displaying the wrong JSON assertion results<\/strong><\/p>\n As you can see, the assertion failed because the expected value doesn\u2019t match the received one, which is \u201cMary Gay\u201d.<\/p>\n If you update the JSON Assertion<\/em> accordingly, then your tests will pass.<\/p>\n As you\u2019ve seen, JMeter is a powerful tool that comes with many built-in functionalities for various scenarios. Apart from that, JMeter\u2019s community provides you with an enormous amount of open-source plugins<\/a> that you can add to give even more flexibility and power to your load tests. One of them that is very useful is the JSONFormatter<\/a> that helps with beautifying your HTTP JSON responses.<\/p>\nJMeter setup<\/h2>\n
![](\"https:\/\/www.red-gate.com\/simple-talk\/wp-content\/uploads\/2021\/03\/word-image-84.png\")
<\/p>\n![](\"https:\/\/www.red-gate.com\/simple-talk\/wp-content\/uploads\/2021\/03\/word-image-85.png\")
<\/p>\nThe .NET application<\/h2>\n
dotnet run<\/pre>\n
<\/a>JMeter test plans<\/h2>\n
![](\"https:\/\/www.red-gate.com\/simple-talk\/wp-content\/uploads\/2021\/03\/word-image-86.png\")
<\/p>\n\n
![](\"https:\/\/www.red-gate.com\/simple-talk\/wp-content\/uploads\/2021\/03\/word-image-87.png\")
<\/p>\n![](\"https:\/\/www.red-gate.com\/simple-talk\/wp-content\/uploads\/2021\/03\/word-image-88.png\")
<\/p>\n![](\"https:\/\/www.red-gate.com\/simple-talk\/wp-content\/uploads\/2021\/03\/word-image-89.png\")
<\/p>\n![](\"https:\/\/www.red-gate.com\/simple-talk\/wp-content\/uploads\/2021\/03\/word-image-90.png\")
<\/p>\n![](\"https:\/\/www.red-gate.com\/simple-talk\/wp-content\/uploads\/2021\/03\/word-image-91.png\")
<\/p>\n![](\"https:\/\/www.red-gate.com\/simple-talk\/wp-content\/uploads\/2021\/03\/word-image-92.png\")
<\/p>\n![](\"https:\/\/www.red-gate.com\/simple-talk\/wp-content\/uploads\/2021\/03\/word-image-93.png\")
<\/p>\n![](\"https:\/\/www.red-gate.com\/simple-talk\/wp-content\/uploads\/2021\/03\/word-image-94.png\")
<\/p>\n![](\"https:\/\/www.red-gate.com\/simple-talk\/wp-content\/uploads\/2021\/03\/word-image-95.png\")
<\/p>\n![](\"https:\/\/www.red-gate.com\/simple-talk\/wp-content\/uploads\/2021\/03\/word-image.gif\")
<\/p>\nExtra listeners<\/h2>\n
![](\"https:\/\/www.red-gate.com\/simple-talk\/wp-content\/uploads\/2021\/03\/word-image-96.png\")
<\/p>\n![](\"https:\/\/www.red-gate.com\/simple-talk\/wp-content\/uploads\/2021\/03\/word-image-97.png\")
<\/p>\nResponse assertions<\/h2>\n
![](\"https:\/\/www.red-gate.com\/simple-talk\/wp-content\/uploads\/2021\/03\/word-image-98.png\")
<\/p>\n![](\"https:\/\/www.red-gate.com\/simple-talk\/wp-content\/uploads\/2021\/03\/word-image-99.png\")
<\/p>\n![](\"https:\/\/www.red-gate.com\/simple-talk\/wp-content\/uploads\/2021\/03\/word-image-100.png\")
<\/p>\n[\r\n {\r\n \"id\":1,\r\n \"name\":\"Mary Gay\",\r\n \"email\":\"mary@yahoo.com\",\r\n \"document\":\"0562264851\",\r\n \"phone\":\"+1 888-452-1232\"\r\n },\r\n {\r\n \"id\":2,\r\n \"name\":\"Neil Strip\",\r\n \"email\":\"neil@outlook.com\",\r\n \"document\":\"-654353851\",\r\n \"phone\":\"+1 888-452-1232\"\r\n },\r\n {\r\n \"id\":3,\r\n \"name\":\"Jonathan O'Neil\",\r\n \"email\":\"jonathan@outlook.com\",\r\n \"document\":\"0424625040\",\r\n \"phone\":\"+1 888-452-1232\"\r\n },\r\n {\r\n \"id\":4,\r\n \"name\":\"Joe Spenser\",\r\n \"email\":\"joe@outlook.com\",\r\n \"document\":\"1415116364\",\r\n \"phone\":\"+1 888-452-1232\"\r\n },\r\n {\r\n \"id\":5,\r\n \"name\":\"Jonathan O'Neil\",\r\n \"email\":\"jonathan@hotmail.com\",\r\n \"document\":\"-367589335\",\r\n \"phone\":\"+1 888-452-1232\"\r\n }\r\n]<\/pre>\n![](\"https:\/\/www.red-gate.com\/simple-talk\/wp-content\/uploads\/2021\/03\/word-image-101.png\")
<\/p>\nLoad\/stress testing .NET apps with JMeter<\/h2>\n