Performance Report
| Test Number | Number of concurrent users | Number of Household in each request | Number of household pods | Number of individuals in each request | Number of individual pods | Number of Household members in each request | Number of Project beneficiary in each request | Number of Project task in each request | Number of pods for Project | Delay between each set of request | Number of ID Gen pods | Status | Result |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
01 | 10 | 30 | 1 | 30 | 1 | 30 | 30 | 30 | 1 | 2s | 1 | FAIL | Individuals were not found while creation of household members /Users/guruprasadsreenivasarao/Documents/eGov/Perf/SS/TC01_HouseholdService.png /Users/guruprasadsreenivasarao/Documents/eGov/Perf/SS/TC01_IndividualService.png |
03 | 10 | 30 | 1 | 30 | 2 | 30 | 30 | 30 | 1 | 2s | 1 | PASS | No errors in logs |
03.01 | 10 | 30 | 1 | 30 | 2 | 30 | 30 | 30 | 1 | 2s | 1 | FAIL | Observed that the idgen was taking a long time - 1s to give a response. We see that search of individuals happens while individuals are getting created and giving errrors. /Users/guruprasadsreenivasarao/Documents/eGov/Perf/SS/TC03.01_HouseholdService.png /Users/guruprasadsreenivasarao/Documents/eGov/Perf/SS/TC03.01_IndividualService.png |
03.02 | 10 | 30 | 1 | 30 | 2 | 30 | 30 | 30 | 1 | 2s | 2 | FAIL | IDgen is taking between 1-5 seconds. The failures occured at the time when data was still being created by individual service and household member searched for the same |
3.03 | 10 | 30 | 1 | 30 | 2 | 30 | 30 | 30 | 1 | 2s | 2 | FAIL | IDgen is taking between 1-2 seconds. The failures occured at the time when data was still being created by individual service and household member searched for the same |
04 | 10 | 30 | 1 | 30 | 1 | 30 | 30 | 30 | 1 | 4s | 1 | PASS | We did not observe any errors. |
04.01 | 10 | 30 | 1 | 30 | 1 | 30 | 30 | 30 | 1 | 4s | 1 | PASS | We did not observe any errors. |
4.02 | 10 | 30 | 1 | 30 | 1 | 30 | 30 | 30 | 1 | 4s | 1 | PASS | We did not observe any errors. |
04.03 | 10 | 30 | 1 | 30 | 1 | 30 | 30 | 30 | 1 | 1s delay between each of the threads 2s delay between individual and household member | 1 | FAIL | |
04.04 | 10 | 30 | 1 | 30 | 1 | 30 | 30 | 30 | 1 | 1s delay between each of the threads 4s delay between individual and household member | 1 | PASS | |
04.05 | 10 | 30 | 1 | 30 | 1 | 30 | 30 | 30 | 1 | 500ms delay between each of the threads 4s delay between individual and household member | 1 | FAIL | Project beneficiary was missing for project task creation. Project task was getting failed for few. |
04.06 | 10 | 30 | 1 | 30 | 1 | 30 | 30 | 30 | 1 | 500ms delay between each of the threads 4s delay between individual and household member 1s delay between project beneficiary and project tasks | 1 | PASS | |
04.07 | 10 | 30 | 1 | 30 | 1 | 30 | 30 | 30 | 1 | 500ms delay between each of the threads 4s delay between individual and household member 1s delay between project beneficiary and project tasks | 1 | PASS | |
J-04.08 | 10 | 30 | 1 | 30 | 1 | 30 | 30 | 30 | 1 | 500ms delay between each of the threads 4s delay between individual and household member 1s delay between project beneficiary and project tasks | 1 | PASS | |
05 | 20 | 30 | 1 | 30 | 1 | 30 | 30 | 30 | 1 | 500ms delay between each of the threads 4s delay between individual and household member 1s delay between project beneficiary and project tasks | 1 | ||
C06.01 | 10 | 30 | 1 | 30 | 3 | 30 | 30 | 30 | 1 | 500ms delay between each of the threads 2.5s delay between individual and household member 1.5s delay between project beneficiary and project tasks | 1 | PASS | |
C06.02 | 10 | 30 | 1 | 30 | 3 | 30 | 30 | 30 | 1 | 500ms delay between each of the threads 2s delay between individual and household member 1.5s delay between project beneficiary and project tasks | 1 | PASS | |
C06.03 | 10 | 30 | 1 | 30 | 3 | 30 | 30 | 30 | 1 | 500ms delay between each of the threads 1.5s delay between individual and household member 1.5s delay between project beneficiary and project tasks | 1 | PASS | |
C06.05 | 10 | 30 | 1 | 30 | 3 | 30 | 30 | 30 | 1 | 500ms delay between each of the threads 1.5s delay between individual and household member 1.5s delay between project beneficiary and project tasks | 1 | PASS | |
C06.06 | 10 | 30 | 1 | 30 | 3 | 30 | 30 | 30 | 1 | 500ms delay between each of the threads 1.5s delay between individual and household member 1.5s delay between project beneficiary and project tasks | 1 | PASS | |
C06.08 | 15 | 30 | 1 | 30 | 3 | 30 | 30 | 30 | 1 | 500ms delay between each of the threads 1.5s delay between individual and household member 1.5s delay between project beneficiary and project tasks | 1 | PASS | Best result for 1 pod and delay configuration between calls. |
C06.09 | 20 | 30 | 1 | 30 | 3 | 30 | 30 | 30 | 1 | 500ms delay between each of the threads 1.5s delay between individual and household member 1.5s delay between project beneficiary and project tasks | 1 | FAIL | Household pods goes to crash loop back off state and household member creation failes. Hence the project beneficiary and subsequently project tasks also fail. |
C07.01 | 10 | 30 | 1 | 120 | 12 | 30 | 30 | 30 | 1 | 500ms delay between each of the threads 1.5s delay between individual and household member 1.5s delay between project beneficiary and project tasks | 1 | FAIL | |
C07.02 | 6 | 30 | 1 | 120 | 12 | 30 | 30 | 30 | 1 | 500ms delay between each of the threads 1.5s delay between individual and household member 1.5s delay between project beneficiary and project tasks | 1 | FAIL | Creation of household members failed with individualid not found. Rest all were created successfully. |
C07.04 | 6 | 30 | 1 | 120 | 12 | 30 | 30 | 30 | 1 | 500ms delay between each of the threads 2s delay between individual and household member 1.5s delay between project beneficiary and project tasks | 1 | FAIL | Inconsistent results with tis set up. Ran thrice and failed twice |
C07.05 | 6 | 30 | 1 | 120 | 12 | 30 | 30 | 30 | 1 | 500ms delay between each of the threads 2.5s delay between individual and household member 1.5s delay between project beneficiary and project tasks | 1 | PASS | table_name | count ---------------------+------- project_task | 180 project_beneficiary | 180 household_member | 720 household | 180 individual | 720 Individual service takes about avg of 2.7s and max 7s to send a response. |
C07.06 | 6 | 30 | 1 | 120 | 12 | 30 | 30 | 30 | 1 | 500ms delay between each of the threads 2.5s delay between individual and household member 1.5s delay between project beneficiary and project tasks | 1 | PASS | table_name | count ---------------------+------- project_task | 180 project_beneficiary | 180 household_member | 720 household | 180 individual | 720 Individual service takes about avg of 0.7s and max 1.1s to send a response. |
C07.07 | 6 | 30 | 1 | 120 | 12 | 30 | 30 | 30 | 1 | 500ms delay between each of the threads 2.5s delay between individual and household member 1.5s delay between project beneficiary and project tasks | 1 | PASS | table_name | count ---------------------+------- project_task | 180 project_beneficiary | 180 household_member | 720 household | 180 individual | 720 Individual service takes about avg of 0.75s and max 1.1s to send a response. |
C08.01 | 10 | 30 | 1 | 120 | 12 | 30 | 30 | 30 | 1 | 500ms delay between each of the threads 2.5s delay between individual and household member 1.5s delay between project beneficiary and project tasks | 1 | FAIL | Household member creation fails with individual not found. Hence the project beneficiary and subsequently project tasks also fail. |
C09.01 | 10 | 30 | 1 | 120 | 1 | 30 | 30 | 30 | 1 | 500ms delay between each of the threads 2.5s delay between individual and household member 1.5s delay between project beneficiary and project tasks | 1 | PASS | |
C09.02 | 10 | 30 | 1 | 120 | 1 | 30 | 30 | 30 | 1 | 500ms delay between each of the threads 2.5s delay between individual and household member 1.5s delay between project beneficiary and project tasks | 1 | PASS | table_name | count ---------------------+------- project_task | 300 project_beneficiary | 300 household_member | 1200 household | 300 individual | 1200 |
C-09.03 | 20 | 30 | 1 | 120 | 1 | 30 | 30 | 30 | 1 | 500ms delay between each of the threads 2.5s delay between individual and household member 1.5s delay between project beneficiary and project tasks | 1 | PASS | table_name | count ---------------------+------- project_task | 600 project_beneficiary | 600 household_member | 2400 individual | 2400 household | 600 |
C-09.04 | 60 | 30 | 1 | 120 | 1 | 30 | 30 | 30 | 1 | 500ms delay between each of the threads 2.5s delay between individual and household member 1.5s delay between project beneficiary and project tasks | 1 | PASS | table_name | count ---------------------+------- project_task | 1800 project_beneficiary | 1800 household | 1800 household_member | 7200 individual | 7200 |
C-09.05 | 60 | 30 | 1 | 120 | 1 | 30 | 30 | 30 | 1 | 500ms delay between each of the threads | 1 | PASS | table_name | count ---------------------+------- project_task | 1800 project_beneficiary | 1800 household | 1800 household_member | 7200 individual | 7200 |
C-09.06 | 100 | 30 | 1 | 120 | 1 | 30 | 30 | 30 | 1 | 500ms delay between each of the threads | 1 | PASS | table_name | count ---------------------+------- project_task | 3000 project_beneficiary | 3000 household | 3000 household_member | 12000 individual | 12000 Best result for 1 pod and delay configuration between calls. |