Skip to content

CMS performance testing. Part IV (Sitefinity)

February 28, 2011

This post is almost closing theme describing performance of popular CMS. Below is Sitefinity CMS performance analysis.

CMS performance testing. Part I

CMS performance testing. Part II (DotNetNuke)

CMS performance testing. Part III (Kentico)

1.  Sitefinity CMS test results

1.1.         Blog page

1.1.1.     Summary

Load behavior: Start 100 user simultaneously

Maximum running virtual users: 100

1.1.2.     Average values

Blog page, 1 Vueser Blog page, 100 Vusers
Response Time 1.4 42.3
Processor Queue Length, MS IIS 0.6 3 Not more than 2 for each processor unit
Processor Time (%),  MS ISS 32 87 Not more than 85%
Processor Queue Length, SQL Server 0.9 0.6 Not more than 2 for each processor unit
Processor Time (%), SQL Server 29 25 Not more than 85%
Disk Time (%), SQL Server 3.8 3.2
Disk Queue Length, SQL Server 0.01 0.003

1.1.3.     Counters comparison graph

1.1.4.     Results

Here we can see MS ISS bottleneck because of Processor queue length more than 2 for each unit and % Processor time in average more than 85%. This directly affects Sitefinity end user response time (~42 sec). SQL Server numbers are under critical values. So we can assume that there is a possible MS ISS server CPU bottleneck.

1.2.         Blog post comment (ramp-up)

1.2.1.     Summary

Load behavior: Start 25 every 1 min 30 sec

Maximum running virtual users: 100

1.2.2.     Counters comparison graph

1.2.3.     Results

After this test we found out that the current system configuration allows not more than 90 concurrent virtual users. In Figure above timeout errors appeared on 5th minute and then some vusers were dropped (yellow line).

So the next step is to make flat run with vuser amount we discovered.

1.3.         Blog post comment (flat)

1.3.1.     Summary

Load behavior: Start 100 user simultaneously

Maximum running virtual users: 100

1.3.2.     Average values

Blog post comments, 1 Vuser Blog post comments, 100 Vusers
Response Time 2.2 Users were dropped by timeout ( > 120 sec )
Processor Queue Length, MS IIS 0.7 Not more than 2 for each processor unit
Processor Time (%),  MS ISS 36 Not more than 85%
Processor Queue Length, SQL Server 0.5 Not more than 2 for each processor unit
Processor Time (%), SQL Server 24 Not more than 85%
Disk Time (%), SQL Server 4.3
Disk Queue Length, SQL Server 0.01

1.3.3.     Counters comparison graph

1.3.4.     Results

Although we found a critical vuser amount the system dropped most of users and then continued in proper way. So we can consider that MS ISS server cannot handle such a huge load.

1.4.         Data base trace

1.4.1.     Blog page (1 user)

There were executed 453 queries and 182 of it were inline.

SQL Server execution time:  ≈ 2.6 sec!

1.4.2.     Blog post comment (1 user)

According to trace table there were 561 queries (and this only for 1 user!). Also there 263 inline queries! (To execute it sql engine firstly compile it and only after it execute it – Sitefinity CMS takes much more time to compare with precompiled stored procedures).

SQL Server execution time:  ≈ 3.9 sec!

Advertisements
4 Comments
  1. Casey permalink

    wow! sitefinity is slow. did you ever find a cms with decent performance? i’m using sitefinity right now and it is still slow.

    • it is pity that sitefinity do not working on performance.
      I thing there is no a good CMS at all because of it idea, it allows you to do a lot of task, you can extend it and so on… it is all affect performance. It is good for fast development but if you need high performance – it is better to write you own application/service/site or significantly optimize CMS (our сolleagues did it for .net nuke by improving modules)

  2. Dzmitry Kashlach permalink

    No long ago I’ve tried Drupal Module for performance testing. It’s awesome, because it allows you to test site right from the administration panel.

    But do you know another CMS’s with the same functionality?

Trackbacks & Pingbacks

  1. CMS performance testing. Analysis Summary « QA Questions

Leave a Reply

Fill in your details below or click an icon to log in:

WordPress.com Logo

You are commenting using your WordPress.com account. Log Out / Change )

Twitter picture

You are commenting using your Twitter account. Log Out / Change )

Facebook photo

You are commenting using your Facebook account. Log Out / Change )

Google+ photo

You are commenting using your Google+ account. Log Out / Change )

Connecting to %s

%d bloggers like this: