[Cosmo-dev] Hub activity breakdown

[Jared Rhine]

One long-standing question has been "what sort of traffic mix are we 
going to see in the real-world"?  Since some sorts of operations (Atom 
feed, webcal gets) are expensive operations, and others are not 
(images), the specific mix we see will determine in large part the 
overall performance and capacity of Chandler Hub.

To help answer that question, an analysis program has been written which 
uses the Apache-style access logs generated by the Hub and produces a 
report with percentage breakdowns.

Two reports are included below; an alternate view of some of this data 
is also available here:

   http://dashboard.osafoundation.org/dashboard/hub

For yesterday, on Chandler Hub, we saw:

-----

[Cosmo usage report from 2007-06-25]
--- Totals ---
total hits                       : 2328
unparsed hits                    : 12
errors                           : 26
distinct ips                     : 50
--- Authentication status ---
distinct authenticated users     : 24
distinct tickets                 : 11
empty authentication hits        : 814
anonymous records                : 223
--- Event breakdown ---
mc syncs                         : 883 (37.9%)
mc updates (including publish)   : 169 (7.3%)
mc publishes                     : 2 (0.1%)
pim web ui loads                 : 78 (3.4%)
atom ops                         : 32 (1.4%)
webcal gets                      : 39 (1.7%)
caldav report (query)            : 11 (0.5%)
caldav get (read)                : 0 (0.0%)
caldav put (update)              : 2 (0.1%)
caldav other                     : 6 (0.3%)
homepage hits                    : 27 (1.2%)
logins                           : 12 (0.5%)
signups                          : 6 (0.3%)
activations                      : 4 (0.2%)
account browser                  : 0 (0.0%)
web ui ops (json-rpc)            : 170 (7.3%)
javascript files                 : 313 (13.4%)
image files                      : 264 (11.3%)
css files                        : 47 (2.0%)
help accesses                    : 3 (0.1%)
legacy chandler cloudxml         : 1 (0.0%)
iCal 2.x webcal update           : 0 (0.0%)
low [CMP,robot,favico,tz,logout] : 219 (9.4%)
other request types              : 23 (1.0%)

-----

Randy, though I still don't have a final server to benchmark, the above 
might move forward our prep for that.  osaf.us, being around for much 
longer (1100 users), has a more substantial CalDAV mix.  A report from 
say mid-February on osaf.us looks like this:

-----

[Cosmo usage report from 2007-02-13]
--- Totals ---
total hits                       : 16900
unparsed hits                    : 0
errors                           : 0
distinct ips                     : 1
--- Authentication status ---
distinct authenticated users     : 0
distinct tickets                 : 0
empty authentication hits        : 16900
anonymous records                : 0
--- Event breakdown ---
mc syncs                         : 0 (0.0%)
mc updates (including publish)   : 0 (0.0%)
mc publishes                     : 0 (0.0%)
pim web ui loads                 : 7 (0.0%)
atom ops                         : 0 (0.0%)
webcal gets                      : 0 (0.0%)
caldav report (query)            : 30 (0.2%)
caldav get (read)                : 5838 (34.5%)
caldav put (update)              : 330 (2.0%)
caldav other                     : 465 (2.8%)
homepage hits                    : 12 (0.1%)
logins                           : 0 (0.0%)
signups                          : 0 (0.0%)
activations                      : 0 (0.0%)
account browser                  : 0 (0.0%)
web ui ops (json-rpc)            : 25 (0.1%)
javascript files                 : 662 (3.9%)
image files                      : 272 (1.6%)
css files                        : 71 (0.4%)
help accesses                    : 0 (0.0%)
legacy chandler cloudxml         : 7693 (45.5%)
iCal 2.x webcal update           : 0 (0.0%)
low [CMP,robot,favico,tz,logout] : 1035 (6.1%)
other request types              : 460 (2.7%)

-----

-- Jared