系统运行日志基础数据分析
总括
***************************************************************************************
2014.02.25
总PV:420W个;
总UV:5.1W人;
独立IP:12W个;
(平均每人请求82次;平均每个IP请求35次;)
(截止用户总数723112,即日活7.05%)
(当天新用户39751,注册20309,激活16551,激活率81.50%,平均每分钟11.5人激活,每秒0.19人)
平均每小时PV:17W个(按24小时算);
平均每秒PV:146个(按8小时算);
平均每秒PV:97个(按80%流量,40%时间算);
单秒最高:
09:36:35 -> 336个
09:52:58 -> 329个
10:28:16 -> 317个
早8点~9点PV最高:26W(平均每秒73个);
***************************************************************************************
1. 全天24小时,每秒请求数,前50名:
**[root@web SysLogs]# cat info.log.2014-02-25 | awk '{a[$2]++} END {for(b in a) print b"\t"a[b]}' | sort -n -k 2 -r | head -50**
09:36:35 336
09:52:58 329
10:28:16 317
09:00:06 315
10:17:50 305
09:40:18 298
09:36:20 283
09:50:13 277
10:00:16 273
09:52:45 273
09:39:52 268
10:37:42 267
10:30:41 266
09:59:28 266
09:58:16 264
09:34:38 264
10:03:00 263
09:58:41 263
09:10:26 262
10:29:35 260
09:58:11 260
10:24:10 258
10:26:23 256
08:59:36 256
10:17:55 254
09:52:18 254
10:19:16 253
09:39:25 252
09:54:39 251
09:43:58 251
09:32:29 251
10:22:03 249
10:27:25 248
09:54:46 248
09:35:12 248
23:06:06 247
09:39:09 247
09:46:37 246
10:49:42 245
09:49:29 245
09:39:48 245
09:35:43 245
08:02:13 245
10:02:32 244
09:57:58 244
09:57:12 244
09:54:32 244
09:31:43 244
10:33:50 243
10:24:06 243
09:45:35 243
09:40:06 243
10:39:33 242
09:53:22 242
08:55:14 240
10:41:05 239
09:30:55 239
09:38:18 238
09:33:48 238
09:18:34 237
10:42:11 236
10:40:04 236
10:17:31 235
10:30:13 234
10:24:57 234
09:54:20 234
09:32:13 234
09:27:49 234
10:29:27 233
10:02:09 233
09:56:50 233
09:52:08 233
2. 全天24小时,单秒最高请求数(09:36:35最高336个请求),查看该时间内请求URL排名:
**[root@web SysLogs]# cat info.log.2014-02-25 | grep "09:36:35" | awk '{a[$15]++} END {for(b in a) print b"\t"a[b]}' | sort -n -k 2 -r**
http://api.xxxx.com/user/getPushKey.do 83
http://api.xxxx.com/contacts/findUserContact.do 28
http://api.xxxx.com/user/requestList.do 22
http://api.xxxx.com/contacts/download.do 18
http://api.xxxx.com/user/saveGPS.do 13
http://api.xxxx.com/user/requestProgress.do 12
http://api.xxxx.com/news/systemSDRExtension.do 12
http://api.xxxx.com/contacts/add2Contacts.do 12
http://api.xxxx.com/user/visitorNum.do 9
http://api.xxxx.com/user/signInByThirdPart.do 9
http://api.xxxx.com/user/InduRecommend.do 9
http://api.xxxx.com/user/signUp.do 8
http://api.xxxx.com/user/signIn.do 8
http://api.xxxx.com/contacts/upload.do 7
http://api.xxxx.com/news/friendCastNew.do 6
http://api.xxxx.com/message/sendMessage.do 6
http://api.xxxx.com/message/readMessageDetail.do 6
http://api.xxxx.com/user/vCodeResend.do 5
http://api.xxxx.com/message/listForUnRead.do 4
3.查看8点时间段,每秒请求数,前50名:
**[root@web SysLogs]# cat info.log.2014-02-25 | grep "2014-02-25 08:" | awk '{a[$2]++} END {for(b in a) print b"\t"a[b]}' | sort -n -k 2 -r | head -50**
08:59:36 256
08:02:13 245
08:55:14 240
08:43:55 233
08:27:14 231
08:23:25 231
08:34:18 227
08:51:38 217
08:23:17 216
08:41:11 213
08:31:08 213
08:55:04 210
08:12:47 203
08:58:24 202
08:41:17 202
08:40:57 202
08:27:30 202
08:34:05 201
08:19:44 200
08:51:57 198
08:54:50 197
08:48:55 197
08:51:50 196
08:59:03 194
08:56:09 193
08:55:20 193
08:41:05 193
08:19:51 191
08:55:47 190
08:57:03 189
08:54:26 189
08:27:22 189
08:48:48 188
08:34:11 187
08:54:56 186
08:46:26 186
08:57:16 185
08:57:22 184
08:56:34 181
08:56:16 181
08:31:00 180
08:55:40 178
08:02:27 178
08:57:57 176
08:55:33 176
08:44:11 176
08:58:09 173
08:54:15 173
08:44:00 172
08:43:11 172
4.查看8点时间段,被请求连接URL,前50名:
[root@web SysLogs]# cat info.log.2014-02-25 | grep "2014-02-25 08:" | awk '{a[$15]++} END {for(b in a) print b"\t"a[b]}' | sort -n -k 2 -r | head -50
http://api.xxxx.com/contacts/upload.do 42051
http://api.xxxx.com/user/getPushKey.do 32500
http://api.xxxx.com/contacts/findUserContact.do 19979
http://api.xxxx.com/user/requestList.do 14990
http://api.xxxx.com/contacts/download.do 14888
http://api.xxxx.com/user/InduRecommend.do 13884
http://api.xxxx.com/news/systemSDRExtension.do 10201
http://api.xxxx.com/user/signUp.do 9209
http://api.xxxx.com/news/friendCastNew.do 8613
http://api.xxxx.com/user/visitorNum.do 8027
http://api.xxxx.com/contacts/add2Contacts.do 7630
http://api.xxxx.com/user/signIn.do 6037
http://api.xxxx.com/message/readMessageDetail.do 5837
http://api.xxxx.com/user/saveGPS.do 5455
http://api.xxxx.com/user/uidGenerate.do 4952
http://api.xxxx.com/user/requestProgress.do 4681
http://api.xxxx.com/message/sendMessage.do 3953
http://api.xxxx.com/user/accountVerify.do 3800
http://api.xxxx.com/user/signInByThirdPart.do 2819
http://api.xxxx.com/user/vCodeResend.do 2532
http://api.xxxx.com/user/privacySetting.do 2136
http://api.xxxx.com/user/locationBased.do 2128
http://api.xxxx.com/comment/list.do 1980
http://api.xxxx.com/user/socialToken.do?method=batch 1859
http://api.xxxx.com/sdr/detail.do 1855
http://api.xxxx.com/user/userBind.do 1810
http://api.xxxx.com/message/listForUnRead.do 1505
http://api.xxxx.com/product/listAll.do 1447
http://api.xxxx.com/user/updateUserProfile.do 1294
http://api.xxxx.com/message/sys.do 920
http://api.xxxx.com/user/industryBased.do 914
http://api.xxxx.com/user/search.do 789
http://api.xxxx.com/product/industryCount.do 786
http://api.xxxx.com/user/visitor.do 626
http://api.xxxx.com/user/accessToken.do 624
http://api.xxxx.com/message/historyList.do 571
http://api.xxxx.com/user/updateSDRInfo.do 568
http://api.xxxx.com/user/sdrSearch.do 497
http://api.xxxx.com/news/praise.do 466
http://api.xxxx.com/group/topicList.do 466
http://api.xxxx.com/news/userDynamicCast.do 448
http://api.xxxx.com/comment/receive.do 362
http://api.xxxx.com/group/basicInfo.do?method=groupPage 358
http://api.xxxx.com/user/updateUserWorks.do 302
http://api.xxxx.com/news/addFriendNewsList.do 290