CMI系统开发笔记-优快云博客

本文链接：https://blog.youkuaiyun.com/caicai89tu/article/details/54847997

super_help_superdocument.jsp UserHelpAction.java —————————————————— IP校验的代码 function addIp(ipbegin,ipend) { var ipbegintemp = f.ipbegin.value.split(“.”); var ipendtemp = f.ipend.value.split(“.”); for(var i = 0; i ; —————————————————————————- 频道同步：iam3131合的代码： JobConsts.java ChannelInfoDao.java OttChannelJobSender.java 还在ChannelInfoAction.java里面添加MessageEventInit.publish(JobConsts.OTT_CHANNEL_EVENT, 0); CMI合的代码 JobConsts.java OttChannelJobReceiver.java OttChannelDao.java OttChannel.java 注意url要配置另外注意pojo类的变量名：比如cmi传递给iam的jsonstr：[{“value”:12,”text”:”JD”}]，对应的pojo类应该是有value和text的。 ————————————————————————— UTVCP的同步 CMI中： JobConsts.java UTVCPSender.java IAM中： UTVCPReceiver.java UTVCP.java UTVCPDao.java 对应的建表语句： SELECT ‘create table t_utv_cp’ AS prompt; DROP TABLE IF EXISTS t_utv_cp ; CREATE TABLE t_utv_cp ( operid INT(11) NOT NULL AUTO_INCREMENT, NAME VARCHAR(32) NOT NULL, PRIMARY KEY (operid,NAME) ) ENGINE=INNODB DEFAULT CHARSET=utf8 后来改operid为cpid，对应的建表语句： SELECT ‘create table t_utv_cp’ AS prompt; DROP TABLE IF EXISTS t_utv_cp ; CREATE TABLE t_utv_cp ( cpid VARCHAR(128) NOT NULL, NAME VARCHAR(200) NOT NULL, PRIMARY KEY (cpid,NAME) ) ENGINE=INNODB DEFAULT CHARSET=utf8 ————————————————————————— utvonlineuser.jsp 1、根据用户组选择展示内容

2、频道列表可以参照请求数链接数页面注意getnode返回的数据格式： {“data”:[{“value”:”11111”,”text”:”OTT-WK”},{“value”:”node123”,”text”:”cache节点1”},{“value”:”ott1”,”text”:”ott1”},{“value”:”servicenodenj111”,”text”:”南京服务节点1”},{“value”:”test00001”,”text”:”CMI测试节点”}]} 而我一开始是{“data”:[{“channelname”:”sohuname”}]} 将格式修改之后就正常了。 3、查询语句对比着看请求数链接数页面的查询参数： queryparam：”{“starttime”:”20161208000000”,”endtime”:”20161208191503”,”timezoneoffset”:28800000,”website”:[],”node”:”“,”servicetype”:”“}” queryparam：”{“starttime”:”20161208000000”,”endtime”:”20161208191530”,”timezoneoffset”:28800000,”website”:[“97”,”98”,”99”],”node”:”“,”servicetype”:”“}” 对于多选的website，是以数组的方式传送的。传送的时候全选的channel的值都是null，而不是“”，原因是multiple=”multiple” requestconnectService.java里发送大数据的参数： {“granularity”:”0”,”starttime”:”20161207160000”,”endtime”:”20161208115302”,”siteid”:”96,97”,”nodeid”:”node123”} 而我的 UTVOnlineUserService.java {“granularity”:”0”,”starttime”:”20161207160000”,”endtime”:”20161208123254”,”siteid”:”97,98”,”nodeid”:”test00001”,”channelid”:”sohu1”} =================================================================================================== nodeservice_ipv6new.jsp 不能连续导出模板、导出把exportForm1改成exportForm就可以了 =================================================================================================== 自动上报发送的数据：{“desc”:”已缓存”,”domain”:”http://www.a3.com.cn”,”sendState”:”3”} 按钮状态上报发送的数据：{“data”:[{“desc”:”不缓存”,”domain”:”http://www.sina.com.cn”,”sendState”:”2”}],”action”:”reportWhiteState”} 修改后发送的数据正确：{“data”:[{“desc”:”已缓存”,”domain”:”http://www.a1.com”,”sendState”:”3”}],”action”:”reportWhiteState”} 需要修改自动上报发送数据的代码： public int reportChange(String id,String domain,String status){ JSONObject reportData = new JSONObject(); String desc = null; if(status.equals(“0”)){//0待处理、3可缓存、4缓存失败 desc = getText(“iam.cachejob.processing”); }else if(status.equals(“3”)){ desc = getText(“iam.cachejob.cachesuccess”); }else{ desc = getText(“iam.cachejob.cachefailure”); } reportData.put(“desc”, desc); reportData.put(“domain”, domain); reportData.put(“sendState”, status); JSONObject resultObj = new JSONObject(); try { String reportDataString = reportData.toString(); String report_url = webExchangeConfigService.getItemValueByName(“SD_WHITE_URL”, “WEB”); String result = SendHttpMessage.postMsg(report_url,reportDataString); resultObj = JSONObject.fromObject(result); } catch (Exception e) { e.printStackTrace(); } if(resultObj!=null &&!resultObj.isNullObject()&& resultObj.has(“code”)&&”0”.equals(resultObj.getString(“code”))){ return 0;//上报成功 }else{ return 1; } } 按钮状态上报的代码： public JSONObject reportAll(List domainList){ JSONObject reportData = new JSONObject(); JSONArray list = new JSONArray(); JSONObject bean = new JSONObject(); String tempStr[] = null; for (int i = 0; i 不知道有没有必要action=” 成功 ———————————————————————————————————- bootstrap fileinput在上传成功之后一定要有一个json对象的返回，否则页面会报错。添加 JSONObject obj = new JSONObject(); obj.put(“result”, “0”); CommonUtils.writeJson(obj.toString()); 成功 =========================================================================================================== 和程文超联调 139没有channelid 联调前发送的param： {“granularity”:”0”,”starttime”:”20161211160000”,”endtime”:”20161212023436”,”siteid”:”“,”nodeid”:”“,”channelid”:null} 程文超给我的建议格式为： curl -XPOST ‘http://10.46.173.147:8080/1124/rest/statistic/useronline/report’ -d ‘{“starttime”:”20161206000000”,”endtime”:”20161207235959”,”channel”:”605”,”node”:”02”}’ 总共改了三处用于联调 if(jobj.containsKey(“node”)){ param.put(StatsticConsts.NODE_ID, jobj.getString(“node”)); // param.put(StatsticConsts.NODE_ID, “605”);//联调 } if(jobj.containsKey(“channel”)){ param.put(StatsticConsts.CHANNEL_ID, jobj.getString(“channel”)); // param.put(StatsticConsts.CHANNEL_ID, “02”);//联调 } url=”http://10.46.173.147:8080/1124/rest/statistic/useronline/report”;//联调修改后 {“granularity”:”0”,”starttime”:”20161205160000”,”endtime”:”20161207153400”,”siteid”:”“,”nodeid”:”605”,”channelid”:”02”} 联调成功（不知道站点要不要加） ============================================================================================================ 川总让我改查不到数据就不显示图表原来查不到数据时候返回的resp：{“utvonlineuserline”:{“xaxis”:[],”data”:[[]]}} 在Service类里面都增加一个卫语句： if(xaxis.size()==0){ return null; } 这样没数据就不会显示图表。 =============================================================================================================

=============================================================================================================
//返回更新时间
DateFormat df =new SimpleDateFormat(“yyyy-MM-dd hh:mm:ss”);
Long lastModified = helpFile.lastModified();
Date date = new Date(lastModified);
fileUpdateTime = df.format(date);

=============================================================================================================
$(“#file_zh”).fileinput({ uploadUrl: ‘<%=path%>/cmi/user_uploadHelpFile.action?fileType=1’, allowedFileExtensions : [‘pdf’], maxFileSize: 0,//单位是KB，0表示不限制文件大小 autoReplace: true, maxFileCount: 1, uploadAsync: false, })on(“filebatchselected”, function(event, files) {$ (this).fileinput(“upload”);
}).on(“filebatchuploadsuccess”, function(event, data) {//上传成功后回调函数
alert(‘处理成功’);
$(“#superZhFile”).text(‘’);
});
uploadAsync: false的时候回调函数如果要生效，只能用filebatchuploadsuccess

或者用下面一种方法： ============================================================================================================= $(“#file_en”).fileinput({ uploadUrl: ‘ 建议用这一种方法 ============================================================================================================= 周三新任务 CAcert_init.action cretificate.jsp CA证书上传时发送的数据： formData：id=

("#form6_id").val();new FormData( $("#form6_id").val();new FormData($ (“#form5”)[0]); ============================================================================================================= WebsiteAction.java public String init(){ String operid = (String)this.getSession().get(“OPERID”); int roletype = (Integer)this.getSession().get(“ROLETYPE”); if((roletype == 1) || (!websiteService.isValidOperId(operid))){//isValidOperId(),判断operId是否在t_cp表中 return “super”; }else{ return “success”; } } ============================================================================================================= 姚敏说我原来的方案不好看删除了按钮组

=============================================================================================================
超链接
a {
text-decoration:none;
}
a:link {
color:#000000;
text-decoration:none;
}
a:visited {
color:#000000
}
a:hover {
text-decoration:none;
color:#DDDDDD;

} ============================================================================================================= 修改IAM向CMI频道同步的问题， CMI侧接收文档： UTVChannelJobReceive.java JobConsts.java UTVChannel.java UTVChannelDao.java 下面的建表语句有问题： SELECT ‘create table t_utvchannelinfo’ AS prompt; DROP TABLE IF EXISTS t_utvchannelinfo ; CREATE TABLE t_utvchannelinfo ( id INT(11) AUTO_INCREMENT NOT NULL, channelcode VARCHAR(32) NOT NULL, channelnum VARCHAR(32) NOT NULL, chinesename VARCHAR(128) NOT NULL, englishname VARCHAR(128) NOT NULL, fieldname VARCHAR(64) NOT NULL, channelname VARCHAR(64) NOT NULL ) ; CREATE UNIQUE INDEX idx_utvchannelinfo_01 ON t_utvchannelinfo(id, channelcode) ; 改成如下： SELECT ‘create table t_utvchannelinfo’ AS prompt; DROP TABLE IF EXISTS t_utvchannelinfo ; CREATE TABLE t_utvchannelinfo ( id INT(11) NOT NULL AUTO_INCREMENT, channelcode VARCHAR(32) NOT NULL, channelnum VARCHAR(32) NOT NULL, chinesename VARCHAR(128) NOT NULL, englishname VARCHAR(128) NOT NULL, fieldname VARCHAR(64) NOT NULL, channelname VARCHAR(64) NOT NULL, PRIMARY KEY (id,channelcode) ) ENGINE=INNODB DEFAULT CHARSET=utf8 =============================================================================== 修改上传文档的更新时间，注意date的12小时和24小时的用法。 /* * 获取文件更新时间 * */ public String getUpdateTime(String fileName){ File file = new File(root, fileName); DateFormat df =new SimpleDateFormat(“yyyy-MM-dd HH:mm:ss”);//大写为24小时时间，小写为12小时时间 Long lastModified = file.lastModified(); Date date = new Date(lastModified); return df.format(date); } ================================================================================ 频道同步的时候， UTVChannelAction.java用到了基类BaseAction.java里面的BactchDelete方法，如果要把频道同步的方法放在基类不合适。可以在UTVChannelAction.java里面加一个这种代码： public String batchDelete() throws Exception{ //发送UTV频道同步信息给CMI MessageEventInit.publish(JobConsts.UTV_CHANNEL_EVENT, 0); return super.batchDelete(); } 完美解决。 ================================================================================ WEB CMI_URL http://127.0.0.1:8080/uniportal 字符串 CMI WEB URL,与CMI合设时不需要修改 ================================================================================ CMI上任何操作都要记录到操作日志。比如 UTVOnlineUserAction.java中 String opername = (String)this.getSession().get(“OPERNAME”); String message = getOperLogText(“cmi.analysis.requestlink.query”,new String[]{opername, start, end}); OsServiceAccess.getInstance().getLogService().writeLog(getSession(), OperConst.REQUEST_LINK, ret, message); 我依葫芦画瓢加了如下代码： String opername = (String)this.getSession().get(“OPERNAME”); OperResult ret = OperResult.SUCCESS;//OperResult ret = OperResult.FAILURE; String message = getOperLogText(“cmi.helpfile.uploadedfile”,new String[]{opername,fileFileName}); OsServiceAccess.getInstance().getLogService().writeLog(getSession(), OperConst.UPLOAD_DOCUMENT, ret, message); 另外国际化代码cmi.helpfile.uploadedfile：用户[{0}]上传了一个帮助文档，文档名为[{1}]。 User [{0}] uploaded a help manual named [{1}]. 注意：还要在Code\IAM\V3.01\ZXCDN-IAM-DB-CMIV3.01.04.xx\cmidb_packet\db\mysql\install\cn下的 zxinsys_data.sql中的 CALL proc_res_op_paratype(22590,1,4207,’请求链接数’);后添加 CALL proc_res_op_paratype(22590,1,4208,’帮助手册’); ================================================================================ UTV发给大数据的数据格式： {“granularity”:”0”,”starttime”:”20161215160000”,”endtime”:”20161216012738”,”siteid”:”“,”nodeid”:”“,”channelid”:”“} 请求数链接数发给大数据的格式： {“granularity”:”0”,”starttime”:”20161215160000”,”endtime”:”20161216020336”,”siteid”:”“,”nodeid”:”“} ================================================================================ 解决接收空流会报错的问题，用ajax试试。 ”> 用ajax好像行不通，现在改为在下载前先判断路径下是否存在这个文件。代码： ” οnclick=”downloadFile(1)”> function downloadFile(fileType){

.ajax({
        “type”: “post”,
        “url”:  “ $.ajax({ “type”: “post”, “url”: “$ {pageContext.request.contextPath}/cmi/user_isExist.action?t=” + (new Date()).valueOf(), “dataType”: “json”, “data”: {“fileType”:fileType}, “success”: function(resp){ if(resp.result == 0){//文件存在即下载 window.location.href=”

{path}/cmi/fileDownload.action?number=”+fileType;
}else{ ${path}/cmi/fileDownload.action?number=”+fileType; }else{$ .umapMessager.alert(“”,””); } } }); } 对应的action类方法如下： /* * 判断文件是否存在 * */ public String isExist(){ switch (fileType) { case 1: fileFileName = SUPER_ZH_FILE; break; case 2: fileFileName = SUPER_EN_FILE; break; case 3: fileFileName = CP_ZH_FILE; break; default: fileFileName = CP_EN_FILE; break; } String url = root + File.separator + fileFileName; JSONObject resp = new JSONObject(); if(new File(url).exists()){ resp.put(“result”, 0); }else{ resp.put(“result”, 1); } CommonUtils.writeJson(resp.toString()); return NONE; }

圆满解决。 ================================================================================

================================================================================
加组信息的是operatorstore.action，但是在struts-cmi.xml文件中却找不到。
从数据库看
组信息主要在oper_grpscript2中看，因为UTV是要安装cmi版本后看的，所以只能根据描述来判断UTV组，而不是opergrpid。

操作员信息则是在oper_rights2中看，操纵员id：operid和虚拟组id：opergrpid

虚拟组id和实际组id之间有一个映射，是在oper_virtual_grpdef中看。
查询的sql语句
SELECT COUNT(1) FROM oper_rights2 a WHERE a.operid=’13’ AND a.opergrpid=
(SELECT b.v_opergrpid FROM oper_virtual_grpdef b WHERE b.opergrpid=
(SELECT c.opergrpid FROM oper_grpscript2 c WHERE c.grpscript IN (‘UTV’,’utv’))

) ================================================================================ UTVOnlineUser.jsp里面 if(

(“select[name=’operid’]”).length > 0){ $(“select[name=’operid’]”).length > 0){$ (“select[name=’operid’]”).change(function(){ var operid =

(this).selectpicker(‘val′);varservicetype= $(this).selectpicker(‘val’); var servicetype =$ (“select[name=’servicetype’]”).selectpicker(‘val’); getNode(operid); getWebsite(operid,servicetype); getChannel(operid); })

.ajax({
        “type”: “post”,
        “url”:  “ $.ajax({ “type”: “post”, “url”: “$ {pageContext.request.contextPath}/cmi/select_oper.action?t=” + (new Date()).valueOf(), “dataType”: “json”, “success”: function(resp){ resp.data.splice(0,0,{“value”:”“,”text”:””});

(“select[name=′operid′]”).selectpicker(‘reloadData′,resp.data); $(“select[name=’operid’]”).selectpicker(‘reloadData’,resp.data);$ (“select[name=’operid’]”).selectpicker(‘val’,”); } }); }else{ var operid =

直接把字段名字改为accelobject即可 ================================================================================ utv在线用户数统计查询的post()方法，除了需要配置StatsticConsts.java中的public static final String USERONLINE_CODE = “useronline”; //UTV在线用户数统计还要配置rest-interface.xml：

================================================================================ UTVCP的频道同步改在对操作员信息进行确认修改后执行，修改operator_edit.jsp页面可以同时给onclick绑定两个事件 οnclick=”onSubmit();updateUTVCP();” 写js方法，利用ajax调用后台函数 function updateUTVCP(){

.ajax({
        “type”: “post”,
        “url”:  “ $.ajax({ “type”: “post”, “url”: “$ {pageContext.request.contextPath}/cmi/utvonlineuser_updateUTVCP.action”, “dataType”: “json”, “success”: function(resp){ alert(“11”); } }); } 对应的action类中定义方法 public String updateUTVCP(){ MessageEventInit.publish(JobConsts.UTV_CP_EVENT, 0); return NONE; } ================================================================================ UTV在线用户数的节点在cmi： SELECT DISTINCT a.nodeid VALUE, a.nodename TEXT FROM zxcdn_cmi.t_node a, zxcdn_cmi.t_cp_node b, zxcdn_cmi.t_cp c WHERE a.nodeid = b.nodeid AND b.cpid = c.cpid AND c.operid = 12 或 SELECT nodeid VALUE, nodename TEXT FROM zxcdn_cmi.t_node 在iam，节点和cpid没有关联，只能全部展示 SELECT a.* FROM zxcdn_iam.r_node a, zxcdn_iam.t_agent_group b, zxcdn_iam.t_agent_cachenode c

WHERE a.entid = c.nodeid AND b.groupid = c.groupid ================================================================================= 加速对象查询，一开始用 //加速对象 public List

} ================================================================================== 【故障描述】 mlb管理-总存储容量管理页面 1.饼图，无论是已用容量还是剩余容量，鼠标移到饼图位置显示的数字后面都有（100.00%）,详见附件中的图片 2.饼图下面的标记的汉字显示不全检查了MFSQueryAction.java的查询方法query() resultMsg=CommonUtil.sendUrl(url, task.toString()); 既不是DCF上报的，也不是大数据的，而是直接到设备上去查的没办法演示数据，只能直接改totalstorage.jsp页面的样式了

把饼图的series.radius=’50%’、series.center=[‘50%’, ‘50%’]和title.x=’right’修改了。 ================================================================================== 1.mlb管理-存储配置页面，告警阈值都写成了告警阀值; 2.mlb管理-存储配置页面，重置有，全部为空，应该保留上次保留的配置数据原因是重置按钮绑定了reset()事件，函数名改为resetAll()并在其中加上query()语句即可 function resetAll(){ //

(“#disknum”).val(null);
// $(“#disknum”).val(null); //$ (“#jboddisknum”).val(null); //

(“#mfsalarmrate”).val(null);
// $(“#mfsalarmrate”).val(null); //$ (“#jbodmfsalarmrate”).val(null); //

(“#diskalarmrate”).val(null);
// $(“#diskalarmrate”).val(null); //$ (“#jboddiskalarmrate”).val(null); query();

} ===================================================================================== 为了让UTV报表只针对super用户和UTV用户显示，需要在zxinsys_data.sql里面添加 CALL proc_res_op_function(22590,1,1551,155106,’UTV在线用户数统计’);

155106为对应的role id。 =====================================================================================

只有super才能看到客户名称组，utv用户也看不到，所以这段代码可以不用了： ===================================================================================== CMI报表必须有CP才可以查询

(“#queryBtn”).click(function(){
//必须有CP才可以查询
var operid = $(“#queryBtn”).click(function(){ //必须有CP才可以查询 var operid =$ (“[name=’operid’]”).val(); if(operid == null){ $.umapMessager.alert(“”,””); return; }

… ===================================================================================== param.put(“cp”, dao.getCpIdByOperId(operid)); getCpIdByOperId可以直接返回String类型的对象方法如下： public String getCpIdByOperId(String operid){ String sql =”select cpid from ” + DBUtil.getDbName() + “t_cp where 1=1 “; List param = new ArrayList(); if(StringUtils.isNotBlank(operid)){ sql += ” and operid = ?”; param.add(operid); } return jdbcTemplate.queryForObject(sql,param.toArray(),String.class);

} =====================================================================================

“umapSort”:false, ===================================================================================== Request URL:http://10.47.232.233:8080/cmi/fileDownload.action?number=2 Request Method:GET Status Code:404 Not Found Remote Address:10.47.232.233:8080 下载异常是因为

path和 ${path}和$ {pageContext.request.contextPath}不一致，

} ==================================================================================== 在jsp页面的filebatchselected()方法中下入如下代码： //添加上传前的事件

.ajax({
    “type”: “post”,
    “url”:  “${pageContext.request.contextPath}/cmi/user_isExist.action?t=” + (new Date()).valueOf(),
    “dataType”: “json”,
    “data”: {“fileType”:1},
    “success”: function(resp){
            if(resp.result == 0){//文件存在即下载
                $(“#file_zh”).fileinput(“upload”);
            }else if(resp.result == 2){//文件被锁
                $.umapMessager.alert(“”,””);
            }else{
                $.umapMessager.alert(“”,””);
            }
    }
});
// $.ajax({ “type”: “post”, “url”: “${pageContext.request.contextPath}/cmi/user_isExist.action?t=” + (new Date()).valueOf(), “dataType”: “json”, “data”: {“fileType”:1}, “success”: function(resp){ if(resp.result == 0){//文件存在即下载 $(“#file_zh”).fileinput(“upload”); }else if(resp.result == 2){//文件被锁 $.umapMessager.alert(“”,””); }else{ $.umapMessager.alert(“”,””); } } }); //$ (this).fileinput(“upload”); 在每一次上传的时候都操作application对象， request.getSession().getServletContext().setAttribute(“uploadstatus”, “1”);

其他线程可以通过lock.isLocked()方法来判断是否被锁。 ===================================================================================== CMI_web:中英文界面都有的问题，super账号登陆CMI，对CP账号增加、修改或者删除的URL替换配置进行审核时，

审核人的名称可以修改，建议改成不可以修改审核人 =====================================================================================

项目部署路径在myeclipse里面可以改，注意cmi连的数据库端口是5516 =====================================================================================

URL替换审批，火狐浏览器不支持function()里面直接调用event,加入function(event)解决 ===================================================================================== CMI ciruitid输入框不能左移原因是circuitid输入框用了onkeyup事件，作用是不让输入非字母 οnkeyup=”value=value.replace(/[\W|_]/g, ”)” 但是这种方法在chrome下会导致不能左移。换一种方法： οnkeyup=”cdnreplace(/[^\w]/g,this)” function cdnreplace(regexvalue,obj) { var objvalue = obj.value; if(objvalue.search(regexvalue) != -1) { while(objvalue.search(regexvalue) != -1) { objvalue = objvalue.replace(regexvalue,”); } obj.value = objvalue; } }

成功解决。 ===================================================================================== 文件下载的时候要能够同时锁定文件，之前的方法不可取。之前的方式是直接通过struts2自带的stream流实现文件的下载。 attachment;filename=”${fileName}” downloadFile package com.zte.anyservice.cmi.frame.action; import java.io.File; import java.io.FileInputStream; import java.io.InputStream; import org.apache.struts2.ServletActionContext; import com.zte.anyservice.cmi.common.OperConst; import com.zte.anyservice.os.OsServiceAccess; import com.zte.anyservice.os.operlog.OperResult; import com.zte.anyservice.support.struts.GridActionSupport; public class FileDownloadAction extends GridActionSupport { private int number; private String fileName; private String root = ServletActionContext.getServletContext().getRealPath(“/helpdoc”); private String SUPER_ZH_FILE = “智能加速缓存系统 CMI操作指导（Super用户）中文版.pdf”; private String SUPER_EN_FILE = “Intelligent Accelerate Cache System CMI Manual For Super User.pdf”;//”智能加速缓存系统 CMI操作指导（Super用户）英文版.pdf”; private String CP_ZH_FILE = “智能加速缓存系统 CMI操作指导（CP用户）中文版.pdf”; private String CP_EN_FILE = “Intelligent Accelerate Cache System CMI Manual For CP User.pdf”;//”智能加速缓存系统 CMI操作指导（CP用户）英文版.pdf”; public int getNumber() { return number; } public void setNumber(int number) { this.number = number; } public String getFileName() { return fileName; } public void setFileName(String fileName) { this.fileName = fileName; } public InputStream getDownloadFile() throws Exception { switch (number) { case 1: this.fileName = SUPER_ZH_FILE; break; case 2: this.fileName = SUPER_EN_FILE; break; case 3: this.fileName = CP_ZH_FILE; break; default: this.fileName = CP_EN_FILE; break; } // this.fileName = new String(this.fileName.getBytes(),”ISO8859-1”); // InputStream is= ServletActionContext.getServletContext().getResourceAsStream(“helpdoc/”+this.fileName); String url = root + File.separator + this.fileName; if(!(new File(url).exists())){ return null; } InputStream is= new FileInputStream(url); String orginFileName = this.fileName; // this.fileName = new String(this.fileName.getBytes(“GBK”),”ISO8859-1”);//防止中文乱码问题 this.fileName = java.net.URLEncoder.encode(this.fileName.replaceAll(” “, “”), “UTF-8”).replaceAll(“%25”, “%”);//防止中文乱码问题 //CMI所有操作都要写入操作日志 String opername = (String)this.getSession().get(“OPERNAME”); OperResult ret = OperResult.SUCCESS;//OperResult ret = OperResult.FAILURE; String message = getOperLogText(“cmi.helpfile.downloadfile”,new String[]{opername,orginFileName}); OsServiceAccess.getInstance().getLogService().writeLog(getSession(), OperConst.OPER_MANUAL, ret, message); return is; } @Override public String execute() throws Exception { return SUCCESS; } }

改为”${pageContext.request.contextPath}/iam/weightthreshold_query.action”即可。 ===================================================================================================== 重启tomcat之后报错严重: StandardWrapper.Throwable java.lang.Error: IOException occured when reading ‘D:\Tomcat%206.0\webapps\crawler\WEB-INF\classes\vas-inoc-extensiondesc.xml’ 。。。 Caused by: java.io.FileNotFoundException: D:\Tomcat%206.0\webapps\crawler\WEB-INF\classes\vas-inoc-extensiondesc.xml (系统找不到指定的路径。) 不知道什么原因。内存溢出 -Xms1024m -Xmx1024m -XX:PermSize=256m -XX:MaxPermSize=256m无法启动jvm

改成-Xms512m -Xmx512m -XX:PermSize=256m -XX:MaxPermSize=256m至少可以启动tomcat了 =====================================================================================================

???String index=CommonUtil.getTableIndex(domain); ===================================================================================================== 昊总使用bootstrap的typeahead方法实现输入字符搜索提示

); ===================================================================================================== 昊总修改了我的可缓存性分析页面直接将内容显示判断写在了sql语句里面： SELECT a.domain, ROUND((1-a.t1)*100 ,2) t1 , ROUND(a.s*100 ,2) s , a.port, CASE WHEN ifcontainhttps=1 THEN ‘是’ ELSE ‘否’ END ifcontainhttps, CASE WHEN ifcontainhttps=0 AND PORT=0 THEN ‘可服务’ ELSE ‘不可服务’ END canservice , CASE WHEN ifcontainhttps=0 AND PORT=0 AND t1

FROM zxcdn_spider.t_domainres a LIMIT 0,10 ===================================================================================================== 昊总查询拨测任务信息的sql查询语句 SELECT a.*, (SELECT b.itemvalue FROM zxcdn_iam.t_code b WHERE b.itemkey=a.status AND b.codeid=2018 LIMIT 1)statusname, DATE_FORMAT(a.createtime,’%Y-%m-%d %T’) createtimestr, (SELECT COUNT(1) FROM zxcdn_spider.t_taskurl b,zxcdn_spider.t_seedurl c WHERE b.url=c.url AND b.taskid=a.taskid AND STATUS=’2’ ) finish, (SELECT COUNT(1) FROM zxcdn_spider.t_taskurl b,zxcdn_spider.t_seedurl c WHERE b.url=c.url AND b.taskid=a.taskid ) total

FROM zxcdn_spider.t_task a WHERE 1=1 ORDER BY createtime DESC LIMIT 0,10 ===================================================================================================== 删除的时候注意如果批量匹配删除应该是用in

DELETE FROM zxcdn_spider.t_seedurl WHERE url IN (SELECT a.url FROM zxcdn_spider.t_taskurl a WHERE a.taskid=10); ===================================================================================================== 任务名称不能以dom开头，可以使用如下代码 if((document.getElementById(“task.name”).value.indexOf(“dom”)==0) || (document.getElementById(“task.name”).value.indexOf(“dpi”)==0)){ $.umapMessager.alert(“”,”爬虫任务名称不能使用dom和dpi开头”); return ;

********************************************************************************************************* ===================================================================================================== 修改可缓存分析的查询语句增加ifcontainpost和wsname字段的查询，修改可服务和可缓存的判断条件， SELECT a.domain, ROUND((1-a.t1)*100 ,2) t1 , ROUND(a.s*100 ,2) s , a.port, CASE WHEN ifcontainpost=1 THEN ‘是’ ELSE ‘否’ END ifcontainpost, CASE WHEN ifcontainhttps=1 THEN ‘是’ ELSE ‘否’ END ifcontainhttps, CASE WHEN ifcontainhttps=0 AND ifcontainpost=0 AND PORT=0 THEN ‘可服务’ ELSE ‘不可服务’ END canservice , CASE WHEN ifcontainhttps=0 AND ifcontainpost=0 AND PORT=0 AND t1

FROM zxcdn_spider.t_domainres a LIMIT 0,10 ===================================================================================================== 从A可缓存性分析页面跳转到B域名资源分析页面，现在增加从B域名资源分析页面返回到A可缓存性分析页面使用，在B域名资源分析页面添加函数： function resAnalyze(domain){ var domain = form1.domain.value; if(domain==”“){

.umapMessager.alert(“”,””,”info”);
        return ;
    }
    window.location=” $.umapMessager.alert(“”,””,”info”); return ; } window.location=”$ {pageContext.request.contextPath}/iam/cacheadvice_init.action?domain=” + domain; } A可缓存性分析页面需要注意的是：用代替原来的，

否则跳过来的页面不带domain信息。 ===================================================================================================== 如果在输入框只输入部分字符就给提示：引入添加js代码：

(“#domain”).typeahead({
items:10,
source: function (query, process) { $(“#domain”).typeahead({ items:10, source: function (query, process) {$ .post("${pageContext.request.contextPath}/iam/cacheanalyze_queryDomain.action”, {“domain”:query}, function (resp) { process(resp.list); },”json”); } }); 需要action类提供支持： public String queryDomain() { List domainList = cacheAnalyzeService.queryDomain(domain); JSONObject obj = new JSONObject(); obj.put(“list”, domainList); CommonUtil.writeoutJSONObject(obj); return NONE; } 对应dao类： public List queryDomain(String domain){ String sql=”select domain from zxcdn_spider.t_domainres where domain like ? limit 10”; return jdbcTemplate.queryForList(sql, String.class, new Object[]{ “%”+domain+”%”});

} ===================================================================================================== UTV报表频道channel取的有问题，师傅的备份方法 2017-01-05 15:27:51*[李青川10117882]说: _utv_channel SET fieldname = channelnum; 2017-01-05 15:27:51*[李青川10117882]说: CREATE TABLE t_utv_channel_3141 SELECT * FROM t_utv_channel;

UPDATE t ===================================================================================================== 分析结果至t_domainres 昊总原来的代码： replace into zxcdn_spider.t_domainres( domain ,cp,status, totalcount,t1,t2,t3,t4,t5 ,s, result , lasttime,port,ifcontainhttps) select ?’domain’,null , ‘4’ , b.total, b.t1/b.total,b.t2/staticount,b.t3/b.staticount,b.t4/b.staticount ,b.t5/b.staticount , null,null,now(),?’port’,?’ifcontainhttps’ from (select count(1) total ,sum(case when ifstatic =0 then 1 else 0 end ) t1 , sum(ifstatic) staticount , sum(case when ifcachecode=1 and ifstatic=1 then 1 else 0 end ) t2 , sum( case when ifstaticcache =0 and ifstatic=1 then 1 else 0 end )t3, sum(case when ( contentlength >= ?’Fmax’ or contentlength

}

增加延迟启动，可以直接在数据库里面操作时间延迟
REPLACE INTO zxcdn_spider.t_dpitask (taskid,deviceid,duration,top,STATUS,createtime,starttime)

VALUE (‘16’,’1’,’180’,’3000’,’1’,NOW(),DATE_ADD(NOW(), INTERVAL 120 MINUTE))

四舍五入函数

SELECT duration ,ROUND(duration/60) FROM zxcdn_spider.t_dpitask

自己写的用get方法请求的测试方法
package Amazn;

import org.apache.http.HttpEntity;
import org.apache.http.HttpHost;
import org.apache.http.HttpResponse;
import org.apache.http.HttpStatus;
import org.apache.http.client.config.RequestConfig;
import org.apache.http.client.methods.HttpGet;
import org.apache.http.entity.ContentType;
import org.apache.http.impl.client.CloseableHttpClient;
import org.apache.http.impl.client.HttpClientBuilder;
import org.apache.http.util.EntityUtils;

public class Main {

private static String HTTPURL = "http://icp.chinaz.com";

// private static String HTTPURL = “http://it.zte.com.cn“;
// private static String HTTPURL = “http://www.163.com/“;
//http://it.zte.com.cn:8080/its/app/articlePub/RkmArticlePub/getOneClass.action?type=searchJsp&searchValue=google

public static void main(String[] args) {
    System.out.println("=============爬虫开始=============");
    CloseableHttpClient httpClient = HttpClientBuilder.create().build();

// HttpClient httpClient = new DefaultHttpClient();
HttpGet httpRequest = new HttpGet(HTTPURL);
HttpResponse response = null;
//设置代理(可选)
HttpHost proxy = new HttpHost(“proxysz.zte.com.cn”, 80, “http”);
//超时设置
RequestConfig requestConfig = RequestConfig.custom()
.setConnectTimeout(5000)
.setConnectionRequestTimeout(5000)
.setSocketTimeout(50000)//setSocketTimeout()设置的太小可能会出现Read timed out超时异常
.setProxy(proxy).build();
httpRequest.setConfig(requestConfig);

    try {
        response = httpClient.execute(httpRequest);
        if(response.getStatusLine().getStatusCode()==HttpStatus.SC_OK){
            //获取响应实体
            HttpEntity entity = response.getEntity();
            //获取响应的body部分
            String strResult = EntityUtils.toString(entity);
            System.out.println("body:"+strResult);
            //获取响应的媒体类型
            String contentMimeType = ContentType.getOrDefault(entity).getMimeType();
            System.out.println("MimeType:"+contentMimeType);
        }else{
            System.out.println("请求错误！");
        }
    } catch (Exception e) {
        e.printStackTrace();
    } finally{
        httpClient.getConnectionManager().shutdown();
    }
}

}

=====================================================================================================
有待改进的post方法请求
private static String HTTPURL = “http://icp.chinaz.com/searchs“;
public static String CONTENT_ENCODE = “UTF-8”;

public static void main(String[] args) {
System.out.println(“=============爬虫开始=============”);
CloseableHttpClient httpClient = HttpClientBuilder.create().build();
HttpPost httpPost = new HttpPost(HTTPURL);
CloseableHttpResponse response = null;
//设置代理(可选)
HttpHost proxy = new HttpHost(“proxysz.zte.com.cn”, 80, “http”);
//超时设置
RequestConfig requestConfig = RequestConfig.custom()
.setConnectTimeout(5000)
.setConnectionRequestTimeout(5000)
.setSocketTimeout(50000)//setSocketTimeout()设置的太小可能会出现Read timed out超时异常
.setProxy(proxy).build();
httpPost.setConfig(requestConfig);
//设置请求头
httpPost.setHeader(“Content-Type”, “application/x-www-form-urlencoded”);
List params = new ArrayList();
params.add(new BasicNameValuePair(“urls”, “163.com”+”\r\n”+”youkuaiyun.com”));
params.add(new BasicNameValuePair(“btn_search”, “查询”));
try {
//添加参数
httpPost.setEntity(new UrlEncodedFormEntity(params,CONTENT_ENCODE));
//发送post请求
System.out.println(“发送post请求：” + httpPost.getURI());
response = httpClient.execute(httpPost);
if(response.getStatusLine().getStatusCode()==HttpStatus.SC_OK){
//获取响应实体
HttpEntity entity = response.getEntity();
//获取响应的body部分
System.out.println(“————————————————–”);
String html = EntityUtils.toString(entity);
System.out.println(“body:”+html);
System.out.println(“————————————————–”);
//获取响应的媒体类型
String contentMimeType = ContentType.getOrDefault(entity).getMimeType();
System.out.println(“MimeType:”+contentMimeType);//MimeType:text/html
}else{
System.out.println(“请求错误！”);
}
} catch (Exception e) {
e.printStackTrace();
} finally{
try {
response.close();
} catch (IOException e) {
e.printStackTrace();
}
}
}

=====================================================================================================
INSERT INTO zxcdn_spider.t_domaininfo(domain) SELECT ‘sohu.com’ FROM DUAL WHERE NOT EXISTS(SELECT domain FROM zxcdn_spider.t_domaininfo WHERE domain=’sohu.com’);

插入前检测重复字段，如果有就不插入，区别于replace into是覆盖式替换

可缓存分析页面的导出文件加了等待提示
这是原来的代码，备份一下
/*可缓存性分析-导出结果
* 分普通查询导出和高级查询导出两种方式
* */
public String exportDomainRes(){
boolean queryFlag;
if(StringUtils.isEmpty(domainList)){
queryFlag = true;//普通查询
}else{
queryFlag = false;//高级查询
}
int pageSize=4000;
SXSSFWorkbook wb = new SXSSFWorkbook();
Sheet sheet = wb.createSheet();
Row head = sheet.createRow(0);
head.createCell(0).setCellValue(getText(“iam.nodereport.domain”));
head.createCell(1).setCellValue(getText(“iam.analyze.staticproportion”));
head.createCell(2).setCellValue(“HTTPS”);
head.createCell(3).setCellValue(getText(“iam.analyze.cacheproportion”));
head.createCell(4).setCellValue(getText(“iam.analyze.port”));
head.createCell(5).setCellValue(getText(“iam.analyze.serveable”));
head.createCell(6).setCellValue(getText(“iam.analyze.cacheadvice”));
head.createCell(7).setCellValue(“站点名称”);
head.createCell(8).setCellValue(“备案号”);
head.createCell(9).setCellValue(getText(“iam.please.explanation”));
int j=1;
List list = null;
for (int i = 0;; i++) {
if(queryFlag){
list = cacheAnalyzeService.queryDomainRes(“domain”,wsname,i * pageSize, pageSize);
}else{
list = cacheAnalyzeService.queryDomainRes(domainList,null,i * pageSize, pageSize);
}
if (CollectionUtils.isEmpty(list)) {
break;
}
for (Map map : list) {
Row row = sheet.createRow(j);
row.createCell(0).setCellValue(String.valueOf(map.get(“domain”)));
row.createCell(1).setCellValue(String.valueOf(map.get(“t1”)));
row.createCell(2).setCellValue(String.valueOf(map.get(“ifcontainhttps”)));
row.createCell(3).setCellValue(String.valueOf(map.get(“s”)));
row.createCell(4).setCellValue(String.valueOf(map.get(“port”)));
row.createCell(5).setCellValue(String.valueOf(map.get(“canservice”)));
row.createCell(6).setCellValue(String.valueOf(map.get(“cancache”)));
row.createCell(7).setCellValue(String.valueOf(map.get(“wsname”)));
row.createCell(8).setCellValue(String.valueOf(map.get(“casenum”)));
row.createCell(9).setCellValue(String.valueOf(map.get(“info”)));
j++;
}
}

HttpServletResponse response = ServletActionContext.getResponse();
response.addHeader("Content-Disposition", "attachment;filename=" +"report.xlsx");
response.setContentType("application/octet-stream");
try {
    wb.write(response.getOutputStream());
} catch (IOException e) {
    e.printStackTrace();
}
return NONE;

}

/*可缓存性分析-导出原始数据
* */
public String exportDomainResOriginal(){
int pageSize=4000;
SXSSFWorkbook wb = new SXSSFWorkbook();
Sheet sheet = wb.createSheet();
Row head = sheet.createRow(0);
head.createCell(0).setCellValue(“domain”);
head.createCell(1).setCellValue(“cp”);
head.createCell(2).setCellValue(“status”);
head.createCell(3).setCellValue(“totalcount”);
head.createCell(4).setCellValue(“t1”);
head.createCell(5).setCellValue(“t2”);
head.createCell(6).setCellValue(“t3”);
head.createCell(7).setCellValue(“t4”);
head.createCell(8).setCellValue(“t5”);
head.createCell(9).setCellValue(“s”);
head.createCell(10).setCellValue(“result”);
head.createCell(11).setCellValue(“port”);
head.createCell(12).setCellValue(“ifcontaihttps”);
head.createCell(13).setCellValue(“lasttime”);
head.createCell(14).setCellValue(“ifcontainpost”);
head.createCell(15).setCellValue(“wsname”);
head.createCell(16).setCellValue(“casenum”);
int j=1;
for (int i = 0;; i++) {
List list = cacheAnalyzeService.queryDomainResOriginal(null,null,i * pageSize, pageSize);
if (CollectionUtils.isEmpty(list)) {
break;
}
for (Map map : list) {
Row row = sheet.createRow(j);
row.createCell(0).setCellValue(String.valueOf(map.get(“domain”)));
row.createCell(1).setCellValue(String.valueOf(map.get(“cp”)));
row.createCell(2).setCellValue(String.valueOf(map.get(“status”)));
row.createCell(3).setCellValue(String.valueOf(map.get(“totalcount”)));
row.createCell(4).setCellValue(String.valueOf(map.get(“t1”)));
row.createCell(5).setCellValue(String.valueOf(map.get(“t2”)));
row.createCell(6).setCellValue(String.valueOf(map.get(“t3”)));
row.createCell(7).setCellValue(String.valueOf(map.get(“t4”)));
row.createCell(8).setCellValue(String.valueOf(map.get(“t5”)));
row.createCell(9).setCellValue(String.valueOf(map.get(“s”)));
row.createCell(10).setCellValue(String.valueOf(map.get(“result”)));
row.createCell(11).setCellValue(String.valueOf(map.get(“port”)));
row.createCell(12).setCellValue(String.valueOf(map.get(“ifcontainhttps”)));
row.createCell(13).setCellValue(String.valueOf(map.get(“lasttime”)));
row.createCell(14).setCellValue(String.valueOf(map.get(“ifcontainpost”)));
row.createCell(15).setCellValue(String.valueOf(map.get(“wsname”)));
row.createCell(16).setCellValue(String.valueOf(map.get(“casenum”)));
j++;
}
}

HttpServletResponse response = ServletActionContext.getResponse();
response.addHeader("Content-Disposition", "attachment;filename=" +"reportOriginal.xlsx");
response.setContentType("application/octet-stream");
try {
    wb.write(response.getOutputStream());
} catch (IOException e) {
    e.printStackTrace();
}
return NONE;

}

导出excel添加页面变灰等待提示
function exportOriginExcel(){
//if( $(‘#exportForm’).length<=0){ //var exportForm = ‘‘; //exportForm+=’‘; //$(‘body’).append(exportForm); //} //var$ form = $(‘#exportForm’).attr(‘action’, ‘$ {pageContext.request.contextPath}/iam/cacheanalyze_exportDomainResOriginal.action’);
// $form.get(0).submit(); layer.load(2,{ shade: [0.2, ‘#000’] //打开load，设置0.5透明度的白色背景 });$ .ajax({
“type”: “post”,
“url”: “ ${pageContext.request.contextPath}/iam/cacheanalyze_prepareExportDomainResOriginal.action?t=” + (new Date()).valueOf(), “dataType”: “json”, “data”: {}, “success”: function(resp){ layer.closeAll();//关闭load if(resp.result == 0){//文件准备完成即下载 window.location.href=”$ {pageContext.request.contextPath}/cacheDoc/reportOriginal.xlsx”;
}else{//文件不存在
$.umapMessager.alert(“”,””);
}
}
});