TMMI_测试过程改进框架_已定义级别6_非功能测试7

Generic Practices by Goals 通用实践和目的

GG 2 Institutionalize a Managed Process 制度化管理过程

GP 2.1 Establish an organizational policy

Establish and maintain an organizational policy for planning and performing the Non-functional Testing process. Elaboration The policy for non-functional testing typically specifies:  Typical quality attributes that are important to the business and products  A set of important and relevant quality attributes per test level  The level of test automation and type of tools required  The incident classification scheme to be used when non-functional test incidents are documented and reported  The document procedure to be used to evaluate, classify and process reported non-functional test incidents

GP 2.2 Plan the process

Establish and maintain the plan for performing the Non-functional Testing process. Elaboration Typically, the plan for performing the Non-functional Testing process is included in the test plan, which is described in the Test Planning process area. The activities for non-functional testing are explicitly scheduled as part of the test plan.

GP 2.3 Provide resources

Provide adequate resources for performing the Non-functional Testing process, developing the test work products, and providing the services of the process. Elaboration  Adequate time is provided to perform the non-functional test planning, design and execution activities  Experienced individuals, who have expertise in non-functional testing activities and tools are available  Experienced individuals, who have expertise in the application domain of the test object and those who have expertise in the development process are available to support the development of the non-functional test approach, e.g., participating in product risk analysis sessions and the nonfunctional test designs, as well as participating at reviews  Tools to support the non-functional test design and execution process are available Examples of tools include the following:  Monitoring tool  Performance tool  Static analysis tool  Dynamic analysis tool

GP 2.4 Assign responsibilities

Assign responsibility and authority for performing the Non-functional Testing process, developing the work products, and providing the services of Non-functional Testing process.

GP 2.5 Train people

Train the people performing or supporting the Non-functional Testing process as needed. Elaboration Test specialists, and other individuals or groups, involved in non-functional testing, are trained in nonfunctional testing and the accompanying procedures, techniques and tools. Examples training topics include the following:  The importance of non-functional testing  Quality attributes (e.g., ISO 9126)  Product risk analysis for non-functional testing  Defining a test approach for non-functional testing  Formal and informal test techniques for non-functional testing  Exit criteria for non-functional attributes  Supporting tools

GP 2.6 Manage configurations

Place selected work products of the Non-functional Testing process under appropriate levels of configuration control. Elaboration Examples of work products placed under configuration management include the following:  Non-functional product risk assessment data  Non-functional test design specifications  Non-functional test case specifications  Non-functional test procedure specifications (and/or test scripts)  Test logs

GP 2.7 Identify and involve relevant stakeholders

Identify and involve relevant stakeholders of the Non-functional Testing process as planned. Elaboration Examples of activities for stakeholder involvement include:  During the product risk assessment, identifying the non-functional risks of the product and product components to be tested  Reviewing and approving the non-functional test designs and test cases  Executing tests, e.g., usability testing by end users

GP 2.8 Monitor and control the process

Monitor and control the Non-functional Testing process against the plan for performing the process and take appropriate actions. Elaboration Examples of review and/or audit topics for evaluation and adherence include the following:  Number of non-functional test specifications completed  Number of non-functional tests executed  Number of non-functional risks mitigated  Number of outstanding non-functional incidents (per priority level)

GP 2.9 Objectively evaluate adherence

Objectively evaluate adherence of the Non-functional Testing process and selected work products against the process description, standards, and procedures, and address non-compliances. Elaboration Examples of review and/or audit evaluation adherence topics include the following:  Compliance with the non-functional aspects of the test strategy  The defined test approach for non-functional testing  The non-functional product risk assessment process  The effectiveness and efficiency of non-functional test design techniques  The quality of the non-functional test cases

GP 2.10 Review status with higher level management

Review the activities, status and results of Non-functional Testing process with higher level management and resolve issues.

GG 3 Institutionalize a Defined Process 制度化定义过程

GP 3.1 Establish a defined process

Establish and maintain a description of a defined Non-functional Testing process.

GP 3.2 Collect improvement information

Collect process related experiences derived from planning and performing the Non-functional Testing process to support the future use and improvement of the organization’s processes and process assets. Elaboration Examples of measures include the following:  Effort ratio of non-functional testing versus functional testing  Test effort spent per non-functional attribute  Number of non-functional attributes tested per project  Incident reports for non-functional attributes by priority and severity  Coverage achieved for non-functional requirements