Sikuli测试应用研究报告

 

最近Sikuli的作者发表了一份研究报告《GUI Testing Using Computer Vision》，在报告中阐述了Sikuli作为GUI测试工具的5个设计目标：

 

Based on the findings of this interview, we identified the following five design goals to guide the design and development of our new GUI testing tool:

• (G1) The tool should allow testers to write scripts to automate tests.

• (G2) The tool should not require testers to refer GUI components by names or by locations.

• (G3) The tool should minimize the instances when test scripts need to be modified due to design changes.

• (G4) The tool should minimize the effort of writing test scripts.

• (G5) The tool should support good testing practices such as unit testing, regression testing, and test-driven development.

 

  

在报告中同时还阐述了Sikuli应用在GUI自动化测试时的的可测性研究和可重用性研究。

  

表明大部分的GUI控件和操作模式都能得到支持。在选取的Capivara、jEdit等软件作为测试用例可重用性研究表明随着版本的演进，受到界面设计和交互设计改变的影响，测试用例的可重用性会逐步下降。

 

  

在报告的最后，作者也提到Sikuli Test目前存在的两大主要限制，一个是对于非预期的可视化反馈的检测，一个是不能测试GUI的内部功能。因此建议不要把Sikuli作为现有测试工具的替代品，而是一个有益的补充。

 

However, Sikuli Test currently has two major limitations that can be improved upon in the future. First, while Sikuli Test can assert what visual feedback is expected to appear or to disappear, it is unable to detect unexpected visual feedback. For example, if a programmer accidentally places a random image in a blank area, it is an undetectable error since no one would have anticipated the need to test that area with assertions. One solution would be to run the visual feedback detector at the test time to see if there is any detected visual feedback not covered by an assertion statement. Second, Sikuli Test is designed to test a GUI’s outward visual feedback and is thus unable to test the GUI’s internal functionalities. For example, while Sikuli Test can check if a visual feedback is correctly provided to the user who clicks the save button, it does not know if the file is indeed saved. One solution would be to treat Sikuli Test not as a replacement of but a complement to an existing testing tool. Together they make sure both the outward feedback and inward functionalities of a GUI can be sufficiently tested, a task neither can

accomplish alone.