A Study on a Quantitative Evaluation System for Navigation APPs
-
摘要: 在参考国内外主流手机软件(以下简称APP)评价体系与标准的基础上,以定量分析方式建立了导航类APP评价指标体系,提出了功能量化指标、用户体验类指标、软件开发者自评三位一体的评价方式,从主观(即用户体验)与客观(即软件功能)2个方面全面评测导航类APP.构建了行程时间预测准确率、路况信息覆盖率、定位准确率、路况信息分级准确率4个功能量化指标及其计算方法.建立了基于操作便捷度、信息准确度、流畅度、信息及时度、稳定度、满意度在内的六个用户体验指标.软件开发者自评价重点考察导航应用软件的信息源、传输模式以及软件功能.通过多目标的判定决策,根据多级评价中的最不利评级最终确定综合评价结果.以国内3款主流导航软件为案例,开展导航类APP量化评价方法实例应用.案例中,被测软件A功能量化指标得分分别为76.42%、76.24%、100%与76.53%,用户体验指标得分4.54,总评级为一级,与被测APP的市场份额及应用市场评价结果保持了良好的一致性,为市民出行选择导航应用以及开发人员改善系统软件功能提供重要参考.Abstract: Taking the most popular evaluation systems and standards for APPs all around the world as references, an evaluation index system for road navigation APPs is proposed.Quantitative measurements of functions, degrees of user experience, and self-evaluation by developers are set as indices.APPs are evaluated from both subjective and objective aspects.Four quantitative measurements along with correspondence algorithms are constructed, which are the accuracy of estimated travel time, coverage rate of information, accuracy of localization, and grading accuracy of traffic information.Six indicators are considered to assess the degrees of user experience for navigation APPs, including operational convenience, accuracy, fluency, and timeliness of information, stability, and satisfaction.Self-evaluation by developers mainly focuses on the quality of data source, transmission mode of information, and software features.The evaluation results for APPs are finally determined based on the most unfavorable rating in the multi-level evaluation.A case study is carried out by assessing three most popular APPs for road navigation in China.The results of four indicators for APP (A) are 76.42%, 76.24%, 100% and 76.53%, respectively.The score of user experience is 4.54, which indicates that APP (A) rating in the first level.The results are consistent with the market share of it as well as the results from market investigation, which verifies the usability and dependability of this proposed evaluation system.
-
Key words:
- traffic information /
- navigation APP /
- evaluation system /
- quantitative analysis
点击查看大图
计量
- 文章访问数: 227
- HTML全文浏览量: 47
- PDF下载量: 5
- 被引次数: 0