Methods for Collecting and Analyzing User Experience Information in Online Product Reviews
-
摘要: 面向产品设计改进, 提出一种在线产品评论中用户体验信息采集与分析方法。首先构建用户体验要素模型; 然后, 依据要素模型采用分步提取的方法提取单个评论句中的用户情感、产品特征和使用情境三类要素; 最后, 对提取出的用户体验要素信息进行分类整合, 通过定量分析评论数据识别出对用户体验影响较大的产品特征和使用情境。以京东商城上某款智能手机的在线评论为例进行实例验证。实验结果表明, 方法能有效提取在线产品评论中的用户体验要素, 识别对用户体验产生较大影响的产品特征和使用情境, 辅助设计师有针对性地改进产品设计。Abstract: Aiming at the product design improvement, a collection and analysis method of user experience information in online product reviews was proposed. Firstly, an user experience element model was constructed. Then, according to the element model, the user emotion, product feature and usage context in a single review sentence were extracted step by step. Finally, the user experience elements extracted from a single review sentence were classified and integrated, and through quantitative analysis of the review data, the product features and use contexts that have a greater impact on user experience were identified. The method was verified by taking the online reviews of a smart phone on Jingdong Mall as the example. The experimental results show that the method can effectively extract the user experience elements from online product reviews, identify the product features and use contexts that have a great impact on the user experience, and assist designers to improve the product design.
-
Key words:
- user experience /
- online product reviews /
- element model /
- design improvement
-
表 1 情感词典中部分情感词
情感词极性 个数 实例 正向情感词 207 好、完美、流畅、惊艳、… 负向情感词 122 差、失望、卡顿、模糊、… 表 2 产品特征与使用情境提取
评论要素 实例 产品特征 外观、相机、耳机、屏幕、闪光灯、… 使用情境 玩游戏时、阳光下、充电时、接电话、… 表 3 评论挖掘实验结果
评论要素 Precision Recall F-measure 产品特征 89.11% 83.56% 86.24% 使用情境 71.43% 60.50% 65.51% 用户情感 94.85% 91.02% 92.90% 表 4 对用户体验影响较大的产品特征
表 5 关于系统速度的关键使用情境
产品特征 情感极性 使用情境 评论数据量 系统速度 正向 玩游戏时 105 看视频时 66 负向 充电时 29 重启后 16 -
[1] 杨琨钰, 王伟伟. 我国用户体验设计发展研究分析[J]. 设计, 2020, 33(13): 117-119 https://www.cnki.com.cn/Article/CJFDTOTAL-SJTY202013037.htmYANG K Y, WANG W W. Research and analysis on development of user experience design in China[J]. Design, 2020, 33(13): 117-119 (in Chinese) https://www.cnki.com.cn/Article/CJFDTOTAL-SJTY202013037.htm [2] LIN C, CHENG L Y. Product attributes and user experience design: how to convey product information through user-centered service[J]. Journal of Intelligent Manufacturing, 2017, 28(7): 1743-1754 doi: 10.1007/s10845-015-1095-8 [3] ISO. ISO 9241-210 Ergonomics of human system interaction-Part 210: human-centered design for interactive systems[S]. Switzerland: ISO, 2019 [4] PARK J, HAN S H, KIM H K, et al. Developing elements of user experience for mobile phones and services: survey, interview, and observation approaches[J]. Human Factors and Ergonomics in Manufacturing & Service Industries, 2013, 23(4): 279-293 [5] 丁一, 郭伏, 胡名彩, 等. 用户体验国内外研究综述[J]. 工业工程与管理, 2014, 19(4): 92-97, 114 doi: 10.3969/j.issn.1007-5429.2014.04.013DING Y, GUO F, HU M C, et al. A review of uer experience[J]. Industrial Engineering and Management, 2014, 19(4): 92-97, 114 (in Chinese) doi: 10.3969/j.issn.1007-5429.2014.04.013 [6] 罗仕鉴, 龚蓉蓉, 朱上上. 面向用户体验的手持移动设备软件界面设计[J]. 计算机辅助设计与图形学学报, 2010, 22(6): 1033-1041 https://www.cnki.com.cn/Article/CJFDTOTAL-JSJF201006020.htmLUO S J, GONG R R, ZHU S S. User experience oriented software interface design of handheld mobile devices[J]. Journal of Computer-Aided Design & Computer Graphics, 2010, 22(6): 1033-1041 (in Chinese) https://www.cnki.com.cn/Article/CJFDTOTAL-JSJF201006020.htm [7] LIN K Y, CHIEN C F, KERH R. UNISON framework of data-driven innovation for extracting user experience of product design of wearable devices[J]. Computers & Industrial Engineering, 2016, 99: 487-502 [8] 胡飞, 周坤, 麦永治. 面向产品服务系统的用户体验可拓评价方法研究[J]. 机械设计, 2018, 35(2): 109-114 doi: 10.3969/j.issn.2095-509X.2018.02.025HU F, ZHOU K, MAI Y Z. Evaluation method of user experience for PSS based on Extenics[J]. Journal of Machine Design, 2018, 35(2): 109-114 (in Chinese) doi: 10.3969/j.issn.2095-509X.2018.02.025 [9] PARK J, HAN S H, KIM H K, et al. Modeling user experience: a case study on a mobile device[J]. International Journal of Industrial Ergonomics, 2013, 43(2): 187-196 doi: 10.1016/j.ergon.2013.01.005 [10] 唐帮备, 郭钢, 王凯, 等. 联合眼动和脑电的汽车工业设计用户体验评选[J]. 计算机集成制造系统, 2015, 21(6): 1449-1459 https://www.cnki.com.cn/Article/CJFDTOTAL-JSJJ201506006.htmTANG B B, GUO G, WANG K, et al. User experience evaluation and selection of automobile industry design with eye movement and electroencephalogram[J]. Computer Integrated Manufacturing Systems, 2015, 21(6): 1449-1459 (in Chinese) https://www.cnki.com.cn/Article/CJFDTOTAL-JSJJ201506006.htm [11] LI Z, TIAN Z G, WANG J W, et al. Extraction of affective responses from customer reviews: an opinion mining and machine learning approach[J]. International Journal of Computer Integrated Manufacturing, 2020, 33(7): 670-685 doi: 10.1080/0951192X.2019.1571240 [12] HE W. Improving user experience with case-based reasoning systems using text mining and Web 2.0[J]. Expert Systems with Applications, 2013, 40(2): 500-507 doi: 10.1016/j.eswa.2012.07.070 [13] 蒋盛益, 郭林东, 王连喜, 等. 评价对象抽取研究综述[J]. 自动化学报, 2018, 44(7): 1165-1182 https://www.cnki.com.cn/Article/CJFDTOTAL-MOTO201807002.htmJIANG S Y, GUO L D, WANG L X, et al. Survey on opinion target extraction[J]. Acta Automatica Sinica, 2018, 44(7): 1165-1182 (in Chinese) https://www.cnki.com.cn/Article/CJFDTOTAL-MOTO201807002.htm [14] 单晓红, 王春稳, 刘晓燕, 等. 基于在线评论的混合推荐算法[J]. 系统工程, 2019, 37(6): 130-138 doi: 10.3969/j.issn.1001-2362.2019.06.096SHAN X H, WANG C W, LIU X Y, et al. Hybrid recommendation algorithms based on online review[J]. Systems Engineering, 2019, 37(6): 130-138 (in Chinese) doi: 10.3969/j.issn.1001-2362.2019.06.096 [15] 王红霞, 陈健, 程艳芬. 采用评论挖掘修正用户评分的改进协同过滤算法[J]. 浙江大学学报(工学版), 2019, 53(3): 522-532 https://www.cnki.com.cn/Article/CJFDTOTAL-ZDZC201903013.htmWANG H X, CHEN J, CHENG Y F. Improved collaborative filtering algorithm to revise users' rating by review mining[J]. Journal of Zhejiang University (Engineering Science), 2019, 53(3): 522-532 (in Chinese) https://www.cnki.com.cn/Article/CJFDTOTAL-ZDZC201903013.htm [16] ROTO V. User experience building blocks[C]// Proceedings of the 2nd COST294-MAUSE Workshop-Towards a Unified View. New York: ACM, 2006: 124-128 [17] HASSENZAHL M, TRACTINSKY N. User experience-a research agenda[J]. Behaviour & Information Technology, 2006, 25(2): 91-97 [18] LIN C P. Learning online brand personality and satisfaction: the moderating effects of gaming engagement[J]. International Journal of Human-Computer Interaction, 2009, 25(3): 220-236 doi: 10.1080/10447310802629827 [19] LEE I, CHOI G W, KIM J, et al. Cultural dimensions for user experience: cross-country and cross-product analysis of users' cultural characteristics[C]//Proceedings of the 22nd British HCI Group Annual Conference on People and Computers: Culture, Creativity, Interaction. Liverpool: BCS HCI, 2008: 3-12 [20] WINCKLER M, BACH C, BERNHAUPT R. Identifying user experience dimensions for mobile incident reporting in urban contexts[J]. IEEE Transactions on Professional Communication, 2013, 56(2): 97-119 doi: 10.1109/TPC.2013.2257212 [21] 朱新华, 马润聪, 孙柳, 等. 基于知网与词林的词语语义相似度计算[J]. 中文信息学报, 2016, 30(4): 29-36 https://www.cnki.com.cn/Article/CJFDTOTAL-MESS201604004.htmZHU X H, MA R C, SUN L, et al. Word semantic similarity computation based on HowNet and CiLin[J]. Journal of Chinese Information Processing, 2016, 30(4): 29-36 (in Chinese) https://www.cnki.com.cn/Article/CJFDTOTAL-MESS201604004.htm [22] 邱云飞, 赵彬, 林明明, 等. 结合语义改进的K-means短文本聚类算法[J]. 计算机工程与应用, 2016, 52(19): 78-83 doi: 10.3778/j.issn.1002-8331.1412-0418QIU Y F, ZHAO B, LIN M M, et al. Improved K-means clustering algorithm combined semantic similarity of short text[J]. Computer Engineering and Applications, 2016, 52(19): 78-83 (in Chinese) doi: 10.3778/j.issn.1002-8331.1412-0418 [23] 任海兵, 周晶, 冯万群. 基于马田系统的智能手机用户体验评价研究[J]. 包装工程, 2017, 38(20): 204-210 https://www.cnki.com.cn/Article/CJFDTOTAL-BZGC201720044.htmREN H B, ZHOU J, FENG W Q. Evaluation of the smart phone user experience based on MTS[J]. Packaging Engineering, 2017, 38(20): 204-210 (in Chinese) https://www.cnki.com.cn/Article/CJFDTOTAL-BZGC201720044.htm -