多媒体终端上新型压力交互范式研究

doi:10.13229/j.cnki.jdxbgxb.20220036

Abstract

Abstract:

The pressure-and multi-touch-based smartphone user interface uses multiple interaction techniques to improve input efficiency and reduce finger fatigue. With wide application prospect， it can enhance natural interaction and using experience between human and smartphone， which makes it simple to use. For interactions on pressure-and multi-touch-based smartphone user interface， aiming at the problems of lacking relevant graphic user interface paradigms and the limits of the existing paradigms， a new interface paradigm called LWHP for interaction on the mobile devices， and an algorithm predicting users' input intent and optimizing the division for pressure space using Bayesian method are presented. In LWHP paradigm， L means Layer， W means Widget， H means Hierarchical Menu， and P means Pressure+Gesture. Compared with WIMP paradigm， LWHP paradigm is designed on the desk metaphor， which extends the desktop metaphor from two dimensions to three dimensions， which decreases users' cognitive and learning load by imitating daily scenes and real working environment. Considering the different habit between individuals when interacting by pressure， the division of pressure spaces should be finer-adjusted according to their previous input. The optimizing algorithm collects the pressure signals， the properties of user behavior（Movement Time and Number of Crossings）， and the environmental information， and uses Bayesian method to interpret and predict users' input， which improves the accuracy and enhances natural interaction. At the end， a pressure-based album application designed with LWHP paradigm is described to illustrate how the new paradigm is applied and the advantages of these pressure-based components.

Key words: human-computer interaction, interface paradigm, user interface, pressure input, smartphone, component

CLC Number:

TP37

Gui-he QIN,Man-ying WANG,Ming-hui SUN. Research on a pressure-based interaction paradigm for multimedia terminal[J].Journal of Jilin University(Engineering and Technology Edition), 2023, 53(11): 3186-3193.

Figures/Tables 4

Fig.1

Fig.2

Fig.3

Fig.4

References 23

1	许为. 再论以用户为中心的设计: 新挑战和新机遇[J]. 人类工效学, 2017, 23(1): 82-86.
	Xu Wei. User-centered design(Ⅱ): new challenges and new chances[J]. Chinese Journal of Ergonomics, 2017, 23(1): 82-86.
2	范俊君, 田丰, 杜一, 等. 智能时代人机交互的一些思考[J]. 中国科学: 信息科学, 2018, 48(4): 361-375.
	Fan Jun-jun, Tian Feng, Du Yi, et al. Thoughts on human-computer interaction in the age of artificial intelligence[J]. Sci Sin Inform, 2018, 48(4): 361-375.
3	Corsten C, Lahaye M, Borchers J, et al. ForceRay: extending thumb reach via force input stabilizes device grip for mobile touch input[C]∥Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems, Glasgow, UK, 2019: 1-12.
4	Hakka K, Isomoto T, Shizuki B. One-handed interaction technique for single-touch gesture input on large smartphones[C]∥Symposium on Spatial User Interaction, New Orleans, USA, 2019: 1-2.
5	Corsten C, Voelker S, Link A, et al. Use the force picker, luke: space-efficient value input on force-sensitive mobile touchscreens[C]∥Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems, Montreal, Canada, 2018: 1-12.
6	Lumsden J, Brewster S. A paradigm shift for mobile interaction: a decade later[C]∥Proceedings of the 2013 Conference of the Center for Advanced Studies on Collaborative Research, Toronto, Canada, 2013: 2-9.
7	Brewster S A, Hughes M. Pressure-based text entry for mobile devices[C]∥Proceedings of the 11th International Conference on Human-Computer Interaction with Mobile Devices and Services, Bonn, Germany, 2009: 1-4.
8	Hsiu M C, Huang D Y, Chen C, et al. ForceBoard: using force as input technique on size-limited soft keyboard[C]∥Proceedings of the 18th International Conference on Human-Computer Interaction with Mobile Devices and Services Adjunct, Florence, Italy, 2016: 599-604.
9	Green M, Jacob R. SIGGRAPH'90 workshop report: software architectures and metaphors for non-WIMP user interfaces[J]. ACM SIGGRAPH Computer Graphics, 1991, 25(3): 229-235.
10	Dam A V. Post-WIMP user interfaces[J]. Communications of the ACM, 1997, 40(2): 63-67.
11	Jacob R J K, Girouard A, Hirshfield L M, et al. Reality-based interaction: a framework for post-WIMP interfaces[C]∥Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, Toronto, Canada, 2008: 201-210.
12	石磊, 邓昌智, 戴国忠. 一种 Post-WIMP 界面: PGIS 的实现[J]. 中国图象图形学报, 2010, 15(7): 985-992.
	Shi Lei, Deng Chang-zhi, Dai Guo-zhong. Implementation of PGIS: a type of post-WIMP user interface[J]. Journal of Image and Graphics, 2010, 15(7): 985-992.
13	Robbins D C, Lee B, Fernandez R. TapGlance: designing a unified smartphone interface[C]∥Proceedings of the 7th ACM conference on Designing interactive systems, Cape Town, South Africa, 2008: 386-394.
14	张小龙, 吕菲, 程时伟. 智能时代的人机交互范式[J]. 中国科学: 信息科学, 2018, 48: 406-418.
	Zhang Xiao-long, Fei Lyu, Cheng Shi-wei. Interaction paradigm in intelligent systems[J]. Sci Sin Inform, 2018, 48: 406-418.
15	Kay M, Nelson G L, Hekler E B. Researcher-centered design of statistics: why Bayesian statistics better fit the culture and incentives of HCI[C]∥Proceedings of the 2016 CHI Conference on Human Factors in Computing Systems, San Jose, USA, 2016: 4521-4532.
16	王利民,刘洋,孙铭会,等. 基于Markov blanket的无约束型K阶贝叶斯集成分类模型[J]. 吉林大学学报: 工学版, 2018, 48(6): 1851-1858.
	Wang Li-min, Liu Yang, Sun Ming-hui, et al. Ensemble of unrestricted K-dependence Bayesian classifiers based on Markov blanket[J]. Journal of Jilin University(Engineering and Technology Edition), 2018, 48(6): 1851-1858.
17	Goodman J, Venolia G, Steury K, et al. Language modeling for soft keyboards[C]∥Proceedings of the 7th International Conference on Intelligent User Interfaces, San Francisco, USA, 2002: 194-195.
18	Yu C, Sun K, Zhong M, et al. One-dimensional handwriting: inputting letters and words on smart glasses[C]∥Proceedings of the 2016 CHI Conference on Human Factors in Computing Systems, San Jose, USA, 2016: 71-82.
19	秦贵和,黄俊锋,孙铭会. 基于双手键盘的虚拟现实文本输入[J]. 吉林大学学报: 工学版, 2022, 52(8): 1881-1888.
	Qin Gui-he, Huang Jun-feng, Sun Ming-hui. Text input based on two-handed keyboard in virtual environment[J]. Journal of Jilin University(Engineering and Technology Edition), 2022, 52(8): 1881-1888.
20	易鑫, 喻纯, 史元春. 普适计算环境中用户意图推理的 Bayes 方法[J]. 中国科学: 信息科学, 2018, 48: 419-432.
	Yi Xin, Yu Chun, Shi Yuan-chun. Bayesian method for intent prediction in pervasive computing environments[J]. Sci Sin Inform, 2018, 48: 419-432.
21	Ramos G, Boulos M, Balakrishnan R. Pressure widgets[C]∥Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, Toronto, Canada, 2004: 487-494.
22	文涛, 李雪, 李晟, 等. 手机输入法可用性评估研究[J]. 人类工效学, 2012, 18(2): 27-31.
	Wen Tao, Li Xue, Li Sheng, et al. Usability evaluation of input methods in mobile phone[J]. Chinese Journal of Ergonomics, 2012, 18(2): 27-31.
23	Wang F, Ren X. Empirical evaluation for finger input properties in multi-touch interaction[C]∥Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, Toronto, Canada, 2009: 1063-1072.

Related Articles 15

[1]	Shi-jun SONG,Min FAN. Design of big data anomaly detection model based on random forest algorithm [J]. Journal of Jilin University(Engineering and Technology Edition), 2023, 53(9): 2659-2665.
[2]	Yan LI,Jiu-peng ZHANG,Zi-xuan CHEN,Guo-jing HUANG,Pei WANG. Evaluation of asphalt pavement performance based on PCA⁃PSO⁃SVM [J]. Journal of Jilin University(Engineering and Technology Edition), 2023, 53(6): 1729-1735.
[3]	Sui-ning ZHENG,Rui HE,Tian-yu LU,Zi-yi XU,Hua-xin CHEN. Preparation and evaluation of RET/rubber composite modified asphalt and asphalt mixture [J]. Journal of Jilin University(Engineering and Technology Edition), 2023, 53(5): 1381-1389.
[4]	Yong-fei ZHANG,Tao CHEN. Design of communication data classification algorithm based on fuzzy segmentation of time series [J]. Journal of Jilin University(Engineering and Technology Edition), 2023, 53(11): 3268-3273.
[5]	Lin JIANG,Li YANG,Wen-jun ZHANG,Qiong-yu ZHANG,Yan-xia WU. Detection and processing algorithm of slope point cloud in obstacle detection [J]. Journal of Jilin University(Engineering and Technology Edition), 2023, 53(11): 3221-3228.
[6]	Shu-yang SUN,Wei-bin CHENG,Hao-zhen ZHANG,Xiang-ping DENG,Hong QI. Deep-learning-based two-stage approach for real-time explicit topology optimization [J]. Journal of Jilin University(Engineering and Technology Edition), 2023, 53(10): 2942-2951.
[7]	Qiang GUO,Ming-song LI,Kai ZHOU. Multi⁃mode radar signal sorting based on potential distance graph and improved cloud model [J]. Journal of Jilin University(Engineering and Technology Edition), 2022, 52(8): 1904-1911.
[8]	Gui-he QIN,Jun-feng HUANG,Ming-hui SUN. Text input based on two⁃handed keyboard in virtual environment [J]. Journal of Jilin University(Engineering and Technology Edition), 2022, 52(8): 1881-1888.
[9]	Zhen CAO,Lu-yao CUI,Bin LEI,Jing-yi WANG,Shuang-sheng CAO. Feature dimensionality reduction and random forest method in intelligent diagnosis of rolling bearings for urban rail trains [J]. Journal of Jilin University(Engineering and Technology Edition), 2022, 52(10): 2287-2293.
[10]	Hong-xue LI,Shi-wu LI,Wen-cai SUN,Wei LI,Meng-zhu GUO. Driving cycle construction of heavy semi⁃trailers carrying hazardous cargos [J]. Journal of Jilin University(Engineering and Technology Edition), 2021, 51(5): 1700-1707.
[11]	Lao-hu YUAN,Dong-shan LIAN,Liang ZHANG,Yi LIU. Fault diagnosis of key mechanical components of aircraft based on densenet and support vector machine [J]. Journal of Jilin University(Engineering and Technology Edition), 2021, 51(5): 1635-1641.
[12]	Jia-cheng YUAN,Chang WANG,Kun HE,Xing-yu WAN,Qing-xi LIAO. Effect of components mass ratio under sieve on cleaning system performance for rape combine harvester [J]. Journal of Jilin University(Engineering and Technology Edition), 2021, 51(5): 1897-1907.
[13]	Yuan-ning LIU,Di WU,Xiao-dong ZHU,Qi-xian ZHANG,Shuang-shuang LI,Shu-jun GUO,Chao WANG. User interface components detection algorithm based on improved YOLOv3 [J]. Journal of Jilin University(Engineering and Technology Edition), 2021, 51(3): 1026-1033.
[14]	Nai-yan GUAN,Juan-li GUO. Component awareness adaptive model based on attitude estimation algorithms [J]. Journal of Jilin University(Engineering and Technology Edition), 2020, 50(5): 1850-1855.
[15]	Li-qun WU,Liang-liang ZHANG. Health detection of bridge structures based on data mining technology [J]. Journal of Jilin University(Engineering and Technology Edition), 2020, 50(2): 565-571.

Metrics

Viewed

Full text

Abstract

Cited

Shared

Discussed

Comments

Recommended 10

[1]	LI Shoutao, LI Yuanchun. Autonomous Mobile Robot Control Algorithm Based on Hierarchical Fuzzy Behaviors in Unknown Environments[J]. 吉林大学学报(工学版), 2005, 35(04): 391 -397 .
[2]	Liu Qing-min，Wang Long-shan，Chen Xiang-wei，Li Guo-fa. Ball nut detection by machine vision[J]. 吉林大学学报(工学版), 2006, 36(04): 534 -538 .
[3]	Li Hong-ying; Shi Wei-guang;Gan Shu-cai. Electromagnetic properties and microwave absorbing property of Z type hexaferrite Ba_3-xLa_xCo₂Fe₂₄O₄₁[J]. 吉林大学学报(工学版), 2006, 36(06): 856 -0860 .
[4]	Zhang Quan-fa，Li Ming-zhe，Sun Gang，Ge Xin . Comparison between flexible and rigid blank-holding in multi-point forming[J]. 吉林大学学报(工学版), 2007, 37(01): 25 -30 .
[5]	Yang Shu-kai, Song Chuan-xue, An Xiao-juan, Cai Zhang-lin . Analyzing effects of suspension bushing elasticity on vehicle yaw response character with virtual prototype method[J]. 吉林大学学报(工学版), 2007, 37(05): 994 -0999 .
[6]	. [J]. 吉林大学学报(工学版), 2007, 37(06): 1284 -1287 .
[7]	Che Xiang-jiu，Liu Da-you，Wang Zheng-xuan . Construction of joining surface with G¹ continuity for two NURBS surfaces[J]. 吉林大学学报(工学版), 2007, 37(04): 838 -841 .
[8]	Liu Han-bing, Jiao Yu-ling, Liang Chun-yu,Qin Wei-jun . Effect of shape function on computing precision in meshless methods[J]. 吉林大学学报(工学版), 2007, 37(03): 715 -0720 .
[9]	Li Yue-ying，Liu Yong-bing，Chen Hua . Surface hardening and tribological properties of a cam materials[J]. 吉林大学学报(工学版), 2007, 37(05): 1064 -1068 .
[10]	Zhang He-sheng, Zhang Yi, Wen Hui-min, Hu Dong-cheng . Estimation approaches of average link travel time using GPS data[J]. 吉林大学学报(工学版), 2007, 37(03): 533 -0537 .

Research on a pressure-based interaction paradigm for multimedia terminal

RICH HTML

PDF (PC)