Hostname: page-component-77f85d65b8-lfk5g Total loading time: 0 Render date: 2026-03-27T18:20:17.109Z Has data issue: false hasContentIssue false

A wearable wrist haptic display for motion tracking and force feedback in the operational space

Published online by Cambridge University Press:  14 May 2021

Marco Laghi*
Affiliation:
Soft Robotics for Human Cooperation and Rehabilitation, Istituto Italiano di Tecnologia, Genova, Italy Centro di Ricerca “Enrico Piaggio,” Universitá di Pisa, Pisa, Italy
Manuel G. Catalano
Affiliation:
Soft Robotics for Human Cooperation and Rehabilitation, Istituto Italiano di Tecnologia, Genova, Italy
Giorgio Grioli
Affiliation:
Soft Robotics for Human Cooperation and Rehabilitation, Istituto Italiano di Tecnologia, Genova, Italy
Antonio Bicchi
Affiliation:
Soft Robotics for Human Cooperation and Rehabilitation, Istituto Italiano di Tecnologia, Genova, Italy Centro di Ricerca “Enrico Piaggio,” Universitá di Pisa, Pisa, Italy
*
*Corresponding author: Email: marco.laghi89@gmail.com

Abstract

Force feedback is often beneficial for robotic teleoperation, as it enhances the user’s remote perception. Over the years, many kinesthetic haptic displays (KHDs) have been proposed for this purpose, which have different types of interaction and feedback, depending on their kinematics and their interface with the operator, including, for example, grounded and wearable devices acting either at the joint or operational space (OS) level. Most KHDs in the literature are for the upper limb, with a majority acting at the shoulder/elbow level, and others focusing on hand movements. A minority exists which addresses wrist motions. In this paper, we present the Wearable Delta (W$ \Delta $), a proof-of-concept wearable wrist interface with hybrid parallel–serial kinematics acting in the OS, able to render a desired force directly to the hand involving just the forearm–hand subsystem. It has six degrees of freedom (DoFs), three of which are actuated, and is designed to reduce the obstruction of the range of the user’s wrist. Integrated with positions/inertial sensors at the elbow and upper arm, the W$ \Delta $ allows the remote control of a full articulated robotic arm. The paper covers the whole designing process, from the concept to the validation, as well as a multisubject experimental campaign that investigates its usability. Finally, it presents a section that, starting from the experimental results, aims to discuss and summarize the W$ \Delta $ advantages and limitations and look for possible future improvements and research directions.

Information

Type
Research Article
Creative Commons
Creative Common License - CCCreative Common License - BYCreative Common License - NCCreative Common License - SA
This is an Open Access article, distributed under the terms of the Creative Commons Attribution-NonCommercial-ShareAlike licence (http://creativecommons.org/licenses/by-nc-sa/4.0/), which permits non-commercial re-use, distribution, and reproduction in any medium, provided the same Creative Commons licence is included and the original work is properly cited. The written permission of Cambridge University Press must be obtained for commercial re-use.
Copyright
© The Author(s), 2021. Published by Cambridge University Press
Figure 0

Figure 1. Scheme of generalized interaction between operator and kinesthetic haptic display. $ {f}_{c_i},i=1,\dots, 4 $ are the exchanged forces between the human and the interface at the contact points (assumed to be 4 for simplicity). The force exchanged through the first contact point $ {f}_{c_1} $ is also called $ {f}_B $, whereas the last ($ {f}_{c_4} $) is called $ {f}_E $. The second and third are then collected in the vector $ {f}_C={\left[{f}_{c_2}^T\;{f}_{c_3}^T\right]}^T $. $ {f}_{GH} $ and $ {f}_{GI} $ denote the contact forces with the ground of the human and the mechanism, respectively.

Figure 1

Table 1. Classification of existing kinesthetic haptic displays and relative examples.

Figure 2

Figure 2. Picture of the W$ \Delta $ worn, complete with sensorized elbow brace and Myo armband for the arm trajectory tracking: (a) front and (b) back views.

Figure 3

Figure 3. Technical drawings and information of the W$ \Delta $: (a) real device aspect with its different functional components highlighted; (b) tech drawings of the three main parts with highlighted lengths defined in the device; and (c) table summarizing the chosen values of the different dimensions interested in the design.

Figure 4

Table 2. Range of motion (ROM) of human (a) forearm supination/pronation, (b) wrist abduction/adduction, and (c) wrist flexion/extension and length ranges of (d) forearm and (e) hand (wrist–palm’s center) human segments

Figure 5

Table 3. Device torques and forces summary. Columns divided in: (a) maximum continuous and (b) peak values (both from data sheet), and (c) used ones (through software saturation)

Figure 6

Table 4. The custom 7-point Likert scale questionnaire for the comparison of the two leader interfaces

Figure 7

Figure 4. Setup used for the characterization: the Delta has the base anchored to the table, and the plate attached to the Franka robot end effector through the ATI mini45-e F/T sensor. The Franka end-effector rotation is blocked so to be always look perpendicular to the table plane, while it is moved to pose the Delta plate in the interested position.

Figure 8

Figure 5. Results of the three motors’ characterization ([a] first, [b] second, and [c] third motors): position (rad)–torque (Nm)–current (A) fitting (brown points and colored surfaces), relative torque (Nm)–current (A) projection (gray points), and resulting first-order polynomial fitting (blue line) with relative equation.

Figure 9

Figure 6. Step response of the W$ \Delta $ with reference torque $ {\tau}_s=1 $ N. $ {T}_n $ indicates the time required by the actuators to reach the $ n\% $ of the step. The times reported are the slowest between all the motors. $ {T}_s $ is the Settling Time and corresponds to $ {T}_{95} $. $ {T}_r $ is the Rise Time, defined as $ {T}_r={T}_{90}-{T}_{10} $.

Figure 10

Figure 7. Setup used for the W$ \Delta $ psychophysical test: the subject, seated, leans its elbow on a comfort foam and wears the W$ \Delta $, and witch is supported by a custom frame. The drawn reference frame orientation corresponds to the one of the base of the W$ \Delta $ (see Figure 17a) in order to facilitate the read of plots reporting the assessment results in Figure 8.

Figure 11

Figure 8. Results of the force discrimination in the different directions for each subject (first 12 boxes) and for the total data pool (bottom big box). Abscissa axes are centered at the RS (RS = 3 N), with range corresponding to the one of the CS (CS$ \in \left[2,4\right] $ N). Grid vertical lines—plots left and right borders included—indicate the seven used CS (see Section “Methods”). On the ordinate axes, “Portion of greater” for each CS is reported, which is the portion of trials for that specific CS in which the subject declared it greater than the RS. Each box shows results for each CS (dots) and binomial fit (curve; see Section “Data Analysis”) in each direction (red for $ x $, yellow for $ y $, and blue for $ z $; see Figures 7 and 17a). The total plot also reports point of subjective equality (PSE) and just noticeable difference (JND) for each direction.

Figure 12

Figure 9. Teleoperation control loop block representation. Apices indicating the reference frame in which the entities are expressed and not reported for the sake of readability.

Figure 13

Figure 10. Setup used for the W$ \Delta $ experimental validation.

Figure 14

Figure 11. Free-space motion: trajectories and forces. For the sake of simplicity, only the linear components are reported. First row: desired follower positions (dashed) and actual ones (continuous). Second row: follower position errors. Third row: linear forces commanded by the follower impedance controller, expressed in the end-effector frame $ {\Psi}_{ee} $. Fourth row: environment forces received by the W$ \Delta $ (dashed) and the ones rendered to the user after the current saturation (continuous), expressed in the palm frame $ {\Psi}_{pm} $.

Figure 15

Figure 12. Contact with a surface experiment: trajectories and forces. The plot and data distribution follow the same convention of Figure 11. The light blue strips indicate the time intervals in which the contacts occur. In this case, the effect of motor current saturation on the exerted force is clearly appreciable in the fourth plot, where the force rendered to the user after the current saturation (continuous line) is way lower than the one received by the remote side (dashed line).

Figure 16

Figure 13. Discrete violin plots showing the distribution of the subjects’ answers to the custom questionnaire reported in Table 4. Each violin is completed with its mean (black line), median (yellow line), and mode values (dotted light-blue line). Results above 4 (green area) are in favor of the W$ \Delta $, and the ones below 4 (red area) are in favor of the nonhaptic interface.

Figure 17

Table 5. The System Usability Scale questionnaire (Brooke, 1996)

Figure 18

Figure 14. Discrete violin plots showing the distribution of the subjects’ answers to the SUS questionnaire (Table 5). The answers are grouped for each statement, with the ones relative the nonhaptic interface usage on the left (in blue) and the ones relative to the W$ \Delta $ on the right (in orange). The mean (black line), median (yellow line), and mode (dotted light-blue line) values are reported for each subgroup. Results lying in the green areas are in favor of the relative interface. At the top horizontal axis, the p-values resulting from the Kruskal–Wallis test on the relative sets of answers (nonhaptic vs. W$ \Delta $) are reported (green if $ p\le 0.05 $, red otherwise).

Figure 19

Figure 15. Contact recognition multisubject experiment: average maximum force along the contact direction (y-axis) for each subject and the total one (last bars; x-axis), with (orange) and without (blue) the W$ \Delta $ haptic interface. At the top horizontal axis, the p-values resulting from the Kruskal–Wallis test on the relative sets of $ {\overline{f}}_{e,\mathit{\max}}^{ee,y} $ (nonhaptic vs. W$ \Delta $) are reported (green if $ p\le 0.05 $, red otherwise).

Figure 20

Figure 16. Ratio of the average maximum forces $ {\overline{f}}_{e,\mathit{\max}}^{ee,y} $ between the W$ \Delta $ and the nonhaptic interface cases (namely W$ \Delta $/nonhaptic from Figure 15). Results below 1 (green area) are in favor of the W$ \Delta $, and the ones above 1 (red area) are in favor of nonhaptic interface.

Figure 21

Table 6. Maximum torque/force comparison between different small operational space and wrist KHDs: Omega Delta by Phantom Force (OD), Phantom Touch by 3D Systems (PT), Open Wrist (OW), Wres (WR), Rice Wrist (RW), and the presented Wearable Delta (W$ \Delta $) with peak and max used values (from the second and last columns of Table 3, respectively). (c) and (p) indicate if the values can be maintained continuously or for a limited amount of time (peak)

Figure 22

Figure 17. Representation of the main lengths and frames of (a) the device and (b) the human arm. $ {\Psi}_{\ast } $ indicate the position of reference frames used in the text to define the kinematics of the W$ \Delta $ and the human arm.

Laghi et al. supplementary material

Laghi et al. supplementary material

Download Laghi et al. supplementary material(Video)
Video 41.1 MB