Strojniški vestnik - Journal of Mechanical Engineering 64(2018)4, 216-224 © 2018 Journal of Mechanical Engineering. All rights reserved. D0l:10.5545/sv-jme.2017.5084 Original Scientific Paper Received for review: 2017-11-14 Received revised form: 2018-01-29 Accepted for publication: 2018-02-14 Design of an Apple-Picking End Effector Yinggang Shi - Kaijia Zhu - Shenghang Zhai - Dewei Zhang - Li Liu* - Jizheng Zhao - Yan Long - Yongjie Cui Northwest A&F University, College of Mechanical and Electronic Engineering, China A motor-driven end effector with 9 degrees of freedom has been designed. Information of the joint position is transmitted to the potentiometer through gears to realize the position control for the finger joint. The maximum torque of the finger joint motor is verified by imposing a load on the end effector fingertip under the parabola-straight line angular velocity curve. The single-finger coordinate system and the whole-hand coordinate system are established for the end effector through the Denavit-Hartenberg (D-H) method. The forward kinematics and inverse kinematics analysis of the end effector are carried out. To realize the stationary motion of the end effector, the basic algorithms for the starting, stopping and accelerating of the finger joint is designed, based on the analysis of the grasping space using Monte Carlo method and the analysis of the angular displacement of motor using an isochronic interpolation algorithm. The control system is designed based on STM32F103RC to realize the stationary motion of the end effector. Using Tiny 6410, the remote wireless debugging system of the end effector is designed to realize independent control and remote wireless debugging of each joint motor. Keywords: apple picking, end effector, trajectory planning, remote wireless debugging, STM32F103RC, Tiny6410 Highlights • A motor-driven end effector with 9 degrees of freedom is designed. • The forward kinematics and inverse kinematics analysis of the end effector are carried out. • This end effector can be independently controlled and debugged wirelessly. • The mechanical strength of the end effector can meet the requirements of apple picking. 0 INTRODUCTION In China, apples are mostly harvested by human labour. Harvesting is expected to be automated as the farming population is gradually decreasing. He et al. [1] reported new variations of the shake-and-catch harvesting system in 2017. However, this method of picking frequently causes substantial fruit damage and the dropping of immature fruits. Researchers have proposed that the robotic system which mimics the human hand-picking process can improve manipulation performance and reduce damage [2]. However, one of the bottlenecks in the development of a robotic apple harvester is the lack of effectively functional apple picking end-effector to meet the challenging requirements for practical application, because the picking end-effector handle can plant materials directly and potentially influence the market value of the product [3]. The automatic picking of fruit requires higherlevel mechanical control and feedback of the end effector [4]. At present, many experts and scholars have carried out related studies on the end effector which is used for picking round or oval fruits such as apple [5], tomato [6], orange [7], and kiwi [8]. To date, the end effector used for picking round or oval fruit has drive modes such as tendon transmission, belt drive, air pressure transmission, and hydraulic transmission. However, the end effector designed by adopting the abovementioned transmission modes has poor self-adaptability of grasping [9] and [10]. Bao et al. [11] designed a type of pneumatic flexible end-effector that can protect fruits from damage. Furthermore, the conventional off-line programming, force feedback check and other grasping posture debugging methods need to be operated by professionals, which is rather cumbersome. The flexible finger made of new materials has fairly strong adaptability and causes less damage to the fruit. However, the price is high, and the control system is rather complex. Therefore, it is imperative to design a cheaper debugging mode which allows farmers to independently set the end effector grasping posture to improve the grasping adaptability of the end effector. From the point of view of cost and efficiency, the design of such a debugging mode is conducive to the promotion of the round or oval fruit picking. Among apple, pear, peach, kiwi, and other round or oval fruits, a mature apple is representative in terms of weight and shape. Thus, this paper takes the apple picking as example for designing the end effector. 1 DESIGN OF THE OVERALL SYSTEM In the process of apple picking, the end effector is required to envelop the fruit. The number of fingers is set as three. The three fingers are in a circular layout and are distributed evenly. Fig. 1 shows the design of *Corr. Author's Address: College of Mechanical and Electronic Engineering, Northwest A&F University, NO. 3 Taicheng Road, Yangling 712100, Shaanxi, China, liuli_ren_79@nwsuaf.edu.cn the overall layout of the end effector. A direct-current dynamo is used to drive the reduction gear to drive the finger, and the output shaft of the motor is connected with the potentiometer to realize the collection of the joint position information. Position-based control is used to ensure the dexterous operation of the end effector. Fig. 1. Overall layout of end effector The end effector has a total of nine degrees of freedom. The control system architecture of the end effector is shown in Fig. 2. The joint motor operation can be controlled after the input of the nine-channel PWM wave into the joint motor driver. To ensure that farmers can independently set the fruit grasping posture of the end effector, it is necessary to design a remote wireless debugging module to debug the grasping posture of the end effector. Meanwhile, the operation law for the starting, accelerating, and stopping of each joint motor is made into standard modules, which is stored in the memory of the lower computer controller. The lower computer carries out the joint trajectory planning according to the grasping posture of the end effector. Then, the joint trajectory of the end effector is constructed according to the results of trajectory planning and application of the modularized trajectory curve program of the starting, speeding, and stop of each joint motor and the even operation of the subroutine of the motor. 2 DESIGN AND VERIFICATION OF MECHANICAL STRUCTURES OF END EFFECTOR 2.1 The Mechanical System Design Mature apples are usually 80 mm to 100 mm in diameter. Each finger of the end effector is designed to consist of three knuckles whose lengths are 41 mm, 41 mm, and 30 mm. The mechanical structure of the single finger is shown in Fig. 3. At the end of the output shaft of the reduction motor, the rotating angle of the joint is transmitted to the potentiometer through the gear meshing, as shown in Fig. 4. GAM-N20 is selected as the joint deceleration motor, whose parameters are shown in Table 1. Fig. 5 shows the end effector made of polylactic acid (PLA) material through rapid prototyping technology. Fig. 3. The mechanical structure of a single finger; 1) motor of far joint, 2) motor of middle joint, 3) motor of base joint, 4) base knuckle, 5) middle knuckle, and 6) fingertip Fig. 4. Detection mechanism of joint rotation angle; 1) output gear of the gearmotor, 2) motor housing, 3) potentiometer gear, 4) potentiometer shaft, and 5) gearmotor Table 1. The parameters of the joint motor GAM-N20 Rated voltage 6 V No load speed 60 r/min Load speed 48 r/min Rated torque 0.098 Nm Rated current 120 mA Stopping torque 0.686 Nm Stall current 200 mA Reduction ratio 250 Fig. 2. Architecture of the control system of the end effector Fig. 5. The 3D-printed end effector The weight of an apple is generally 180 g to 250 g. In the picking process, the distribution of the finger load is uniform without consideration of the reaction force of the fruit stem on the end effector. The load of each knuckle is shown in Eq. (1). f=mg. k, (1) where m is the weight of the apple, g is the acceleration of gravity, n is the number of the fingers and k is the safety factor. n = 3 represents the fact that the maximum load of the finger knuckle is to bear 1/3 of the weight of the apple. Considering an apple with a maximum mass of about 0.25 kg, the safety factor is set as 1.2, so the value of force is 0.98 N. Fig. 6. Stress distribution of middle finger knuckle In extreme cases, the fingertips bear all the weight of the fruits. Consider an apple with a maximum mass of about 0.25 kg. When distributed to each finger, the load is about 0.98 N as shown in Eq. (1). In the picking process, the middle finger bears the largest load. To simulate the mechanical strength of the finger, the load of 1 N is imposed on the tip of the middle finger with its basal joint fixed. The end effector is made of 1345 aluminium alloy, with a shear modulus of 27,000 MPa, a density of 2,700 kg/m3, a yield strength of 27.574200 MPa, an elastic modulus of 69,000 MPa, and a Poisson's ratio of 0.33. The loading pattern, stress and strain stress of the middle finger are shown in Figs. 6 and 7, respectively. The simulation indicates that the minimum shear stress is 0.0000732 MPa and the maximum is 0.2671942 MPa; the minimum strain is 1.167x10-9, and the maximum is 2.453x10 6. The mechanical strength of the middle finger satisfies the requirement, as does the mechanical strength of other fingers [12]. 2.2 Kinematic Analysis of End Effector The single finger Denavit-Hartenberg (D-H) coordinate system of the end effector is established, as shown in Fig. 8. Its parameters are shown in Table 2. Fig. 8. The single finger D-H coordinate system of the end effector Table 2. Parameters of single finger D-H coordinate system of end effector link 0, [°] d, a, a, [°] Variable range 1 01 0 30 0 0 to 90 2 82 0 41 0 0 to 90 3 03 0 41 0 0 to 90 Fig. 7. Strain distribution of middle finger knuckle Set = sin ex, cx = cos6>x, s^ = sin (0+0+0k), cijk = cos (0i+8j+8k), then the rotation matrix Ab A2, A3 can be obtained. Transformation matrix from n fingertip coordinate to base coordinate, as shown in Eq. (2) [13]. AjXA 2 x A3 = C123 -i123 0 a1 C1 +a2C12 S123 C123 0 a1 +a2 Î12 0 0 1 0 0 0 0 1 nx ox ax Px ny oy ay Py n z o a z z Pz 0 0 0 1 (2) The inverse kinematics of the end effector is solved by using the algebraic method [14] and [15]. Eqs. (3) to (6) can be obtained by equation (2). Eqs. (7) and (8) can be obtained by substituting Eqs. (3) and (4) into Eqs. (5) and (6). Though Eqs. (7) and (8) 02 can be obtained, as shown in Eq. (9). Then, 01 can be solved by substituting Eq. (9) into Eq. (7), as shown in Eq. (10). Finally, 03 can obtained by Eqs. (3) and (4). The inverse kinematics equation of the finger of the end effector has many solutions, so it is necessary to consider the actual situation of picking and the requirement of the stability of motion. C123 = nx, (3) ^123 = ny , (4) (5) (6) (7) (8) d2 = arccos a ci + a2c!2 + a3 ci23 _ px , ai ^ + a2 + ^123 — Py, al cl + a2 cl2 = px — a3 nx, al s1 + a2 s12 = py - a3 ny, (x - a3 nx )2 + (y - a3 ny )2 - a1 2a1 a2 (9) d1 =arctan( P^)-arctan(- px -a3n x ft =arctan a2sin02 + a2 cos02 V v nx J ), (10) (11) 2.3 Trajectory Planning and Motor Checking In the starting phase of the joint motor motion, the acceleration curve is set as a trapezoidal shape. The joint angular velocity of the end effector can be calculated by adopting the parabola-straight line velocity curve planning algorithm, so that the motion of the end effector can be stabilized [16] and [17]. Considering the mechanical structure of the end effector, each joint of the end effector is set to rotate from 0° to 90°. The maximum acceleration of joint motor is emax = 5°/s2, and the maximum velocity is wmax = 10°/s. The speed of the motor of each joint is planned as shown in Eq. (12). The angular velocity curve of each joint motor can be obtained by Eq. (12), as shown in Fig. 9. co(t ) = Smax 12 2-t1 —t, s +t s 2 1 max m 1 s 0 < t < t1 t1 < t < t2 W •t2 - 2■(t-t1 t2 ) t2