Summary of the invention
The shortcomings that it is an object of the invention to overcome the above-mentioned prior art and deficiency provide a kind of based on Kinect sensor
Human upper limb rehabilitation training and movement auxiliary system.Upper limb disorder patient is helped to carry out autonomous rehabilitation training and to day
Often life is assisted.
The present invention is achieved through the following technical solutions:
A kind of human upper limb rehabilitation training and movement auxiliary system based on Kinect sensor, including human motion identification
System, exoskeleton device and control cabinet;
The human body movement recognition system includes sequentially connected sensor module, data collection module, data buffer storage mould
Block, microprocessor and digital analog converter;
The exoskeleton device provides Three Degree Of Freedom synkinesia for both arms comprising motor and encoder;
The control cabinet includes the I/O module and processor chips interconnected, the long-range control of processor chips connection
Computer processed;The I/O module includes AD plate, tally and DA plate;
The digital analog converter connects AD plate;
The encoder connection count plate;
The DA plate connects motor by motor driver.
The mounting height of the sensor module is higher than the height of tested human body, and is mounted on distance and is tested human body 1.5~2
The position of rice, the angle of depression for shooting sensor module downwards obtain complete skeleton figure acquisition at 10 °~15 °, to facilitate.
The human upper limb rehabilitation training based on Kinect sensor and the operating procedure for acting auxiliary system include:
Human motion consciousness identifying system identifies human motion;I.e. sensor module detects human upper limb
Angle value, and transfer data on data collection module, and by the data buffer storage of collection in data cache module, then by micro-
It is spread out of by serial communication to digital analog converter after processor processing and is converted into analog signal, which fills as ectoskeleton
The input signal set;
Control cabinet controls the movement of ectoskeleton auxiliary device, i.e., the AD plate in I/O module in control cabinet is for receiving from people
The human upper limb locomotion information obtained in body motor mindedness identifying system, and be transferred in processor chips and carry out data processing;
Treated, and signal is spread out of by DA plate to motor driver, and drive motor moves, and is mentioned using controlling exoskeleton device as both arms
It is acted for Three Degree Of Freedom synkinesia;
Exoskeleton device provides auxiliary movement for upper limb, i.e., it by the turning joint between two connecting rods by being formed by connecting
Mechanical arm three-degree-of-freedom motion, both arms auxiliary movement is provided;The signal that motor driver is exported by receiving DA plate, controls machine
The rotation of motor at each shutdown of tool arm;Encoder is mounted on each motor, for obtaining the rotation data of upper limb and being transferred to control
On tally in case processed;
Human upper limb locomotion information and RGB picture are passed through transmission of network to long-range control by sensor data collection module
Computer enables a physician to obtain data information of the patient in rehabilitation course in distal end by remotely controlling computer.
The present invention compared with the existing technology, have following advantages and effects
Human-computer interaction is carried out using sensor module (Kinect), and real using exoskeleton device (upper limb exoskeleton device)
The auxiliary and recovery function of existing upper extremity exercise.For with the hemiplegic patient after upper limb disorder, especially apoplexy, pass through
Sensor module detects the motion information of patient's upper limb, by distinguishing that the angle of skeleton and upper limb determines that the movement of upper limb becomes
Gesture, can buckling/stretching, extension three degree of freedom to shoulder joint buckling/stretching, extension, abduction/adduction and elbow joint assist.Patient
The rehabilitation training to suffering limb can be realized by the autonomous of healthy side upper limb.
Meanwhile the information of the RGB picture that detects of sensor module and patient's upper limb can by network transmission to distally,
Rehabilitation teacher and doctor can provide remote rehabilitation guidance and diagnosis according to the actual conditions of patient.The invention can be used in upper limb
In the daily rehabilitation training of dyskinesia patient and life, different illness period is according to patient, rehabilitation training/daily is provided
Two different services are assisted, to improve the quality of life of patient.
Specific embodiment
The present invention is more specifically described in detail combined with specific embodiments below.
As shown in Figs. 1-5.The invention discloses a kind of human upper limb rehabilitation training and movement based on Kinect sensor
Auxiliary system, including human body movement recognition system, exoskeleton device and control cabinet;
The human body movement recognition system includes sequentially connected sensor module, data collection module, data buffer storage mould
Block, microprocessor and digital analog converter;
The exoskeleton device provides Three Degree Of Freedom synkinesia for both arms comprising motor and encoder;
The control cabinet includes the I/O module and processor chips interconnected, the long-range control of processor chips connection
Computer processed;The I/O module includes AD plate, tally and DA plate;
The digital analog converter connects AD plate;
The encoder connection count plate;
The DA plate connects motor by motor driver.
The mounting height of the sensor module is higher than the height of tested human body, and is mounted on distance and is tested human body 1.5~2
The position of rice, the angle of depression for shooting sensor module downwards obtain complete skeleton figure acquisition at 10 °~15 °, to facilitate.
The control of Kinect is write, using Visual Studio to obtain real-time human upper limb locomotion data.Obtaining upper limb fortune
After dynamic angle information, it is transferred in exoskeleton device by the bluetooth module of Arduino microprocessor.
The human upper limb rehabilitation training based on Kinect sensor and the operating procedure for acting auxiliary system include:
Human motion consciousness identifying system identifies human motion;I.e. sensor module detects human upper limb
Angle value, and transfer data on data collection module, and by the data buffer storage of collection in data cache module, then by micro-
It is spread out of by serial communication to digital analog converter after processor processing and is converted into analog signal, which fills as ectoskeleton
The input signal set;
Wherein, sensor module parameter is Kinect 2.0, is second generation Kinect for Windows inductor.Data
Collection module parameter are as follows: MSI-GL63i7-8750H 8GRAM.Microprocessor parameters are Arduino, i.e. Arduino Uno bluetooth
Module HC-05.Digital analog converter parameter is TLC-5615.
Control cabinet controls the movement of ectoskeleton auxiliary device, i.e., the AD plate in I/O module in control cabinet is for receiving from people
The human upper limb locomotion information obtained in body motor mindedness identifying system, and be transferred in processor chips and carry out data processing;
Treated, and signal is spread out of by DA plate to motor driver, and drive motor moves, and is mentioned using controlling exoskeleton device as both arms
It is acted for Three Degree Of Freedom synkinesia;
Wherein, AD board parameter is the channel PCI-3341A-8.DA board parameter is the channel PCI-3135-16.Processor chips are
Hitachi, Japan develops SH4 chip.
Exoskeleton device provides auxiliary movement for upper limb, i.e., it by the turning joint between two connecting rods by being formed by connecting
Mechanical arm three-degree-of-freedom motion, both arms auxiliary movement is provided;The signal that motor driver is exported by receiving DA plate, controls machine
The rotation of motor at each shutdown of tool arm;Encoder is mounted on each motor, for obtaining the rotation data of upper limb and being transferred to control
On tally in case processed;
Wherein, motor is servo, altogether there are three, be located at each joint, be responsible for the movement in each joint, parameter point
It is not: FAULHABER 3557K012CR;FAULHABER 3863H012C;FAULHABER 3557K012CR.The coding of motor
Device parameter is PCI-6201E.Motor driver parameter is TITEC PC-0143-2.
Sensor data collection module (including the computer of Kinect sensor module and data collection module) is by people
Body upper extremity exercise information and RGB picture pass through transmission of network to remotely controlling computer, are enabled the clinician to by remotely controlling computer
It is enough to obtain data information of the patient in rehabilitation course in distal end.
Below by concrete application process, the invention will be further described.
After obtaining human upper limb locomotion information, user can according to the actual conditions of itself select rehabilitation training or
The daily auxiliary both of which of person.Specific process is as follows:
(1) patient for needing to carry out recovery training for illness initial stage can choose and use autonomous rehabilitation modality.The mould
Patient can will be mirrored in suffering limb by healthy side upper limb autokinetic movement, motion profile under formula.Sensor module
(Kinect) upper extremity exercise of user health side will be detected, patient is dynamic by the rehabilitation of learning and mastering standard set
Make, and executes the movement using the upper limb of healthy side.The movement is transmitted at suffering limb by mirror image rehabilitation training system, auxiliary
Suffering limb executes autonomous recovery training.For user when lifting the right limbs, equipment can be by the movement mirror image on right side
Onto the upper limb on the left side, independence rehabilitation training is carried out to left side upper limb.
(2) patient of certain limb motion ability recovered for the illness later period, can choose daily auxiliary using upper limb
Help mode.The mode lower sensor module (Kinect) will detect the movement of patient, when being provided according to the movement of suffering limb for it
Ground auxiliary.Since the muscular strength of upper limb under the state does not restore completely, patient independently lifts hand in the case where nobody helps
Arm and maintenance operating stably will have certain difficulty.Equipment can be according to trouble after the auxiliary device under using the mode
The actual motion of person's upper limb provides certain auxiliary force for it, to help patient independently to lift upper limb and execute some simple days
Normal life activities.Be able to ascend the quality of life of patient under the mode, patient do not need with the help of other people can independently into
Behavior is managed in some simple daily lifes of row.When user lifts right side upper limb, equipment can be according to the track of its movement
It provides for it and assists in real time, need to only use the power of very little that can lift upper limb and remain stable by lifting upper limb user
State.
By two different auxiliary modes, which can provide rehabilitation training and life to upper extremity exercise impaired patients
Auxiliary living.Combine auxiliary system by building more Kinect, builds broader auxiliary space, widened the use of equipment
Range, as shown in Figure 4.Meanwhile the human upper limb locomotion data being collected into and rgb video can arrive distal end using network transmission
At doctor, doctor can provide long-range diagnosis and guidance for patient according to the information being collected into.Using the system, user is not required to
Going out door can be carried out rehabilitation training, while oneself can also carry out some simple activitiess of daily life in the rehabilitation later period,
Doctor does not need to go to scene to patient's memory interrogation every time yet.This invents the living burden that can reduce patient, while
Improve treatment efficiency.
As described above, the present invention can be better realized.
Embodiment of the present invention are not limited by the above embodiments, other are any without departing from Spirit Essence of the invention
With changes, modifications, substitutions, combinations, simplifications made under principle, equivalent substitute mode should be, be included in of the invention
Within protection scope.