CN103631381A - Man-machine interaction system and man-machine interaction method for electric transmission line patrolling simulation system - Google Patents

Abstract

The invention discloses a human-computer interaction system of a power transmission line inspection simulation system, which includes a screen, a projector for projecting a power transmission line three-dimensional inspection line and a scene on the screen, and a device for capturing student body and arm movement information. Human body motion recognition instrument, used to collect the student's head rotation and up and down movement information and the angle of view locator to locate the student's head position, the walking belt used for students to walk freely, used to collect the speed and direction of the walking belt when it rolls to obtain Displacement sensors for trainees’ walking speed and direction, signal output terminals of the human body action recognition device, visual angle locator and displacement sensors are used to connect to the human-computer interaction module of the transmission line inspection simulation system, and the signal input terminals of the projector are used to connect to the transmission line inspection The three-dimensional inspection line of the transmission line of the simulation system and the output port of the scene image signal. The invention improves the interactivity and simulation of human-computer interaction.

Description

Human-computer interaction system and human-computer interaction method of transmission line inspection simulation system

technical field

The invention relates to the technical field of electric power training systems, in particular to a human-computer interaction system and a human-computer interaction method of a transmission line inspection simulation system.

technical background

The teaching and training of power systems using simulation technology has been more and more widely used. The existing transmission line inspection simulation system has established a three-dimensional inspection line scene, but the existing transmission line inspection simulation system uses the traditional keyboard 1. The human-computer interaction mode of the mouse is used for line inspection, so it is difficult to simulate the reality of the inspection operation, its simulation is greatly reduced, and the training effect is not good.

Contents of the invention

The object of the present invention is to address the above technical problems, to provide a human-computer interaction system and a human-computer interaction method of a power transmission line inspection simulation system. The real body movements of the students are perfectly synchronized, which greatly improves the interactivity and simulation of human-computer interaction.

To achieve this goal, the human-computer interaction system of the power transmission line inspection simulation system designed by the present invention is characterized in that it includes a screen, a projector for projecting the three-dimensional inspection lines and scenes of the power transmission line on the screen, and for capturing A human body motion recognition instrument for the student's body and arm movement information, a viewing angle locator for collecting the student's head rotation and up and down movement information and locating the student's head position, a walking belt for the student to walk freely, and a walking belt for collecting The speed and direction when rolling thereby obtain the displacement sensor of the student's walking speed and direction, wherein the signal output terminals of the human motion recognition instrument, the angle of view locator and the displacement sensor are used to connect the human-computer interaction module of the transmission line inspection simulation system, The signal input end of the projector is used to connect the three-dimensional inspection line of the transmission line and the output end of the scene image signal of the inspection simulation system of the transmission line.

The human motion recognition instrument is arranged at the top of the screen.

The screen is a spherical screen.

The displacement sensor is located below the collecting walking belt.

A human-computer interaction method using the human-computer interaction system of the above-mentioned power transmission line inspection simulation system, is characterized in that it includes the following steps:

Step 1: The power transmission line inspection simulation system generates a virtual power transmission inspection line scene map, and displays it on the screen through a projector;

Step 2: The student makes a preset standard posture, and the human motion recognition device scans the standard posture made by the student, and matches the posture of the student to complete the initialization of the human motion recognition device;

Step 3: The trainees stand on the walking belt and make corresponding human inspection postures and actions according to the inspection line in the virtual power transmission inspection line scene diagram in step 1;

Step 4: The human body motion recognition instrument collects the human body posture information and arm position information in the student's human patrol posture action; at the same time, the perspective locator collects the head rotation movement and head up and down movement information in the student's human patrol posture action and locates the student's head At the same time, the displacement sensor obtains the walking speed information and direction information in the patrol posture of the trainees by collecting the speed and direction when the walking belt rolls;

Step 5: The human body action recognition instrument transmits the human body posture information and arm position information in the above-mentioned student's human body inspection posture action to the power transmission line inspection simulation system; the viewing angle locator transmits the head rotation movement and The head up and down movement information, as well as the student's head position information are transmitted to the transmission line inspection simulation system; the displacement sensor transmits the walking speed information and direction information in the above-mentioned student's human inspection posture action to the transmission line inspection simulation system;

Step 6: The power transmission line inspection simulation system uses the human body posture information and arm position information, head rotation and head up and down movement information, head position information, student walking speed information and direction information in the above-mentioned students' human inspection posture actions. Feedback to the scene diagram of the virtual power transmission inspection line displayed on the screen, so that the virtual characters in the scene diagram of the virtual power transmission inspection line have the same human inspection posture and action as the students. The above process completes a human-computer interaction and realizes the virtual on-screen The movements of the characters are synchronized with the real movements of the students.

In said step 2, when the student is replaced, the human body motion recognition device scans the standard posture made by the replaced new student, and matches the posture of the replaced new student, and completes the human body motion recognition device after the replacement of the new student. initialization.

The trainee makes a preset standard posture to stand naturally, raises his hands up over his shoulders, and maintains this posture for 2-4 seconds.

The beneficial effects of the present invention are:

1. The present invention provides a human-computer interaction method for a transmission line inspection simulation system, which frees the transmission line inspection simulation training system from the shackles of the traditional keyboard and mouse.

2. The present invention synchronizes the movements of virtual characters with the real body movements of students, greatly improving the interactivity of human-computer interaction;

3. The present invention improves the sense of reality of the circuit inspection simulation system, and helps to improve the training effect of circuit inspection.

Description of drawings

Fig. 1 is the structure schematic diagram of existing transmission line inspection simulation system;

Fig. 2 is a structural schematic diagram of the present invention.

Among them, 1—projector, 2—screen, 3—human motion recognition device, 4—viewpoint positioning device, 5—walking belt, 6—displacement sensor, 7—power transmission line patrol simulation system, 7.1—human-computer interaction module, 7.2 — Patrol Line Library, 7.3 — Transmission Line 3D Scene Library, 7.4 — Equipment Defect Library, 7.5 — Patrol Operation Module, 7.6 — Defect Record Module, 7.7 — Virtual Transmission Patrol Line Generation Module, 8 — Support, 9 — Training Room.

Detailed ways

Below in conjunction with accompanying drawing and embodiment the present invention is described in further detail:

The human-computer interaction system of the power transmission line inspection simulation system as shown in Figure 2, it includes a screen 2, a projector 1 for projecting the three-dimensional inspection lines and scenes of the power transmission line on the screen 2, and a projector 1 for capturing the trainee's body and arm Human motion recognition instrument for motion information 3. Angle locator for collecting student head rotation and up and down movement information and locating the student's head position 4. Walking belt for students to walk freely 5. Walking belt 5 for collecting rolling Speed and direction at the time, thereby obtaining the displacement sensor 6 of the student's walking speed and direction, wherein, the signal output terminals of the human body action recognition instrument 3, the angle of view locator 4 and the displacement sensor 6 are used to connect the people of the transmission line inspection simulation system 7 The computer interaction module 7.1, the signal input end of the projector 1 is used to connect the three-dimensional inspection line of the transmission line and the output end of the scene image signal of the inspection simulation system 7 of the transmission line. The viewing angle locator 4 is worn on the student's head. The above-mentioned projector 1 is fixed in the training room 9 through a bracket 8 .

In the above technical solution, the human motion recognition instrument 3, the viewing angle locator 4, and the displacement sensor 6 are all connected to the human-computer interaction module 7.1 of the power transmission line inspection simulation system 7 through a data line with a general interface, and the collected information is uploaded in real time .

In the above technical solution, the human motion recognition device 3 is arranged on the top of the screen 2 .

In the above technical solution, the screen 2 is a spherical screen.

In the above technical solution, the displacement sensor 6 is located below the collecting walking belt 5 .

In the above technical solution, the transmission line inspection simulation system 7 can be divided into three layers, as shown in Figure 1: the first layer is a database including inspection line library 7.2, transmission line three-dimensional scene library 7.3 and equipment defect library 7.4, wherein the equipment defect Library 7.4 includes various defect models of transmission line conductors, insulators, fittings, pole towers, ground wires, foundations and other components; transmission line 3D scene library 7.3 includes transmission line wires, insulators, fittings, pole towers, ground wires, foundations and other components model; inspection line database 7.2 contains typical lines under voltage levels such as 110kV, 220kV and 500kV; the second layer is the virtual power transmission inspection line generation module 7.7, which calls the data of the first layer database to generate virtual inspection lines; the third The layer is the application layer. The inspection operation module 7.5 is used to complete the common operations of the inspection, such as viewing the line with a telescope, inspecting the tower, using tools, etc.; the defect recording module 7.6 is used to record the defects found in the inspection of the line; the human-computer interaction module 7.1 It is used for data communication with the human body motion recognition device 3, the viewing angle locator 4, and the displacement sensor 6, and analyzes and processes the collected student body and motion information, so that the virtual electrician can make corresponding actions synchronously to realize human-computer interaction.

A human-computer interaction method utilizing the human-computer interaction system of the above-mentioned power transmission line inspection simulation system, it comprises the following steps:

Step 1: The power transmission line inspection simulation system 7 generates a virtual power transmission inspection line scene diagram, and displays it on a spherical screen through the projector 1;

Step 2: The student makes a preset standard posture, and the human motion recognition device 3 scans the standard posture made by the student, and matches the posture of the student to complete the initialization of the human motion recognition device 3;

Step 3: The trainees stand on the walking belt 5 and make corresponding human inspection posture actions according to the inspection line in the virtual power transmission inspection line scene diagram in step 1;

Step 4: The human body motion recognition device 3 collects the human body posture information and arm position information in the student's human patrolling posture action (such as the student raises his right hand, and the human body motion recognition device 3 scans the student's human body posture and arm position, that is, the student's body posture and arm position information are collected. "body information"); at the same time, the angle of view locator 4 collects the head rotation and head up and down movement information of the student's human inspection posture and locates the student's head position (such as the student turns his head to the left, the angle of view positioning on the top of the student's head The instrument 4 deflects the head to the left to detect the deflection angle, that is, the "head turning information" of the student is collected); at the same time, the displacement sensor 6 obtains the walking of the student's human body patrol posture action by collecting the speed and direction of the walking belt 5 when it rolls Speed information and direction information (such as the student walking forward, driving the walking belt 5 to roll to the right, the displacement sensor 6 detects the speed and direction of the walking belt 5 rolling, that is, the "walking information" of the student is collected);

Step 5: The human body action recognition instrument 3 transmits the human body posture information and arm position information in the above-mentioned student's human body inspection posture action to the power transmission line inspection simulation system 7; Rotational movement and head up and down movement information, as well as the student's head position information are transmitted to the transmission line inspection simulation system 7; the displacement sensor 6 transmits the walking speed information and direction information in the above-mentioned student's human body inspection posture action to the transmission line inspection simulation system 7;

Step 6: The power transmission line inspection simulation system 7 uses the human body posture information and arm position information, the student's head rotation and head up and down movement information, the student's head position information, the student's walking speed information and direction in the above-mentioned student's human body inspection posture action. The information is fed back to the scene diagram of the virtual power transmission inspection line displayed on screen 2, so that the virtual characters in the scene diagram of the virtual power transmission inspection line have the same human body inspection postures and actions as the students. The above process completes a human-computer interaction and realizes the The movements of the virtual characters on the computer are synchronized with the real movements of the students.

In step 2 of the above technical solution, when the student is replaced, the human body motion recognition device 3 scans the standard posture of the replaced new student, and matches the posture of the replaced new student to complete the replacement of the new student's human body. The motion recognition device 3 is initialized.

In the above technical solution, the trainee makes a preset standard posture for the human body to stand naturally, raises both hands upwards over the shoulders, and maintains the posture for 2 to 4 seconds.

In the above technical solution, the virtual power transmission inspection line scene map includes inspection lines composed of various tower types, nearby topography and weather conditions.

The content not described in detail in this specification belongs to the prior art known to those skilled in the art.

Claims (7)

1. the man-machine interactive system of a patrolling transmission line analogue system, it is characterized in that: it comprises screen (2), for transmission line of electricity three-dimensional is maked an inspection tour to circuit and the projector (1) of scene simulation on screen (2), for catching student's health and the human action identifier (3) of arm action information, for gathering student's end rotation motion and the information locate the visual angle orientator (4) of student's head position of moving up and down, the walking band (5) of freely walking for student, be used for gathering walking band (5) thereby the displacement transducer (6) that the speed while rolling and direction are obtained student's speed of travel and direction, wherein, described human action identifier (3), the signal output part of visual angle orientator (4) and displacement transducer (6) is used for being connected the human-computer interaction module (7.1) of patrolling transmission line analogue system (7), the signal input part of described projector (1) is used for connecting three-dimensional circuit and the scene image signal output part maked an inspection tour of transmission line of electricity of patrolling transmission line analogue system (7).

2. the man-machine interactive system of patrolling transmission line analogue system according to claim 1, is characterized in that: described human action identifier (3) is arranged on the top of screen (2).

3. the man-machine interactive system of patrolling transmission line analogue system according to claim 1 and 2, is characterized in that: described screen (2) is spherical screen.

4. the man-machine interactive system of patrolling transmission line analogue system according to claim 1, is characterized in that: described displacement transducer (6) is positioned at the below that gathers walking band (5).

5. a man-machine interaction method that utilizes the man-machine interactive system of patrolling transmission line analogue system described in claim 1, is characterized in that, it comprises the steps:

Step 1: circuit scene graph is maked an inspection tour in the transmission of electricity of described patrolling transmission line analogue system (7) generating virtual, and is presented on screen (2) by projector (1);

Step 2: student makes and presets standard gestures, the standard gestures that human action identifier (3) is made student scans, and student's posture is mated, and completes the initialization of human action identifier (3);

Step 3: student stands in the upper tour circuit according to virtual transmission of electricity tour circuit scene graph in step 1 of walking band (5) and makes corresponding human body tour gesture actions;

Step 4: human action identifier (3) gathers student's human body and makes an inspection tour human posture's information and the arm position information in gesture actions; Simultaneously visual angle orientator (4) gathers student's human body and makes an inspection tour move up and down information locate student's head position of end rotation motion in gesture actions and head; Speed when simultaneous displacement sensor (6) is walked band (5) rolling by collection and direction are obtained student's human body and are maked an inspection tour speed of travel information and the directional information in gesture actions;

Step 5: described human action identifier (3) is maked an inspection tour human posture's information in gesture actions and arm position communication to patrolling transmission line analogue system (7) by above-mentioned student's human body; Information that visual angle orientator (4) moves the end rotation in above-mentioned student's human body tour gesture actions and head moves up and down, and student's head position communication is to patrolling transmission line analogue system (7); Speed of travel information and directional information that displacement transducer (6) is maked an inspection tour above-mentioned student's human body in gesture actions are transferred to patrolling transmission line analogue system (7);

Step 6: patrolling transmission line analogue system (7) is maked an inspection tour human posture's information and the arm position information in gesture actions by above-mentioned student's human body, information that student's end rotation moves and head moves up and down, student's head position information, student's speed of travel information and directional information feed back to the virtual transmission of electricity of screen (2) demonstration and make an inspection tour in circuit scene graph, the virtual portrait that virtual transmission of electricity is maked an inspection tour in circuit scene graph has the human body tour gesture actions identical with student, said process has completed a man-machine interaction, the action that has realized the virtual portrait on screen (2) is synchronous consistent with the real action of student.

6. man-machine interaction method according to claim 5, it is characterized in that: in described step 2, when student changes, the standard gestures that human action identifier (3) is made the new student who changes scans, and the new student's who changes posture is mated, complete human action identifier (3) initialization more renewing after student.

7. man-machine interaction method according to claim 5, is characterized in that: described student makes and presets standard gestures and stand for human body natural, and both hands were upwards lifted shoulder, kept this posture 2～4 seconds.

Images