CN103677324B - Virtual instrument operation and control device based on single hand keyboard and mouse - Google Patents

Abstract

The invention discloses a virtual instrument control device based on a one-handed keyboard and mouse. The sending end includes a keyboard module, an inertial navigation module, a controller, and a wireless sending module. The keys on the keyboard module include function keys and knob keys, respectively corresponding to virtual The function keys and knobs on the instrument panel, the function keys include single-function keys corresponding to a virtual instrument function, and multiple function keys corresponding to the mutually exclusive functions of multiple virtual instruments; the inertial navigation module is based on its three-axis gyroscope and three-axis accelerator The parameters are calculated to calculate the quaternion, and the controller generates a control signal through the pressing signal of the keyboard module and the quaternion of the inertial navigation module. When the pressing signal comes from a function button, a function control signal is generated. When the pressing signal comes from a knob button , generate the knob control signal, and send it to the receiving end through the wireless sending module. The invention is easy to operate and can realize flexible manipulation of virtual instruments.

Description

A virtual instrument control device based on one-handed keyboard and mouse

technical field

The invention belongs to the technical field of virtual instrument control, and more specifically relates to a virtual instrument control device based on a one-handed keyboard and mouse.

Background technique

A virtual instrument is an instrument with a visual interface built on the basis of a computer by adding related hardware and software. Compared with traditional instruments, the display, keys, and knobs of virtual instruments are all realized through software interfaces rather than hardware components. Users can conveniently and flexibly use the mouse or buttons to operate various "buttons" and "knobs" on the soft panel of the virtual instrument on the computer display screen for testing, and can switch between different virtual instruments through windows according to different test requirements, or through Modify the software to change, increase or decrease the function and scale of the virtual instrument system. The superior characteristics of "developability" and "expandability" of virtual instrument make virtual instrument have strong vitality and competitiveness. Virtual instruments can be widely used in electronic measurement, aerospace, electric power engineering, mechanical engineering and many other fields. At present, virtual instruments are mostly controlled by traditional mouse or keyboard, but traditional control devices cannot fully meet the needs of virtual instruments, and some functions need to be realized through complex operation combinations.

The wireless 3D one-handed mouse and keyboard is an input device that combines the keyboard and the mouse into one hand-operated input device, and it has the functions of keyboard text input and mouse pointing input at the same time. The wireless 3D one-handed mouse and keyboard has become a control device with great development prospects due to its flexible control and wide application.

Contents of the invention

The object of the present invention is to overcome the deficiencies of the prior art, provide a virtual instrument control device based on a one-handed keyboard and mouse, and realize the flexible control of the virtual instrument.

In order to achieve the above-mentioned purpose of the invention, the present invention is based on a one-handed keyboard and mouse virtual instrument control device, which is characterized in that it includes:

A virtual instrument control device based on one-handed keyboard and mouse, including a sending end and a receiving end. The sending end sends control signals, and the receiving end is connected to the virtual instrument hardware device, and forwards the control signal received from the sending end to the virtual instrument. Its features In that, the sending end includes a keyboard module, an inertial navigation module, a controller, and a wireless sending module, wherein:

The keyboard module includes function keys and knob keys, and the function keys include single-function keys and multiplex function keys, wherein the single-function key corresponds to a function of the virtual instrument panel, and each operation in the N operations of the multiplex function keys is respectively Represents N mutually exclusive functions of the virtual instrument panel. The knob button is used to indicate the knob on the virtual instrument panel; when each button is pressed, it will generate a pressing signal carrying the corresponding virtual instrument key number, and the keyboard module will send the pressing signal to controller;

The inertial navigation module includes a three-axis gyroscope, a three-axis accelerator, and a motion processor. The motion processor calculates the quaternion based on the parameters measured by the three-axis gyroscope and the three-axis accelerator and sends it to the controller;

The controller is used to collect the pressing signal sent by the keyboard module and the quaternion sent by the inertial navigation module. When the pressing signal comes from the function button, it generates the corresponding function control signal and sends it to the wireless sending module; when the pressing signal comes from the knob button , from the start time t _s of obtaining the pressing signal to the end time t _e , calculate the knob increment D _n every Δt, Δt is the preset time interval parameter, and the calculation method is:

Among them, n=1,2,3,..., K represents the proportional coefficient, yaw _n-1 , yaw _n , yaw _e respectively represent t _s +(n-1)×Δt, time t _s +n×Δt, press signal The heading angle at the end time t _e is calculated by the quaternion sent to the controller by the inertial navigation module at the corresponding time, and every time a knob increment D _n is obtained, a corresponding knob control signal is generated and sent to the wireless sending module;

The wireless sending module is used to send control signals to the receiving end.

Further, the virtual instrument function corresponding to each operation of the multiple function key is controlled by a counter, and the counter is used to record the number of pressing operations of the multiple function key, and each time the number of times increases, the preset virtual instrument function sequence table will be reversed. Switch a function. If the current function is the last one in the sequence list and the count is incremented by 1, return to the first function in the sequence list.

Further, the heading angle yaw is calculated according to the following formula:

Among them, w is the real part of the quaternion (w, x, y, z), and x, y, z is the imaginary part of the quaternion (w, x, y, z).

Further, it also includes a wireless sending buffer for storing control signals that have not been sent yet.

The present invention is based on a one-handed keyboard and mouse virtual instrument control device, and its sending end includes a keyboard module, an inertial navigation module, a controller, and a wireless sending module. Function keys and knobs, the function keys include single-function keys corresponding to one virtual instrument function, and multiple function keys corresponding to mutually exclusive functions of multiple virtual instruments; the inertial navigation module calculates according to the parameters of its three-axis gyro and three-axis accelerator Quaternion, the controller generates a control signal through the pressing signal of the keyboard module and the quaternion of the inertial navigation module. When the pressing signal comes from a function button, a function control signal is generated. When the pressing signal comes from a knob button, a knob control is generated. The signal is sent to the receiving end through the wireless sending module, and then sent to the virtual instrument by the receiving end, so as to realize the control of the virtual instrument. The present invention adopts a one-handed keyboard and mouse, has fewer combined keys, and is relatively simple to operate with the combined keys, and can realize flexible manipulation of the virtual instrument with one hand.

Description of drawings

Fig. 1 is a schematic diagram of the hardware structure of the sending end of the present invention;

Figure 2 is an example diagram of a virtual dual-trace oscilloscope panel;

Fig. 3 is an example diagram of the functional partition of the keyboard module;

Fig. 4 is a schematic diagram of the work flow of a specific embodiment of the controller.

detailed description

Specific embodiments of the present invention will be described below in conjunction with the accompanying drawings, so that those skilled in the art can better understand the present invention. It should be noted that in the following description, when detailed descriptions of known functions and designs may dilute the main content of the present invention, these descriptions will be omitted here.

Example

The virtual instrument control device based on one-handed keyboard and mouse of the present invention includes a sending end and a receiving end, the sending end is used to send control signals, the receiving end is connected with virtual instrument hardware equipment, and forwards the control signal received from the sending end to the virtual instrument. The software module of the virtual instrument receives the control signal through the hardware device and executes the corresponding operation. In this embodiment, the receiving end is realized by using the USB Dongle of Nordic Company. FIG. 1 is a schematic diagram of the hardware structure of the sending end of the present invention. As shown in Figure 1, the sending end of the present invention includes a keyboard module, an inertial navigation module, a controller, and a wireless sending module.

The keyboard module includes function keys and knob keys, and the function keys include single-function keys and multiplex function keys, wherein the single-function key corresponds to a function of the virtual instrument panel, and each operation in the N operations of the multiplex function keys is respectively Represents N mutually exclusive functions of the virtual instrument panel, N≥2, the knob button is used to indicate the knob on the virtual instrument panel; when each button is pressed, it will generate a pressing signal carrying the corresponding virtual instrument button number, and the keyboard module will The pressing signal is sent to the controller. It can be seen that the keys on the keyboard module have a corresponding relationship with the keys on the virtual instrument panel.

Figure 2 is an example diagram of a virtual dual-trace oscilloscope panel. As shown in Figure 2, the buttons on the panel of the virtual dual-trace oscilloscope are divided into four parts according to their functions: vertical control part (VERTICAL), horizontal control part (HORIZONTAL), trigger control part (TRIGGER), and other parts. According to the operation mode, the buttons can be divided into: multiple function buttons, such as start/stop (Run/Stop) button, rising/falling (Rising/Falling) button; single-function buttons, such as Auto Set button; knobs, such as displacement adjustment (Position) and so on.

In this embodiment, the multifunction button on the virtual instrument panel has two states: pressed and popped up, which respectively represent two mutually exclusive functions, that is, only one of the two functions exists at the same time, such as the start/stop button, press means start, pop up means stop. This multiple function key can be implemented by two single function keys on the keyboard module, or by one multiple function key on the keyboard module. The single-function keys on the virtual instrument panel naturally correspond to the single-function keys on the keyboard module. If there are mutually exclusive single-function keys on the virtual instrument panel, it can also be realized by using a multiple function key on the keyboard module. In practical applications, the configuration of multiple function keys and single function keys on the keyboard module is determined according to requirements. The knobs on the virtual instrument panel are controlled through the knob buttons on the keyboard module and the inertial navigation module. The knob buttons on the keyboard module are used to indicate the knobs on the virtual instrument panel, and there is a one-to-one correspondence.

The virtual instrument function corresponding to each operation of the multiplexed function keys on the keyboard module can be controlled by a counter, and the counter is used to record the number of pressing operations of the multiplexed function keys. Each time the number of times increases, it will be displayed according to the preset virtual instrument function sequence. After switching a function, if the current function is the last one in the sequence list and the count is increased by 1, then return to the first function in the sequence list.

Fig. 3 is an example diagram of functional partitions of the keyboard module. As shown in FIG. 3 , the keyboard module in this embodiment is divided into a main keyboard and a control keyboard, the main keyboard is a 3×4 matrix keyboard, and the control keyboard is four independent keys. Table 1 is a correspondence table between the keys in the keyboard module and the keys on the virtual instrument panel in this embodiment.

Table 1

The numbers of the keys on the virtual instrument panel are set according to the needs. The number will be carried in the press signal, which is used to identify the virtual instrument panel button corresponding to the signal for manipulation.

The inertial navigation module includes a three-axis gyroscope, a three-axis accelerator, and a motion processor. The motion processor calculates the quaternion based on the parameters measured by the three-axis gyroscope and the three-axis accelerometer and sends it to the controller.

The inertial navigation module in this embodiment adopts the MPU-6050 chip of Invensense Company. The chip integrates a three-axis gyroscope and a three-axis accelerator, and has a built-in digital motion processor (DMP: Digital Motion Processor) that can handle complex nine-axis motion fusion algorithms. The measurable range of the gyroscope is ±250, ±500, ±1000 , ±2000 (dps), the measurable range of the accelerometer is ±2, ±4, ±8, ±16g, which can meet the parameter acquisition and calculation requirements of the present invention.

The controller is used to collect the pressing signal sent by the keyboard module and the quaternion sent by the inertial navigation module and generate a control signal.

The controller in this embodiment uses the STM32F103RBT6 processor produced by ST Company. This processor uses the ARM Cortex-M3 32-bit RSIC core with a working frequency of 72Mhz, built-in high-speed memory, up to 128k bytes of flash memory, and provides ADC , timer and other functions, and also includes many communication interfaces such as SPI, I2C, UART, USB, CAN bus, etc. Fig. 4 is a schematic diagram of the work flow of a specific embodiment of the controller. As shown in Figure 4, the workflow of the controller is:

S401: Collect the pressing signal sent by the keyboard module and the quaternion sent by the inertial navigation module.

S402: Determine whether the pressing signal is from the knob button, if yes, go to step S403, if not, go to step S404.

S403: Continuously calculate the knob increment, the calculation method is:

From the start time t _s of obtaining the pressing signal to the end time t _e , the knob increment D _n is calculated every Δt, Δt is a preset time interval parameter, and the calculation method is:

Among them, n=1,2,3,..., K represents the proportional coefficient, yaw _n-1 , yaw _n , yaw _e respectively represent t _s +(n-1)×Δt, time t _s +n×Δt, press signal The heading angle at the end time t _e is calculated from the quaternion sent by the inertial navigation module to the controller at the corresponding time, and each time a knob increment D _n is obtained, enter step S405.

It can be seen that the progressive knob adjustment realized by the present invention updates the status of the knob on the virtual instrument panel every Δt during the process from the start of the pressing signal to the end of the pressing signal, so that the operator can observe the adjustment range of the knob in real time and improve Controlling accuracy. If the time interval parameter Δt is set to a value that is absolutely greater than the end time t _e of the pressing signal, the controller will only calculate the knob increment once and generate a control signal once. In practical applications, the value of Δt can be determined according to needs.

In this embodiment, the calculation formula of heading angle is:

Among them, w is the real part of the quaternion (w, x, y, z), and x, y, z is the imaginary part of the quaternion (w, x, y, z).

S404: Let the rotation increment be 0.

S405: Generate a control signal and send it to the wireless sending module. The format of the control signal used in this embodiment is:

key number Knob increment

The key number indicates the number of the corresponding virtual instrument key obtained according to the pressing signal. It can be seen that when the key number is a function key, the knob increment is 0, and only when the key code is a knob key, the knob increment is meaningful. Generally, when the knob increment is positive, it means that the knob rotates clockwise, and when it is negative, it means that it rotates counterclockwise.

The wireless sending module is used to send control signals to the receiving end. The virtual instrument control device based on the one-handed mouse and keyboard of the present invention can configure a wireless sending buffer for the wireless sending module to store control signals that have not been sent yet.

In this embodiment, the wireless sending module adopts the NRF24L01 chip. NRF24L01 is a single-chip wireless transceiver chip produced by NORDIC that works in the ISM frequency band of 2.4GHz to 2.5GHz. It adopts FSK (Frequency-shift keying, frequency shift keying) modulation, integrated Enhanced Short Burst protocol inside, can realize point-to-point or point-to-multipoint wireless communication, the fastest speed can reach 2Mbps, and the transmission distance is long and the bit error rate is low .

Although the illustrative specific embodiments of the present invention have been described above, so that those skilled in the art can understand the present invention, it should be clear that the present invention is not limited to the scope of the specific embodiments. For those of ordinary skill in the art, As long as various changes are within the spirit and scope of the present invention defined and determined by the appended claims, these changes are obvious, and all inventions and creations using the concept of the present invention are included in the protection list.

Claims (4)

1. A virtual instrument control device based on one-handed keyboard and mouse, including a sending end and a receiving end, the sending end sends a control signal, the receiving end is connected to the virtual instrument hardware device, and forwards the control signal received from the sending end to the virtual instrument , characterized in that, the sending end includes a keyboard module, an inertial navigation module, a controller, and a wireless sending module, wherein: The keyboard module includes function keys and knob keys, and the function keys include single-function keys and multiplex function keys, wherein the single-function key corresponds to a function of the virtual instrument panel, and each operation in the N operations of the multiplex function keys is respectively Represents one of the N mutually exclusive functions of the virtual instrument panel. The knob button is used to indicate the knob on the virtual instrument panel; when each button is pressed, it will generate a pressing signal carrying the corresponding virtual instrument button number, and the keyboard module will The pressing signal is sent to the controller; The inertial navigation module includes a three-axis gyroscope, a three-axis accelerator, and a motion processor. The motion processor calculates the quaternion based on the parameters measured by the three-axis gyroscope and the three-axis accelerator and sends it to the controller; The controller is used to collect the pressing signal sent by the keyboard module and the quaternion sent by the inertial navigation module. When the pressing signal comes from the function button, it generates the corresponding function control signal and sends it to the wireless sending module; when the pressing signal comes from the knob button , from the start time t _s of obtaining the pressing signal to the end time t _e , calculate the knob increment D _n every Δt, Δt is the preset time interval parameter, and the calculation method is: ${\mathrm{<span\; class="notranslate">\; D.</span>}}_{\mathrm{<span\; class="notranslate">\; no</span>}}<span\; class="notranslate">\; =</span>\left\{\begin{array}{cc}<span\; class="notranslate">\; (</span>{\mathrm{<span\; class="notranslate">\; yaw</span>}}_{\mathrm{<span\; class="notranslate">\; no</span>}}<span\; class="notranslate">\; -</span>{\mathrm{<span\; class="notranslate">\; yaw</span>}}_{\mathrm{<span\; class="notranslate">\; no</span>}<span\; class="notranslate">\; -</span>\mathrm{<span\; class="notranslate">\; 1</span>}}<span\; class="notranslate">\; )</span><span\; class="notranslate">\; /</span>\mathrm{<span\; class="notranslate">\; K</span>}<span\; class="notranslate">\; ,</span>& {\mathrm{<span\; class="notranslate">\; t</span>}}_{\mathrm{<span\; class="notranslate">\; the\; s</span>}}<span\; class="notranslate">\; +</span>\mathrm{<span\; class="notranslate">\; no</span>}<span\; class="notranslate">\; \&times;</span>\mathrm{<span\; class="notranslate">\; \&Delta;</span>}\mathrm{<span\; class="notranslate">\; t</span>}<span\; class="notranslate">\; <</span>{\mathrm{<span\; class="notranslate">\; t</span>}}_{\mathrm{<span\; class="notranslate">\; e</span>}}\\ <span\; class="notranslate">\; (</span>{\mathrm{<span\; class="notranslate">\; yaw</span>}}_{\mathrm{<span\; class="notranslate">\; e</span>}}<span\; class="notranslate">\; -</span>{\mathrm{<span\; class="notranslate">\; yaw</span>}}_{\mathrm{<span\; class="notranslate">\; no</span>}<span\; class="notranslate">\; -</span>\mathrm{<span\; class="notranslate">\; 1</span>}}<span\; class="notranslate">\; )</span><span\; class="notranslate">\; /</span>\mathrm{<span\; class="notranslate">\; K</span>}<span\; class="notranslate">\; ,</span>& {\mathrm{<span\; class="notranslate">\; t</span>}}_{\mathrm{<span\; class="notranslate">\; the\; s</span>}}<span\; class="notranslate">\; +</span>\mathrm{<span\; class="notranslate">\; no</span>}<span\; class="notranslate">\; \&times;</span>\mathrm{<span\; class="notranslate">\; \&Delta;</span>}\mathrm{<span\; class="notranslate">\; t</span>}<span\; class="notranslate">\; \&Greater\; Equal;</span>{\mathrm{<span\; class="notranslate">\; t</span>}}_{\mathrm{<span\; class="notranslate">\; e</span>}}\end{array}\right.$ Among them, n=1,2,3,..., K represents the proportional coefficient, yaw _n-1 , yaw _n , yaw _e respectively represent t _s +(n-1)×Δt, time t _s +n×Δt, press signal The heading angle at the end time t _e is calculated by the quaternion sent to the controller by the inertial navigation module at the corresponding time, and every time a knob increment D _n is obtained, a corresponding knob control signal is generated and sent to the wireless sending module; The wireless sending module is used to send control signals to the receiving end. 2. The virtual instrument control device according to claim 1, wherein the virtual instrument function corresponding to each operation of the multiplex function key is controlled by a counter, and the counter is used to record the number of pressing operations of the multiplex function key, Each time the number of times increases, one function will be switched backwards according to the preset virtual instrument function sequence table. If the current function is the last one in the sequence table and the number of times is increased by 1, it will return to the first function in the sequence table. 3. The virtual instrument control device according to claim 1, wherein the heading angle yaw is calculated by the following formula: $\mathrm{<span\; class="notranslate">\; the\; y</span>}\mathrm{<span\; class="notranslate">\; a</span>}\mathrm{<span\; class="notranslate">\; w</span>}<span\; class="notranslate">\; =</span>\mathrm{<span\; class="notranslate">\; a</span>}\mathrm{<span\; class="notranslate">\; r</span>}\mathrm{<span\; class="notranslate">\; c</span>}\mathrm{<span\; class="notranslate">\; t</span>}\mathrm{<span\; class="notranslate">\; a</span>}\mathrm{<span\; class="notranslate">\; no</span>}<span\; class="notranslate">\; (</span>\frac{\mathrm{<span\; class="notranslate">\; 2</span>}<span\; class="notranslate">\; (</span>\mathrm{<span\; class="notranslate">\; w</span>}\mathrm{<span\; class="notranslate">\; z</span>}<span\; class="notranslate">\; +</span>\mathrm{<span\; class="notranslate">\; x</span>}\mathrm{<span\; class="notranslate">\; the\; y</span>}<span\; class="notranslate">\; )</span>}{\mathrm{<span\; class="notranslate">\; 1</span>}<span\; class="notranslate">\; -</span>\mathrm{<span\; class="notranslate">\; 2</span>}<span\; class="notranslate">\; (</span>{\mathrm{<span\; class="notranslate">\; the\; y</span>}}^{\mathrm{<span\; class="notranslate">\; 2</span>}}<span\; class="notranslate">\; +</span>{\mathrm{<span\; class="notranslate">\; z</span>}}^{\mathrm{<span\; class="notranslate">\; 2</span>}}<span\; class="notranslate">\; )</span>}<span\; class="notranslate">\; )</span>$ Among them, w is the real part of the quaternion (w, x, y, z), and x, y, z is the imaginary part of the quaternion (w, x, y, z). 4. The virtual instrument control device according to claim 1, further comprising a wireless sending buffer for storing unsent control signals.