CN116403345B - Trackless equipment safety early warning method and system based on multi-source information fusion - Google Patents

Trackless equipment safety early warning method and system based on multi-source information fusion

Info

Publication number
CN116403345B
CN116403345B CN202211713643.1A CN202211713643A CN116403345B CN 116403345 B CN116403345 B CN 116403345B CN 202211713643 A CN202211713643 A CN 202211713643A CN 116403345 B CN116403345 B CN 116403345B
Authority
CN
China
Prior art keywords
vehicle
operator
alarm
safety
warning
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
CN202211713643.1A
Other languages
Chinese (zh)
Other versions
CN116403345A (en
Inventor
王华武
刘鹏刚
刘世永
丛金坤
鲁旭杰
任许铭
郝龙松
孙海波
滕智安
贾晓鹏
赵法灿
徐金泽
周波
刘滨
尹文超
孙宝庆
李传宏
刘明辉
曲涛
刘升龙
赵泽
卢威
王海卫
苏环
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Xincheng Gold Mining Shandong Gold Mining Co ltd
Original Assignee
Xincheng Gold Mining Shandong Gold Mining Co ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Xincheng Gold Mining Shandong Gold Mining Co ltd filed Critical Xincheng Gold Mining Shandong Gold Mining Co ltd
Priority to CN202211713643.1A priority Critical patent/CN116403345B/en
Publication of CN116403345A publication Critical patent/CN116403345A/en
Application granted granted Critical
Publication of CN116403345B publication Critical patent/CN116403345B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Classifications

    • GPHYSICS
    • G08SIGNALLING
    • G08BSIGNALLING OR CALLING SYSTEMS; ORDER TELEGRAPHS; ALARM SYSTEMS
    • G08B13/00Burglar, theft or intruder alarms
    • G08B13/02Mechanical actuation
    • G08B13/12Mechanical actuation by the breaking or disturbance of stretched cords or wires
    • G08B13/122Mechanical actuation by the breaking or disturbance of stretched cords or wires for a perimeter fence
    • GPHYSICS
    • G08SIGNALLING
    • G08GTRAFFIC CONTROL SYSTEMS
    • G08G1/00Traffic control systems for road vehicles
    • G08G1/01Detecting movement of traffic to be counted or controlled
    • G08G1/0104Measuring and analyzing of parameters relative to traffic conditions
    • GPHYSICS
    • G08SIGNALLING
    • G08GTRAFFIC CONTROL SYSTEMS
    • G08G1/00Traffic control systems for road vehicles
    • G08G1/123Traffic control systems for road vehicles indicating the position of vehicles, e.g. scheduled vehicles; Managing passenger vehicles circulating according to a fixed timetable, e.g. buses, trains, trams
    • GPHYSICS
    • G08SIGNALLING
    • G08GTRAFFIC CONTROL SYSTEMS
    • G08G1/00Traffic control systems for road vehicles
    • G08G1/16Anti-collision systems
    • G08G1/166Anti-collision systems for active traffic, e.g. moving vehicles, pedestrians, bikes

Landscapes

  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Engineering & Computer Science (AREA)
  • Radar, Positioning & Navigation (AREA)
  • Remote Sensing (AREA)
  • Chemical & Material Sciences (AREA)
  • Analytical Chemistry (AREA)
  • Traffic Control Systems (AREA)

Abstract

本发明公开了一种基于多源信息融合的无轨设备安全预警方法及系统。所述预警方法包括轨迹交集实时监测、环境安全监测、预警等级判别、碰撞判断、主动干预刹车等步骤。预警系统包括运行在服务器上的中控系统,还包括安装在各车辆上的车载主机、车载显示屏、车载定位装置、车载报警装置和所述安全预警识别装置,以及穿戴在工作人员身上的立体感知系统。本发明实现了车辆与人员的实时性交互式预警,还可以确保报警的准确性和有效性,消除预警盲点,提高识别的及时性和稳定性,为矿山的安全生产提供保障。

The present invention discloses a safety warning method and system for trackless equipment based on multi-source information fusion. The warning method includes the steps of real-time monitoring of track intersections, environmental safety monitoring, warning level determination, collision determination, and active braking intervention. The warning system includes a central control system running on a server, an on-board host computer installed on each vehicle, an on-board display screen, an on-board positioning device, an on-board alarm device, and the safety warning identification device, as well as a three-dimensional perception system worn by staff. The present invention realizes real-time interactive warning for vehicles and personnel, and can also ensure the accuracy and effectiveness of the alarm, eliminate warning blind spots, improve the timeliness and stability of identification, and provide protection for safe production in mines.

Description

Trackless equipment safety early warning method and system based on multi-source information fusion
Technical Field
The invention belongs to the field of mine trackless equipment, and particularly relates to an early warning method for running of trackless equipment and an early warning method.
Background
Mechanized mining becomes the trend of development of underground mines in China, and underground trackless equipment is widely applied to underground metal nonmetal underground mines and is more and more widely used due to flexible maneuvering and adaptation to more complex environments. However, due to the fact that the size of an underground roadway is limited and the requirements of collision and falling rocks are met, the trackless equipment has the problems of low position of a vehicle body cab, limited space, long vehicle body and the like, the range of dead zones of the vehicle is large, and the problems of large potential safety hazard and easy initiation of various accidents exist in the working process. Trackless equipment injuries have become an important risk point for mines.
In order to reduce and eliminate vehicle injury accidents caused by blind areas of visual field of trackless equipment, the prior art mainly adopts a radar or sensor-based vehicle collision prevention early warning system. When the recognition device arranged around the vehicle detects that the obstacle is too close to the distance, an alarm is sent out to prompt the driver and related personnel. However, for vehicles running in underground roadways, the monitoring alarm still has defects and hidden trouble:
firstly, the warning state can always appear under the influence of the height and the width of the roadway and the mutual influence of personnel and vehicles, even if other obstacles appear around the vehicles, the warning meaning of the warning state is lost.
Secondly, the existing early warning system is not combined with human behavior recognition, especially cannot recognize human behaviors in blind areas, and early warning blind spots exist.
And thirdly, the intelligent early warning and control linkage cannot be made by combining the human body behaviors and the states of the trackless equipment, the early warning effect is poor, and the safety cannot be truly improved.
Fourth, the condition is abominable in the pit, and the condition is complicated, and the personnel are numerous, and recognition device on the vehicle can't perception personnel's present position in advance, must keep the monitoring state of high strength constantly, and the operand is big, and the time diapause is strong, can not in time discover dangerous condition and take measures immediately, can not normally operate because of the problem such as calorific capacity is big even.
Fifth, the existing alarm mechanism is unilateral alarm of the vehicle, the underground environment is visual field, the noise is large, and the operator in dangerous situation can not receive the alarm signal in time or can not find the dangerous vehicle immediately according to the alarm.
Disclosure of Invention
The invention provides a trackless equipment safety pre-warning method and system based on multi-source information fusion, which aims to (1) realize real-time interactive pre-warning of vehicles and personnel, ensure that the vehicles and the personnel can send and receive effective warning signals, (2) provide dead zone identification capability for the vehicles and eliminate pre-warning blind spots, (3) reduce the operation amount of an identification device, improve the timeliness and stability of identification, and (4) realize linkage of pre-warning and vehicle control and improve safety.
The technical scheme of the invention is as follows:
A trackless equipment safety precaution method based on multisource information fusion includes the steps:
The method comprises the steps that 1, a vehicle and an operator report positions to a central control system in real time, and the central control system judges whether track intersection exists between the vehicle and the operator in real time according to the positions of the vehicle and the operator;
step 2, if the intersection exists between the vehicle and the operator, starting a safety early warning identification device arranged on the vehicle, starting a stereoscopic perception system on the operator, and then continuously executing the step 3;
Step 3, the environmental safety monitoring system judges whether the possibility of collision between the operator and the vehicle and the distance between the operator and the vehicle exist or not through a safety early warning recognition device, and a monitoring result is obtained;
step 4, the central control system judges the early warning level according to the result of the environmental safety monitoring system, if the early warning level is low, the alarm device on the vehicle and the stereoscopic perception system on the operator body send out low-frequency alarm, and then the step 3 is skipped;
And 5, predicting whether the vehicle still collides with the operator under the condition that the driver takes the brake after receiving the alarm, if the predicted result considers that the vehicle cannot collide, both an alarm device on the vehicle and a three-dimensional sensing system on the operator send out high-frequency alarm, then returning to the step 3, carrying out environmental safety monitoring again and judging the early warning level, and if the predicted result considers that the vehicle collides, the central control system sends an active brake signal to a control system of the vehicle to control the vehicle to actively brake until the danger is relieved, and unlocking the vehicle and returning to the step 1.
In the step 1, whether a track intersection exists between a vehicle and an operator is judged according to an electronic fence, wherein the electronic fence is a virtual interference range which is set by a central control system around the real-time position of the vehicle and/or the operator, and when judging, if the intersection exists between the electronic fence of the vehicle and the operator or the intersection exists between the electronic fence and the position of the other party, the two are considered to exist.
In the step 2, the central control system finds that the track between the vehicle and the operator has an intersection, then the clean protection device on the safety early-warning identification device is closed before the safety early-warning identification device is started, the central control system detects that the track between the vehicle and the operator does not have the intersection, then whether the clean protection device on the safety early-warning identification device is started or not is detected, if not, the clean protection device is started, and after the clean protection device is determined to be started, the step 1 is returned.
As a further improvement of the trackless equipment safety precaution method based on multi-source information fusion, the specific steps of the step 3 are as follows:
step 3.1, starting a safety early warning recognition device by the environment safety detection system at a high frame rate;
Step 3.2, the safety early warning recognition device evaluates the noise of the acquired environmental information, if the noise is too high, the step 3.3 is executed after the environmental information noise reduction algorithm is started, otherwise, the step 3.3 is directly executed;
step 3.3, the safety early warning recognition device monitors surrounding obstacles in real time;
Step 3.4, the safety early warning recognition device judges whether to switch the frame rate according to the current acquired data, if so, the safety early warning recognition device jumps to step 3.3 after switching, otherwise, the safety early warning recognition device executes step 3.5;
step 3.5, the safety early warning recognition device obtains the distance between the monitored obstacle target and the vehicle, and gives a monitoring result;
and 3.6, waiting for a period of time, if a closing request is received, closing the environment safety monitoring system, otherwise, jumping to the step 3.3, and continuing to monitor.
In step 3.5, firstly, calculating a space which the vehicle needs to pass through according to the current speed, load and position of a steering wheel, namely a monitoring space, when the vehicle continues to run according to the current state, then, capturing and identifying whether an operator enters the monitoring space in real time by a camera in the safety early-warning identification device, if the operator enters the monitoring space, acquiring the position and the movement speed of the operator relative to the vehicle by an image shot by the camera, further acquiring a scanning result of a radar, and taking the distance between an obstacle corresponding to the position and the vehicle in the scanning result as the distance between the operator and the vehicle.
As a further improvement of the trackless equipment safety early warning method based on multi-source information fusion, after an image of an operator entering a monitoring space is acquired through a camera, the image is displayed on a vehicle-mounted display screen, different audible and visual alarm states are set according to the distance between the operator and a vehicle, and meanwhile, alarm information with different colors is provided on the vehicle-mounted display screen around the operator.
In step 4, if the vehicle or the operator needs to send out alarm signals of a plurality of different grades at the same time, the highest grade is used for alarming.
In step 5, if the predicted result is considered to collide, the central control system monitors the current braking state of the vehicle after sending an active braking signal to the control system of the vehicle, if the driver has braked or temporarily cancels the active braking function, the step returns to step 3, otherwise, the vehicle is controlled to actively brake.
The trackless equipment safety early warning system based on the early warning method comprises the central control system, and further comprises a vehicle-mounted host computer, a vehicle-mounted display screen, a vehicle-mounted positioning device, a vehicle-mounted alarm device and the safety early warning recognition device which are arranged on each vehicle;
The vehicle-mounted host is in communication connection with the central control system, and the vehicle-mounted display screen, the vehicle-mounted positioning device, the vehicle-mounted alarm device and the safety early warning recognition device are respectively in communication connection with the vehicle-mounted host;
The early warning system also comprises a stereoscopic perception system which is arranged on an operator and is in communication connection with the central control system, wherein the stereoscopic perception system comprises a human body positioning device;
the vehicle-mounted alarm device and the stereoscopic perception system are provided with an audible and visual alarm module and a vibration alarm module.
The safety early warning recognition device comprises four groups of cameras and ultrasonic radars which are arranged at the left front, the right front, the left rear and the right rear of the vehicle;
The vehicle-mounted alarm device comprises an in-vehicle alarm and an out-of-vehicle alarm.
Compared with the prior art, the intelligent early warning system has the advantages that (1) when collision possibility exists, alarm signals of different grades including vibration and sound and light are synchronously sent to a vehicle and an operator, so that the driver and the operator can realize danger and dangerous degree at the same time, corresponding measures are quickly taken, real-time interactive early warning of the vehicle and the operator is finally realized, effectiveness of warning is ensured, on the basis of an electronic fence, the possibility of collision between the operator and the vehicle and the distance are further judged through the safety early warning recognition device, comprehensive safety recognition early warning capability is provided for the vehicle, an early warning blind spot is eliminated, early warning accuracy is improved, 3) the safety early warning recognition device and a three-dimensional sensing system are started only after the central control system finds that an intersection exists between the vehicle and the operator according to the electronic fence, the operation amount of the vehicle safety early warning recognition device is reduced, the timeliness and stability of recognition are improved, decision on whether to actively intervene in braking after the vehicle and the operator are finally realized, the safety early warning is improved according to actual conditions, the linkage of the safety warning is improved, the safety warning recognition device can be further judged, the safety warning device is not influenced by the automatic time is not used, the safety warning device is fully monitored, the safety environment pollution is reduced, the safety is not has been monitored, and the safety environment pollution is fully is reduced, and the safety is not has been monitored, and the safety is fully has been monitored, and the safety environment has been fully has been reduced.
Drawings
FIG. 1 is a flow chart of the early warning method of the present invention;
FIG. 2 is a flow chart of an environmental security detection environment;
FIG. 3 is a schematic diagram of the early warning system of the present invention.
Detailed Description
The technical scheme of the invention is described in detail below with reference to the accompanying drawings:
as shown in fig. 3, the present embodiment provides a control system, which includes a central control system 1 running on a server, and further includes a vehicle-mounted host 2, a vehicle-mounted display screen 3, a vehicle-mounted positioning device, a vehicle-mounted alarm device and the safety pre-warning recognition device, which are mounted on each vehicle.
The central control system 1 can remotely manage various vehicle-mounted terminals, implement functions of remote upgrading, remote fault removal and the like, can call or check the remote working state of equipment in real time, and the platform system supports comprehensive butt joint and uploading of various data.
The vehicle-mounted host machine 2 integrates functions of four-way blind area algorithm early warning intelligent function, audio and video monitoring and the like, CAN receive and process GPS or high-precision positioning data and CAN bus information, has functions of video and audio recording, driving information recording, wireless data uploading, on-site printing and the like, and has stronger information processing capability. The vehicle-mounted host machine 2 can accurately detect various alarms based on a deep learning algorithm, and timely carry out video and voice reminding, so that a driver is alert to danger possibly occurring in advance, and the driving safety is effectively improved.
The in-vehicle host 2 is in communication connection with the central control system 1 in a wireless manner. The vehicle-mounted display screen 3, the vehicle-mounted positioning device, the vehicle-mounted alarm device and the safety pre-warning recognition device are respectively in communication connection with the vehicle-mounted host machine 2. The vehicle-mounted positioning device acquires the positioning of the vehicle in a GPS mode, a Beidou mode and the like and reports the positioning in real time.
The safety early warning recognition device comprises four groups of fisheye cameras 6 (can be monocular cameras and binocular cameras and can also be provided with infrared functions) and ultrasonic radars 7 (can be laser radars and millimeter wave radars) which are arranged at the left front, the right front, the left rear and the right rear of the vehicle, so that blind areas in different directions can be conveniently recognized, and full coverage is realized.
The vehicle-mounted alarm device comprises an in-vehicle alarm 4 and an out-of-vehicle alarm 5. The in-car alarm 4 mainly provides an alarm for a driver, and the out-car alarm 5 provides an alarm for surrounding operators.
The early warning system also comprises a stereoscopic perception system which is worn on the body of an operator and is in communication connection with the central control system 1. The stereoscopic perception system can be in the form of a helmet or a safety back clip, comprises a human body positioning device, acquires the positioning of an operator in a GPS (global positioning system), beidou and other modes, and reports the positioning in real time.
All vehicle-mounted alarm devices and three-dimensional perception systems are provided with an audible and visual alarm module and a vibration alarm module.
As shown in fig. 1, the working process of the safety warning of the warning system is as follows:
the central control system 1 is led into a daily operation task, then a vehicle-mounted system (comprising the vehicle-mounted host machine 2, the vehicle-mounted display screen 3 and the vehicle-mounted positioning device) on the trackless equipment and a stereoscopic perception system on the body of an operator are started, then an electronic fence data packet and a trackless vehicle running track data packet are issued, and then the following steps are executed:
and step 1, reporting the position of the vehicle and the operator to the central control system 1 in real time. The central control system 1 judges whether a track intersection exists between the vehicle and the operator in real time according to the positions of the vehicle and the operator.
Further, in step 1, whether a track intersection exists between the vehicle and the operator is judged according to the electronic fence. The electronic fence refers to a virtual interference range set by the central control system 1 around the real-time position of the vehicle and/or the operator, and the size of the range is preset according to the volume of the operator and the vehicle. When judging, if the intersection exists between the vehicle and the electronic fence of the operator or the intersection exists between the electronic fence and the position of the other party, the intersection of the two tracks is considered.
And 2, if an intersection exists between a certain vehicle and a certain operator, starting a safety early warning recognition device arranged on the vehicle, starting a stereoscopic perception system on the operator, preparing early warning, and then continuing to execute the step 3. If no intersection exists, returning to the step 1 to continue monitoring.
Furthermore, the central control system 1 finds that the track between a certain vehicle and other operators has intersection, and before the safety early warning recognition device is started, the clean protection device on the safety early warning recognition device is closed, so that the cleaning work is prevented from interfering with early warning. The central control system 1 detects whether the cleaning protection device on the safety early warning identification device is started or not when finding that the track between a certain vehicle and a certain operator does not have intersection, if not, the cleaning protection device is started, and after determining that the cleaning protection device is started, the step 1 is returned. The mode can fully utilize time to clean the identification device, so that the identification device always works in an optimal state.
The cleaning protection device comprises a brush, a cleaning liquid supply module and the like which swing back and forth, and the structural principle of the cleaning protection device is the same as that of a vehicle glass cleaning device, and the cleaning protection device is not described in detail herein.
However, the presence of intersections merely represents a relatively close distance and does not represent a potential collision, and therefore the following steps are also needed for further screening.
And 3, judging whether the possibility of collision between the operator and the vehicle and the distance between the operator and the vehicle exist or not by the environment safety monitoring system through the safety early warning recognition device, and obtaining a monitoring result. The environment safety monitoring system can be operated on the vehicle-mounted host machine 2 or in the central control system 1 according to the requirement.
As shown in fig. 2:
And 3.1, starting a safety early warning and identifying device by the environment safety detection system at a high frame rate.
And 3.2, the safety early warning recognition device evaluates the noise of the acquired environmental information, if the noise is too high, the environmental information noise reduction algorithm is started, then the step 3.3 is executed, and otherwise, the step 3.3 is directly executed.
As one of alternative noise assessment and noise reduction approaches:
firstly, establishing an imaging model of an image in fog noise:
Iλ(x)=Jλ(x)t(x)+Aλ(1-t(x))
Where I is the fog pattern received by the camera, J is the original signal of the scene, t is the transmissivity of the environment, and a is the light. lambda means that these terms are all wavelength dependent and are related to the three channels RGB in the image.
The model is improved, the illumination influence and the transmissivity graph are fused, the unified parameter K is used for representing the model, and a clear image can be reconstructed from the observed fog graph through the K value:
Jλ(x)=Kλ(x)Iλ(x)-Kλ(x)+1.
and learning out characteristics of different levels by using the neural network model, recovering Kmap in the scene, and completing noise reduction processing of the image based on the clear image from the above formula to the scene.
And 3.3, the safety early warning recognition device monitors surrounding obstacles in real time in a shooting and scanning mode.
And 3.4, the safety early warning recognition device judges whether to switch the frame rate according to the currently acquired data, if the shot image is not clear enough, the human body recognition cannot be realized, the safety early warning recognition device needs to switch to the high frame rate, and if the shot image is too clear, the safety early warning recognition device can switch back to the low frame rate. And after switching, jumping to the step 3.3 to re-shoot, otherwise, not switching and executing the step 3.5.
And 3.5, the safety early warning recognition device acquires the distance between the monitored obstacle target and the vehicle, and gives a monitoring result through a fusion decision.
Specifically, firstly, according to the current speed, load and position of the steering wheel of the vehicle, the space which the vehicle needs to pass through for continuing to run according to the current state, namely the monitoring space, is calculated, wherein the monitoring space comprises an area which can be directly observed by a driver and a blind area which is difficult to observe. Then, a camera in the safety early warning identification device captures and identifies whether an operator enters the monitoring space in real time. If an operator enters, the position and the movement speed of the operator relative to the vehicle are obtained through the image shot by the camera, the scanning result of the radar is further obtained, and the distance between the obstacle corresponding to the position and the vehicle in the scanning result is taken as the distance between the operator and the vehicle.
Further, the safety early warning recognition device can realize the detection and recognition of the dynamic and static states of the personnel, provide the change monitoring of the relative displacement between all operators and trackless equipment in the dead zone, set different warning priorities according to the change of the relative displacement, and lay a foundation for adopting different warning strategies, realizing active warning and classifying early warning in the subsequent steps. The vehicle-mounted host machine 2 CAN be connected with a vehicle body CAN signal, and CAN judge the movement trend by judging the gear, the turn light, the vehicle speed and the steering wheel corner signal and combining the relative distance, the relative movement speed, the movement direction and the like of the human and the vehicle, so that a foundation is laid for obtaining the danger degree later and giving corresponding early warning signals according to a preset rule.
Further, after the image of the operator entering the monitoring space is obtained through the camera, the image can be displayed on the vehicle-mounted display screen 3, the driver is prompted to pay attention to the safety of related personnel through the image, different audible and visual alarm states are set according to the distance between the operator and the vehicle, meanwhile, warning information with different colors is provided on the vehicle-mounted display screen 3 around the operator, for example, the blue data represent personnel are located outside the early warning distance, the blue data represent personnel are located in the primary early warning distance range, the yellow data represent personnel are located in the secondary early warning distance range, the orange data represent personnel are located in the tertiary early warning distance range, the red data represent personnel are located in the quaternary early warning distance range, the risk level, the category and the azimuth are intuitively fed back, and the driver is told in a classification and grading manner.
The distance can be identified in advance according to the image and fused with the detection result of the radar. Taking the height of a normal person as an example, an identification frame with the same size can be arranged on the picture of the camera 6, the position and the distance with trackless equipment are analyzed through displaying the body parts and the change speed of the person in the camera 6 in different early warning distances, and the nearby person is accurately positioned through the feedback distance data of the ultrasonic range radar. The distance threshold value is set on the data processing interface, and alarms with different degrees are performed when different threshold values are triggered.
In this step, as one of the optional decision modes, an environmental information weight function is defined first:
Wherein F (k) is a camera information weight function, r (k i) is an infrared camera information weight function, G (m) is a radar information weight function, and J (n) is a positioning information weight function. i is the i-th device sensor signal conveying information. The collision early warning grades among vehicles, operators and vehicles can be calculated through the comprehensive weight function of the environmental information, the coordinate parameters of the safe distance range are transmitted to the central control system 1, and the comprehensive judgment is carried out to carry out the safety early warning of different grades.
It should be noted that the above decision method is not the only decision method. In actual operation, the decision result can be directly obtained by combining the preset rule through the azimuth and the distance of the operator.
And 3.6, waiting for a period of time, if a closing request is received, closing the environment safety monitoring system, otherwise, jumping to the step 3.3, and continuing to monitor.
And 4, as shown in fig. 1, the central control system 1 judges the early warning level according to the result of the environmental safety monitoring system, if the early warning level is low, the alarm device on the vehicle and the stereoscopic perception system on the operator send out low-frequency alarm, and then the step 3 is skipped, and if the early warning level is high, the step 5 is continuously executed.
And 5, predicting whether the vehicle still collides with the operator or not under the condition that the driver takes the brake after receiving the alarm. If the predicted result indicates that the vehicle cannot collide, the warning device on the vehicle and the stereoscopic perception system on the operator body all send out high-frequency warning to prompt the operator to avoid and brake the driver, and then the vehicle returns to the step 3 to monitor the environmental safety again and judge the early warning level. If the predicted result indicates that the vehicle can collide, the central control system 1 sends an active braking signal to the control system of the vehicle, monitors the current braking state of the vehicle, and jumps back to the step 3 if the driver has braked or temporarily cancels the active braking function, otherwise, controls the vehicle to actively brake until the danger is relieved, unlocks the vehicle and returns to the step 1.
Further, if a certain vehicle or operator needs to send out alarm signals of a plurality of different grades at the same time, the highest grade is used for alarming. Meanwhile, after the operator feels the alarm of the stereoscopic perception system, the operator can observe the surrounding environment, and observe which vehicle gives out the alarm frequency consistent with the alarm frequency on the body, so as to determine the vehicle which should be avoided at present.
It should be noted that, since the determination time in step 5 is short, the audible and visual alarm, the vibration alarm, and the image alarm on the in-vehicle display screen 3 occur substantially simultaneously. As a part of cooperative alarm, the high-frequency and low-frequency alarm can be further refined during alarm, and surrounding personnel can quickly sense the dangerous degree in the modes of amplifying influence, changing the volume of a loudspeaker, increasing buzzing prompt, changing the speech speed of voice prompt and the like according to the distance value. For example, when the relative distance between the person and the front end or the rear end of the car body is 5 meters to 7 meters, a first-level early warning is sent out, the high-definition screen in the cab pops up the corresponding image in the front side or the rear side blind area, when the relative distance between the person and the front end or the rear end of the car body is 3 meters to 5 meters, the relative distance is becoming smaller, a second-level early warning is sent out, the high-definition screen in the cab pops up the corresponding image in the front side or the rear side blind area, the loudspeaker rings at the same time, the audible-visual alarm sounds and blinks, when the relative distance between the person and the front end or the rear end of the car body is becoming smaller, the high-definition screen in the cab pops up the corresponding image in the front side or the rear side blind area, the loudspeaker rings up the prompt sound and blinks, the audible-visual alarm sounds at the same time, the loudspeaker sounds the audible-visual alarm sounds the sound and blinks at the time, the sound-visual alarm sounds the sound and blinks at the time, and the vehicle is prevented from being braked directly by the driver. The vehicle head and the vehicle tail are provided with the primary warning area which is 7 meters away from the vehicle body, when the distance between the personnel and the front end or the rear end of the vehicle body exceeds 7 meters, the primary warning is released, the driver is not warned in a warning manner, the relative distance is between 5 meters and 7 meters, and when the relative distance is becoming larger, the primary warning is also released, and the driver is not warned in a warning manner so as to reduce invalid warning. The alarm classification of the personnel and the vehicles in the left and right dead zones is consistent with the front end and rear end classification method, and the classification distance is smaller, and the method is specifically characterized in that when the distance between the personnel and the left or right of the vehicle body is 2 meters to 1 meter and the relative distance is becoming smaller, a first-level early warning is sent out, and a high-definition screen in a cab pops up a corresponding image in the left or right dead zone; when the relative distance between the person and the left or right side of the car body is 1 meter to 0.6 meter, a secondary early warning is sent out, a high-definition screen in the cab pops up a corresponding image in the left or right blind area, the loudspeaker rings at the same time, an audible and visual alarm sounds and flashes, when the relative distance between the person and the front or the rear end of the car body is 0.3 meter to 0.6 meter, a tertiary early warning is sent out, the high-definition screen in the cab pops up a corresponding image in the left or right blind area, the loudspeaker rings at the same time, the audible and visual alarm sounds and flashes, when the relative distance between the person and the front or the rear end of the car body is less than 0.3 meter, a four-stage early warning is sent out, the high-definition screen in the cab pops up a corresponding image in the left or right blind area, the loudspeaker rings at the same time, the audible and visual alarm sounds at the same time, the engine directly takes emergency braking to avoid hurting the person.
The photo and video of the risk point early warning and the information of the related early warning can be stored in a local storage or uploading central control system 1, the blind area range or the early warning distance is increased or decreased through automatic data processing or manual processing, and the alarm is further set in a refined mode aiming at unused scenes such as reversing, straight running, turning and the like, so that dangerous false alarms are reduced, and the effectiveness of the alarm is improved.

Claims (10)

1.一种基于多源信息融合的无轨设备安全预警方法,其特征在于步骤为:1. A trackless equipment safety early warning method based on multi-source information fusion, characterized by the following steps: 步骤1、车辆和作业人员向中控系统(1)实时上报位置;中控系统(1)根据车辆和作业人员的位置,实时判断车辆与作业人员之间是否存在轨迹交集;Step 1: The vehicle and the operator report their positions to the central control system (1) in real time; the central control system (1) determines in real time whether there is an intersection between the trajectories of the vehicle and the operator based on their positions; 步骤2、如果车辆与作业人员之间存在交集,则启动安装在该车辆上的安全预警识别装置,并启动该作业人员身上的立体感知系统,然后继续执行步骤3;如果不存在交集,则返回步骤1继续监测;Step 2: If there is an intersection between the vehicle and the operator, activate the safety warning identification device installed on the vehicle and the stereoscopic perception system on the operator, and then continue to step 3; if there is no intersection, return to step 1 to continue monitoring; 步骤3、环境安全监测系统通过安全预警识别装置判断该作业人员是否存在与该车辆相互碰撞的可能性以及二者之间的距离,得到监测结果;Step 3: The environmental safety monitoring system determines whether there is a possibility of collision between the operator and the vehicle and the distance between the two through the safety warning identification device, and obtains a monitoring result; 步骤4、中控系统(1)根据环境安全监测系统的结果判断预警等级,如果预警等级为低,则该车辆上的报警装置和该作业人员身上的立体感知系统均发出低频报警,然后跳回步骤3;如果预警等级为高,则继续执行步骤5;Step 4: The central control system (1) determines the warning level based on the results of the environmental safety monitoring system. If the warning level is low, the alarm device on the vehicle and the stereoscopic perception system on the operator both issue a low-frequency alarm, and then jump back to step 3; if the warning level is high, continue to step 5; 步骤5、预测该车辆在驾驶员收到报警后采取刹车的情况下是否仍会与该作业人员发生碰撞;如果预测结果认为不会碰撞,则车辆上的报警装置和该作业人员身上的立体感知系统均发出高频报警,然后回到步骤3,重新进行环境安全监测并判断预警等级;如果预测结果认为会碰撞,则中控系统(1)向车辆的控制系统发出主动刹车信号,控制车辆主动刹车,直至危险解除后,解锁车辆并回到步骤1。Step 5: Predict whether the vehicle will still collide with the operator even if the driver brakes after receiving the alarm. If the prediction result shows that there will be no collision, the alarm device on the vehicle and the stereoscopic perception system on the operator will both issue a high-frequency alarm, and then return to step 3 to re-perform environmental safety monitoring and determine the warning level. If the prediction result shows that there will be a collision, the central control system (1) sends an active braking signal to the vehicle control system to control the vehicle to actively brake until the danger is eliminated, then unlock the vehicle and return to step 1. 2.如权利要求1所述的基于多源信息融合的无轨设备安全预警方法,其特征在于:步骤1中,依据电子围栏判断车辆与作业人员之间是否存在轨迹交集;所述电子围栏是指中控系统(1)围绕车辆和、或作业人员的实时位置而设置的虚拟干涉范围,判断时,若车辆和作业人员的电子围栏之间存在轨迹交集、或电子围栏与另一方的位置存在轨迹交集,则认为二者存在轨迹交集。2. The trackless equipment safety warning method based on multi-source information fusion as claimed in claim 1 is characterized in that: in step 1, it is judged whether there is a trajectory intersection between the vehicle and the operator based on the electronic fence; the electronic fence refers to a virtual interference range set by the central control system (1) around the real-time position of the vehicle and/or the operator, and when judging, if there is a trajectory intersection between the electronic fence of the vehicle and the operator, or there is a trajectory intersection between the electronic fence and the position of the other party, then it is considered that there is a trajectory intersection between the two. 3.如权利要求1所述的基于多源信息融合的无轨设备安全预警方法,其特征在于:步骤2中,当中控系统(1)发现车辆与作业人员之间的轨迹存在交集,则在启动安全预警识别装置之前,先关闭安全预警识别装置上的洁净防护装置;当中控系统(1)发现车辆与作业人员之间的轨迹不存在交集,则检测安全预警识别装置上的洁净防护装置是否已经启动,如果未启动则启动,在确定洁净防护装置已启动后,再返回步骤1。3. The trackless equipment safety warning method based on multi-source information fusion as described in claim 1 is characterized in that: in step 2, when the central control system (1) finds that there is an intersection between the trajectories of the vehicle and the operator, the clean protection device on the safety warning identification device is turned off before starting the safety warning identification device; when the central control system (1) finds that there is no intersection between the trajectories of the vehicle and the operator, it detects whether the clean protection device on the safety warning identification device has been started, and if not, it starts it, and after determining that the clean protection device has been started, returns to step 1. 4.如权利要求1所述的基于多源信息融合的无轨设备安全预警方法,其特征在于步骤3的具体步骤为:4. The trackless equipment safety early warning method based on multi-source information fusion according to claim 1, wherein the specific steps of step 3 are: 步骤3.1、环境安全检测系统以高帧率启动安全预警识别装置;Step 3.1: The environmental safety detection system activates the safety warning identification device at a high frame rate; 步骤3.2、安全预警识别装置对获取到的环境信息的噪声进行评估,如果噪声过高则启动环境信息降噪算法后再执行步骤3.3,否则直接执行步骤3.3;Step 3.2: The safety warning identification device evaluates the noise of the acquired environmental information. If the noise is too high, the environmental information noise reduction algorithm is activated before executing step 3.3. Otherwise, step 3.3 is executed directly. 步骤3.3、安全预警识别装置对周围障碍物进行实时监测;Step 3.3: The safety warning identification device monitors surrounding obstacles in real time; 步骤3.4、安全预警识别装置根据当前获取的数据判断是否切换帧率,如果需要切换则在切换后跳转至步骤3.3,否则执行步骤3.5;Step 3.4: The safety warning identification device determines whether to switch the frame rate based on the currently acquired data. If switching is required, the process jumps to step 3.3 after the switching. Otherwise, the process executes step 3.5. 步骤3.5、安全预警识别装置获取监测到的障碍物目标与本车辆之间的距离,给出监测结果;Step 3.5: The safety warning identification device obtains the distance between the monitored obstacle target and the vehicle and provides a monitoring result; 步骤3.6、等待一段时间,如果收到关闭请求,则关闭环境安全监测系统,否则跳转至步骤3.3,继续监测。Step 3.6: Wait for a while. If a shutdown request is received, shut down the environmental safety monitoring system. Otherwise, jump to step 3.3 and continue monitoring. 5.如权利要求4所述的基于多源信息融合的无轨设备安全预警方法,其特征在于:所述步骤3.5中,首先根据车辆当前的速度、载重和方向盘的位置,计算出车辆按当前状态继续行驶需要经过的空间即监测空间;然后,安全预警识别装置中的摄像头实时捕捉、识别是否有作业人员进入到该监测空间中,如果有作业人员进入,通过摄像头拍摄的图像获得该作业人员相对于车辆的位置与运动速度,再进一步获取雷达的扫描结果,将扫描结果中与该位置相对应的障碍物与车辆之间的距离作为该作业人员与车辆之间的距离。5. The trackless equipment safety early warning method based on multi-source information fusion as described in claim 4 is characterized in that: in the step 3.5, first, based on the current speed, load and steering wheel position of the vehicle, the space that the vehicle needs to pass through to continue traveling in the current state, i.e., the monitoring space, is calculated; then, the camera in the safety early warning identification device captures and identifies in real time whether there is an operator entering the monitoring space; if an operator enters, the position and movement speed of the operator relative to the vehicle are obtained through the image captured by the camera, and then the radar scanning result is further obtained, and the distance between the obstacle corresponding to the position in the scanning result and the vehicle is used as the distance between the operator and the vehicle. 6.如权利要求5所述的基于多源信息融合的无轨设备安全预警方法,其特征在于:在通过摄像头获取到进入监测空间的作业人员的图像后,将该图像显示在车载显示屏(3)上,并根据作业人员与车辆之间的距离设定不同的声光报警状态,同时在车载显示屏(3)上围绕该作业人员提供不同颜色的警示信息。6. The trackless equipment safety warning method based on multi-source information fusion as claimed in claim 5 is characterized in that: after the image of the operator entering the monitoring space is obtained by the camera, the image is displayed on the vehicle-mounted display screen (3), and different sound and light alarm states are set according to the distance between the operator and the vehicle, and at the same time, warning information of different colors is provided around the operator on the vehicle-mounted display screen (3). 7.如权利要求1所述的基于多源信息融合的无轨设备安全预警方法,其特征在于:步骤4中,如果车辆或作业人员需要同时发出多个不同等级的报警信号,则按其中最高的等级进行报警。7. The trackless equipment safety early warning method based on multi-source information fusion as claimed in claim 1 is characterized in that: in step 4, if the vehicle or the operator needs to send out multiple alarm signals of different levels at the same time, the highest level among them is used for alarm. 8.如权利要求1所述的基于多源信息融合的无轨设备安全预警方法,其特征在于:步骤5中,如果预测结果认为会碰撞,则在中控系统(1)向车辆的控制系统发出主动刹车信号后,先监控车辆当前的刹车状态,如果驾驶员已经刹车或者临时取消主动刹车功能,则跳回到步骤3,否则控制车辆主动刹车。8. The trackless equipment safety warning method based on multi-source information fusion as claimed in claim 1 is characterized in that: in step 5, if the prediction result shows that a collision will occur, then after the central control system (1) sends an active braking signal to the vehicle control system, the current braking state of the vehicle is first monitored. If the driver has braked or temporarily canceled the active braking function, the method jumps back to step 3; otherwise, the vehicle is controlled to brake actively. 9.一种基于如权利要求1所述的预警方法的无轨设备安全预警系统,其特征在于:包括所述中控系统(1),还包括安装在各车辆上的车载主机(2)、车载显示屏(3)、车载定位装置、车载报警装置和所述安全预警识别装置;9. A trackless equipment safety warning system based on the warning method according to claim 1, characterized in that it comprises the central control system (1), and further comprises an on-board host (2), an on-board display screen (3), an on-board positioning device, an on-board alarm device and the safety warning identification device installed on each vehicle; 所述车载主机(2)与中控系统(1)通信连接,所述车载显示屏(3)、车载定位装置、车载报警装置和安全预警识别装置分别与车载主机(2)通信连接;The vehicle-mounted host (2) is communicatively connected to the central control system (1), and the vehicle-mounted display screen (3), the vehicle-mounted positioning device, the vehicle-mounted alarm device, and the safety warning identification device are respectively communicatively connected to the vehicle-mounted host (2); 所述预警系统还包括安装在作业人员身上的、与所述中控系统(1)通信连接的立体感知系统;所述立体感知系统中包含人体定位装置;The early warning system further comprises a three-dimensional perception system installed on the operator and connected to the central control system (1); the three-dimensional perception system comprises a human body positioning device; 所述车载报警装置和立体感知系统均有声光报警模块和振动报警模块。The vehicle-mounted alarm device and the stereoscopic perception system both have an audible and visual alarm module and a vibration alarm module. 10.如权利要求9所述的无轨设备安全预警系统,其特征在于:所述安全预警识别装置包括安装在车辆左前方、右前方、左后方和右后方的四组摄像机(6)与超声雷达(7);10. The trackless equipment safety warning system according to claim 9, characterized in that: the safety warning identification device comprises four sets of cameras (6) and ultrasonic radars (7) installed at the front left, front right, rear left and rear right of the vehicle; 所述车载报警装置包括车内报警器(4)和车外报警器(5)。The vehicle-mounted alarm device comprises an in-vehicle alarm (4) and an out-vehicle alarm (5).
CN202211713643.1A 2022-12-19 2022-12-19 Trackless equipment safety early warning method and system based on multi-source information fusion Active CN116403345B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN202211713643.1A CN116403345B (en) 2022-12-19 2022-12-19 Trackless equipment safety early warning method and system based on multi-source information fusion

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN202211713643.1A CN116403345B (en) 2022-12-19 2022-12-19 Trackless equipment safety early warning method and system based on multi-source information fusion

Publications (2)

Publication Number Publication Date
CN116403345A CN116403345A (en) 2023-07-07
CN116403345B true CN116403345B (en) 2025-08-08

Family

ID=87014839

Family Applications (1)

Application Number Title Priority Date Filing Date
CN202211713643.1A Active CN116403345B (en) 2022-12-19 2022-12-19 Trackless equipment safety early warning method and system based on multi-source information fusion

Country Status (1)

Country Link
CN (1) CN116403345B (en)

Families Citing this family (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN119360674A (en) * 2024-12-24 2025-01-24 西安优迈智慧矿山科技有限公司 Vehicle-mounted anti-collision terminal based on single Beidou RTK positioning and V2V communication

Citations (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN104933893A (en) * 2013-08-02 2015-09-23 本田技研工业株式会社 Vehicle To Pedestrian Communication System And Method
CN106781700A (en) * 2017-03-21 2017-05-31 中国矿业大学(北京) Coal mine underground transport vehicle personnel injure early warning system

Family Cites Families (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2019180074A (en) * 2018-03-30 2019-10-17 パナソニックIpマネジメント株式会社 Driving support system, image processing device, and image processing method
CN111554124B (en) * 2020-04-16 2022-07-01 天津职业技术师范大学(中国职业培训指导教师进修中心) Right-turn collision avoidance warning system and warning method for large trucks at intersections
KR20220060003A (en) * 2020-11-02 2022-05-11 현대모비스 주식회사 Vehicle collision preventignd system and control method thereof
CN214138371U (en) * 2020-11-09 2021-09-07 上海网车科技有限公司 Door opening early warning device based on ultrasonic radar
CN112885144B (en) * 2021-01-20 2022-05-31 同济大学 Method and system for early warning of vehicle crash event in construction work area
CN113223325A (en) * 2021-03-26 2021-08-06 南京市德赛西威汽车电子有限公司 Method for safely passing signal-lamp-free intersection

Patent Citations (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN104933893A (en) * 2013-08-02 2015-09-23 本田技研工业株式会社 Vehicle To Pedestrian Communication System And Method
CN106781700A (en) * 2017-03-21 2017-05-31 中国矿业大学(北京) Coal mine underground transport vehicle personnel injure early warning system

Also Published As

Publication number Publication date
CN116403345A (en) 2023-07-07

Similar Documents

Publication Publication Date Title
US20220406073A1 (en) Obstacle detection and notification for motorcycles
EP3971857A1 (en) System & method for remote monitoring of a vehicle, robot or drone
CN102387941B (en) Method and system to enhance traffic safety and efficiency for vehicles
CN113276769A (en) Vehicle blind area anti-collision early warning system and method
CN114586082A (en) Enhanced on-board equipment
US20070088488A1 (en) Vehicle safety system
CN112885144A (en) Early warning method and system for vehicle crash event in construction operation area
CN107458306A (en) Vehicle safety method for early warning and device
CN105474635A (en) Periphery monitoring device for work machine
KR20210102540A (en) Method for alerting danger situations of moving object and apparatus for the same
CN102858611A (en) Integrated object detection and warning system
CN107077795A (en) Assistance systems for detecting driving obstacles in the vehicle's surroundings
JP7072591B2 (en) Vehicle collision prevention device and vehicle collision prevention method
CN114360210A (en) Vehicle fatigue driving early warning system
CN114537374A (en) Vehicle front anti-collision system based on travelable area
JP2018092554A (en) Accident occurrence prediction device
CN115249416B (en) Mining shuttle car anti-collision early warning method and system
CN117533303A (en) Engineering machinery active safety early warning system
EP2151358A1 (en) Method and device for assisting the driver of a vehicle in identifying obstacles with ultrasound sensors
CN115064005A (en) A vehicle blind spot early warning method, system and storage medium
CN116403345B (en) Trackless equipment safety early warning method and system based on multi-source information fusion
CN120452126A (en) A road construction safety adaptive warning broadcast system and method
CN114852055B (en) Dangerous pedestrian perception cognition method and system in parking lot environment
JP2009083743A (en) Warning device for vehicle
CN112037484A (en) A railway freight yard anti-intrusion safety intelligent early warning system

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant