TWI717425B - Physiological sensor system for distinguishing personal characteristic - Google Patents

Abstract

The physiological sensor system includes a human-computer interaction system, and a detector. The human-computer interaction system has a head mounted apparatus including a display device, a processing device, and a stored device. The detector detects at least one physiological characteristic of the wearer. The processing device receives the physiological characteristic of the wearer and compares the physiological characteristic of the wearer with a plurality of the biometric data of users whose identity are known. The biometric data of users are stored by the stored device. When the physiological characteristic of the wearer is same with at least one the biometric data of the user, the processing device determines that the wearer’s identity is verified, the processing device transmits at least one of the video content signals, according to the physiological characteristic of the wearer to the display device and the display device displays the video content signal.

Description

User physiological sensing system capable of distinguishing user's physiological characteristics

The invention relates to a user physiological sensing system that can distinguish the physiological characteristics of the user.

Smart phones, tablet computers and other terminal devices with display screens combined with head-mounted display devices to watch multi-dimensional videos, experience virtual reality games, and watch virtual tourist attractions have become the focus of the global market. The head-mounted display device can cover most of the viewing angle of the viewer by wearing the head, so as to realize the creation of a virtual reality environment and improve the feeling of being in it. At the same time, supplemented by a head position tracking and positioning device, the display content of the device is changed correspondingly by capturing the viewer's viewpoint position, thereby creating an immersive sense of interaction and experience.

In the field of wearable devices, head-mounted display devices usually use a combination of letters and digits as a means of identifying a user’s identity. It is inconvenient and inconvenient to use an operator to wave in mid-air to select letters and digits on a virtual keyboard. Very laborious. On the other hand, the head-mounted display device lacks active recognition of the body language and emotional response generated by the user watching videos or experiencing games and the means of interacting with the user, making it difficult for the user to be completely immersed in the interaction. Sense and experience.

In order to solve the problems in the background art, the present invention discloses a user physiological sensing system. The user physiological sensing system includes a physiological sensing device, a head-mounted device, a processing device, and a data storage device. The processing device, the data storage device and the physiological sensing device are all arranged in the head-mounted device. When the user fixes the head-mounted device on the head, the physiological sensing device can detect the physiological signal of at least one user and send it to the processing device, and the processing device stores the physiological signal of the user in the data The multiple physiological identification signals of the storage device are compared.

The head-mounted device also includes a display device connected to the processing device, the data storage device also stores a plurality of video and audio signals, the processing device can compare the physiological signal of the user with the physiological identification signal and generate a detection signal, the processing The device can respond to the detection signal, and transmit at least one video and audio signal corresponding to the detection signal to the display device.

According to another embodiment of the present invention, the processing device and the data storage device are arranged outside the head-mounted device. The processing device, the data storage device and the head-mounted device can utilize wireless communication or wired connection to transmit the user's physiological signal, the physiological identification signal, and the video and audio signal.

According to another embodiment of the present invention, the physiological sensing device is an independent device provided outside the head-mounted device, and is fixed to the user's body by wearing. Wireless communication or wired connection can be used between the physiological sensing device and the head-mounted device to transmit physiological signals of the user.

According to another embodiment of the present invention, the physiological sensing device can detect at least one physiological signal of the user and transmit it to the processing device, and the processing device can compare the physiological signal of the user with the data stored in the data storage device. This physiological identification signal is compared. The processing device can use the comparison result of the physiological signal of the user and the physiological identification signal to determine the current emotional state of the user.

100‧‧‧User Physiological Sensing System of the First Embodiment

102‧‧‧Signal Analysis System

1021‧‧‧Head-mounted device

1022‧‧‧Fixed device

1023‧‧‧Display device

1024‧‧‧Optical system

1025‧‧‧Processing device

1026‧‧‧Data storage device

104‧‧‧Physiological sensing device

106‧‧‧User's physiological signal

108‧‧‧Video signal

200‧‧‧User Physiological Sensing System

2021‧‧‧The head-mounted device of the second embodiment

2025‧‧‧Processing device

2026‧‧‧Data Storage Device

206‧‧‧User's physiological signal

208‧‧‧Video signal

300‧‧‧User Physiology Sensing System of the Third Embodiment

3021‧‧‧Head-mounted device

304‧‧‧Physiological sensing device

306‧‧‧User's physiological signal

308‧‧‧Video signal

400‧‧‧User Physiological Sensing System of the Fourth Embodiment

4025‧‧‧Processing device

4026‧‧‧Data storage device

404‧‧‧Physiological sensing device

406‧‧‧User's physiological signal

4082‧‧‧Video signal

4084‧‧‧Video signal

500‧‧‧Fourth embodiment flow chart

600‧‧‧User Physiological Sensing System of the Fifth Embodiment

6021‧‧‧Head-mounted device

6022‧‧‧Fixed device

6023‧‧‧Display device

6024‧‧‧Optical system

60242‧‧‧lens

6025‧‧‧Processing device

6026‧‧‧Data storage device

604‧‧‧Physiological sensing device

606‧‧‧User's physiological signal

608‧‧‧Video signal

Figure 1 is a schematic diagram of a user's physiological sensing system according to the first embodiment of the present invention.

Figure 2 is a cross-sectional view taken along line A-A' of Figure 1 of the user's physiological sensing system according to the first embodiment of the present invention.

Figure 3 is a schematic diagram of the user's physiological sensing system in use according to the first embodiment of the present invention.

Figure 4 is a schematic diagram of the user's physiological sensing system in use according to the second embodiment of the present invention.

Figure 5 is a schematic diagram of the user's physiological sensing system in use according to the third embodiment of the present invention.

FIG. 6 is a schematic diagram of the use state of the user's physiological sensing system according to the fourth embodiment of the present invention.

FIG. 7 is a schematic diagram of the implementation process of the user's physiological sensing system according to the fourth embodiment of the present invention.

FIG. 8 is a schematic diagram of a user's physiological sensing system according to the fifth embodiment of the present invention.

Figure 9 is a schematic diagram of the user's physiological sensing system in use according to the fifth embodiment of the present invention.

FIG. 10 is a schematic diagram of the use state of the user's physiological sensing system according to the sixth embodiment of the present invention.

FIG. 11 is a schematic diagram of the use state of the user's physiological sensing system according to the seventh embodiment of the present invention.

The present invention provides a detailed description of the subject of creative work. Although several embodiments are described, it should be understood that the subject of creative work is not limited to any one embodiment, but includes numerous alternatives, modifications and equivalent forms. In addition, although numerous specific details are stated in the following description in order to provide a thorough understanding of the subject of creative work, some embodiments may be practiced without some or all of these details. In addition, for the sake of clarity, certain technical materials known in related fields have not been described in detail so as not to unnecessarily confuse the subject of creative work.

1 is a schematic front view of a first embodiment of a user's physiological sensing system 100. The user's physiological sensing system 100 includes a signal analysis system 102 and a physiological sensing device 104. The signal analysis system 102 includes a head-mounted device 1021, and the head-mounted device 1021 can be fixed on the head of a user by a fixing device 1022 connected to the head-mounted device 1021.

2 is a cross-sectional view of the first embodiment of the user's physiological sensing system 100 taken along the line AA' in FIG. 1. The signal analysis system 102 further includes a processing device 1025 and a data storage device 1026. The head-mounted The device 1021 also includes a display device 1023 and an optical system 1024. In the first embodiment, the processing device 1025 and the data storage device 1026 are disposed inside the head-mounted device 1021, and the processing device 1025 is connected to the display device 1023. When the user uses the fixing device 1022 to fix the head-mounted device 1021 on the user's head, one end of the optical system 1024 can correspond to the user's eyes, and the other end of the optical system 1024 can be opposite to the display device 1023, so that the user can Through the focus adjustment of the optical system 1024, the image or image played by the display device 1023 can be clearly seen. The data storage device 1026 can receive and store the user's physiological signals, a plurality of physiological identification signals, and a plurality of video and audio signals detected by the physiological sensing device 104. In another embodiment, the head-mounted device 1021 does not have the optical system 1024, and the user does not need to see the clear image or image played by the display device 1023 directly through the optical system 1024, or by using The vision correction device (for example, glasses, contact lenses) worn by the user himself sees the clear image or image played by the display device 1023.

The display device 1023 is used for receiving and playing the video and audio signal. The display device 1023 may be a display screen, a display screen with the function of playing audio signals, or an electronic device with the function of playing images or audio signals. The display screen may be, but not limited to, a liquid crystal display, a liquid crystal panel or a plasma display. The device can be, but is not limited to, a smart phone or a tablet computer. The audio-visual signal is stored in the data storage device 1026, and any one of the audio-visual signals includes at least one of the following: an image signal, an audio signal, a user preference setting signal, a user interactive interface signal, and a combination of the above. The video and audio signal can be the data originally stored in the data storage device 1026 of the user's physiological sensing system 100, or it can be loaded and stored by the user's physiological sensing system 100 connected to an external server through wireless communication or wired transmission. To the data storage device 1026, the video and audio signal can also be used by the user according to his own preferences, using the user's physiological sensing system 100 to set the user's preferred image, audio, user interaction interface, and the above combination to generate the user A preference setting signal, the user preference setting signal is combined with an image signal, an audio signal or a user interactive interface signal to generate the video and audio signal and store it in the user physiological sensing system 100. In at least one embodiment, the video and audio signal is based on the user’s current emotional state, using the user’s physiological sensing system 100 to set the user’s preferred video signal, audio signal, user interaction interface, and the above combination to generate and use The user prefers the setting signal, and the user preference setting signal is combined with the image signal, the audio signal or the user interactive interface signal to generate the video and audio signal and store it in the user physiological sensing system 100.

The processing device 1025 is connected to the display device 1023 and the data storage device 1026, and is used to receive the physiological signal of the user and compare the similarity between the physiological signal of the user and the physiological identification signal and generate a detection signal In response to the detection signal, the processing device 1025 can transmit at least one video and audio signal corresponding to the detection signal to the display device 1023. The physiological identification signal is a physiological signal of a user whose identity has been authenticated or a physiological signal of a user whose emotional state has been confirmed. The physiological identification signal may be the data originally stored in the data storage device 1026 of the user physiological sensing system 100, or the user physiological sensing system 100 may be loaded and stored by connecting to an external server through wireless communication or wired transmission. To the data storage device 1026. The above-mentioned physiological signals of the authenticated user and the physiological signals of the user whose emotional state has been identified can be, but are not limited to, electrocardiogram, brain wave, heartbeat, heart sound, blood pressure, blood oxygen, smell, intraocular pressure, limbs Or facial motion, iris image, facial image, and a combination of the above.

The data storage device 1026 can store the physiological signal of the user detected by the physiological sensing device 104, a plurality of the physiological identification signals, and a plurality of the video and audio signals.

The physiological sensing device 104 is used to detect the physiological signal of the user. The physiological sensing device 104 can be, but not limited to, a microneedle array device, a light sensor, a metal electrode, a microphone, a pressure sensor, an iris recognition device, and a combination thereof. In the first embodiment, the physiological sensing device 104 is disposed on the head-mounted device 1021 and connected to the processing device 1025. The physiological signals of the user can be, but are not limited to, electrocardiogram, brain wave, heartbeat, heart sounds, blood pressure, blood oxygen, smell, intraocular pressure, limb or facial movements, iris images, facial images, and combinations of the above. In at least one embodiment, the physiological sensing device 104 further includes a first communication element capable of transmitting physiological signals of the user, the head-mounted device 1021 further includes a second communication element connected to the processing device 1025, and the use The physiological signal of the user can be transmitted to the second communication element by wireless communication technology, and the second communication element can receive the physiological signal of the user and transmit it to the processing device 1025.

FIG. 3 is a schematic diagram of the implementation state of the first embodiment of the user physiological sensing system 100. In the first embodiment, the processing device 1025, the data storage device 1026, and the physiological sensing device 104 are all disposed in the head-mounted device 1021. When the user fixes the head-mounted device 1021 on the head, the physiological sensing device 104 can detect the physiological signal 106 of at least one user and send it to the processing device 1025. The processing device 1025 receives the physiological signal of the user. 106 is compared with a plurality of the physiological identification signals stored in the data storage device 1026, and a detection signal is generated. In another embodiment, the processing device 1025 can use a data analysis method, such as Fourier transform, to analyze the physiological signal 106 of the user and extract one or more characteristic points and multiple characteristics of the physiological signal 106 of the user. The physiological identification signal is relatively correct.

If the physiological signal 106 of the user does not match the physiological identification signal, it means that the identity of the current user has not been authenticated. The processing device 1025 will search for the detection signal based on the result of the comparison. A plurality of the audio-visual signals 108 corresponding to the physiological identification signal similar to the physiological signal 106 of the user in the data storage device 1026, and the audio-visual signal 108 is transmitted to the display device 1023 for the user to select the preferred audio-visual signal 108 Or the user can use the user physiological sensing system 100 to adjust the video and audio signal 108 or set the user's own preferred image and audio according to his own preferences, and generate a new user preference setting signal, the new user preference setting The signal is combined with the image signal, and the audio signal generates a new audio-visual signal and is stored in the data storage device 1026.

If the physiological signal 106 of the user is compared with at least one of the physiological identification signals to match it, it means that the identity of the current user has been authenticated, and the processing device 1025 can compare the physiological signal 106 of the user with the physiological signal 106. Identify the signal, determine the user’s identity, and generate the detection signal corresponding to the user’s identity. The processing device 1025 will search for the data storage device 1026 and the user’s physiology based on the detection signal generated by the comparison result. The at least one audiovisual signal 108 corresponding to the physiological identification signal corresponding to the signal 106 is sent to the display device 1023 to play the audiovisual signal 108 to the user.

FIG. 4 is a schematic diagram of the implementation state of the second embodiment of the user physiological sensing system 200. The second embodiment is similar to the first embodiment. The difference is that the processing device 2025 and the data storage device 2026 are not provided inside the head-mounted device 2021, but are independent devices provided outside the head-mounted device 2021. The processing device 2025, the data storage device 2026, and the head-mounted device 2021 can use wireless communication or wired connection to transmit the user's physiological signal 206, the physiological identification signal, and the video and audio signal 208. The wireless communication can be, but not limited to, hotspot (Wi-Fi), infrared light wireless transmission technology, Bluetooth wireless transmission technology, or other wireless signal transmission communication methods.

FIG. 5 is a schematic diagram of the implementation state of the third embodiment of the user physiological sensing system 300. The third embodiment is similar to the first embodiment. The difference is that the physiological sensing device 304 is an independent device provided outside the head-mounted device 3021 and fixed to the user's body by wearing. The physiological sensing device 304 and the head-mounted device 3021 can use wireless communication or wired connection to transmit the physiological signal 306 of the user. The wireless communication can be, but not limited to, hotspot (Wi-Fi), infrared light wireless transmission technology, Bluetooth wireless transmission technology, or other wireless signal transmission communication methods.

FIG. 6 is a schematic diagram of the implementation state of the fourth embodiment of the user physiological sensing system 400. The fourth embodiment is similar to the first embodiment. The difference is that the physiological sensing device 404 can detect at least one physiological signal 406 of the user and send it to the processing device 4025. The processing device 4025 receives the physiological signal of the user. 406 compares with a plurality of the physiological identification signals stored in the data storage device 4026, and generates a detection signal. The processing device 4025 can use the comparison result of the physiological signal 406 of the user and the physiological identification signal to determine the emotional state of the user, and generate the detection signal corresponding to the emotional state of the user. The processing device 4025 can respond to the detection signal, and transmit at least one audio-visual signal 4082 corresponding to the detection signal to the display device 4023. In at least one embodiment, the physiological sensing device 404 can also detect the physiological signal 406 of the user discontinuously or continuously, and the processing device 4025 can use the ratio of the physiological signal 406 of the user to the physiological identification signal. Yes, distinguish whether the user's emotional state has changed, and select and transmit the video and audio signal 4084 corresponding to the changed user's emotional state to the display device 4023, and play it to the user. The non-continuous detection can be a fixed period of time, such as one minute, one quarter of an hour, or one hour, or can be a non-continuous measurement performed by the user's own control of the user's physiological sensing system 400.

FIG. 7 is an implementation flowchart 500 of the fourth embodiment of the user's physiological sensing system 400.

In step 502, the physiological sensing device 404 can detect at least one physiological signal 406 of the user and send it to the processing device 4025.

In step 504, the processing device 4025 compares the user's physiological signal 406 with a plurality of the physiological identification signals stored in the data storage device 4026, and generates a detection signal. In the fourth embodiment, the physiological identification signal corresponds to the physiological signal for which the emotional state has been confirmed, and the emotional state may be, but not limited to, happiness, anger, sadness, fear, and a combination of the foregoing. The physiological identification signal includes at least one physiological signal whose emotional state of the user has been confirmed, an image signal and an audio signal. Specifically, when confirming that the user’s current emotional state is fear, measure at least one physiological signal of the user, such as an electrocardiogram, and convert it into a physiological signal with confirmed emotions, which can be processed The device 4025 determines that the current emotional state of the user with similar physiological signals is fear, and the processing device 4025 can combine the current image signal, audio signal and the emotionally confirmed physiological signal of the user to generate the physiological identification. And store the physiological identification signal in the storage device 4026, as shown in step 516.

In step 506, the processing device 4025 can use the comparison result of the user's physiological signal 406 and the physiological identification signal to determine the user's current emotional state, and generate the detection signal corresponding to the user's current emotional state. In the fourth embodiment, the processing device 4025 can compare the user's physiological signal 406 with the emotionally confirmed physiological signal of the physiological identification signal to determine the user's current emotional state, and based on the comparison result The detection signal corresponding to the current emotional state of the user is generated.

In step 508, the processing device 4025 can transmit the detection signal to the display device 4023 for presentation to the user, and the user can provide a feedback signal to the user's physiological sensing system 400 based on the detection signal. More specifically, if the user’s physiological signal 406 is compared with at least one of the physiological recognition signals to match it, the physiological recognition signal is converted into the detection signal, and the detection signal is transmitted to the display device 4023 for presentation to the user , Inform the user of the current emotion judgment result or video and audio signal suggestion. If the physiological signal 406 of the user does not match with the physiological signal 406, search for one or more physiological identification signals in the data storage device 4026 that are similar to the physiological signal 406 of the user, and compare the The physiological recognition signal is aggregated into the detection signal, and the detection signal is sent to the display device 4023 for presentation to the user, allowing the user to select the user’s current emotional judgment result that best matches the current emotional state, and the video and audio signal suggests or for the user The physiological sensing system 400 determines whether the current user's emotional state is correct to give a feedback signal.

In step 510, the user physiological sensing system 400 receives a feedback signal from the user. If the feedback signal is negative or negative, return to step 502 to re-detect the physiological signal 406 of the user or return to step 504 to re-compare the physiological signal of the user with the physiological identification signal. If the feedback signal is positive or positive, the physiological signal 406 of the user detected this time and the corresponding physiological identification signal are stored.

In step 512, the processing device 4025 searches for at least one video signal 4082 corresponding to the detection signal in the data storage device 4026 based on the detection signal generated by the comparison result, and transmits it to the display device 4023.

In step 514, the display device 4023 plays the audiovisual signal 4082 to the user. While playing the video signal 4082 to the user, the user physiological sensing system 400 can repeat steps 502 to step 506 to detect whether the user’s emotional state has changed, and in step 508 to step 512, the user can select The audio-visual signal 4084 corresponding to the changed user's emotional state is transmitted to the display device 4023, and played and presented to the user.

In step 516, the physiological signal of the user and the audio-visual signal 4082 corresponding to the emotional state of the user or the audio-visual signal 4084 corresponding to the changed emotional state of the user are stored.

FIG. 8 is a front view of a fifth embodiment of a user's physiological sensing system 600. The fifth embodiment is similar to the first embodiment. The difference is that the head-mounted device 6021 has a structure similar to glasses, and is fixed on the user's head by the fixing device 6022 connected to the head-mounted device 6021. The head-mounted device 6021 includes the display device 6023, the optical system 6024, the processing device 6025, the data storage device 6026, and the physiological sensing device 604 disposed inside the head-mounted device 602. The optical system 6024 includes two lenses 60242 corresponding to the user's eyes. Each lens 60242 is a transparent and light-permeable structure. The display device 6023 is installed in at least one lens 60242 for a part or all of the lenses. On the surface of the user or away from the user.

FIG. 9 is a schematic diagram of the implementation state of the fifth embodiment of the user's physiological sensing system 600. The physiological sensing device 604 can detect the physiological signal 606 of at least one user and send it to the processing device 6025. The processing device 6025 compares the physiological signal 606 of the user with a plurality of physiological identification signals, and generates Detection signal. The user’s physiological signal 606 is compared with at least one of the physiological identification signals to match it, indicating that the identity of the current user has been authenticated, and the processing device 6025 will search for the corresponding signal based on the detection signal generated by the comparison result. At least one of the audio-visual signal 608 corresponding to the physiological identification signal corresponding to the physiological signal 606 of the user is sent to the display device 6023 to play the audio-visual signal 608 to the user so that the user can see the audio-visual signal 608 at the same time And the real image of the external environment.

FIG. 10 is a schematic diagram of the implementation state of the sixth embodiment of the user's physiological sensing system 700. The sixth embodiment is similar to the fifth embodiment. The difference is that the processing device 7025 and the data storage device 7026 are not provided inside the head-mounted device 7021, but are independent devices provided outside the head-mounted device 7021. The processing device 7025, the data storage device 7026, and the head-mounted device 7021 can use wireless communication or wired connection to transmit the user's physiological signal 706, the physiological identification signal, and the video and audio signal 708.

FIG. 11 is a schematic diagram of the implementation state of the seventh embodiment of the user physiological sensing system 800. The seventh embodiment is similar to the fifth embodiment. The difference is that the physiological sensing device 804 is an independent device provided outside the head-mounted device 8021 and is fixed on the user's body by wearing. The physiological sensing device 804 and the head-mounted device 8021 can use wireless communication or wired connection to transmit the physiological signal 806 of the user.

In another embodiment, the processing device 4025 compares the user's physiological signal 406 with a plurality of the physiological identification signals stored in the data storage device 4026, and generates a detection signal. The user's physiological sensing system can train the user's physiological sensing system to recognize the user's emotional state by mechanical learning based on a plurality of the physiological identification signals and data analysis rules, and produce corresponding The detection signals, each of the detection signals includes an arousal level signal and an emotional valence level signal, and the arousal level signal and the emotional valence level signal can correspond to the emotional state of the user. For example, when the arousal level signal and the emotional valence level signal are connected to a higher level value, the user physiological sensing system will determine that the user is in a happy emotional state.

Although the foregoing has been described in detail for the sake of clarity, it is obvious that certain changes and modifications can be made without departing from the principles of the present invention. It should be noted that there are many alternative methods for implementing the processes and devices described herein. Therefore, the current implementation will be regarded as illustrative rather than restrictive, and the subject of creative work is not limited to the details given herein, and within the scope and equivalent form of the appended claims, the The details are modified.

102: Signal Analysis System

104: Physiological Sensing Device

106: User's physiological signal

108: video signal

Claims (10)

A physiological sensing system for a user, comprising: a physiological sensing device capable of detecting the physiological signal of the user; a head-mounted device; a data storage device capable of storing the physiological signal of the user and multiple physiological identification signals; and processing A device connected to the data storage device, the processing device can receive the physiological signal of the user and compare the similarity between the physiological signal of the user and the physiological identification signal, the head-mounted device includes a display device, the display device Connected to the processing device, the data storage device also stores a plurality of video and audio signals. The processing device can compare the physiological signal of the user with the physiological identification signal and generate a detection signal. The processing device can respond to the detection signal and send the corresponding At least one of the video and audio signals in the detection signal is sent to the display device. According to the user's physiological sensing system in item 1 of the scope of patent application, the physiological identification signal is the physiological signal of the user whose identity has been authenticated, and the processing device can compare the physiological signal of the user with the physiological identification signal, The identity of the user is determined, and the detection signal is generated, and the detection signal corresponds to the identity of the user. According to the user's physiological sensing system in the first item of the scope of patent application, the physiological sensing device is installed in the head-mounted device. According to the user's physiological sensing system in the first item of the scope of patent application, the physiological sensing device further includes a first communication element capable of transmitting physiological signals of the user, and the head-mounted device further includes a second communication element, the first communication element Two communication components are connected to the processing device, the The physiological signal of the user can be transmitted to the second communication element through wireless communication, and the second communication element can receive the physiological signal of the user and transmit it to the processing device. According to the user's physiological sensing system in the first item of the scope of patent application, the user's physiological signal can be electrocardiogram, brain wave, heartbeat, heart sound, blood pressure, blood oxygen, smell, intraocular pressure, limb or face movement, iris Image, face image, and a combination of the above. According to the user's physiological sensing system in the first item of the patent application, the sensing component can be a microneedle array device, a light sensor, a metal electrode, a microphone, a pressure sensor, an iris recognition device, and a combination of the above. According to the user's physiological sensing system in item 1 of the scope of patent application, the physiological identification signal is the physiological signal of the user whose emotional state has been recognized, and the processing device can compare the physiological signal of the user with the physiological identification signal , Determine the emotional state of the user, and generate the detection signal, which corresponds to the emotional state of the user. According to the user’s physiological sensing system of item 7 of the scope of patent application, the physiological sensing device can also non-continuously detect the physiological signal of the user, and the processing device can use the physiological signal of the user and the physiological identification signal. Comparing, distinguish whether the user's emotional state has changed, and select and transmit the video and audio signal corresponding to the changed user's emotional state to the display device. According to the user’s physiological sensing system of item 7 of the scope of patent application, the physiological sensing device can also continuously detect the physiological signal of the user, and the processing device can use the ratio of the physiological signal of the user to the physiological identification signal Yes, distinguish whether the user’s emotional state has changed, and select and transmit the one corresponding to the changed user’s emotional state The video and audio signal is sent to the display device. According to the user's physiological sensing system of item 7 of the scope of patent application, the processing device can send the detection signal to the display device to present it to the user, and the user can provide a feedback signal to the user's physiological sensing system based on the detection signal .

Images