CN103634205A - Vehicular entertainment system with integrated instant messaging/social application and method - Google Patents

Abstract

A vehicle entertainment system and method integrating instant messaging/social applications. The system includes: an input device and an output device; a communication device, which has a communication interface for wired and/or wireless connection with the mobile terminal, and transmits message data of instant messaging/social applications between the vehicle entertainment system and the mobile terminal; The processing device, after obtaining the application message input by the user through the input device, sends corresponding message data to the mobile terminal through the communication device according to the current instant messaging/social application of the mobile terminal; After the application message in the instant messaging/social application, relevant information of the application message is presented to the user through an output device. Users can also use instant messaging/social applications while driving, and can ensure driving safety.

Description

In-vehicle entertainment system and method integrating instant messaging/social applications

technical field

The invention relates to the application and development of in-vehicle entertainment service technology, in particular to an in-vehicle entertainment system and method integrating instant messaging/social applications.

Background technique

Nowadays, when driving a car, people not only pay attention to the driving experience, but also pay attention to the entertainment experience during driving. This demand for entertainment experience also promotes the continuous improvement and optimization of in-vehicle entertainment system functions. During this process, technologies related to radio and multimedia playback have also been continuously upgraded. Nowadays, with the further improvement of entertainment experience requirements, people are increasingly dissatisfied with the functional experience based on the existing car entertainment system, but hope to bring more other entertainment functions into the car.

At present, mobile terminal devices (such as mobile phones, tablet computers, etc.) provide far richer and more diverse entertainment experiences than in-vehicle entertainment functions. Among them, instant messaging applications and social networking applications are very popular among mobile terminal device users. Many users, especially young users, frequently use these software applications to communicate with friends. However, in the process of driving, especially for drivers, distracted use of these software applications will bring huge hidden dangers to driving safety. Even, in many areas, it is illegal to use mobile terminal devices while driving.

Contents of the invention

The problem solved by the present invention is to provide a vehicle entertainment system and method integrating instant messaging/social networking applications, so that users can experience instant messaging/social networking applications without using mobile terminal equipment while driving.

In order to solve the above problems, the vehicle entertainment system integrated instant messaging/social application provided by the present invention includes: .

input devices and output devices;

The communication device has a communication interface for wired and/or wireless connection with the mobile terminal, and transmits the message data of the instant messaging/social application between the vehicle entertainment system and the mobile terminal;

The application processing device, after obtaining the application message input by the user through the input device, sends corresponding message data to the mobile terminal through the communication device according to the current instant messaging/social application of the mobile terminal; After the application message in the instant messaging/social application, the relevant information of the application message is presented to the user through the output device.

The method for integrating instant messaging/social applications in the vehicle provided by the present invention includes:

Establish wired and/or wireless connections between vehicle equipment and mobile terminals;

The in-vehicle device receives the user's application message input, and transmits the message data to the mobile terminal through the established wired and/or wireless connection according to the current instant messaging/social application of the mobile terminal;

The vehicle-mounted device receives the message data of the mobile terminal, and presents relevant information of the application message to the user according to the current instant messaging/social application of the mobile terminal.

Compared with the prior art, the above solution has the following advantages: by using the vehicle-mounted device as a client device for processing instant messaging/social applications, instead of the interactive interface of the mobile terminal, it provides the user with the functions of message input and message presentation, and through The transmission of message data with the mobile terminal enables users to experience instant messaging/social applications in the car without directly using the mobile phone. Therefore, when the user uses the instant messaging/social application, the driving safety of the user can also be guaranteed.

Description of drawings

FIG. 1 is a schematic diagram of an embodiment of an in-vehicle entertainment system integrating instant messaging/social applications of the present invention;

Fig. 2 is a schematic diagram of an embodiment of the instant messaging/social application integrated vehicle entertainment system and the mobile terminal of the present invention to realize instant messaging/social application;

Fig. 3 is a schematic diagram of the processing procedure of new message notification and playing in an embodiment of the present invention;

Fig. 4 is a schematic diagram of the process of sending messages from the vehicle entertainment system in an embodiment of the present invention;

Fig. 5 is a schematic diagram of the process of sending a message from the vehicle entertainment system through speech recognition in an embodiment of the present invention.

Detailed ways

In the following description, numerous specific details are set forth in order to enable those skilled in the art to fully understand the present invention. It will be apparent, however, to one skilled in the art that the present invention may be practiced without some of these specific details. Furthermore, it should be understood that the invention is not limited to the particular embodiments described. Instead, it is conceivable to implement the present invention in any combination of the following features and elements, regardless of whether they relate to different embodiments. Accordingly, the following aspects, features, embodiments and advantages are by way of illustration only and should not be considered elements or limitations of the claims unless explicitly stated in the claims.

The present invention aims to provide a solution for integrating instant messaging/social applications, so as to solve the problem mentioned in the prior art that distracted use of software applications of mobile terminals will affect driving safety. Specifically, the solution provided by the present invention uses the vehicle-mounted device as a client device in processing instant messaging/social applications, replaces the interactive interface of the mobile terminal, provides the user with the functions of message input and message presentation, and communicates with the mobile terminal through the message Data transmission, so that users can experience instant messaging/social applications in the car without directly using the mobile phone.

Referring to Fig. 1, according to an embodiment of the present invention, the vehicle entertainment system that integrates instant messaging/social application provided by it includes:

input device 10 and output device 20;

The communication device 30 has a communication interface for wired and/or wireless connection with the mobile terminal, and transmits message data of instant messaging/social applications between the vehicle entertainment system and the mobile terminal;

The application processing device 40, after obtaining the application message input by the user through the input device, sends corresponding message data to the mobile terminal through the communication device according to the current instant messaging/social application of the mobile terminal; After the application message in the current instant messaging/social networking application, relevant information of the application message is presented to the user through an output device.

An example of how the instant messaging/social networking application integrated vehicle entertainment system of the present invention cooperates with the mobile terminal to realize the instant messaging/social networking application in the vehicle will be described in detail below with reference to the accompanying drawings.

Referring to Figure 2, the communication device in this example includes: one or more communication interfaces for wired and/or wireless connection with the mobile terminal, and a protocol stack for processing communication data transmitted through the one or more communication interfaces 305. The one or more interfaces include but are not limited to: a communication interface for wired connection—USB interface 303 and/or HDMI interface 301 ; a communication interface for wireless connection—Bluetooth interface 304 and/or WiFi interface 302 .

The input device in this example is the input interface 100, which provides one or more interfaces for connecting peripheral input devices, and transmits application messages input by the user through the peripheral input devices to the application processing device.

The peripheral input devices include, but are not limited to, one or more of the following:

The buttons on the steering wheel D1, the user can perform operations such as selecting contacts, editing and sending message content, and broadcasting control of message content by operating the buttons on the steering wheel D1;

Camera D2, the user can obtain pictures or videos through the shooting of the camera D2, for subsequent operations such as sending pictures or video messages to contacts;

Microphone D2, the user can perform voice input through the microphone D2, and use the voice recognition function in the application processing device 40 (will be described in detail later) to perform, for example, selection of contacts, input and sending of message content, broadcast control of message content, etc. operate;

The vehicle-mounted control panel D3, the user can carry out button operation or gesture operation through the vehicle-mounted control panel, so as to carry out operations such as the selection of contacts, the input and editing and sending of message content, the broadcast control of message content; The vehicle-mounted control panel D3 can include for example Components such as a panel or a touch screen with a display screen and operation buttons.

Of course, the above-mentioned peripheral input devices can also be partly or completely installed in the vehicle entertainment system according to actual use or design requirements. In this case, the input interface 100 and the peripheral input devices connected to it constitute the above-mentioned input device.

The application processing device in this example includes: a message processing unit 401, a speech recognition unit 402 and a TTS (Text to Speech) unit 403.

After the in-vehicle entertainment system establishes a connection with the mobile terminal through the above-mentioned wired and/or wireless communication interface, the message processing unit 401 obtains the current instant messaging/social application information of the mobile terminal through the communication interface currently connected to the mobile terminal. For example, which instant messaging/social application (MSN, Weibo, WeChat, QQ, etc.) is currently used by the mobile terminal; the contact list of the instant messaging/social application; user setting information of the instant messaging/social application, etc. In other application implementations, the mobile terminal can also obtain its current instant messaging/social application information from the vehicle entertainment system, so as to coordinate between the two ends and facilitate the user's subsequent instant messaging/social application based on the vehicle entertainment system.

After obtaining the application message input by the user, the message processing unit 401 performs targeted processing according to the type of the application message to form message data, and then according to the current instant messaging/social application of the mobile terminal, through the currently connected mobile terminal The communication interface sends the message data. For example, for an application message sent by a user to a contact, the message data includes message content and information of the contact to be sent; and for an application message sent by the user to a group, the message data includes at least the message content.

And when the mobile terminal obtains new information in the current instant messaging/social application, the message processing unit 401 obtains the application information in the current instant messaging/social application through the communication interface currently connected to the mobile terminal, and according to the application information According to the current instant messaging/social application of the mobile terminal, relevant information of the application message is presented to the user through the output device. The relevant information of the application message includes: one or more of new application message notification, message type, message source, message content, status update information, and contact information.

The output device in this example is the output interface 200, which provides one or more interfaces connected to peripheral output devices, and presents relevant information of the application message to the user through the peripheral output devices.

The peripheral output devices include, but are not limited to, one or more of the following devices:

Instrument D5, which can display information such as new message notification, contact status and other information to the user through instrument D5;

Speaker D4, through which information such as new message notification, message type and message content can be broadcast or played to the user;

The vehicle-mounted control panel D3 can display information such as new message notification, message type and message content to the user through the vehicle-mounted control panel D3;

Of course, the above-mentioned peripheral output devices can also be partially or completely installed in the vehicle entertainment system according to actual use or design requirements, and at this time the output interface 200 and the peripheral output devices connected thereto constitute the above-mentioned output device.

Taking the mobile terminal as a mobile phone and the instant messaging/social application as WeChat as an example, some examples of instant messaging/social applications are illustrated in conjunction with the accompanying drawings, so as to more clearly illustrate how the in-vehicle entertainment system and the mobile terminal cooperate. Instant messaging/social applications.

Application example about new message notification

Assume a Bluetooth connection has been established between the mobile phone and the car entertainment system. When the WeChat currently used by the mobile phone receives a new message from a contact, the WeChat of the mobile phone will receive a notification of the new message as shown in step 501 . The message processing unit 401 in the vehicle entertainment system can also obtain the new message notification through the established Bluetooth connection. At this time, as shown in step 502, the message processing unit 401 may display a new message notification to the user through the above-mentioned example output device. For example, a new message notification can be displayed to the user through a display screen of an instrument or a vehicle control panel, or the new message notification can be played through a vehicle speaker to prompt the user.

Next, as shown in step 503, the message processing unit 401 requests the mobile phone to obtain new messages through the established Bluetooth connection; and as shown in step 504, obtains the content of the new message from the mobile phone.

Then, as shown in step 505, the message processing unit 401 performs processing according to the user's response operation corresponding to the new message notification. These responsive operations can be performed by the user through the input device. Users can issue new message broadcast instructions through buttons on the steering wheel, buttons on the vehicle control panel, gesture operations on the touch screen, or even voice operation commands. The message processing unit recognizes different types of user operation instructions to trigger the operation of broadcasting new messages. For example, for a voice operation instruction, the voice recognition unit 402 performs voice recognition to obtain an instruction to trigger the broadcast of a new message, so as to trigger the operation.

Subsequently, as shown in step 506, the message processing unit 401 performs state synchronization with the WeChat of the mobile phone through the established Bluetooth connection, so as to make sure that the new message has been presented to the user on the vehicle entertainment system side. Correspondingly, for the mobile terminal, on its WeChat interface, the status of the new message will change from unread to read. And, as shown in step 507, new messages are presented to the user in various ways. For example, the type of new message and which contact person or group the new message comes from is reported to the user by the TTS unit 403; when the new message is a voice message, the voice message is played to the user through the car speaker; when the new message is a text message , the TTS unit 403 may also be used to perform text-to-speech conversion, so as to broadcast the text message to the user.

Application examples about sending messages through buttons and touches

The communication connection between the mobile phone and the vehicle entertainment system is the same as that of the first application example, and will not be described again. As shown in step 511, when the user sends out the contact information of the message to be sent through buttons, gestures on the touch screen, or even a voice operation command, the message processing unit 401 identifies different types of user operation instructions to select from the obtained contact list. Find the contact and trigger the operation of sending a new message.

Next, as shown in step 512, the TTS unit 403 can be used to prompt the user to input the content of the message, or the instrument or the display screen can be used to prompt the user to input the content of the message; when the user inputs the voice message through the microphone, the voice recognition unit 402 can convert the voice message As shown in step 513, the message processing unit 401 sends the text message to the mobile phone through the bluetooth connection; or, the message processing unit 401 directly sends the voice message to the mobile phone through the bluetooth connection as shown in step 513; When inputting a text message, the TTS unit can also convert the text message into a voice message, and the message processing unit 401 can send the voice message to the mobile phone through the Bluetooth connection, or the message processing unit 401 can directly send the text message to the mobile phone through the Bluetooth connection. And when the user obtains a picture or video through the shooting of the camera (for example, the shooting of the camera can be triggered by a voice operation instruction after finding a contact person) and takes it as a message to be sent, the message processing unit 401 can also send the picture message through the bluetooth connection. or send video messages to mobile phones.

As for the mobile phone, there is no need to change the previous WeChat processing, and the received voice message/text message can be sent to the contact person through WeChat as shown in step 514 . After the message is sent, as shown in step 515, the state synchronization is performed with the vehicle entertainment system through the established Bluetooth connection, so as to confirm that the message has been sent. Correspondingly, for the mobile terminal, the message will be added to the message record with the contact on its WeChat interface. Even if the message fails to be sent due to, for example, a network failure or other reasons, a mark of failed delivery will be displayed on the WeChat interface of the mobile phone.

An application example of sending messages by voice recognition

This application example is basically similar to the previous application example, the difference is that the operation of sending a message is triggered by voice recognition. As shown in step 521, after the user triggers voice recognition input by pressing a button, the message processing unit 401 will control the corresponding functional unit to prompt the user to input contact information or message content in various ways. As shown in step 522, it may be acceptable for the user to input contact information and message content by voice. Moreover, in step 523 , the message processing unit 401 may also optionally send the voice message directly, or the voice recognition unit 402 converts the voice message into a text message, and the message processing unit 401 sends the message. Subsequent steps 524 to 526 are the same as the previous application example, and will not be repeated here.

Although the present invention has been disclosed above with preferred embodiments, the present invention is not limited thereto. Any person skilled in the art, without departing from the various changes and modifications made within the spirit and scope of the present invention, all should be included in the protection scope of the present invention, so the protection scope of the present invention should be defined by the claims. allow.

Claims (15)

1. A car entertainment system integrating instant messaging/social applications, characterized in that it comprises: input devices and output devices; The communication device has a communication interface for wired and/or wireless connection with the mobile terminal, and transmits the message data of the instant messaging/social application between the vehicle entertainment system and the mobile terminal; The application processing device, after obtaining the application message input by the user through the input device, sends corresponding message data to the mobile terminal through the communication device according to the current instant messaging/social application of the mobile terminal; After the application message in the instant messaging/social application, the relevant information of the application message is presented to the user through the output device. 2. The vehicle entertainment system integrating instant messaging/social applications according to claim 1, wherein the input device comprises: an input device and an input interface connecting the input device and the application processing device; or, the The input device only includes: an input interface connecting peripheral input devices with the application processing device. 3. The vehicle entertainment system integrating instant messaging/social applications according to claim 2, wherein the input device and the peripheral input device include: a vehicle microphone device, a vehicle control panel, buttons arranged on the steering wheel one or more of. 4. The vehicle entertainment system integrating instant messaging/social applications according to claim 1, wherein the output device comprises: an output device and an output interface connecting the output device and the application processing device; or, the The output device only includes: an output interface connecting peripheral output devices with the application processing device. 5. The vehicle entertainment system integrating instant messaging/social applications according to claim 4, wherein the output device and the peripheral output device include: one or more of a vehicle speaker, a vehicle display, and an instrument . 6. The in-vehicle entertainment system integrating instant messaging/social applications according to claim 1, wherein the wired communication interface includes: USB interface and/or HDMI interface; the wireless connected communication interface includes: Bluetooth interface and/or WiFi interface. 7. The in-vehicle entertainment system integrating instant messaging/social networking applications as claimed in claim 1, wherein the application message corresponding to the input of the user is a text message, and the application processing device according to the current instant messaging/social networking application of the mobile terminal , sending corresponding text message data to the mobile terminal through the communication device. 8. The in-vehicle entertainment system integrating instant messaging/social applications as claimed in claim 1, wherein the application message corresponding to the user input is a voice message, and the application processing device according to the current instant messaging/social application of the mobile terminal , converting the voice message into a text message, and sending the text message data to the mobile terminal through the communication device; or, the application processing device directly sends the voice message data to the mobile terminal through the communication device according to the current instant messaging/social application of the mobile terminal. 9. The in-vehicle entertainment system integrating instant messaging/social applications as claimed in claim 1, wherein the application message corresponding to the user input is a picture message or a video message, and the application processing device according to the current instant messaging of the mobile terminal /Social application, sending corresponding picture message data or video message data to the mobile terminal through the communication device. 10. The in-vehicle entertainment system integrating instant messaging/social networking applications according to claim 1, wherein the application message corresponding to the user input is a location message, and the application processing device according to the current instant messaging/social networking application of the mobile terminal , sending corresponding location message data to the mobile terminal through the communication device. 11. The in-vehicle entertainment system integrating instant messaging/social networking applications according to claim 1, wherein presenting the relevant information of the application message to the user through the output device comprises: displaying or playing or broadcasting the relevant information of the application message to the user. 12. The vehicle entertainment system integrating instant messaging/social applications according to claim 1, wherein the relevant information of the application message includes: new application message notification, message type, message source, message content, status update information , one or more of contact information. 13. A method for integrating instant messaging/social applications in a car, characterized in that it comprises: Establish wired and/or wireless connections between vehicle equipment and mobile terminals; The in-vehicle device receives the user's application message input, and transmits the message data to the mobile terminal through the established wired and/or wireless connection according to the current instant messaging/social application of the mobile terminal; The vehicle-mounted device receives the message data of the mobile terminal, and presents relevant information of the application message to the user according to the current instant messaging/social application of the mobile terminal. 14. The method for integrating instant messaging/social networking applications in a vehicle according to claim 13, characterized in that it comprises: data interaction between the vehicle-mounted device and the mobile terminal through an established wired and/or wireless connection, said The information of data interaction includes the current instant messaging/social application information of the vehicle equipment or the mobile terminal. 15. The method for integrating instant messaging/social networking applications in a vehicle according to claim 13, wherein the wired connection includes: USB connection and/or HDMI connection; the wireless connection includes: Bluetooth connection and/or Wi-Fi connection.

Images