CN112861638B

CN112861638B - Screen projection method and device

Info

Publication number: CN112861638B
Application number: CN202110048469.2A
Authority: CN
Inventors: 薛志荣; 邓园; 李宏汀; 叶军涛; 黄雪妍; 刘祖齐
Original assignee: Huawei Technologies Co Ltd
Current assignee: Huawei Technologies Co Ltd
Priority date: 2021-01-14
Filing date: 2021-01-14
Publication date: 2025-02-18
Anticipated expiration: 2041-01-14
Also published as: CN120198894A; CN112861638A

Abstract

The embodiment of the application discloses a screen projection method and a screen projection device, which can be applied to the field of automobiles, wherein the method comprises the steps that terminal equipment (or a vehicle) acquires a plurality of screen projection conditions of a plurality of display modules on the vehicle, which are projected on the screen, one display module corresponds to one screen projection condition, the screen projection condition can be set according to running information (such as the driving speed of the vehicle, the type of traffic scene where the vehicle is located and the like) of the vehicle, or according to characteristic information (such as the application type of a first application program running on the terminal equipment, the preset use frequency of the first application program and the like) of an application program, when the first screen projection condition is met, the screen projection information of the first application program is projected on the first display module corresponding to the first screen projection condition, so that the screen projection information on the terminal equipment is reasonably distributed to different display modules of the vehicle, the driver can quickly acquire the information on the terminal equipment, the probability of dispersing the attention of the driver is reduced, the screen projection information is reduced to the interference of the driver, and the driving safety of the driver is improved.

Description

Screen projection method and device

Technical Field

The application relates to the field of screen projection display, in particular to a screen projection method and device.

Background

With the improvement of the overall economic level of society and the rapid development of automobile technology, in the field of automobile consumption, people change from traditional consumption meeting the use of automobile functions to novel consumption pursuing automobile life experience. The number of screens (also called display modules) in a car is increasing, while the number of physical buttons is decreasing, and most of the information and functions are carried on the central control screen of the car, as shown in the sub-schematic diagram (a) of fig. 1. In addition, the rapid development of intelligent terminal devices (such as mobile phones) also makes people leave the terminal devices such as mobile phones more and more, and people are inevitably in the situation of needing to use the terminal devices in the process of driving automobiles, for example, the sub-schematic diagram in fig. 1 (b) is for a driver to navigate by using the mobile phones, but legal rules that the driver is not allowed to use the terminal devices such as the mobile phones in the driving process can bring danger to driving.

Therefore, the existing solution is to directly screen the information to be displayed on the terminal equipment such as mobile phone onto the central control screen of the automobile, and the user can directly obtain the related information through the information displayed on the central control screen.

However, the central control screen is not an optimal viewing area for the driver in any situation, the driver is required to twist his head and divert his line of sight to view the central control screen, and frequent viewing is easy to distract the driver, which brings danger to the driving process.

Disclosure of Invention

The embodiment of the application provides a screen projection method and a screen projection device, which are used for acquiring screen projection conditions (such as driving speed of a vehicle, traffic scene type and the like of the vehicle, application type of an application program running on a terminal device and reaching preset use frequency) which are required to be met when a display module on the vehicle is projected, and projecting screen projection information of the application program running on the terminal device to a corresponding display module when the screen projection conditions are met, so that the screen projection information on the terminal device is reasonably distributed to different display modules on the vehicle, a driver can quickly acquire the information on the terminal device, the probability of distraction of the driver is reduced, the interference of the screen projection information on the driving of the driver is reduced, and the driving safety is improved.

Based on the above, the embodiment of the application provides the following technical scheme:

In a first aspect, an embodiment of the present application provides a screen projection method, which may be used in the automotive consumption field, where first, a terminal device (or a target vehicle) may acquire a first screen projection condition of a first display module projected on the target vehicle, where the first screen projection condition may be related to running information of the target vehicle or may be related to feature information of an application program to be projected, and in particular, the first screen projection condition is not limited herein. In particular, since the traveling information of the vehicle can be characterized by various parameters, such as the driving speed of the vehicle, the type of traffic scene in which the vehicle is located, the number of passengers in the vehicle, the fatigue state of the driver of the vehicle, the distance between the vehicle and the obstacle, and the like. Therefore, in the embodiment of the application, the first screen-throwing condition can be set according to the running information of the target vehicle, and in this case, when the running information of the target vehicle meets the first screen-throwing condition, the first screen-throwing condition can be set according to the characteristic information of the application program to be screened in addition to the running information of the target vehicle. In this case, when the first screen-casting condition is satisfied, the characteristic information of the first screen-casting application program on the terminal device satisfies the first screen-casting condition. And when the first screen throwing condition is met and the communication connection is established between the terminal equipment and the vehicle, the screen throwing information of the first screen throwing application program on the terminal equipment is thrown to the first display module. For example, the judging manner of meeting the first screen-throwing condition may be that the characteristic information of the first screen-throwing application program on the terminal device meets the first screen-throwing condition, or that the running information of the target vehicle meets the first screen-throwing condition, which is not limited herein. In the embodiment of the present application, the first display module is one of a plurality of display modules on the target vehicle, and different display modules on the target vehicle have different screen-throwing conditions, for example, if 2 different display modules on the target vehicle a are respectively an instrument panel screen and a central control screen, there are 2 screen-throwing conditions for each display module, and the screen-throwing conditions are respectively a screen-throwing condition 1 and a screen-throwing condition 2.

It should be noted that the application program to be screened may refer to an application program to be screened on a terminal device which establishes communication connection with the target vehicle, but if a plurality of terminal devices are all connected with the target vehicle, a terminal device with earlier establishment time may be selected as the terminal device to be screened, the application program to be screened on the terminal device may be called the application program to be screened, a terminal device which is set as default may be selected as the terminal device to be screened, and a user may select which terminal device is selected as the terminal device to be screened according to actual requirements by himself, which is not limited in this embodiment. It should be noted that, the application to be displayed on the terminal device may refer to an application that displays an application interface on a display interface of the terminal device, or may refer to an application that runs in the background of the terminal device (i.e. does not display an application interface on a display interface of the terminal device), which is not limited herein.

In the above embodiment of the present application, by acquiring the first screen-throwing condition that needs to be met when the first display module on the vehicle is thrown, when the first screen-throwing condition (for example, the driving speed of the vehicle, the type of traffic scene where the vehicle is located, etc., the application type of the application program to be thrown on the terminal device, reaching the preset use frequency, etc.) is met, the screen-throwing information of the application program to be thrown on the terminal device is thrown on the corresponding first display module, so that the screen-throwing information on the terminal device is reasonably distributed to the corresponding display module on the vehicle based on the screen-throwing condition, so that the driver can quickly acquire the information on the terminal device, the probability of distraction of the driver is reduced, the interference of the screen-throwing information on the driving of the driver is reduced, and the driving safety is improved.

In one possible design of the first aspect, the specific manner of the terminal device (or the target vehicle) acquiring the first screen-throwing condition of the first display module on the target vehicle may be that the terminal device (or the target vehicle) acquires the first screen-throwing condition of the first display module on the target vehicle from a plurality of screen-throwing conditions stored in advance by the terminal device (or the target vehicle), may acquire a plurality of screen-throwing conditions simultaneously, may acquire the first screen-throwing conditions according to a preset sequence for comparison, and may also be cross-device receiving, for example, the terminal device acquires screen-throwing condition information from the target vehicle, or the target vehicle acquires screen-throwing condition information from the terminal device of a vehicle owner. The screen-throwing condition can be set by default or set by a user according to own driving habits or other requirements. Thus, references herein to acquisition may also refer to accepting user input settings.

In one possible design of the first aspect, the specific manner in which the terminal device (or the target vehicle) obtains the first screen-throwing condition of the first display module on the target vehicle may be that the terminal device (or the target vehicle) firstly obtains a plurality of screen-throwing conditions of a plurality of display modules on the target vehicle, in this embodiment of the present application, one display module corresponds to one screen-throwing condition, for example, assuming that there are 3 different display modules on the target vehicle a, namely, a dashboard screen, a steering wheel screen and a central control screen, there are one corresponding screen-throwing condition for each display module, and there are 3 screen-throwing conditions in total, namely, screen-throwing condition 1, screen-throwing condition 2 and screen-throwing condition 3. After the terminal device (or the target vehicle) acquires a plurality of screen-throwing conditions that a plurality of display modules on the target vehicle are thrown on, when a screen-throwing condition (which can be called a first screen-throwing condition) that a certain display module (which can be called a first display module) on the target vehicle is thrown on is met, and under the condition that the terminal device establishes communication connection with the vehicle, screen-throwing information of a first screen-throwing application program on the terminal device is thrown on the first display module.

In the embodiment of the application, the screen-throwing conditions required to be met when each display module on the vehicle is thrown are obtained, and when the screen-throwing conditions are met, the display information of the first application program to be thrown on the terminal equipment is thrown on the corresponding display module, so that the screen-throwing information on the terminal equipment is reasonably distributed to different display modules on the vehicle, a driver can quickly obtain the information on the terminal equipment, the probability of distraction of the driver is reduced, the interference of the screen-throwing information on the driving of the driver is reduced, and the driving safety is improved.

In one possible configuration of the first aspect, the conditions to be met by the screen are different when the driving information of the vehicle is characterized by different parameters. In one case, the travel information of the target vehicle may include a driving speed of the target vehicle. The first screen-throwing condition includes that the driving speed of the target vehicle is within a first driving speed range. Since different driving speeds are essentially aimed at driving safety, one principle to be followed is that in the case of low safety, the screen projection information should be presented on a display module which is most visible and can be seen at least cost by the driver, for example, when the driving speed is high, the driver needs to have higher attention, the screen projection information can be projected on a screen which can be seen by the driver with least attention (such as a steering wheel screen, a head-up display (HUD), etc.), and when the driving speed is low, the screen projection information can be projected on a screen which can be seen by the driver with little twisting of the head (such as a central control screen) because the driver can not need to have high attention due to low driving speed.

In the embodiment of the application, the screen projection information of the application program to be projected on the terminal equipment is projected on different display modules based on different driving speeds, so that the driving safety is improved.

In one possible design of the first aspect, the driving information of the target vehicle may include a traffic scene type in which the target vehicle is located. The first screen throwing condition includes that the traffic scene type of the target vehicle belongs to the first traffic scene type. It should be noted that, in the embodiment of the present application, a traffic scene refers to a scene formed by traffic participants (such as vehicles, pedestrians, etc.) and objects (such as traffic signs, obstacle signs, etc.) on a traffic road. The traffic scene can be divided into different types of traffic scenes according to preset division rules, for example, one division mode can be divided according to traffic identifications, the types of the traffic scenes can be divided into crossroads, T-shaped intersections, traffic light intersections (displaying red lights), turning intersections, straight roads and the like, and one division mode can also be divided according to road conditions and surrounding traffic participants, and the types of the traffic scenes can be divided into highways, mountain roads, rural roads, urban roads and the like. In the embodiment of the application, the division of the traffic scene type based on the principle is not limited. Similarly, because the different traffic scene types where the vehicle is located are essentially aimed at driving safety, one principle to be followed is that in the case of low safety, the screen throwing information should be presented on a display module which can be seen by the driver with minimal cost and is easiest to see, for example, when the vehicle is at an intersection with a bright red light, the driver has stopped the vehicle waiting for the red light to become a street lamp, and at the moment, the driver can not need to pay as much attention, then the screen throwing information can throw the screen which can be seen by the driver with little turning head (such as a central control screen), and when the vehicle is at a turning intersection, because the turning intersection is generally a traffic accident high-incidence area, at the moment, the driver needs to have enough attention, then the screen throwing information can throw the screen (such as a steering wheel screen, a HUD and the like) which can be seen by the driver with minimal attention.

In the embodiment of the application, the screen projection information of the application program to be projected on the terminal equipment is projected on different display modules based on the different traffic scene types of the vehicle, so that the driving safety is improved.

In one possible design of the first aspect, the travel information of the target vehicle may include a number of passengers in the target vehicle. The first screen-throwing condition includes the number of passengers in the target vehicle being within a first passenger number range. It should be noted that, in the embodiment of the present application, the number of passengers in the vehicle is not inclusive of the driver, for example, when there is only the driver in the vehicle, the number of passengers in the vehicle=0. The difference of the number of passengers in the vehicle is substantially aimed at the privacy and the commonality of the screen throwing information, when the application program to be thrown on the terminal device belongs to the application program with high privacy (such as WeChat), in order to avoid other passengers from seeing the screen throwing information, the application program with high privacy can be thrown on a dashboard screen or a steering wheel screen which is only seen by a driver, when the application program to be thrown on the terminal device belongs to the application program with low privacy (such as Tencerting video), and in consideration of the common use requirement, the application program with low privacy can be thrown on a central control screen which can be seen by both the driver and the passengers during operation.

In the embodiment of the application, based on the consideration of the privacy and the commonality of the application programs, the number of passengers in the vehicle is different, and the screen-throwing information of the application program to be screened on the terminal equipment can be screened on different display modules, so that the user experience is improved.

In one possible design of the first aspect, the driving information of the target vehicle may include a fatigue state of a driver of the target vehicle. The first screen-throwing condition includes that the fatigue state of the driver of the target vehicle belongs to the first fatigue state. It should be noted that, in the embodiment of the present application, the fatigue state of the driver of the vehicle may be calculated from the human body state information detected by the sensor module disposed in the vehicle, or may be calculated from the human body state information detected by the wearable device (e.g., smart bracelet, smart watch, etc.) worn on the driver. In some embodiments of the present application, the fatigue state of the driver may be classified according to the number of display modules of the vehicle, for example, if the number of display modules on the vehicle is 3, the fatigue state of the driver may be classified into 3 classes of "fatigue", "sub-fatigue" and "spirit", if the number of display modules on the vehicle is 2, the fatigue state of the driver may be classified into 2 classes of "fatigue" and "spirit", etc., and based on the different fatigue states of the driver, whether the corresponding driving behavior is safe or not may be known. The different driving speeds are essentially aimed at driving safety, so that one principle to be followed is that when the fatigue state of the driver is at a high fatigue level, meaning that the driving behavior safety is not high at this time, the screen-throwing information should be presented on a display module which can be seen and is most easily seen with minimum cost for the driver, for example, when the fatigue state of the driver is fatigue, less energy and attention are required to be applied to the driving of the vehicle by the driver, the screen-throwing information can be thrown on a screen (such as a steering wheel screen, a HUD (head-up display) which can be seen with minimum attention of the driver, and when the fatigue state of the driver is mental, meaning that the driver is full at this time, the screen-throwing information can be thrown on a screen (such as a central control screen) which can be seen with little twisting of the driver.

In the embodiment of the application, the screen projection information of the application program to be projected on the terminal equipment is projected on different display modules based on different fatigue states of the driver, so that the driving safety is improved.

In one possible design of the first aspect, the travel information of the target vehicle may include a distance between the target vehicle and the obstacle. The first screen-throwing condition includes a distance between the target vehicle and the obstacle being within a first distance range. It should be noted that, in the embodiment of the present application, the distance between the vehicle and the obstacle may be calculated based on the sensing information collected by the sensor (e.g., lidar, camera, etc.) disposed on the vehicle, and the distance between the vehicle and each obstacle and the position and location of the obstacle relative to the vehicle may be obtained according to the collected sensing information. The difference in distance between the vehicle and the obstacle is also driving safety, so that one principle to be followed is that when the distance between the vehicle and the obstacle is closer, the reaction time left for the driver is shorter, the risk of the collision between the vehicle and the obstacle is larger, the driving environment of the vehicle is unsafe, the driver is required to pay attention to carefully drive so as not to collide with the obstacle, the screen information can be projected to a screen (such as a steering wheel screen, a HUD (head up display) which can be seen by the driver with minimum attention, and when the distance between the vehicle and the obstacle is farther, the driving environment of the vehicle is safer, the screen information can be projected to a screen (such as a central control screen) which can be seen by the driver with little turning head.

In the embodiment of the application, the screen projection information of the application program to be projected on the terminal equipment is projected to different display modules based on different distances between the vehicle and the obstacle, so that the probability of collision between the vehicle and the obstacle is reduced, and the driving safety is improved.

In one possible design of the first aspect, the feature information of the application program to be screened may include an application type to which the application program to be screened belongs, that is, the screening condition is that the specific application type corresponds to the specific display module, where in this case, the first screening condition that the first application program to be screened on the terminal device meets that the first display module on the vehicle is screened includes that the application type of the first screening condition includes that the application program is a first application type (such as a social type), and meanwhile, the first application program to be screened on the terminal device belongs to the first application type, and may also be referred to as that the application type to which the first application program to be screened on the terminal device belongs to the application type required in the first screening condition.

In the above embodiment of the present application, it is explained that the screen-throwing conditions are divided based on the application types to which the application programs belong, and different screen-throwing conditions correspond to different application types, so that the application programs belonging to different application types can be thrown to the respective corresponding display modules correspondingly, and differentiated screen throwing is realized from the application type perspective, and user experience is improved.

In one possible design of the first aspect, the feature information of the application may include information about a usage frequency of the application, that is, the application may be configured to set a specific usage frequency range of the application on the terminal device to correspond to a specific display module, and the information about the usage frequency of the application on the terminal device may be obtained from a "healthy use handset" of the terminal device or the like, where the first to-be-set application on the terminal device meets a first to-be-set condition that the first display module on the vehicle is set on, and the first to-be-set condition includes that the usage frequency information of the application is within a first usage frequency range (e.g., a high usage frequency range), and at the same time, the usage frequency of the first to-be-set application on the terminal device is within the first usage frequency range, which may also be referred to as that the usage frequency of the first to-be-set application on the terminal device is within a required usage frequency range in the first to-be-set condition. In the embodiment of the application, one principle is followed that the screen projection information of the application program with higher use frequency is presented on a display module which can be seen or is most easily seen by a user with minimum cost. For example, the screen information of the application program with high use frequency is presented on a steering wheel screen or HUD of the vehicle, and the screen information of the application program with low use frequency is presented on a central control screen of the vehicle.

In the above embodiment of the present application, it is explained that the screen-throwing conditions are divided based on the frequency information of the application program on the terminal device, and different screen-throwing conditions correspond to different frequency ranges of use, so that the application programs with different frequency of use can be thrown to the respective corresponding display modules, and the differential screen throwing is realized from the angle of the frequency of use of the application program, and the screen-throwing information of the application program with higher frequency of use is presented on the display module which can be seen or is most easily seen with the least cost of the user, thereby indirectly improving the driving attention of the user.

In one possible design of the first aspect, the feature information of the application program may include both an application type to which the application program belongs and usage frequency information of the application program, where in the case that the first to-be-screen application program on the terminal device meets a first screen-projection condition that the first display module is projected on the vehicle includes that the application type to which the first to-be-screen application program on the terminal device belongs is the application type required in the first screen-projection condition, and the usage frequency information of the first to-be-screen application program on the terminal device is within the usage frequency range required in the first screen-projection condition.

In the embodiment of the application, the single factors (for example, the application type is a single factor, and the use frequency information of the application program is a single factor) are mutually combined to obtain the dividing result based on the combined factors, so that the conditions required to be met by screen projection are more diversified, and the user experience is improved.

In one possible design of the first aspect, the frequency of use information of the application program on the terminal device may be characterized by 1) a duration of use of the application program on the terminal device, for example, a total time spent by a user when the application program is running on the terminal device since the application program was downloaded, or a time spent by the application program when the application program is running on the terminal device in a period of one day, one week or one month, and in particular, a calculation mode of the duration of use is not limited herein, and 2) a number of times the application program is started to run on the terminal device, for example, a number of times the application program is started to run on the terminal device since the application program was downloaded, or a number of times the application program is started to run on the terminal device in a period of one day, one week or one month, and in particular, a calculation mode of the number of times of starting to run is not limited herein.

In the above embodiment of the present application, several characterization modes of using frequency information by an application program on a terminal device are specifically described, which have selectivity and flexibility.

In one possible design of the first aspect, the application types to which the application program belongs may have a plurality of division manners, where one division manner may be to classify the application types into social categories, travel navigation categories, audio-visual categories, tools categories, information categories, games categories, travel accommodation categories, shopping categories, education categories, sports health categories, financial and financial categories, and any application program must belong to a certain category of the application types. The division is based on that when the terminal device downloads the application programs from the "application market" or "App Store" of the terminal device (the manufacturer of the terminal device may be different, the name is not limited herein), the application programs are already classified in the application market (i.e. the classification information determined by the application market label, and each application program downloaded from the application market belongs to its own classification), that is, the above classification.

In the above embodiment of the present application, a dividing manner of application types is specifically described, which is easy to obtain, can cover most application programs, and has realizability.

In one possible design of the first aspect, an application may simultaneously satisfy feature information of applications required in a plurality of screen-casting conditions. For example, the application type "social class" (e.g., "WeChat", "QQ", "short message", etc.) to which the application belongs may be either the application type required in the drop-screen condition 1 or the application type required in the drop-screen condition 2. That is, when the first to-be-screen application on the terminal device simultaneously satisfies the first screen-projection condition that the first display module on the vehicle is projected and the second screen-projection condition that the second display module on the vehicle is projected, in this case, the screen-projection information of the first to-be-screen application may be simultaneously projected to the first display module and the second display module, where the first display module and the second display module are two different display modules on the vehicle. It should be noted that, in the embodiment of the present application, the first display module and the second display module are not occupied by the screen projection of the screen projection information of the first to-be-projected application program.

In the above embodiment of the present application, it is specifically explained that when a certain application program meets the screen-throwing condition that a plurality of display modules are thrown on, the application program is thrown on the plurality of display modules, and the user selects which display module to watch the screen-throwing information, so that flexibility is provided.

In one possible design of the first aspect, an application may simultaneously satisfy feature information of applications required in a plurality of screen-casting conditions. That is, when the first to-be-screen application on the terminal device simultaneously satisfies the first screen-projection condition that the first display module on the vehicle is projected and the second screen-projection condition that the second display module on the vehicle is projected, in this case, the terminal device may divide the screen-projection information of the first to-be-screen application into the first screen-projection sub-information and the second screen-projection sub-information according to the preset manner, where the first display module and the second display module are two different display modules on the vehicle, and then, the first screen-projection sub-information and the second screen-projection sub-information are projected to the first display module and the second display module, respectively.

In the above embodiment of the present application, it is specifically explained that when a certain application program meets the screen-projection condition that a plurality of display modules are projected, the screen-projection information of the application program is correspondingly split into a plurality of screen-projection sub-information, and one screen-projection sub-information is correspondingly projected onto one display module, so that the user can select which display module to view the screen-projection sub-information, thereby having flexibility.

In one possible design of the first aspect, an application may simultaneously satisfy feature information of applications required in a plurality of screen-casting conditions. That is, when the first to-be-screen-projected application program on the terminal device simultaneously meets the first screen projection condition that the first display module on the vehicle is projected and the second screen projection condition that the second display module on the vehicle is projected, under the condition that the screen projection priority of the first display module is higher than the screen projection priority of the second display module, the screen projection information of the first to-be-projected application program is projected to the first display module with higher priority.

In the above embodiment of the present application, it is specifically described that when an application program satisfies a screen-throwing condition that a plurality of display modules are thrown, selective screen throwing can be further performed based on priority, and screen throwing information is preferentially thrown to a display module with a high priority. The screen projection method ensures that the user can watch the screen projection information in an optimal mode in real time according to the priority, and the influence of distraction of the user is reduced to the greatest extent.

In one possible design of the first aspect, the screen-casting information of the first application to be screened is screened onto the second display module only if the first display module with the higher priority is occupied by the screen.

In the above embodiment of the present application, it is specifically explained that only when the display module with the higher priority is occupied by the screen, the screen is projected onto the display module with the next priority, so that the user can watch the screen projection information in an optimal manner in real time.

In one possible design of the first aspect, the screen-throwing information of the first to-be-cast application may be an entire application program interface of the first to-be-cast application, or may be a part of the application program interface of the first to-be-cast application.

In the above embodiments of the present application, it is described which components the screen-projection information may be, and flexibility may be provided based on which part or parts of the screen-projection display interface the user needs to selectively.

In one possible design of the first aspect, the display module on the target vehicle may include at least a center control screen, a dashboard screen, a steering wheel screen, a HUD, a front windshield screen (e.g., which may include a left view screen, a right view screen, etc. of the vehicle), a rear windshield screen, a co-driver screen, a window screen (e.g., a left window screen, a right window screen, etc.), a sunroof screen, etc., or the display module on the vehicle may further include any surface area inside/outside the vehicle that is wrapped, coated with a material having a display function (e.g., a flexible display screen), such as a body, a door, a sun visor in the vehicle, a sunroof, etc. That is, in the embodiment of the present application, any area or device in the vehicle where the terminal device can throw a screen may be referred to as a display module on the vehicle according to the embodiment of the present application.

In the above embodiments of the present application, several embodiments of the display module of the vehicle are described, which have versatility and flexibility.

The second aspect of the embodiment of the application also provides a display information switching method, which comprises the steps that firstly, a vehicle can acquire the running information of the vehicle, then, the vehicle judges whether the running information of the vehicle is in accordance with a first running condition, when the running information of the vehicle is not in accordance with the first running condition, the switching of the screen throwing information of a first application program displayed on a first display module to a second display module is indicated to display, wherein the first display module and the second display module are respectively two different display modules on the vehicle, and the first running condition is a condition which needs to be met when the first display module is thrown.

In the above embodiment of the present application, after the screen-throwing information on the terminal device has been thrown to the first display module at the vehicle end, the vehicle may further combine the running information of the vehicle to determine whether the first screen-throwing condition corresponding to the first display module is consistent with the running condition of the vehicle, if not, the screen-throwing information needs to be switched to other display modules (e.g., the second display module) on the vehicle for display, which has flexibility and improves user experience.

It should be noted that, in some embodiments of the present application, in addition to the screen-throwing information of the first application program, other information may be displayed on the first display module, for example, may be an operation interface of an application program installed on the vehicle itself, or may be a part of the operation interface, or may be collectively referred to as target information, where the screen-throwing information is not displayed on the first display module, and in this case, one way of implementing screen-cutting is that: the vehicle acquires the running information of the vehicle, judges whether the running information of the vehicle meets the first running condition, and switches the target information displayed on the first display module to the second display module for display when the running information of the vehicle does not meet the first running condition, wherein the first display module and the second display module are respectively two different display modules on the vehicle, and the first running condition is a condition which needs to be met when the first display module is thrown.

In one possible design of the second aspect, when the running information of the vehicle does not conform to the first running condition, the specific manner of indicating to switch the screen-throwing information of the first application program displayed on the first display module to be displayed on the second display module may be that when the running information of the vehicle does not conform to the first running condition and the running information of the vehicle conforms to the second running condition, the screen-throwing information of the first application program displayed on the first display module is indicated to be switched to be displayed on the second display module, and the second running condition is a condition that needs to be met when the second display module is screen-throwing.

In the above embodiment of the present application, after the screen-throwing information on the terminal device has been thrown onto the first display module at the vehicle end, the vehicle may further determine whether screen-throwing display is required in different driving scenarios according to the driving information of the vehicle, and only if the first screen-throwing condition corresponding to the first display module does not conform to the current driving condition of the vehicle, and if other display modules (e.g., the second display module) conform to the current driving condition of the vehicle, the screen-throwing information of the first application program displayed on the first display module is indicated to be switched to be displayed on the second display module, that is, dynamic switching may be performed between different display modules according to the driving state of the vehicle, so that under any driving condition, the user may watch the screen-throwing information in an optimal manner, thereby improving the user experience.

In one possible design of the second aspect, the driving information of the vehicle may include a driving speed of the vehicle, in which case the driving information of the vehicle does not conform to the first driving condition, and the driving information of the vehicle conforms to the second driving condition includes the first driving condition including the driving speed being within a first driving speed range, the second driving condition including the driving speed being within a second driving speed range, the driving speed of the vehicle not being within the first driving speed range, and the driving speed of the vehicle being within the second driving speed range. It should be noted that, since the driving speeds are substantially aimed at driving safety, the following principles are similar to those of the first aspect, and detailed descriptions thereof are omitted herein.

In the embodiment of the application, based on the driving speed of the vehicle, the screen-throwing information of the application program running on the terminal equipment is cut off to be displayed on the display module corresponding to the driving condition which accords with the driving speed of the vehicle, so that the display information on the terminal equipment is reasonably distributed to different display modules on the vehicle according to the real-time driving speed of the vehicle, and the driving safety is improved.

In one possible design of the second aspect, the driving information of the vehicle may include a traffic scene type in which the vehicle is located. In this case, the running information of the vehicle does not conform to the first running condition, and the running information of the vehicle conforms to the second running condition, wherein the first running condition comprises that the traffic scene type belongs to the first traffic scene type, the second running condition comprises that the traffic scene type belongs to the second traffic scene type, the traffic scene type of the vehicle does not belong to the first traffic scene type, and the traffic scene type of the vehicle belongs to the second traffic scene type. It should be noted that in the embodiment of the present application, the division of traffic scene types based on the principle is not limited, and the description of the first aspect is omitted herein, and in addition, since the traffic scene types where the vehicle is located are substantially aimed at the driving safety, the principle to be followed is similar to that of the first aspect, and the description of the first aspect is omitted herein.

In the embodiment of the application, based on different traffic scene types of the vehicle, the screen-switching information of the application program running on the terminal equipment is switched to the display module corresponding to the running condition which accords with the traffic scene type of the vehicle for display, so that the display information on the terminal equipment is reasonably distributed to different display modules on the vehicle according to the traffic scene type of the vehicle in real time, and the driving safety is improved.

In one possible design of the second aspect, the driving information of the vehicle may include the number of passengers in the vehicle. In this case, the running information of the vehicle does not conform to the first running condition, and the running information of the vehicle conforms to the second running condition, including the number of passengers being within the first passenger number range, the second running condition including the number of passengers being within the second passenger number range, the number of passengers in the vehicle not being within the first passenger number range, and the number of passengers in the vehicle being within the second passenger number range. It should be noted that, in the embodiment of the present application, the number of passengers in the vehicle is not inclusive of the driver, for example, when there is only the driver in the vehicle, the number of passengers in the vehicle=0. The difference of the number of passengers in the vehicle is essentially aimed at the privacy and the commonality of the screen throwing information, when the application program running on the terminal device belongs to the application program with high privacy (such as WeChat), in order to avoid other passengers from seeing the screen throwing information, the application program with high privacy can be thrown on a dashboard screen or a steering wheel screen which is only seen by a driver, when the application program running on the terminal device belongs to the application program with low privacy (such as Tencerting video), and in consideration of the requirement of common use, the application program with low privacy can be thrown on a central control screen which can be seen by both the driver and the passengers when running.

In the embodiment of the application, based on the consideration of the privacy and the commonality of the application programs, the number of passengers in the vehicle is different, the screen-throwing information of the application programs running on the terminal equipment can be cut off to be displayed on the display modules corresponding to the running conditions which are in accordance with the number of the passengers in the vehicle, the display information on the terminal equipment is reasonably distributed on different display modules on the vehicle according to the number of the passengers in the vehicle, and the user experience is improved.

In one possible design of the second aspect, the driving information of the vehicle may include a fatigue state of a driver of the vehicle. In this case, the running information of the vehicle does not conform to the first running condition, and the running information of the vehicle conforms to the second running condition includes that the first running condition includes that the fatigue state of the driver belongs to the first fatigue state, the second running condition includes that the fatigue state of the driver belongs to the second fatigue state, the fatigue state of the driver of the vehicle does not belong to the first fatigue state, and the fatigue state of the driver of the vehicle belongs to the second fatigue state. It should be noted that, in the embodiment of the present application, the fatigue state of the driver of the vehicle may be calculated from the human body state information detected by the sensor module disposed in the vehicle, or may be calculated from the human body state information detected by the wearable device (e.g., smart bracelet, smart watch, etc.) worn on the driver. In some embodiments of the present application, the fatigue state of the driver may be classified according to the number of display modules of the vehicle, for example, if the number of display modules on the vehicle is 3, the fatigue state of the driver may be classified into 3 classes of "fatigue", "sub-fatigue" and "spirit", if the number of display modules on the vehicle is 2, the fatigue state of the driver may be classified into 2 classes of "fatigue" and "spirit", etc., and based on the different fatigue states of the driver, whether the corresponding driving behavior is safe or not may be known. The driving safety is essentially aimed at by different driving speeds, and therefore, the principle to be followed is similar to that of the first aspect, and the description of the first aspect is specifically referred to, and will not be repeated here.

In the embodiment of the application, based on different fatigue states of the driver, the screen-throwing information of the application program running on the terminal device is cut off to be displayed on the display module corresponding to the running condition which accords with the fatigue state of the driver of the vehicle, so that the display information on the terminal device is reasonably distributed to different display modules on the vehicle according to the fatigue state of the driver of the vehicle, and the driving safety is improved.

In one possible design of the second aspect, the travel information of the vehicle may include a distance between the vehicle and the obstacle. In this case, the travel information of the vehicle does not conform to the first travel condition, and the travel information of the vehicle conforms to the second travel condition including the distance between the vehicle and the obstacle being within a first distance range, the second travel condition including the distance between the vehicle and the obstacle being within a second distance range, the distance between the vehicle and the obstacle not being within the first distance range, and the distance between the vehicle and the obstacle being within the second distance range. It should be noted that, in the embodiment of the present application, the distance between the vehicle and the obstacle may be calculated based on the sensing information collected by the sensor (e.g., lidar, camera, etc.) disposed on the vehicle, and the distance between the vehicle and each obstacle and the position and location of the obstacle relative to the vehicle may be obtained according to the collected sensing information. The difference in distance between the vehicle and the obstacle is also substantially aimed at driving safety, so the principle to be followed is similar to that of the first aspect, and specific reference is made to the description of the first aspect, and details are omitted here.

In the embodiment of the application, based on different distances between the vehicle and the obstacle, the screen-throwing information of the application program running on the terminal equipment is cut off to be displayed on the display module corresponding to the running condition which accords with the distance between the vehicle and the obstacle, so that the display information on the terminal equipment is reasonably distributed to different display modules on the vehicle according to the distance between the vehicle and the obstacle, the collision probability of the vehicle and the obstacle is reduced, and the driving safety is improved.

In one possible design of the second aspect, the process that the vehicle switches the screen-throwing information to the second display module for displaying may specifically be that the vehicle generates a switching instruction (which may be referred to as a first switching instruction) firstly, where the first switching instruction is used to instruct the vehicle to switch the screen-throwing information to the second display module, and then the vehicle switches the screen-throwing information to the second display module for displaying according to the first switching instruction.

In the above embodiment of the present application, it is specifically described how to perform the cut-screen display, which has the feasibility.

In one possible design of the second aspect, the screen-dropping information of the first application may be an entire application program interface of the first application, or may be a part of the application program interface of the first application.

In one possible design of the second aspect, the display module on the vehicle may include at least a center control screen, a dashboard screen, a steering wheel screen, a HUD, a front windshield screen (e.g., may include a left view screen, a right view screen, etc. of the vehicle), a rear windshield screen, a co-driver screen, a window screen (e.g., a left window screen, a right window screen, etc.), a sunroof screen, etc., or the display module on the vehicle may further include any surface area inside/outside the vehicle that is wrapped, coated with a material having a display function (e.g., a flexible display screen), such as a body, a door, a sun visor in the vehicle, a sunroof, etc. That is, in the embodiment of the present application, any area or device in the vehicle where the terminal device can throw a screen may be referred to as a display module on the vehicle according to the embodiment of the present application.

The third aspect of the embodiment of the application also provides a screen projection method, which comprises the steps that a terminal device firstly sends a first instruction to a vehicle, wherein the first instruction is used for indicating that screen projection information of a first application program is displayed on a first display module of the vehicle, in addition, the terminal device also periodically receives running information of the vehicle, which is sent by the vehicle, when the running information of the vehicle is not in accordance with a first running condition and the running information of the vehicle is in accordance with a second running condition, a second instruction is sent to the vehicle, the second instruction is used for indicating that information (such as a running interface of the first application program or a first part of the running interface) of the first application program is displayed on a second display module of the vehicle, the first running condition is a condition which needs to be met when the first display module is projected, the second running condition is a condition which needs to be met when the second display module is projected, and the first display module and the second display module are different two display modules on the vehicle.

In the above embodiment of the present application, after the screen-throwing information on the terminal device is thrown to the display module at the vehicle end, the terminal device may also determine whether screen-cutting display is required in different driving scenarios in combination with the driving information of the vehicle, that is, the terminal device may dynamically switch between different display modules in combination with the driving state of the vehicle, so that under any driving condition, the user may watch the screen-throwing information in an optimal manner, and user experience is improved.

In one possible design of the third aspect, the driving information of the vehicle may include a driving speed of the vehicle, in which case the driving information of the vehicle does not conform to the first driving condition, and the driving information of the vehicle conforms to the second driving condition includes the driving speed being within a first driving speed range, the second driving condition includes the driving speed being within a second driving speed range, the driving speed of the vehicle is not within the first driving speed range, and the driving speed of the vehicle is within the second driving speed range. Since the driving speeds are substantially aimed at driving safety, the following principles are similar to those of the first aspect, and detailed descriptions thereof are omitted herein.

In one possible design of the third aspect, the driving information of the vehicle may include a traffic scene type in which the vehicle is located. In this case, the running information of the vehicle does not conform to the first running condition, and the running information of the vehicle conforms to the second running condition, wherein the first running condition comprises that the traffic scene type belongs to the first traffic scene type, the second running condition comprises that the traffic scene type belongs to the second traffic scene type, the traffic scene type of the vehicle does not belong to the first traffic scene type, and the traffic scene type of the vehicle belongs to the second traffic scene type. It should be noted that in the embodiment of the present application, the division of traffic scene types based on the principle is not limited, and the description of the first aspect is omitted herein, and in addition, since the traffic scene types where the vehicle is located are substantially aimed at the driving safety, the principle to be followed is similar to that of the first aspect, and the description of the first aspect is omitted herein.

In one possible design of the third aspect, the driving information of the vehicle may include a number of passengers in the vehicle. In this case, the running information of the vehicle does not conform to the first running condition, and the running information of the vehicle conforms to the second running condition, including the number of passengers being within the first passenger number range, the second running condition including the number of passengers being within the second passenger number range, the number of passengers in the vehicle not being within the first passenger number range, and the number of passengers in the vehicle being within the second passenger number range. It should be noted that, in the embodiment of the present application, the number of passengers in the vehicle is not inclusive of the driver, for example, when there is only the driver in the vehicle, the number of passengers in the vehicle=0. The difference of the number of passengers in the vehicle is essentially aimed at the privacy and the commonality of the screen throwing information, when the application program running on the terminal equipment belongs to the application program with high privacy (such as WeChat), in order to avoid other passengers from seeing the screen throwing information, the application program with high privacy can be thrown on a dashboard screen or a steering wheel screen which is only seen by a driver, when the application program running on the terminal equipment belongs to the application program with low privacy (such as Tencerting video), and in consideration of the common use requirement, the application program with low privacy can be thrown on a central control screen which can be seen by both the driver and the passengers when running.

In the embodiment of the application, based on the consideration of the privacy and the commonality of the application programs, the number of passengers in the vehicle is different, the screen switching information of the application programs running on the terminal equipment can be selectively switched to the display module corresponding to the running condition which accords with the number of the passengers in the vehicle for display, the display information on the terminal equipment is reasonably distributed to different display modules on the vehicle according to the number of the passengers in the vehicle, and the user experience is improved.

In one possible design of the third aspect, the driving information of the vehicle may include a fatigue state of a driver of the vehicle. In this case, the running information of the vehicle does not conform to the first running condition, and the running information of the vehicle conforms to the second running condition includes that the first running condition includes that the fatigue state of the driver belongs to the first fatigue state, the second running condition includes that the fatigue state of the driver belongs to the second fatigue state, the fatigue state of the driver of the vehicle does not belong to the first fatigue state, and the fatigue state of the driver of the vehicle belongs to the second fatigue state. It should be noted that, in the embodiment of the present application, the fatigue state of the driver of the vehicle may be calculated from the human body state information detected by the sensor module disposed in the vehicle, or may be calculated from the human body state information detected by the wearable device (e.g., smart bracelet, smart watch, etc.) worn on the driver. In some embodiments of the present application, the fatigue state of the driver may be classified, the number of the display modules of the vehicle may be classified, and whether the corresponding driving behavior is safe may be known based on the different fatigue states of the driver. The driving safety is essentially aimed at by different driving speeds, and therefore, the principle to be followed is similar to that of the first aspect, and the description of the first aspect is specifically referred to, and will not be repeated here.

In one possible design of the third aspect, the travel information of the vehicle may include a distance between the vehicle and the obstacle. In this case, the travel information of the vehicle does not conform to the first travel condition, and the travel information of the vehicle conforms to the second travel condition including the distance between the vehicle and the obstacle being within a first distance range, the second travel condition including the distance between the vehicle and the obstacle being within a second distance range, the distance between the vehicle and the obstacle not being within the first distance range, and the distance between the vehicle and the obstacle being within the second distance range. It should be noted that, in the embodiment of the present application, the distance between the vehicle and the obstacle may be calculated based on the sensing information collected by the sensor (e.g., lidar, camera, etc.) disposed on the vehicle, and the distance between the vehicle and each obstacle and the position and location of the obstacle relative to the vehicle may be obtained according to the collected sensing information. The difference in distance between the vehicle and the obstacle is also substantially aimed at driving safety, so the principle to be followed is similar to that of the first aspect, and specific reference is made to the description of the first aspect, and details are omitted here.

In one possible design of the third aspect, the screen-dropping information of the first application may be an entire application program interface of the first application, or may be a part of an application program interface of the first application.

In one possible design of the third aspect, the display module on the vehicle may comprise at least a center control screen, a dashboard screen, a steering wheel screen, a head-up display (HUD), a front windshield screen (e.g. may comprise a left view screen, a right view screen, etc. of the vehicle), a rear windshield screen, a co-driver screen, a window screen (e.g. left window screen, right window screen, etc.), a sunroof screen, etc. or the display module on the vehicle may further comprise any surface area of the interior/exterior of the vehicle that is wrapped, coated with a material having a display function (e.g. a flexible display screen), such as a body, a door, a sun visor in the vehicle, a sunroof, etc. That is, in the embodiment of the present application, any area or device in the vehicle where the terminal device can throw a screen may be referred to as a display module on the vehicle according to the embodiment of the present application.

A fourth aspect of the embodiments of the present application provides an apparatus having a function to implement the method of the first aspect or any one of the possible implementations of the first aspect. The functions can be realized by hardware, and can also be realized by executing corresponding software by hardware. The hardware or software includes one or more modules corresponding to the functions described above. In some embodiments of the present application, the device may be a terminal device or a vehicle, and is not limited herein.

A fifth aspect of an embodiment of the present application provides an apparatus having a function to implement a method of the second aspect or any one of the possible implementations of the second aspect. The functions can be realized by hardware, and can also be realized by executing corresponding software by hardware. The hardware or software includes one or more modules corresponding to the functions described above. In some embodiments of the application, the device may be a vehicle.

A sixth aspect of the embodiments of the present application further provides an apparatus having a function of implementing the method of the third aspect or any one of the possible implementation manners of the third aspect. The functions can be realized by hardware, and can also be realized by executing corresponding software by hardware. The hardware or software includes one or more modules corresponding to the functions described above. In some embodiments of the application, the apparatus may be a terminal device.

A seventh aspect of the embodiments of the present application provides an apparatus, which may include a memory, a processor, and a bus system, where the memory is configured to store a program, and the processor is configured to call the program stored in the memory to perform a method according to the first aspect or any one of the possible implementations of the first aspect of the embodiments of the present application, or the processor is configured to call the program stored in the memory to perform a method according to the second aspect or any one of the possible implementations of the second aspect of the embodiments of the present application, or the processor is configured to call the program stored in the memory to perform a method according to the third aspect or any one of the possible implementations of the third aspect of the embodiments of the present application.

An eighth aspect of the present application provides a computer readable storage medium having instructions stored therein which, when run on a computer, cause the computer to perform the method of any one of the possible implementations of the first aspect or the first aspect, or cause the computer to perform the method of any one of the possible implementations of the second aspect or the second aspect, or cause the computer to perform the method of any one of the possible implementations of the third aspect or the third aspect.

A ninth aspect of the embodiments of the present application provides a computer program which, when run on a computer, causes the computer to perform the method of any one of the possible implementations of the first aspect or the first aspect, or causes the computer to perform the method of any one of the possible implementations of the second aspect or the second aspect, or causes the computer to perform the method of any one of the possible implementations of the third aspect or the third aspect.

Drawings

FIG. 1 is a schematic illustration of a driver using a center screen and terminal equipment in a vehicle;

fig. 2 is a schematic hardware structure of a terminal device according to an embodiment of the present application;

Fig. 3 is a schematic software structure of a terminal device according to an embodiment of the present application;

FIG. 4 is a block diagram of several exemplary terminal devices provided by an embodiment of the present application;

FIG. 5 is a block diagram of a folded mobile phone in an unfolded state according to an embodiment of the present application;

fig. 6 is a block diagram of a folding mobile phone in a folded state according to an embodiment of the present application;

FIG. 7 is a schematic diagram of different display modules in a vehicle according to an embodiment of the present application;

FIG. 8 is a schematic flow chart of a screen projection method according to an embodiment of the present application;

Fig. 9 is a schematic diagram of a manner in which a terminal device provided in an embodiment of the present application obtains a plurality of screen-throwing conditions in which a plurality of display modules are thrown on a vehicle;

Fig. 10 is a schematic diagram of a user selecting to acquire identification information corresponding to a display module of a target vehicle on a terminal device according to an embodiment of the present application;

fig. 11 is a schematic diagram of another manner in which a terminal device provided by an embodiment of the present application obtains a plurality of screen-throwing conditions in which a plurality of display modules are thrown on a vehicle;

fig. 12 is another schematic diagram of a user selecting to acquire identification information corresponding to a display module of a target vehicle on a terminal device according to an embodiment of the present application;

Fig. 13 is a schematic diagram of adding an application name running on a terminal device into a target screen-throwing condition according to an embodiment of the present application;

Fig. 14 is a schematic diagram of adding an application name running on a terminal device to a target screen-throwing condition by a voice prompt manner of the terminal device according to the embodiment of the present application;

FIG. 15 is a schematic view of a screen projection method according to an embodiment of the present application;

FIG. 16 is a schematic view of another screen projection method according to an embodiment of the present application;

FIG. 17 is a schematic diagram of another screen projection method according to an embodiment of the present application;

FIG. 18 is a schematic diagram of another screen projection method according to an embodiment of the present application;

FIG. 19 is a schematic view of another screen projection method according to an embodiment of the present application;

FIG. 20 is a schematic illustration of the relationship between the individual screen throwing conditions provided by embodiments of the present application;

FIG. 21 is another schematic illustration of the relationship between individual screen throwing conditions provided by an embodiment of the present application;

FIG. 22 is another schematic diagram of the relationship between the individual screen throwing conditions provided by an embodiment of the present application;

FIG. 23 is a schematic diagram of another screen projection method according to an embodiment of the present application;

FIG. 24 is a schematic view of another screen projection method according to an embodiment of the present application;

FIG. 25 is a schematic view of another screen projection method according to an embodiment of the present application;

Fig. 26 is another flow chart of a display information switching method according to an embodiment of the present application;

FIG. 27 is a schematic diagram of another screen projection method according to an embodiment of the present application;

FIG. 28 is a schematic view of a traffic scenario of an intersection provided by an embodiment of the present application;

FIG. 29 is a schematic view of a distance between a vehicle traveling on a highway and surrounding obstacles provided by an embodiment of the present application;

fig. 30 is another flow chart of a display information switching method according to an embodiment of the present application;

FIG. 31 is a schematic view of an apparatus according to an embodiment of the present application;

FIG. 32 is a schematic diagram of another embodiment of the apparatus;

FIG. 33 is a schematic view of another structure of an apparatus according to an embodiment of the present application;

Fig. 34 is a schematic structural view of a vehicle according to an embodiment of the present application.

Detailed Description

The following description of the technical solutions according to the embodiments of the present application will be given with reference to the accompanying drawings in the embodiments of the present application, and it is apparent that the described embodiments are only some embodiments of the present application, but not all embodiments. All other embodiments, which can be made by those skilled in the art based on the embodiments of the application without making any inventive effort, are intended to be within the scope of the application.

The terms first, second and the like in the description and in the claims and in the above-described figures, are used for distinguishing between similar elements and not necessarily for describing a particular sequential or chronological order. It is to be understood that the terms so used are interchangeable under appropriate circumstances and are merely illustrative of the manner in which embodiments of the application have been described in connection with the description of the objects having the same attributes. Furthermore, the terms "comprises," "comprising," and "having," and any variations thereof, are intended to cover a non-exclusive inclusion, such that a process, method, system, article, or apparatus that comprises a list of elements is not necessarily limited to those elements, but may include other elements not expressly listed or inherent to such process, method, article, or apparatus.

The screen projection method provided by the embodiment of the application can be applied to various terminal devices, and various different types of terminal devices can be used to realize the terminal devices provided by the application, for example, the terminal devices in the application can include, but are not limited to, smart phones (such as mobile phones), laptop computers (laptop computers), personal computers (personal computer, PCs), tablet computers, super books, wearable devices (such as smart bracelets, smart watches, smart glasses, head-mounted display devices (head mount display, HMD) and the like), augmented reality (augmented reality, AR) devices, mixed Reality (MR) devices, cellular phones (cellular phones), personal Digital Assistants (PDAs), digital broadcast terminals and the like. Of course, in the following embodiments, there is no limitation on the specific form of the terminal device.

By way of non-limiting example only, the structure of the terminal device provided by the present application will be exemplarily described below by taking a specific structure as an example. Referring specifically to fig. 2, fig. 2 shows a schematic structural diagram of the terminal device 100.

The terminal device 100 may include a processor 110, an external memory interface 120, an internal memory 121, a universal serial bus (universal serial bus, USB) interface 130, a charge management module 140, a power management module 141, a battery 142, an antenna 1, an antenna 2, a mobile communication module 150, a wireless communication module 160, an audio module 170, a speaker 170A, a receiver 170B, a microphone 170C, an earphone interface 170D, a sensor module 180, keys 190, a motor 191, an indicator 192, a camera 193, a display 194, and a subscriber identity module (subscriber identification module, SIM) card interface 195, etc. The sensor module 180 may include a pressure sensor 180A, a gyro sensor 180B, an air pressure sensor 180C, a magnetic sensor 180D, an acceleration sensor 180E, a distance sensor 180F, a proximity sensor 180G, a fingerprint sensor 180H, a temperature sensor 180J, a touch sensor 180K, an ambient light sensor 180L, a bone conduction sensor 180M, and the like.

It is to be understood that the structure illustrated in the embodiment of the present application does not constitute a specific limitation on the terminal device 100. In other embodiments of the application, terminal device 100 may include more or less components than illustrated, or certain components may be combined, or certain components may be split, or different arrangements of components. The illustrated components may be implemented in hardware, software, or a combination of software and hardware.

The processor 110 may include one or more processing units, for example, the processor 110 may include an application processor (application processor, AP), a modem processor, a graphics processor (graphics processing unit, GPU), an image signal processor (IMAGE SIGNAL processor, ISP), a controller, a video codec, a digital signal processor (DIGITAL SIGNAL processor, DSP), a baseband processor, and/or a neural network processor (neural-network processing unit, NPU), etc. Wherein the different processing units may be separate devices or may be integrated in one or more processors.

The controller can generate operation control signals according to the instruction operation codes and the time sequence signals to finish the control of instruction fetching and instruction execution.

A memory may also be provided in the processor 110 for storing instructions and data. In some embodiments, the memory in the processor 110 is a cache memory. The memory may hold instructions or data that the processor 110 has just used or recycled. If the processor 110 needs to reuse the instruction or data, it can be called directly from the memory. Repeated accesses are avoided and the latency of the processor 110 is reduced, thereby improving the efficiency of the system.

In some embodiments, the processor 110 may include one or more interfaces. The interfaces may include an integrated circuit (inter-INTEGRATED CIRCUIT, I2C) interface, an integrated circuit built-in audio (inter-INTEGRATED CIRCUIT SOUND, I2S) interface, a pulse code modulation (pulse code modulation, PCM) interface, a universal asynchronous receiver transmitter (universal asynchronous receiver/transmitter, UART) interface, a mobile industry processor interface (mobile industry processor interface, MIPI), a general-purpose input/output (GPIO) interface, a subscriber identity module (subscriber identity module, SIM) interface, and/or a universal serial bus (universal serial bus, USB) interface, among others.

The I2C interface is a bi-directional synchronous serial bus comprising a serial data line (SERIAL DATA LINE, SDA) and a serial clock line (derail clock line, SCL). In some embodiments, the processor 110 may contain multiple sets of I2C buses. The processor 110 may be coupled to the touch sensor 180K, charger, flash, camera 193, etc., respectively, through different I2C bus interfaces. For example, the processor 110 may be coupled to the touch sensor 180K through an I2C interface, so that the processor 110 and the touch sensor 180K communicate through an I2C bus interface to implement a touch function of the terminal device 100.

The I2S interface may be used for audio communication. In some embodiments, the processor 110 may contain multiple sets of I2S buses. The processor 110 may be coupled to the audio module 170 via an I2S bus to enable communication between the processor 110 and the audio module 170. In some embodiments, the audio module 170 may transmit an audio signal to the wireless communication module 160 through the I2S interface, to implement a function of answering a call through the bluetooth headset.

PCM interfaces may also be used for audio communication to sample, quantize and encode analog signals. In some embodiments, the audio module 170 and the wireless communication module 160 may be coupled through a PCM bus interface. In some embodiments, the audio module 170 may also transmit audio signals to the wireless communication module 160 through the PCM interface to implement a function of answering a call through the bluetooth headset. Both the I2S interface and the PCM interface may be used for audio communication.

The UART interface is a universal serial data bus for asynchronous communications. The bus may be a bi-directional communication bus. It converts the data to be transmitted between serial communication and parallel communication. In some embodiments, a UART interface is typically used to connect the processor 110 with the wireless communication module 160. For example, the processor 110 communicates with a bluetooth module in the wireless communication module 160 through a UART interface to implement bluetooth functions. In some embodiments, the audio module 170 may transmit an audio signal to the wireless communication module 160 through a UART interface, to implement a function of playing music through a bluetooth headset.

The MIPI interface may be used to connect the processor 110 to peripheral devices such as a display 194, a camera 193, and the like. The MIPI interfaces include camera serial interfaces (CAMERA SERIAL INTERFACE, CSI), display serial interfaces (DISPLAY SERIAL INTERFACE, DSI), and the like. In some embodiments, processor 110 and camera 193 communicate through a CSI interface to implement the photographing function of terminal device 100. The processor 110 and the display 194 communicate via a DSI interface to implement the display function of the terminal device 100.

The GPIO interface may be configured by software. The GPIO interface may be configured as a control signal or as a data signal. In some embodiments, a GPIO interface may be used to connect the processor 110 with the camera 193, the display 194, the wireless communication module 160, the audio module 170, the sensor module 180, and the like. The GPIO interface may also be configured as an I2C interface, an I2S interface, a UART interface, an MIPI interface, etc.

The USB interface 130 is an interface conforming to the USB standard specification, and may specifically be a Mini USB interface, a Micro USB interface, a USB Type C interface, or the like. The USB interface 130 may be used to connect a charger to charge the terminal device 100, or may be used to transfer data between the terminal device 100 and a peripheral device. And can also be used for connecting with a headset, and playing audio through the headset. The interface may also be used to connect other terminal devices, such as AR devices, etc.

It should be understood that the interfacing relationship between the modules illustrated in the embodiment of the present application is only illustrative, and does not constitute a structural limitation of the terminal device 100. In other embodiments of the present application, the terminal device 100 may also use different interfacing manners, or a combination of multiple interfacing manners in the foregoing embodiments.

The charge management module 140 is configured to receive a charge input from a charger. The charger can be a wireless charger or a wired charger. In some wired charging embodiments, the charge management module 140 may receive a charging input of a wired charger through the USB interface 130. In some wireless charging embodiments, the charge management module 140 may receive wireless charging input through a wireless charging coil of the terminal device 100. The charging management module 140 may also supply power to the terminal device through the power management module 141 while charging the battery 142.

The power management module 141 is used for connecting the battery 142, and the charge management module 140 and the processor 110. The power management module 141 receives input from the battery 142 and/or the charge management module 140 to power the processor 110, the internal memory 121, the display 194, the camera 193, the wireless communication module 160, and the like. The power management module 141 may also be configured to monitor battery capacity, battery cycle number, battery health (leakage, impedance) and other parameters. In other embodiments, the power management module 141 may also be provided in the processor 110. In other embodiments, the power management module 141 and the charge management module 140 may be disposed in the same device.

The wireless communication function of the terminal device 100 can be implemented by the antenna 1, the antenna 2, the mobile communication module 150, the wireless communication module 160, a modem processor, a baseband processor, and the like.

The antennas 1 and 2 are used for transmitting and receiving electromagnetic wave signals. Each antenna in the terminal device 100 may be used to cover a single or multiple communication bands. Different antennas may also be multiplexed to improve the utilization of the antennas. For example, the antenna 1 may be multiplexed into a diversity antenna of a wireless local area network. In other embodiments, the antenna may be used in conjunction with a tuning switch.

The mobile communication module 150 may provide a solution including 2G/3G/4G/5G wireless communication applied to the terminal device 100. The mobile communication module 150 may include at least one filter, switch, power amplifier, low noise amplifier (low noise amplifier, LNA), etc. The mobile communication module 150 may receive electromagnetic waves from the antenna 1, perform processes such as filtering, amplifying, and the like on the received electromagnetic waves, and transmit the processed electromagnetic waves to the modem processor for demodulation. The mobile communication module 150 can amplify the signal modulated by the modem processor, and convert the signal into electromagnetic waves through the antenna 1 to radiate. In some embodiments, at least some of the functional modules of the mobile communication module 150 may be disposed in the processor 110. In some embodiments, at least some of the functional modules of the mobile communication module 150 may be provided in the same device as at least some of the modules of the processor 110.

The modem processor may include a modulator and a demodulator. The modulator is used for modulating the low-frequency baseband signal to be transmitted into a medium-high frequency signal. The demodulator is used for demodulating the received electromagnetic wave signal into a low-frequency baseband signal. The demodulator then transmits the demodulated low frequency baseband signal to the baseband processor for processing. The low frequency baseband signal is processed by the baseband processor and then transferred to the application processor. The application processor outputs sound signals through an audio device (not limited to the speaker 170A, the receiver 170B, etc.), or displays images or video through the display screen 194. In some embodiments, the modem processor may be a stand-alone device. In other embodiments, the modem processor may be provided in the same device as the mobile communication module 150 or other functional module, independent of the processor 110.

The wireless communication module 160 may provide solutions for wireless communication including wireless local area network (wireless local area networks, WLAN), such as wireless fidelity (WIRELESS FIDELITY, wi-Fi) network, bluetooth (BT), global navigation satellite system (global navigation SATELLITE SYSTEM, GNSS), frequency modulation (frequency modulation, FM), near field communication (NEAR FIELD communication, NFC), infrared (IR), etc., applied on the terminal device 100. The wireless communication module 160 may be one or more devices that integrate at least one communication processing module. The wireless communication module 160 receives electromagnetic waves via the antenna 2, modulates the electromagnetic wave signals, filters the electromagnetic wave signals, and transmits the processed signals to the processor 110. The wireless communication module 160 may also receive a signal to be transmitted from the processor 110, frequency modulate it, amplify it, and convert it to electromagnetic waves for radiation via the antenna 2.

In some embodiments, antenna 1 and mobile communication module 150 of terminal device 100 are coupled, and antenna 2 and wireless communication module 160 are coupled, such that terminal device 100 may communicate with a network and other devices via wireless communication techniques. The wireless communication techniques can include the Global System for Mobile communications (global system for mobile communications, GSM), general packet radio service (GENERAL PACKET radio service, GPRS), code division multiple access (code division multiple access, CDMA), wideband code division multiple access (wideband code division multiple access, WCDMA), time division code division multiple access (time-division code division multiple access, TD-SCDMA), long term evolution (long term evolution, LTE), BT, GNSS, WLAN, NFC, FM, and/or IR techniques, among others. The GNSS may include a global satellite positioning system (global positioning system, GPS), a global navigation satellite system (global navigation SATELLITE SYSTEM, GLONASS), a beidou satellite navigation system (beidou navigation SATELLITE SYSTEM, BDS), a quasi zenith satellite system (quasi-zenith SATELLITE SYSTEM, QZSS) and/or a satellite based augmentation system (SATELLITE BASED AUGMENTATION SYSTEMS, SBAS).

The terminal device 100 implements display functions through a GPU, a display screen 194, an application processor, and the like. The GPU is a microprocessor for image processing, and is connected to the display 194 and the application processor. The GPU is used to perform mathematical and geometric calculations for graphics rendering. Processor 110 may include one or more GPUs that execute program instructions to generate or change display information.

The display screen 194 is used to display images, videos, and the like. The display 194 includes a display panel. The display panel may employ a Liquid Crystal Display (LCD) CRYSTAL DISPLAY, an organic light-emitting diode (OLED), an active-matrix organic LIGHT EMITTING diode (AMOLED), a flexible light-emitting diode (FLED), miniled, microLed, micro-oLed, a quantum dot LIGHT EMITTING diode (QLED), or the like. In some embodiments, the terminal device 100 may include 1 or N display screens 194, N being a positive integer greater than 1.

The terminal device 100 may implement a photographing function through an ISP, a camera 193, a video codec, a GPU, a display screen 194, an application processor, and the like.

The ISP is used to process data fed back by the camera 193. For example, when photographing, the shutter is opened, light is transmitted to the camera photosensitive element through the lens, the optical signal is converted into an electric signal, and the camera photosensitive element transmits the electric signal to the ISP for processing and is converted into an image visible to naked eyes. ISP can also optimize the noise, brightness and skin color of the image. The ISP can also optimize parameters such as exposure, color temperature and the like of a shooting scene. In some embodiments, the ISP may be provided in the camera 193.

The camera 193 is used to capture still images or video. The object generates an optical image through the lens and projects the optical image onto the photosensitive element. The photosensitive element may be a charge coupled device (charge coupled device, CCD) or a Complementary Metal Oxide Semiconductor (CMOS) phototransistor. The photosensitive element converts the optical signal into an electrical signal, which is then transferred to the ISP to be converted into a digital image signal. The ISP outputs the digital image signal to the DSP for processing. The DSP converts the digital image signal into an image signal in a standard RGB, YUV, or the like format. In some embodiments, the terminal device 100 may include 1 or N cameras 193, N being a positive integer greater than 1.

The digital signal processor is used for processing digital signals, and can process other digital signals besides digital image signals. For example, when the terminal device 100 selects a frequency bin, the digital signal processor is used to fourier transform the frequency bin energy, or the like.

Video codecs are used to compress or decompress digital video. The terminal device 100 may support one or more video codecs. In this way, the terminal device 100 can play or record video in various encoding formats, such as moving picture experts group (moving picture experts group, MPEG) 1, MPEG2, MPEG3, MPEG4, etc.

The NPU is a neural-network (NN) computing processor, and can rapidly process input information by referencing a biological neural network structure, for example, referencing a transmission mode between human brain neurons, and can also continuously perform self-learning. Applications such as intelligent recognition of the terminal device 100, for example, image recognition, face recognition, voice recognition, text understanding, etc., can be realized through the NPU.

The external memory interface 120 may be used to connect an external memory card, such as a Micro SD card, to realize expansion of the memory capability of the terminal device 100. The external memory card communicates with the processor 110 through an external memory interface 120 to implement data storage functions. For example, files such as music, video, etc. are stored in an external memory card.

The internal memory 121 may be used to store computer executable program code including instructions. The internal memory 121 may include a storage program area and a storage data area. The storage program area may store an application program (such as a sound playing function, an image playing function, etc.) required for at least one function of the operating system, and the like. The storage data area may store data created during use of the terminal device 100 (such as audio data, phonebook, etc.), and the like. In addition, the internal memory 121 may include a high-speed random access memory, and may further include a nonvolatile memory such as at least one magnetic disk storage device, a flash memory device, a universal flash memory (universal flash storage, UFS), and the like. The processor 110 performs various functional applications of the terminal device 100 and data processing by executing instructions stored in the internal memory 121 and/or instructions stored in a memory provided in the processor.

The terminal device 100 may implement audio functions through an audio module 170, a speaker 170A, a receiver 170B, a microphone 170C, an earphone interface 170D, an application processor, and the like. Such as music playing, recording, etc.

The audio module 170 is used to convert digital audio information into an analog audio signal output and also to convert an analog audio input into a digital audio signal. The audio module 170 may also be used to encode and decode audio signals. In some embodiments, the audio module 170 may be disposed in the processor 110, or a portion of the functional modules of the audio module 170 may be disposed in the processor 110.

The speaker 170A, also referred to as a "horn," is used to convert audio electrical signals into sound signals. The terminal device 100 can listen to music or to handsfree talk through the speaker 170A.

A receiver 170B, also referred to as a "earpiece", is used to convert the audio electrical signal into a sound signal. When the terminal device 100 receives a call or voice message, it is possible to receive voice by approaching the receiver 170B to the human ear.

Microphone 170C, also referred to as a "microphone" or "microphone", is used to convert sound signals into electrical signals. When making a call or transmitting voice information, the user can sound near the microphone 170C through the mouth, inputting a sound signal to the microphone 170C. The terminal device 100 may be provided with at least one microphone 170C. In other embodiments, the terminal device 100 may be provided with two microphones 170C, and may implement a noise reduction function in addition to collecting sound signals. In other embodiments, the terminal device 100 may be further provided with three, four or more microphones 170C to collect sound signals, reduce noise, identify the source of sound, implement directional recording functions, etc.

The earphone interface 170D is used to connect a wired earphone. The earphone interface 170D may be a USB interface 130 or a 3.5mm open mobile terminal platform (open mobile terminal platform, OMTP) standard interface, a american cellular telecommunications industry association (cellular telecommunications industry association of the USA, CTIA) standard interface.

The pressure sensor 180A is used to sense a pressure signal, and may convert the pressure signal into an electrical signal. In some embodiments, the pressure sensor 180A may be disposed on the display screen 194. The pressure sensor 180A is of various types, such as a resistive pressure sensor, an inductive pressure sensor, a capacitive pressure sensor, and the like. The capacitive pressure sensor may be a capacitive pressure sensor comprising at least two parallel plates with conductive material. The capacitance between the electrodes changes when a force is applied to the pressure sensor 180A. The terminal device 100 determines the intensity of the pressure according to the change of the capacitance. When a touch operation is applied to the display 194, the terminal device 100 detects the intensity of the touch operation according to the pressure sensor 180A. The terminal device 100 may also calculate the position of the touch from the detection signal of the pressure sensor 180A. In some embodiments, touch operations that act on the same touch location, but at different touch operation strengths, may correspond to different operation instructions. For example, when a touch operation with a touch operation intensity smaller than a first pressure threshold is applied to the short message application icon, an instruction to view the short message is executed. And executing an instruction for newly creating the short message when the touch operation with the touch operation intensity being greater than or equal to the first pressure threshold acts on the short message application icon.

The gyro sensor 180B may be used to determine a motion gesture of the terminal device 100. In some embodiments, the angular velocity of the terminal device 100 about three axes (i.e., x, y, z axes) may be determined by the gyro sensor 180B. The gyro sensor 180B may be used for photographing anti-shake. Illustratively, when the shutter is pressed, the gyro sensor 180B detects the angle of the shake of the terminal device 100, calculates the distance to be compensated by the lens module according to the angle, and allows the lens to counteract the shake of the terminal device 100 by the reverse motion, thereby realizing anti-shake. The gyro sensor 180B may also be used for navigating, somatosensory game scenes.

The air pressure sensor 180C is used to measure air pressure. In some embodiments, the terminal device 100 calculates altitude from barometric pressure values measured by the barometric pressure sensor 180C, aiding in positioning and navigation.

The magnetic sensor 180D includes a hall sensor. The terminal device 100 can detect the opening and closing of the flip cover using the magnetic sensor 180D. In some embodiments, when the terminal device 100 is a folder, the terminal device 100 may detect opening and closing of the folder according to the magnetic sensor 180D. And then according to the detected opening and closing state of the leather sheath or the opening and closing state of the flip, the characteristics of automatic unlocking of the flip and the like are set.

The acceleration sensor 180E can detect the magnitude of acceleration of the terminal device 100 in various directions (typically three axes). The magnitude and direction of gravity may be detected when the terminal device 100 is stationary. The method can also be used for identifying the gesture of the terminal equipment, and is applied to the applications such as horizontal and vertical screen switching, pedometers and the like.

A distance sensor 180F for measuring a distance. The terminal device 100 may measure the distance by infrared or laser. In some embodiments, the terminal device 100 may range using the distance sensor 180F to achieve fast focusing.

The proximity light sensor 180G may include, for example, a Light Emitting Diode (LED) and a light detector, such as a photodiode. The light emitting diode may be an infrared light emitting diode. The terminal device 100 emits infrared light outward through the light emitting diode. The terminal device 100 detects infrared reflected light from a nearby object using a photodiode. When sufficient reflected light is detected, it can be determined that there is an object in the vicinity of the terminal device 100. When insufficient reflected light is detected, the terminal device 100 may determine that there is no object in the vicinity of the terminal device 100. The terminal device 100 can detect that the user holds the terminal device 100 close to the ear to talk by using the proximity light sensor 180G, so as to automatically extinguish the screen for the purpose of saving power. The proximity light sensor 180G may also be used in holster mode, pocket mode to automatically unlock and lock the screen.

The ambient light sensor 180L is used to sense ambient light level. The terminal device 100 may adaptively adjust the brightness of the display 194 based on the perceived ambient light level. The ambient light sensor 180L may also be used to automatically adjust white balance when taking a photograph. The ambient light sensor 180L may also cooperate with the proximity light sensor 180G to detect whether the terminal device 100 is in a pocket to prevent false touches.

The fingerprint sensor 180H is used to collect a fingerprint. The terminal device 100 can utilize the collected fingerprint characteristics to realize fingerprint unlocking, access an application lock, fingerprint photographing, fingerprint incoming call answering and the like.

The temperature sensor 180J is for detecting temperature. In some embodiments, the terminal device 100 performs a temperature processing strategy using the temperature detected by the temperature sensor 180J. For example, when the temperature reported by the temperature sensor 180J exceeds a threshold, the terminal device 100 performs a reduction in the performance of a processor located near the temperature sensor 180J in order to reduce power consumption to implement thermal protection. In other embodiments, when the temperature is below another threshold, the terminal device 100 heats the battery 142 to avoid the low temperature causing the terminal device 100 to shut down abnormally. In other embodiments, when the temperature is below a further threshold, the terminal device 100 performs boosting of the output voltage of the battery 142 to avoid abnormal shutdown caused by low temperatures.

The touch sensor 180K, also referred to as a "touch device". The touch sensor 180K may be disposed on the display screen 194, and the touch sensor 180K and the display screen 194 form a touch screen, which is also called a "touch screen". The touch sensor 180K is for detecting a touch operation acting thereon or thereabout. The touch sensor may communicate the detected touch operation to the application processor to determine the touch event type. Visual output related to touch operations may be provided through the display 194. In other embodiments, the touch sensor 180K may also be disposed on the surface of the terminal device 100 at a different location than the display 194.

The bone conduction sensor 180M may acquire a vibration signal. In some embodiments, bone conduction sensor 180M may acquire a vibration signal of a human vocal tract vibrating bone pieces. The bone conduction sensor 180M may also contact the pulse of the human body to receive the blood pressure pulsation signal. In some embodiments, bone conduction sensor 180M may also be provided in a headset, in combination with an osteoinductive headset. The audio module 170 may analyze the voice signal based on the vibration signal of the sound portion vibration bone block obtained by the bone conduction sensor 180M, so as to implement a voice function. The application processor may analyze the heart rate information based on the blood pressure beat signal acquired by the bone conduction sensor 180M, so as to implement a heart rate detection function.

The keys 190 include a power-on key, a volume key, etc. The keys 190 may be mechanical keys. Or may be a touch key. The terminal device 100 may receive key inputs, generating key signal inputs related to user settings and function controls of the terminal device 100.

The motor 191 may generate a vibration cue. The motor 191 may be used for incoming call vibration alerting as well as for touch vibration feedback. For example, touch operations acting on different applications (e.g., photographing, audio playing, etc.) may correspond to different vibration feedback effects. The motor 191 may also correspond to different vibration feedback effects by touching different areas of the display screen 194. Different application scenarios (e.g., time alert, receipt message, alarm clock, game, etc.) may also correspond to different vibration feedback effects. The touch vibration feedback effect may also support customization.

The indicator 192 may be an indicator light, may be used to indicate a state of charge, a change in charge, a message indicating a missed call, a notification, etc.

The SIM card interface 195 is used to connect a SIM card. The SIM card may be contacted and separated from the terminal apparatus 100 by being inserted into the SIM card interface 195 or by being withdrawn from the SIM card interface 195. The terminal device 100 may support 1 or N SIM card interfaces, N being a positive integer greater than 1. The SIM card interface 195 may support Nano SIM cards, micro SIM cards, and the like. The same SIM card interface 195 may be used to insert multiple cards simultaneously. The types of the plurality of cards may be the same or different. The SIM card interface 195 may also be compatible with different types of SIM cards. The SIM card interface 195 may also be compatible with external memory cards. The terminal device 100 interacts with the network through the SIM card to realize functions such as call and data communication. In some embodiments, the terminal device 100 employs an eSIM, i.e., an embedded SIM card. The eSIM card can be embedded in the terminal device 100 and cannot be separated from the terminal device 100.

The software system of the terminal device 100 may employ a layered architecture, an event driven architecture, a micro-core architecture, a micro-service architecture, or a cloud architecture. In the embodiment of the application, taking an Android system with a layered architecture as an example, a software structure of the terminal device 100 is illustrated. Referring to fig. 3, fig. 3 is a schematic diagram of a software structure of a terminal device 100 according to an embodiment of the present application.

The layered architecture divides the software into a plurality of layers, each layer has clear roles and division, and the layers are communicated through software interfaces. In some embodiments, the Android system is divided into four layers, from top to bottom, an application layer, an application framework layer, a An Zhuoyun-line (Android run) system library, and a kernel layer, respectively.

The application layer may include a series of application packages, that is, the application according to the embodiment of the present application, as shown in fig. 3, where the application packages may include applications such as a camera, gallery, calendar, call, map, navigation, WLAN, bluetooth, music, video, short message, and the like.

The application framework layer provides an application programming interface (application programming interface, API) and programming framework for the application of the application layer. The application framework layer includes a number of predefined functions. As shown in fig. 3, the application framework layer may include a window manager, a content provider, a view system, a phone manager, a resource manager, a notification manager, and the like.

The window manager is used for managing window programs, and can acquire the size of a display screen, judge whether a status bar exists, lock a screen, intercept the screen and the like.

The content provider is used to store and retrieve data and make such data accessible to applications. The data may include video, images, audio, calls made and received, browsing history and bookmarks, phonebooks, etc.

The view system includes visual controls, such as controls to display text, controls to display pictures, and the like. The view system may be used to build applications. The display interface may be composed of one or more views, for example, may include a display interface for a text notification icon, and may also include a view for displaying text and a view for displaying a picture.

The telephony manager is used to provide communication functions of the terminal device 100, such as management of call status (including on, off, etc.).

The resource manager provides various resources for the application program, such as localization strings, icons, pictures, layout files, video files, and the like.

The notification manager allows the application to display notification information in a status bar, can be used to communicate notification type messages, can automatically disappear after a short dwell, and does not require user interaction. Such as notification manager is used to inform that the download is complete, message alerts, etc. The notification manager may also be a notification in the form of a chart or scroll bar text presented in a status bar at the top of the system, such as a notification of a background running application, or a notification presented on a screen in the form of a dialog window, such as a text message being prompted in a status bar, a notification sound being emitted, a terminal device vibrating, a flashing indicator light, etc.

Android run times comprise core libraries and virtual machines, and are responsible for scheduling and management of Android systems. The core library comprises two parts, wherein one part is a function required to be called by java language, and the other part is an android core library.

The application program layer and the application program framework layer run in the virtual machine, the virtual machine executes java files of the application program layer and the application program framework layer into binary files, and the virtual machine is used for executing functions such as management of object life cycle, stack management, thread management, security and exception management, garbage collection and the like.

The system library may include a plurality of functional modules. Such as surface manager (surface manager), media library (media library), three-dimensional graphics processing library (e.g., openGL ES), 2D graphics engine (e.g., SGL), etc.

The surface manager is used to manage the display subsystem and provides a fusion of 2D and 3D layers for multiple applications. Media libraries support a variety of commonly used audio, video format playback and recording, still image files, and the like. The media library may support a variety of audio and video encoding formats such as MPEG4, h.264, MP3, AAC, AMR, JPG, PNG, etc. The three-dimensional graphic processing library is used for realizing three-dimensional graphic drawing, image rendering, synthesis, layer processing and the like. The 2D graphics engine is a drawing engine for 2D drawing.

The kernel layer is a layer between hardware and software, and at least comprises a display driver, a camera driver, an audio driver and a sensor driver.

The workflow of the terminal device 100 software and hardware is illustrated in connection with capturing a photo scene:

When touch sensor 180K receives a touch operation, a corresponding hardware interrupt is issued to the kernel layer. The kernel layer processes the touch operation into the original input event (including information of touch coordinates, time stamp of touch operation, etc.). The original input event is stored at the kernel layer. The application framework layer acquires an original input event from the kernel layer, and identifies a control corresponding to the input event. Taking the touch operation as a touch click operation and the control corresponding to the click operation as a control of a camera application icon as an example, an application program camera invokes an interface of an application frame layer to start a camera application, and further, a camera driver is started by invoking a kernel layer to capture a still image or video through a camera 193.

The screen projection method provided by the embodiment of the application can be applied to various types of terminal equipment, and the block diagrams of several typical terminal equipment are taken as examples to illustrate the terminal equipment provided by the embodiment of the application, as shown in fig. 4, the (a) sub-schematic diagram and the (b) sub-schematic diagram of fig. 4 are respectively schematic diagrams of a smart phone and a smart watch, and the hardware structure of the terminal equipment corresponding to fig. 2 and the software structure corresponding to fig. 3 can be carried on the block diagrams of the terminal equipment of fig. 4, so as to implement the screen projection method provided by the embodiment of the application.

In addition, the screen projection method provided by the embodiment of the application can be applied to various foldable terminal devices, such as a foldable mobile phone, a foldable personal computer, a foldable tablet personal computer, a foldable glasses and the like, and the foldable terminal device provided by the embodiment of the application is illustrated by taking the foldable mobile phone as an example, as shown in fig. 5, fig. 5 illustrates a block diagram of the foldable mobile phone in an unfolding state of the smart foldable mobile phone, a screen of the foldable mobile phone is a flexible screen, a user can watch a video and an image through the flexible screen and input a touch event and the like on the flexible screen, after the user finishes using the foldable mobile phone, the foldable mobile phone can be folded for convenient carrying, as shown in fig. 6, and fig. 6 illustrates a folding state of the foldable mobile phone obtained after the folding of the foldable mobile phone through a rotating device.

It should be noted that, in fig. 5 and fig. 6, one of the unfolding and folding manners is that the folding and unfolding are performed by the rotating device for processing the central axis of the folding mobile phone, in some embodiments of the present application, the rotating device may be located at any position of the folding mobile phone, and the folding device may be more than one, and the folding manner is not limited in the present application.

In the screen projection method provided by the embodiment of the application, screen projection information of an application program running on a terminal device is projected onto a display module meeting corresponding screen projection conditions on a vehicle (such as a common automobile, an intelligent automobile, an automatic driving automobile, a network-connected automobile and the like) based on screen projection conditions, and the display modules on the vehicle are different due to factors such as vehicles produced by different vehicle enterprises and different vehicle types, in the embodiment of the application, the display module on the vehicle can be a display device installed or placed at any position of the vehicle, as shown in fig. 7, fig. 7 illustrates that various display modules are concentrated on one vehicle, and for convenience of understanding, fig. 7 shows the display module deployed on the vehicle from different view angles, and the display module on the vehicle at least can include: a center control screen 101, a dashboard screen 102, a steering wheel screen 103, a head-up display (HUD) 104, a front windshield screen 105 (which may include, for example, a left view screen 1051, a right view screen 1052, etc. of the vehicle), a rear windshield screen 106, a front passenger screen 107, a window screen (e.g., a left window screen 108, a right window screen 109, etc.), a sunroof screen 110, etc., or a display module on the vehicle may further include any surface area of the inside/outside of the vehicle, such as a vehicle body, a door, a sun visor in the vehicle, a sunroof, etc., wrapped with a material having a display function (such as a flexible display screen). That is, in the embodiment of the present application, any area or device in the vehicle where the terminal device can throw a screen may be referred to as a display module on the vehicle according to the embodiment of the present application.

In addition, it should be noted that, in some embodiments of the present application, the display interface corresponding to the display module on the vehicle may be any interface with any shape, such as rectangle (the display interface of some display modules as shown in fig. 7), square, circle, ellipse, trapezoid, and any irregular shape, and the shape of the display interface of the display module is not limited herein.

In some embodiments of the present application, the vehicle may be a car (as shown in fig. 7), a truck, a motorcycle, a bus, a ship, an airplane, a helicopter, a recreational vehicle, a casino vehicle, construction equipment, a trolley, a golf cart, a train, or the like, and the embodiment of the present application is not particularly limited. Therefore, the display module on the vehicle according to the embodiment of the present application may be a display module on any of the above-described types of vehicles.

After the terminal device and the display module on the vehicle according to the embodiments of the present application are described, the screen projection method provided by the embodiments of the present application is described below, and it should be noted that the embodiments described below may be performed based on the terminal device described in fig. 2 to fig. 6, specifically referring to fig. 8, fig. 8 is a schematic flow diagram of the screen projection method provided by the embodiments of the present application, and may specifically include the following steps:

801. A first screen-throwing condition of a first display module on a vehicle is acquired, wherein the first screen-throwing condition is related to running information of a target vehicle or is related to characteristic information of an application program to be screened.

First, the terminal device may acquire a first screen-throwing condition of the first display module on the vehicle, where the first screen-throwing condition is related to the driving information of the target vehicle (i.e., the first screen-throwing condition may be set according to the driving information of the target vehicle), or the first screen-throwing condition is related to the feature information of the application program to be screened (i.e., the first screen-throwing condition may also be set according to the feature information of the application program to be screened), which is not limited herein.

It should be noted that, in some embodiments of the present application, the terminal device may acquire the first screen-throwing condition of the first display module on the target vehicle by throwing the screen, where the terminal device may acquire the first screen-throwing conditions of the first display module on the vehicle by throwing the screen, and one display module corresponds to one screen-throwing condition, for example, as shown in table 1, assuming that there are 3 different display modules on the target vehicle a, namely, a dashboard screen, a steering wheel screen and a central control screen, respectively, there are one corresponding screen-throwing condition for each display module, namely, 3 screen-throwing conditions, namely, a screen-throwing condition 1, a screen-throwing condition 2 and a screen-throwing condition 3, and the screen-throwing conditions are set according to the characteristic information of the application program.

Table 1 correspondence between display modules and screen-throwing conditions on target vehicle a

It should be noted that, in some embodiments of the present application, the terminal device may obtain all the screen-throwing conditions of all the display modules on the vehicle, as shown in the above table 1, where the terminal device may obtain 3 screen-throwing conditions corresponding to each of the 3 display modules on the target vehicle a, or may obtain (at least 2) the partial screen-throwing conditions of the partial display modules on the vehicle, as shown in the above table 1, where the terminal device may obtain only any 2 display modules on the target vehicle a or 2 screen-throwing conditions corresponding to each of the specified 2 display modules (e.g., specify the central control screen and the dashboard screen on the target vehicle a). For ease of understanding, in the following embodiments of the present application, all screen-throwing conditions that are obtained by the terminal device and are thrown on the screen by all display modules on the vehicle are taken as examples.

It should be noted that, in some embodiments of the present application, the terminal device may obtain the plurality of screen-throwing conditions of the plurality of display modules on the vehicle by throwing the screen, which are based on the screen-throwing conditions corresponding to the various display modules stored in advance on the terminal device, and the display modules may be on vehicles of the same vehicle type, or on vehicles of different vehicle types, or the number and types of the display modules on the vehicle may be different, and specifically, as shown in table 2, the screen-throwing conditions corresponding to the display modules are made only based on the types of the different display modules and the positions on the vehicle, regardless of the vehicle on which the display module is located.

For example, it is assumed that the vehicle B has 3 display modules, namely, a dashboard screen, a steering wheel screen, and a center control screen, the vehicle C has 5 display modules, namely, a dashboard screen, a steering wheel screen, a center control screen, a HUD, and a copilot screen, the vehicle D has 6 display modules, namely, a dashboard screen, a steering wheel screen, a center control screen, a left window screen, a right window screen, and a sunroof screen, and the vehicle E has 8 display modules, namely, a dashboard screen, a steering wheel screen, a center control screen, a HUD, a front windshield screen, a rear windshield screen, a left view screen, and a right view screen, respectively. Then, according to the corresponding relation in table 2, the screen projection condition corresponding to the display module on each vehicle can be obtained. For example, assuming that the corresponding relationship between the display modules shown in table 2 and the screen-throwing conditions is stored in the terminal device, the terminal device can obtain that the screen-throwing conditions corresponding to the 3 display modules, i.e. the dashboard screen, the steering wheel screen and the central control screen, on the vehicle B are respectively the screen-throwing condition 1, the screen-throwing condition 2 and the screen-throwing condition 3.

Table 2 correspondence between types of different display modules and screen-throwing conditions

It should be noted that, as the field of human-computer interfaces for vehicles is experiencing technical hot-air in automobile design, the autopilot system is rapidly developing, in the above table 2, all display modules possibly existing on the vehicle are not exhausted, and when a new type of display module appears, the user can update the correspondence of table 2 according to the need, so that the correspondence between the types of different display modules and the screen throwing conditions in table 2 is as perfect as possible.

It should be further noted that, in some embodiments of the present application, the correspondence between the types of different display modules and the screen-throwing conditions illustrated in table 2 is not constant, and in practical applications, the user may adjust the correspondence between the display modules and the screen-throwing conditions according to driving habits, screen-watching habits, and the like.

It should be further noted that, in the embodiment of the present application, the terminal device obtains a plurality of screen-throwing conditions that a plurality of display modules on a vehicle are thrown on a screen, which includes but is not limited to:

A. The terminal equipment receives the identification information of the display modules sent by the vehicle, and obtains a plurality of screen throwing conditions of a plurality of display modules on the vehicle on the basis of the identification information.

In the embodiment of the application, communication connection is required to be established between the terminal equipment and the vehicle, and under the condition that the communication connection is successfully established, the terminal equipment receives identification information of a plurality of display modules sent by the vehicle, wherein each display module in the plurality of display modules corresponds to one identification information, and the identification information is used for uniquely characterizing the corresponding display module, so that the terminal equipment can identify the corresponding display module based on each received identification information, and because the correspondence between the type of the display module and the screen throwing condition is stored in the terminal equipment in advance (as shown in the table 2 above), the terminal equipment can acquire a plurality of screen throwing conditions of the plurality of display modules on the vehicle based on the correspondence.

It should be noted that, in some embodiments of the present application, the identification information of the display module may be the name of the display module directly, such as "center control screen", "steering wheel screen", "dashboard screen", etc., as shown in table 2 above, or may be a self-named identifier, such as "screen-in mark 1", "screen-in mark 2", "screen-in mark 3", etc., as shown in table 3 above, and the identification information of the display module may be a self-defined letter identifier (e.g., a, b, c, etc.), a number identifier (e.g., 11, 22, 33, etc.), a special identifier (e.g., @, # etc.), as long as the identifier has the function of uniquely identifying the corresponding display module, which may be referred to as the identification information of the display module in the embodiment of the present application.

Table 3 correspondence between different display modules and identification information, screen-throwing conditions

For convenience of understanding, a manner in which the terminal device obtains a plurality of screen-throwing conditions of a plurality of display modules on a vehicle by taking the terminal device as a mobile phone is described below by taking the terminal device as an example, referring to fig. 9, firstly, the correspondence between different types of display modules corresponding to the table 3 and identification information, and the screen-throwing conditions (which may be referred to as a mapping relationship table 1) is stored in the mobile phone, and when the mobile phone carried by a user establishes a communication connection with the vehicle a, the communication connection may be a wired connection (for example, through a USB connection) or a wireless connection (for example, through wifi, ultra Wideband (UWB), bluetooth, etc.), which is not limited herein. Assuming that 3 display modules, namely a central control screen, a steering wheel screen and an instrument panel screen, are deployed on the vehicle A, the mobile phone receives a screen-throwing mark 1, a screen-throwing mark 2 and a screen-throwing mark 3 sent by the vehicle A (the vehicle A pre-stores identification information corresponding to each display module). Then, the mobile phone searches in the mapping relation table 1 based on the received screen-throwing mark 1, screen-throwing mark 2 and screen-throwing mark 3, so as to obtain a screen-throwing condition 1, a screen-throwing condition 2 and a screen-throwing condition 3 which respectively correspond to the screen-throwing mark 1, the screen-throwing mark 2 and the screen-throwing mark 3.

In some embodiments of the present application, the mobile phone may receive the central control screen, the steering wheel screen, and the dashboard screen sent by the vehicle a, and then the mobile phone recognizes the corresponding identification information based on the central control screen, the steering wheel screen, and the dashboard screen. That is, in the embodiment of the present application, the identification information may be identified by the vehicle a or by the mobile phone, which is not limited herein.

It should be noted that, in some embodiments of the present application, when the terminal device connects to the vehicle for the first time through a wired or wireless manner, identification information corresponding to a plurality of display modules on the vehicle is obtained from the vehicle and stored in a storage module of the terminal device, and if a subsequent terminal device establishes a communication connection with the vehicle, the vehicle may not need to send the identification information corresponding to the plurality of display modules on the vehicle to the terminal device.

It should be further noted that, in some embodiments of the present application, the terminal device may store identification information corresponding to display modules of more than one vehicle (for example, identification information corresponding to display modules on respective vehicles sent by different vehicles and received at different times), where the user may select which of the display modules of the vehicles corresponds to the identification information on the terminal device. As shown in fig. 10, taking a terminal device as an example of a mobile phone, assuming that the mobile phone stores identification information corresponding to a display module of a vehicle a, identification information corresponding to a display module of a vehicle B, and identification information corresponding to a display module of a vehicle C, if a user carries the mobile phone to drive the vehicle a, the user can select and obtain the identification information corresponding to the display module of the vehicle a from the mobile phone by himself in a case that the mobile phone does not have a communication connection with the vehicle a yet. It should be noted that fig. 10 is only a schematic operation manner, and in a specific application process, there may also be a plurality of operation manners for selecting and acquiring the identification information corresponding to the display module of the vehicle a from the mobile phone, which is not limited herein.

B. the terminal equipment acquires the vehicle model of the vehicle, and acquires a plurality of screen projection conditions of a plurality of display modules on the vehicle on the basis of the vehicle model.

In the embodiment of the application, the terminal device can also acquire the vehicle model to which the vehicle belongs, and the type and the number of the display modules deployed on the vehicle corresponding to each vehicle model are the same, so that the vehicle model to which the vehicle belongs is known, namely, the display modules corresponding to the vehicle are known, and then a plurality of screen throwing conditions for throwing a plurality of display modules on the vehicle are acquired based on the vehicle model.

For the sake of understanding, a manner in which the terminal device obtains a plurality of screen-throwing conditions in which a plurality of display modules are thrown on a vehicle is still taken as an example of a mobile phone will be described below, referring to fig. 11, first, the correspondence between different types of display modules corresponding to the table 3 and identification information and the screen-throwing conditions (which may be referred to as a mapping table 1) is stored in the mobile phone, and besides the mapping table, the terminal device further has a correspondence between a vehicle model and a display module (which may be referred to as a mapping table 2), for example, table 4 shows a specific type of display module of some vehicle models in the mapping table 2, and when the mobile phone carried by a user and the vehicle B establish a communication connection, a wired connection manner (for example, through USB connection) or a wireless connection manner (for example, through wifi, ultra Wideband (UWB), bluetooth, etc.), which is not limited herein. The mobile phone can receive the vehicle model of the vehicle B sent by the vehicle B, and the mobile phone searches 2 display modules, namely a central control screen and an instrument panel screen, of the vehicle of the model of the Volvo XC60 from a mapping relation table 2 on the assumption that the model of the vehicle B is the Volvo XC60, corresponding identification information is a screen throwing condition 1 and a screen throwing condition 3 respectively, and then obtains a screen throwing condition 1 and a screen throwing condition 3 respectively corresponding to the screen throwing mark 1 and the screen throwing mark 3 based on the mapping relation table 1.

Table 4 correspondence between vehicle model and display module type

Similarly, when a new vehicle model appears, the corresponding relationship between the vehicle model and the display module shown in the table 4 can be updated at any time according to the needs of the user, and similarly, when a certain existing vehicle model upgrades the display module on the corresponding vehicle (for example, adding the number of display modules, adding new display modules, replacing the display modules, etc.), the corresponding relationship in the table 4 can also be updated and maintained in time.

In some embodiments of the present application, when the terminal device connects to the vehicle for the first time through a wired or wireless method, the vehicle model to which the vehicle belongs is obtained from the vehicle and stored in the storage module of the terminal device, and if the subsequent terminal device establishes a communication connection with the vehicle, the vehicle may not need to send the vehicle model to which the vehicle belongs to the terminal device.

It should be further noted that, in some embodiments of the present application, the terminal device may store vehicle models of more than one vehicle (for example, vehicle models of respective vehicles transmitted by different vehicles received at different times), in which case, the user may select which vehicle model of the vehicle is acquired by himself at the terminal device. As shown in fig. 12, taking a terminal device as an example of a mobile phone, assuming that a vehicle model to which a vehicle a belongs, a vehicle model to which a vehicle B belongs, and a vehicle model to which a vehicle C belongs are stored in the mobile phone, if a user carries the mobile phone to prepare to drive the vehicle B, the user can select and obtain the vehicle model to which the vehicle a belongs from the mobile phone by himself/herself in the case that the mobile phone does not establish communication connection with the vehicle B. It should be noted that fig. 12 is only a schematic operation manner, and in a specific application process, there may also be a plurality of operation manners for selecting and acquiring a vehicle model to which the vehicle a belongs from the mobile phone, which is not limited herein.

It should be noted that, in the embodiment of the present application, one display module corresponds to a screen-throwing condition, where the screen-throwing condition may be set according to driving information of a vehicle (for example, driving speed of the vehicle, type of traffic scene where the vehicle is located, number of passengers in the vehicle, fatigue state of a driver of the vehicle, etc.), and the screen-throwing condition may also be set according to feature information of an application program (for example, an application type to which an application program to be thrown on a terminal device belongs, reaching a preset use frequency, etc.), and a setting manner of the screen-throwing condition is not limited herein. The following description will be made separately.

1. The screen throwing condition is set according to the characteristic information of the application program

First, an implementation of setting a screen-throwing condition according to characteristic information of an application program is described. Different screen throwing conditions are formed according to different dividing results obtained by dividing the characteristic information of the application program. However, the feature information of the application program includes various expression forms, for example, the application type of the application program, the use frequency of the application program on the terminal device, the power consumption of the application program when running on the terminal device, and the like, different division results can be obtained by performing different division based on different feature information of the application program, and the division results form different screen dropping conditions in the embodiment of the application. In the following embodiments of the present application, 3 display modules on a vehicle are taken as examples, and the 3 display modules are respectively a "center control screen", "a" steering wheel screen "and a" dashboard screen ", and the corresponding identification information of the display modules is respectively indicated by" screen-throwing mark 1"," screen-throwing mark 2 "and" screen-throwing mark 3", for convenience of understanding:

A. the characteristic information of the application program is the application program name, namely, the screen projection condition is that the specific application program corresponds to the specific display module.

In the embodiment of the application, the screen-throwing conditions are divided based on application program names, different screen-throwing conditions correspond to different application program names, as shown in table 5, the corresponding relation between each type of display module and the corresponding screen-throwing condition is shown in the schematic diagram, for example, if the name of the application program to be thrown on the terminal equipment is "WeChat", the "WeChat" is known to belong to the application program name required in the screen-throwing condition 1 according to each screen-throwing condition obtained by dividing based on the application program names in table 5, and the display module corresponding to the screen-throwing condition 1 is a dashboard screen, so when the terminal equipment and a vehicle establish communication connection, the terminal equipment can throw screen information of the application program "WeChat" to the dashboard of the vehicle, and similarly, if the name of the application program to be thrown on the terminal equipment is "navigation", the "navigation" is known to belong to the application program name required in the screen-throwing condition 3 according to each screen-throwing condition obtained by dividing based on the application program name in table 5, and the display module corresponding to the screen-throwing condition 3 is a central control screen, so that when the terminal equipment and the terminal equipment establishes communication connection, the terminal equipment can throw screen information of the vehicle into the dashboard of the vehicle after the communication connection. Similarly, determining which screen-throwing condition is met by the application to be thrown on the terminal device based on each screen-throwing condition obtained by dividing the application name, and if one of the screen-throwing conditions is met, throwing screen-throwing information of the application to a display module corresponding to the screen-throwing condition, which is not described in detail herein.

It should be noted that, table 5 is only a schematic illustration of dividing into each screen-throwing condition based on the application program name, and in the practical application process, there may be more dividing modes, for example, the application program "WeChat" may be divided into the screen-throwing condition 2, which is not limited herein.

Table 5 correspondence between different types of display modules and corresponding screen-throwing conditions

Display module	Identification information	Screen throwing condition	The screen-casting condition includes an application name
				Instrument panel screen	Screen projection mark 1	Screen throwing condition 1	WeChat, telephone, welink, &.
Steering wheel screen	Screen-throwing mark 2	Screen throwing condition 2	Network cloud music, QQ music, and.
				Center control screen	Screen throwing mark 3	Screen throwing condition 3	Navigation, video conferencing, messenger video, king glory, and.
......	......	......	......

It should be noted that, in some embodiments of the present application, the user may modify the corresponding screen-throwing condition according to the need, for example, the application names "WeChat", "telephone", "Welink" are shown in the above table 5, and the screen-throwing information may be thrown on the dashboard screen, and if a new application, such as "QQ", is installed on the terminal device, the user may add the new application to the screen-throwing condition 1. Or after the terminal equipment and the vehicle are in communication connection, the terminal equipment detects that a certain application program running on the terminal equipment does not belong to the application program name in any screen throwing condition, at the moment, the terminal equipment can display or prompt a user through an interface to confirm which display module on the vehicle is connected (namely, the user can set the display module by himself in a manual mode), and after the user confirms the connection, the terminal equipment stores the application program name in the screen throwing condition corresponding to the display module so as to be called next time.

For the sake of understanding, in the following, taking fig. 13 as an example how to add the name of the application program to be screened on the terminal device into a screen screening condition, as shown in fig. 13, an application program "QQ" is running on the mobile phone, and the mobile phone detects that the "QQ" does not belong to any screen screening condition in the stored mapping relationship table 1, at this time, the mobile phone reminds the user to confirm which of 3 display modules (i.e. "central control screen", "steering wheel screen" and "dashboard screen") on the vehicle is screened by means of a display interface, and if the user confirms that the screen is screened on the "dashboard screen", the mobile phone automatically stores the application program name "QQ" in a screen screening condition 1 corresponding to the "steering wheel screen", so that if the mobile phone is connected to the vehicle next time and the application program is running on the mobile phone, the mobile phone can automatically screen the screen screening information of the "QQ" on the corresponding dashboard screen. It should be noted that, fig. 13 illustrates that, in some embodiments of the present application, a mobile phone reminds a user to confirm through text information displayed on a display interface, and in fig. 14, how to enable the user to add a name of an application to be displayed on a terminal device to a certain screen-displaying condition through a voice prompt mode (for example, a mobile phone voice play QQ has no corresponding relation with a vehicle display module, please add "), which is not described herein in detail.

It should be noted that fig. 13 and fig. 14 are only two schematic operation manners of the present application, and in a specific application process, a plurality of display interface manners may also be provided to remind the user to confirm, which is not limited herein.

B. The characteristic information of the application program is the application type of the application program, namely, the screen projection condition is that the specific application type corresponds to the specific display module.

In the embodiment of the present application, the screen-throwing conditions are divided based on the application types to which the application program belongs, and different screen-throwing conditions correspond to different application types, and in one implementation manner of the present application, when the terminal device downloads the application programs from an "application market" of the terminal device, an "App Store" of the terminal device (the manufacturer of the terminal device may be different, the name of the terminal device is not limited herein), each application program is already classified in the application market (i.e., classification information determined by an application market tag, and each application program downloaded from the application market belongs to its own classification), for example, according to the classification tag of the application market, the application types may be classified into social categories, travel navigation categories, audio-visual categories, tool categories, information categories, game categories, accommodation categories, shopping categories, education categories, sports health categories, financial profits, and any application programs may necessarily belong to a certain category of the application types. As shown in table 6, the correspondence between each type of display module and the corresponding screen-throwing condition is illustrated, for example, when a social application program such as "WeChat", "QQ", "short message" is running on the terminal device, the screen-throwing conditions obtained by dividing the application program according to the application type to which the application program belongs in table 6 can be known as the application type required in the screen-throwing condition 1, and the display module corresponding to the screen-throwing condition 1 is a dashboard screen, therefore, after the terminal device establishes a communication connection with the vehicle, the terminal device can throw screen-throwing information of the application program such as "WeChat", "QQ", "short message" to the dashboard screen of the vehicle, similarly, if the application program to be thrown on the terminal device is "mass evaluation", the application type to which the application program belongs is "information class", the screen-throwing conditions obtained by dividing the application program according to the application type to which the application program belongs in table 6 can be known as the application type required in the screen-throwing condition 3, and the screen-throwing condition 3 corresponds to the display module is a dashboard screen, therefore, after the terminal device establishes a communication connection with the vehicle, the screen-throwing information can be thrown to the vehicle. Similarly, determining which screen-throwing condition is met by the application program to be thrown on the terminal device based on each screen-throwing condition obtained by dividing the application type to which the application program belongs, and if one of the screen-throwing conditions is met, throwing screen-throwing information of the application program to a display module corresponding to the screen-throwing condition, which is not described in detail herein.

Table 6 correspondence between different types of display modules and corresponding screen-throwing conditions

It should be noted that, table 6 is only a schematic illustration of dividing based on application types to obtain each screen-throwing condition, and in the practical application process, more dividing modes may be provided, for example, the first class, the second class, the third class and the third class may be directly classified.

It should be further noted that in the above table 6 of the present application, each screen-throwing condition includes at least 2 application types, and in practical application, the number of application types included in the screen-throwing condition is not limited, for example, the screen-throwing condition 1 may include only social application programs, and table 6 is merely illustrative and not limiting to the embodiment of the present application.

It should be noted that, in some embodiments of the present application, the user may modify the corresponding screen-throwing conditions according to the needs, for example, in table 6, the application programs with social types are all thrown on the dashboard screen of the vehicle, and the user may also choose to throw the application programs with social types on other screens according to the usage habit, the viewing habit, the driving habit, and the like, which is not limited herein.

It should be further noted that, in the embodiment of the present application, when the terminal device downloads a new application program from the application market, the terminal device may automatically classify the application program according to the classification of the application program by the application market, and the user does not need to classify the application program by himself at this time, for example, if a new application program such as "QQ" is installed on the terminal device, it is known that "QQ" belongs to the social class according to the classification of "QQ" by the application market. Or after the terminal device establishes communication connection with the vehicle, the terminal device detects that a certain application program running on the terminal device belongs to a social type, if the application type in the embodiment of the application is a user-defined application type, when downloading a new application program, the user can self-classify the newly downloaded application program and update the corresponding relation between different types of display modules and corresponding screen-throwing conditions, and the update mode is similar to the mode type corresponding to fig. 13 and 14, and details are not repeated here.

C. The characteristic information of the application program is the use frequency range of the application program, namely, the screen throwing condition is that the specific use frequency range of the application program on the terminal equipment corresponds to a specific display module.

In the embodiment of the application, the screen-throwing conditions are divided based on the use frequency range of the application program on the terminal equipment, different screen-throwing conditions correspond to different use frequency ranges, and the use frequency of the application program on the terminal equipment can be obtained from the functions of 'health use mobile phones' and the like of the terminal equipment.

In the embodiment of the application, one principle is followed that the screen projection information of the application program with higher use frequency is presented on a display module which can be seen or is most easily seen by a user with minimum cost. For example, the screen information of the application program with high use frequency is presented on a steering wheel screen of the vehicle, and the screen information of the application program with low use frequency is presented on a central control screen of the vehicle.

It should be noted that, in some embodiments of the present application, the frequency range of application usage on the terminal device may be characterized by 1) a time period of application usage on the terminal device, for example, a total time period spent by a user when the application is running on the terminal device since the application was downloaded, or a time period spent by the application when the application is running on the terminal device for a period of one day, one week or one month, and the like, specifically, a calculation mode of the time period of usage is not limited herein, and 2) a number of times of application opening operation on the terminal device, for example, a number of times of application opening operation on the terminal device since the application was downloaded by the user, or a number of times of application opening operation on the terminal device for a period of one day, one week or one month, and the like, and specifically, a calculation mode of the number of times of opening operation is not limited herein.

Taking the use frequency as an example of the duration spent in running on the terminal device within one week of the application program, the corresponding relationship between each type of display module and the corresponding screen-throwing condition is illustrated, and referring to table 7, the use frequencies are distinguished into different classes, for example, into "high", "medium" and "low", each use frequency class corresponds to a use frequency range (i.e., a use duration range), where the use duration in one week is denoted by t and the unit of h is h. For example, when the time length of the application program to be projected on the terminal device is 48h within one week from the moment of the micro-letter, according to each projection condition obtained by dividing the application program on the terminal device based on the frequency range of use of the application program in table 7, the micro-letter is known to be in the range of high frequency of use in the projection condition 2, and the display module corresponding to the projection condition 2 is a steering wheel screen, therefore, when the terminal device establishes communication connection with the vehicle, the terminal device can project the projection information of the application program of the micro-letter onto the dashboard screen of the vehicle, similarly, when the terminal device establishes communication connection with the vehicle, if the time length of the application program to be projected on the terminal device is 5h within one week from the moment of the micro-letter, according to each projection condition obtained by dividing the application program on the terminal device based on the frequency range of use of the application program in table 7, the projection condition of the application program is known to be in the middle control screen, and the display module corresponding to the projection condition 3 is in the range of low frequency of use in the projection condition 3. Similarly, determining which screen-throwing condition is met by the application program to be screened on the terminal device based on each screen-throwing condition obtained by dividing the use frequency of the application program on the terminal device, and if one of the screen-throwing conditions is met, screening the screen-throwing information of the application program onto a display module corresponding to the screen-throwing condition, which is not described in detail herein.

Table 7 correspondence between different types of display modules and corresponding screen-throwing conditions

Display module	Identification information	Screen throwing condition	The screen throwing condition comprises a frequency range (long use time)
				Instrument panel screen	Screen projection mark 1	Screen throwing condition 1	The frequency of use of the method is t epsilon [20h, ++ infinity ]
Steering wheel screen	Screen-throwing mark 2	Screen throwing condition 2	High use frequency t E [10h,20h ]
				Center control screen	Screen throwing mark 3	Screen throwing condition 3	Low frequency of use, t E [0h,10h ]
......	......	......	......

It should be noted that in some embodiments of the present application, the frequency range may be divided according to the number of types of display modules, and 3 display modules are illustrated in table 7, so that the frequency is divided into 3 ranges, each corresponding to "high", "medium", and "low" 3 levels of the frequency, each corresponding to one display module, and if the number of display modules on the vehicle is n, the frequency may be similarly divided into n ranges, each corresponding to one level of the frequency, and each corresponding to one display module.

In some embodiments of the present application, the user may modify the corresponding screen-throwing conditions according to the needs, for example, the application programs with high frequency of use are all thrown on the steering wheel screen of the vehicle, and the user may also choose to throw the application programs with high frequency of use on other screens according to the usage habit, the viewing habit, the driving habit, and the like, which is not limited in this description.

D. The characteristic information of the application program comprises the application type and the use frequency range of the application program, namely, the specific use frequency range of the application program with the screen projection condition of the specific application type on the terminal equipment corresponds to the specific display module.

In the above manner a, B, and C, all are based on the single factors of the application program (for example, application program name, application type, frequency range of application program on the terminal device, etc.), the feature information of the application program is divided, in the embodiment of the present application, the single factors may also be combined to each other to obtain a division result based on the combination factor, then a screen-throwing condition is built based on the two aspects of the application type to which the application program belongs and the frequency range of application program on the terminal device, as shown in table 8, for example, when the duration of running on the terminal device within a week of the distance moment of the application program to be thrown on the screen is 17h, and according to the classification of the application market on the application program "QQ" in downloading, the application type of the application program can be known as a social class, and according to the application type of the application program to which the application program belongs on the terminal device is divided, the screen-throwing condition can be known as a "QQ" in the screen-throwing condition 1 in table 8, and the application program is a screen-throwing condition 1, for example, the vehicle is connected to the terminal device, and the vehicle is connected to the screen-throwing condition; similarly, if the duration of the application program to be screen-thrown on the terminal device is 5h from the time of one week, and the application type of the application program to be screen-thrown on the terminal device is game type according to the classification of the application market to the application program to be screen-thrown on the terminal device, according to the screen throwing conditions obtained by dividing the application program on the terminal equipment based on the using frequency range of the application program and the application type of the application program in table 8, the 'prince glowing' is in the range of low using frequency in the screen throwing condition 3 and is a game type, and the display module corresponding to the screen throwing condition 3 is a central control screen, so that after the communication connection between the terminal equipment and the vehicle is established, the terminal equipment can throw the screen throwing information of the 'prince glowing' of the application program on the central control screen of the vehicle. Similarly, determining which screen-throwing condition is met by the application program to be thrown on the terminal device based on the use frequency of the application program on the terminal device and each screen-throwing condition obtained by dividing the application type to which the application program belongs, and if one of the screen-throwing conditions is met, throwing screen-throwing information of the application program to a display module corresponding to the screen-throwing condition, which is not described in detail herein.

Table 8 correspondence between different types of display modules and corresponding screen-throwing conditions

Similarly, it should be noted that table 8 is only a schematic representation of the division of the application program based on the frequency of use of the application program on the terminal device and the application type to which the application program belongs to obtain each screen-throwing condition, in the practical application process, there may be more division modes, for example, the application types may be directly classified into a first type, a second type, a third type, and the frequency ranges may also be divided according to the number of display module types, 3 display modules are illustrated in table 8, so that the frequency of use is divided into 3 ranges, respectively corresponding to the "high", "medium", and "low" 3 frequency levels, each range corresponds to one display module, and if the display modules on the vehicle are n, then similarly, the frequency of use may be divided into n ranges, each range corresponds to one frequency level, and each range corresponds to one display module. In summary, in the embodiment of the present application, it is only required to ensure that each application program only belongs to one of the application types, and the specific application type division method is not limited by the present application. It should be further noted that in the above table 8 of the present application, each screen-throwing condition includes at least 2 application types, and in practical application, the number of application types included in the screen-throwing condition is not limited, for example, the screen-throwing condition 1 may include only social application programs, and the table 8 is merely illustrative and not limiting to the embodiment of the present application.

It should be noted that, in some embodiments of the present application, the user may modify the corresponding screen-throwing conditions according to the needs, for example, in table 8, the application types are social application programs, and the application programs with middle-level use frequency on the terminal device are all thrown on the dashboard screen of the vehicle, and the user may also select to throw the social application programs on other screens according to use habits, viewing habits, driving habits, and the like, which is not limited herein.

It should be noted that, the above table 8 is only one illustration of a division result based on a combination factor obtained by combining two individual factors (application type and frequency range of use of an application program on a terminal device), and in some embodiments of the present application, any other division result based on a combination factor obtained by combining two or more factors with each other may be used, which is not described herein in detail.

2. The screen throwing condition is set according to the running information of the vehicle

Next, an implementation of the screen-throwing condition setting according to the running information of the vehicle will be described. In the embodiment of the application, the driving information of the vehicle may be represented by various parameters, for example, a driving speed of the vehicle, a traffic scene type (such as a highway, a country road, a mountain road, etc.), the number of passengers in the vehicle (such as 1 passenger in a co-driver, 2 passengers in a rear row, etc.), a fatigue state of a driver of the vehicle (such as fatigue, no fatigue, the fatigue state may be calculated from human body state information detected by a sensor module disposed in the vehicle or human body state information detected by a wearable device worn on the driver), a distance between the vehicle and an obstacle (such as what is the nearest obstacle distance from the vehicle to determine whether the driving environment is safe or unsafe), and the like. Therefore, in the embodiment of the application, the screen-throwing condition can be set according to the running information of the vehicle, and in this case, when the first screen-throwing condition that the first display module on the target vehicle is thrown is met, the first screen-throwing condition is met when the running information of the target vehicle meets the first screen-throwing condition. When the driving information is represented by different parameters, the conditions to be met when the screen is projected are different, and the following description is given respectively, and in the following embodiments of the present application, 3 display modules on the vehicle are taken as examples, and the 3 display modules are respectively illustrated as a "center control screen", "a steering wheel screen" and a "dashboard screen":

A. the running information of the vehicle is a driving speed of the vehicle.

In the embodiment of the application, when the characterization parameter of the driving information is the driving speed, the first screen throwing condition comprises that the driving speed of the target vehicle is in a first driving speed range. The following mode a in step 2602 and table 10 are specifically referred to, and will not be described herein.

Since different driving speeds are essentially aimed at driving safety, one principle to be followed is that in the case of low safety, the screen projection information should be presented on a display module which can be seen by the driver with minimal cost and is easiest to see, for example, when the driving speed is high, the driver needs to have higher attention, the screen projection information can be projected on a screen which can be seen by the driver with minimal attention (such as a steering wheel screen, a HUD (head) and when the driving speed is low, the screen projection information can be projected on a screen which can be seen by the driver with little twisting head (such as a central control screen) because the driver can not need to have high attention due to low driving speed.

B. the driving information of the vehicle is the traffic scene type of the vehicle.

In the embodiment of the application, when the characterization parameter of the driving information is the traffic scene type where the vehicle is located, the first screen throwing condition comprises that the traffic scene type where the target vehicle is located belongs to the first traffic scene type. The details of the method B in step 2602 and table 11 are shown in the following, and will not be described herein.

Similarly, because the different traffic scene types where the vehicle is located are essentially aimed at driving safety, one principle to be followed is that in the case of low safety, the screen throwing information should be presented on a display module which can be seen by the driver with minimal cost and is easiest to see, for example, when the vehicle is at an intersection with a bright red light, the driver has stopped the vehicle waiting for the red light to become a street lamp, and at the moment, the driver can not need to pay as much attention, then the screen throwing information can throw the screen which can be seen by the driver with little turning head (such as a central control screen), and when the vehicle is at a turning intersection, because the turning intersection is generally a traffic accident high-incidence area, at the moment, the driver needs to have enough attention, then the screen throwing information can throw the screen (such as a steering wheel screen, a HUD and the like) which can be seen by the driver with minimal attention.

C. The running information of the vehicle is the number of passengers in the vehicle.

In the embodiment of the application, when the characterization parameter of the driving information is 'number of passengers in the vehicle', the first screen throwing condition comprises that the number of passengers in the target vehicle is in a range of the number of the first passengers. The difference in the number of passengers in the vehicle is substantially aimed at the privacy and commonality of the screen information, and the following manner C in step 2602, table 12 and table 13 may be referred to, and will not be described herein.

D. the running information of the vehicle is a fatigue state of the driver of the vehicle.

In the embodiment of the application, when the characterization parameter of the driving information is 'fatigue state of a vehicle driver', the first screen throwing condition comprises that the fatigue state of the driver of the target vehicle belongs to the first fatigue state. The following manner D in step 2602 and table 14 are specifically referred to, and will not be described herein.

E. The travel information of the vehicle is a distance between the vehicle and the obstacle.

In the embodiment of the application, when the characterization parameter of the driving information is 'the distance between the vehicle and the obstacle', the first screen throwing condition comprises that the distance between the target vehicle and the obstacle is in a first distance range. The following manner E in step 2602 and tables 15 and 16 are referred to herein, and are not described in detail.

802. And when the first screen projection condition is met, projecting screen projection information of the first screen projection application program to be projected on the terminal equipment to the first display module.

After the terminal device obtains a plurality of screen-throwing conditions that a plurality of display modules on the vehicle are thrown, when feature information of an application program to be thrown (which can be called a first application program to be thrown) on the terminal device meets a screen-throwing condition that a certain display module on the vehicle (which can be called a first display module) is thrown (which can be called a first screen-throwing condition), or running information of the vehicle meets a first screen-throwing condition that a first display module on the vehicle is thrown, the terminal device throws screen-throwing information of the first application program to be thrown to the first display module.

For the sake of understanding, as shown in fig. 15, the following examples are illustrated by taking a terminal device as an example of a mobile phone, and assuming that feature information of an application program is an application type to which the application program belongs (i.e., the above-mentioned mode B), and assuming that the application program running on the mobile phone is "QQ", as can be seen from the above-mentioned table 6, the "QQ" belongs to an application type required in the screen-throwing condition 1, and a display module corresponding to the screen-throwing condition 1 is an instrument panel screen, that is, the application program "QQ" running on the mobile phone satisfies the screen-throwing condition 1 that the instrument panel screen on the vehicle is thrown on, and then, when the mobile phone establishes a communication connection with the vehicle, the mobile phone throws the screen information of the application program "QQ" to the instrument panel screen of the vehicle.

It should be noted that, in some embodiments of the present application, the screen-throwing information of the first screen-throwing application program may be an entire application program interface of the first screen-throwing application program, or may be a part of an application program interface of the first screen-throwing application program. For ease of understanding, consider fig. 16 and 17 as examples to illustrate that the first to-be-screened application is a "vacation video", and the "vacation video" satisfies the screening condition that the central control screen on the vehicle is screened, if the "vacation video" is playing a certain video, fig. 16 illustrates that the whole application interface presented by the first to-be-screened application on the display interface of the mobile phone is screened onto the central control screen of the vehicle, and fig. 17 illustrates that a part (such as only the video playing part) of the application interface presented by the first to-be-screened application on the display interface of the mobile phone is screened onto the central control screen of the vehicle.

It should be noted that, in the embodiment of the present application, since the size of the display interface of the terminal device is different from the size of different display modules on the vehicle, the vehicle needs to adapt to the screen size in the screen throwing process, for example, from 6.1 inches of the mobile phone to 12 inches, even larger than 17 inches, of the center control screen of the vehicle-mounted display screen.

It should be further noted that, in some embodiments of the present application, there may be more than one to-be-screened application program on the terminal device, i.e. there may be multiple first to-be-screened applications, where only the screened information of one application program is displayed on the display interface on the terminal device, and another application program is running in the background, where in this case, if the multiple first to-be-screened applications running on the terminal device respectively meet the screened conditions that different display modules on the vehicle are screened, there may be different screening modes, including but not limited to the following:

In the mode 1, screen projection information of a plurality of first application programs to be projected onto a display module respectively meeting screen projection conditions.

For example, as shown in fig. 18, assuming that the application "QQ" and "know" are running on the mobile phone, and assuming that the characteristic information of the application is the application type to which the application belongs (i.e., the above-mentioned mode B), as can be seen from the above-mentioned table 6, the application "QQ" belongs to the application type required in the screen-throwing condition 1, the display module corresponding to the screen-throwing condition 1 is a dashboard screen, the application "know" belongs to the application type required in the screen-throwing condition 3, and the display module corresponding to the screen-throwing condition 3 is a center control screen, that is, "QQ" and "know" respectively satisfy the screen-throwing conditions of different display modules, then in this case, the mobile phone can throw the screen-throwing information of "QQ" and the screen-throwing information of "know" to the dashboard screen and the center control screen, respectively.

And 2, selecting a first to-be-screen-projected application program which is being displayed on a display interface of the terminal equipment to project a screen. For example, as shown in fig. 19, it is assumed that the application "QQ" and "know" are running on the mobile phone, and the characteristic information of the application is the application type to which the application belongs (i.e., the above-mentioned mode B), as can be seen from the above-mentioned table 6, the application "QQ" belongs to the application type required in the screen-throwing condition 1, the display module corresponding to the screen-throwing condition 1 is a dashboard screen, the application "know" belongs to the application type required in the screen-throwing condition 3, and the display module corresponding to the screen-throwing condition 3 is a center control screen, but the application "know" runs in the background of the mobile phone, and "QQ" is being displayed on the display interface of the mobile phone, in which case, the mobile phone can throw the screen-throwing information of "QQ" to the dashboard screen, and if at some moment, the user switches the application "know" to the display interface of the mobile phone to display, the mobile phone also needs to synchronously throw the screen-throwing information of "know" to the center control screen.

In the above embodiment of the present application, for example, table 5 is taken as an example to illustrate that, in table 5, different applications are only application names required in one of the screen-casting conditions, and as shown in fig. 20, there is no intersection between the applications required in each of the screen-casting conditions.

However, in some embodiments of the present application, one application may simultaneously satisfy the feature information of the application required in a plurality of screen-casting conditions. For example, as shown in FIG. 21, the application "WeChat" may be either the application required in the drop-screen condition 1 or the application required in the drop-screen condition 2, the application "QQ" may be either the application required in the drop-screen condition 1 or the application required in the drop-screen condition 3, and so on. As another example, as shown in fig. 22, the application type "social class" (e.g., "WeChat", "QQ", "short message", etc.) to which the application belongs may be the application type required in the screen-throwing condition 1, the application type required in the screen-throwing condition 2, or the like. Similarly, the frequency range of use of the application program on the terminal device may be the range of use required in the screen-throwing condition 1 or the range of use required in the screen-throwing condition 2, similar to fig. 21 and 22, and will not be repeated here. In summary, when a certain application program meets the screen-throwing conditions of multiple display modules, in an embodiment of the present application, there may be multiple screen-throwing manners, including, but not limited to, the following, for convenience of understanding, the following is illustrated by taking an example that the application program simultaneously meets the screen-throwing conditions of 2 display modules being thrown, where the 2 display modules are respectively a first display module and a second display module, and the met screen-throwing conditions are respectively a first screen-throwing condition and a second screen-throwing condition:

A. and the screen throwing information of the application program to be thrown on the terminal equipment is thrown to the first display module and the second display module.

In the embodiment of the application, when the first screen-throwing application program on the terminal equipment simultaneously meets the first screen-throwing condition that a first display module on the vehicle is thrown and the second screen-throwing condition that a second display module on the vehicle is thrown, and under the condition that the terminal equipment is in communication connection with the vehicle, the terminal equipment simultaneously throws screen-throwing information of the first screen-throwing application program to the first display module and the second display module of the vehicle, wherein the first display module and the second display module are different two of a plurality of display modules on the vehicle.

It should be noted that, in the embodiment of the present application, the terminal device simultaneously projects the screen projection information of the first application program to be projected onto the first display module and the second display module, if neither the first display module nor the second display module is occupied by the screen projection, then the screen projection information of the first application program to be projected onto the display module not occupied by the screen projection can only be projected onto the display module not occupied by the screen projection.

For convenience of understanding, referring to fig. 23, assuming that a mobile phone is taken as an example of a terminal device, and a first application program to be screen-cast on the mobile phone is "QQ", and according to a mapping relation table 1, it can be known that the application program "QQ" simultaneously satisfies a screen-cast condition that a central control screen and a steering wheel screen on a vehicle are screen-cast, and then, under a condition that both the central control screen and the steering wheel screen are not occupied by the screen-cast, the mobile phone can simultaneously cast screen-cast information of "QQ" on the central control screen and the steering wheel screen. In the embodiment of the application, if any one of the central control screen and the steering wheel screen is occupied by the screen before the screen is thrown, for example, if the central control screen is occupied by the screen, the screen throwing information of 'QQ' can only throw the screen to the display module which is not occupied by the screen, for example, can only throw the screen to the steering wheel screen.

B. Dividing screen projection information of an application program to be projected on the terminal equipment into first screen projection sub-information and second screen projection sub-information according to a preset mode, projecting the first screen projection sub-information to a first display module, and projecting the second screen projection sub-information to a second display module.

In the embodiment of the application, when a first to-be-screened application program on a terminal device simultaneously meets a first screening condition that a first display module on a vehicle is screened and a second screening condition that a second display module on the vehicle is screened, and under the condition that the terminal device is in communication connection with the vehicle, the terminal device divides the screening information of the first to-be-screened application program into first screening sub-information and second screening sub-information according to a preset mode, the first display module and the second display module are different two of a plurality of display modules on the vehicle, and then the terminal device screens the first screening sub-information and the second screening sub-information to the first display module and the second display module respectively.

It should be noted that, in some embodiments of the present application, the terminal device divides the screen projection information of the first to-be-projected application program into the first screen projection sub-information and the second screen projection sub-information according to the preset manner, which may have various division manners, including but not limited to the following several manners:

a. dividing an application program interface of a first to-be-screen application program into a first part and a second part, wherein the first part is first screen projection sub-information, and the second part is second screen projection sub-information.

For convenience of understanding, a terminal device is taken as an example of a mobile phone to illustrate, referring to fig. 24, an application program "vacation video" is being displayed on a display interface of the mobile phone, and if the application program "vacation video" simultaneously satisfies a screen-throwing condition that a central control screen and a steering wheel screen are thrown, according to a preset manner, a video picture that is being played by the vacation video "can be thrown to the central control screen (i.e. a first screen-throwing sub-information is thrown to a first display module), and a text part of the vacation video" is thrown to the steering wheel screen (i.e. a second screen-throwing sub-information is thrown to a second display module). It should be noted that, in the embodiment of the present application, fig. 24 is only an illustration taking the screen-throwing information as an example of the whole application program interface of the application program, and in some embodiments of the present application, the screen-throwing information may also be a part of the application program interface of the application program. Reference may be made specifically to the corresponding portions of the embodiments shown in fig. 16 and 17, and details are omitted here.

B. And dividing the program interfaces corresponding to the first functional module and the second functional module of the first to-be-screen application program into first screen projection sub-information and second screen projection sub-information.

For convenience of understanding, referring to fig. 25 and table 9, it is assumed that a mobile phone is still taking a terminal device as an example, a first application program to be displayed on the mobile phone is "QQ", and a program interface of "QQ" has been divided into a "message pushing module" and a "message listing module" according to functions of the function modules in advance, and if the application program "QQ" satisfies a screen display condition that a central control screen and a steering wheel screen are displayed at the same time, a program interface corresponding to the "message pushing module" of "QQ" can be displayed on a steering wheel screen of a vehicle (i.e., a first screen display module is displayed on a first screen display sub-information), and a central control screen (i.e., a second screen display sub-information) corresponding to the "message listing module" of "QQ" is displayed on a second display module.

Table 9, corresponding relation between screen projection sub information divided by different functional modules based on application program and display module

Application program	Functional module	Identification information	Display module
				QQ	Message pushing module	Screen projection mark 1	Instrument panel screen
QQ	Message list module	Screen-throwing mark 2	Center control screen
				......	......	......	......

It should be noted that in some embodiments of the present application, the division may be performed according to the frequency of use and the interaction behavior of different functional modules, for example, the screen-throwing sub-information of the program interface corresponding to the functional module with high-frequency display and low-frequency interaction may be displayed on a display module that is favorable for the driver to read at the most comfortable angle, for example, the screen-throwing sub-information corresponding to the message pushing module may be displayed on a sub-dashboard screen, and the screen-throwing sub-information of the program interface corresponding to the functional module with a certain interaction flow (for example, list sliding and interaction) may be displayed on a display module that is easiest for the driver to operate with both hands, for example, the screen-throwing sub-information corresponding to the message list module may be displayed on a steering wheel screen or a central control screen. The screen projection sub-information corresponding to each of the different functional modules of the application program is projected onto different display modules on the vehicle, so that the interference to the driving of a driver is reduced, and the driving safety is improved.

It should be noted that, in the embodiment of the present application, fig. 25 is only an example, and in some embodiments of the present application, different application programs may be divided into different functional modules, may be divided into 2 functional modules, or may be divided into more than 2 functional modules (each functional module corresponds to a program interface), which is not described herein.

C. The terminal equipment judges the priority of the first display module and the second display module, and screens the screen-throwing information of the application program to be screened on the terminal equipment to the display module with high priority.

In the embodiment of the application, when a first to-be-screen-projected application program on a terminal device simultaneously meets a first screen projection condition that a first display module on a vehicle is projected and a second screen projection condition that a second display module on the vehicle is projected, and under the condition that the terminal device is in communication connection with the vehicle, the terminal device judges whether the first display module with high priority is occupied by the projection according to a preset priority, wherein the first display module and the second display module are different two display modules on the vehicle, if the first display module is not occupied by the projection, the terminal device preferentially projects the screen projection information of the first to-be-projected application program to the first display module, and only under the condition that the first display module is occupied by the projection, the terminal device projects the screen projection information of the first to-be-projected application program to the second display module.

For the sake of understanding, a mobile phone is taken as an example of a terminal device to illustrate that an application program "WeChat" is being displayed on a display interface of the mobile phone, if the application program "WeChat" meets the screen-throwing condition that a central control screen and a steering wheel screen are thrown by a screen, the mobile phone will first judge the priority of the central control screen and the steering wheel screen that the central control screen is thrown by the application program "WeChat", if the priority of the central control screen is higher than the steering wheel screen, the mobile phone further determines whether the central control screen is occupied by other application programs (for example, whether video is being played), if the central control screen is not occupied by the screen-throwing information of "WeChat" is thrown to the central control screen, if the mobile phone determines that the central control screen is thrown by other application programs (for example, video is being played), and if the mobile phone throws the screen information of "WeChat" to the steering wheel screen (if the steering wheel screen is not occupied by other application programs).

In the embodiment of the application, the method specifically explains that through acquiring the screen-throwing conditions (such as that an application program to be thrown on a terminal device belongs to a certain application type and reaches a preset use frequency) which are required to be met when each display module on a vehicle is thrown on a screen, when the screen-throwing conditions are met, the display information of the application program to be thrown on the terminal device is thrown on the corresponding display module, so that the display information on the terminal device is reasonably distributed to different display modules on the vehicle, a driver can quickly acquire the information on the terminal device, the probability of distraction of the driver is reduced, the interference of the screen-throwing information on driving of the driver is reduced, and the driving safety is improved.

It should be noted that, the execution subject of the screen projection method described in the embodiment corresponding to fig. 8 is a terminal device, and the screen projection process includes that the terminal device obtains a plurality of screen projection conditions that a plurality of display modules of a vehicle are projected, and then the terminal device judges whether the running information of the vehicle (or the characteristic information of an application program to be projected on the terminal device) meets the first screen projection condition, and when the first screen projection condition is met, the terminal device projects the screen projection information of the first application program to be projected on the terminal device onto a first display module corresponding to the first screen projection condition for display. That is, it is the terminal device that performs the screen casting. In some embodiments of the present application, the execution subject of the screen-projection method may also be the vehicle itself, where in the screen-projection process is that a target vehicle obtains a plurality of screen-projection conditions of a plurality of display modules of the vehicle itself, and the target vehicle determines whether the running information of the vehicle itself (or the characteristic information of the application program to be screened on the terminal device) meets the first screen-projection condition, and when the first screen-projection condition is met, the target vehicle automatically screens the received screen-projection information of the first application program to be screened on the terminal device onto the first display module corresponding to the first screen-projection condition for displaying. That is, it is the target vehicle itself that selects which display module to cast the screen information onto itself.

In the embodiments shown in fig. 8 to 25, it is explained how the terminal device projects the projection information of the application program to be projected onto the vehicle (e.g., a general car, an intelligent car, an automatic driving car, a network-connected car, etc.) on the basis of the projection condition, where each display module on the vehicle corresponds to one projection condition. In some modes of the embodiment of the present application, after the terminal device finishes the screen projection based on the screen projection mode shown in fig. 8 to 25, the terminal device may further determine whether to perform screen-cut display in different driving scenarios according to the driving information of the vehicle, that is, may switch between different display modules according to the driving state of the vehicle. Referring to fig. 26, fig. 26 is another flow chart of the display information switching method according to the embodiment of the present application, which specifically includes the following steps:

2601. and acquiring the driving information of the vehicle.

First, the vehicle acquires own travel information. In the embodiment of the application, the driving condition of the vehicle may be represented by various parameters, for example, a driving speed of the vehicle, a traffic scene type (such as a highway, a rural road, a mountain road, etc.), the number of passengers in the vehicle (such as1 passenger in a co-driver, 2 passengers in a rear row, etc.), a fatigue state of a driver of the vehicle (such as fatigue, no fatigue, the fatigue state may be calculated from human body state information detected by a sensor module disposed in the vehicle or human body state information detected by a wearable device worn on the driver), a distance between the vehicle and an obstacle (such as what is the nearest obstacle distance from the vehicle to determine whether the driving environment is safe or unsafe), and the like.

It should be noted that, in the embodiment of the present application, the vehicle may acquire the own running information periodically, for example, the acquisition period may be set to 1 minute, that is, the vehicle may acquire the own running information once every 1 minute, or the vehicle may acquire the own running information when the running information changes, for example, if the running information is represented by a driving speed, then when the change amplitude of the driving speed exceeds a preset value (for example, the preset value is set to 20 km/h), if the driving speed accelerates from 30km/h to 60km/h, and when the driving speed accelerates from 30km/h to 50km/h (that is, reaches the preset value of 20 km/h), the vehicle may be triggered to acquire the own running information. The present application is not limited to how to acquire the running information of the vehicle itself.

2602. And when the running information of the vehicle does not accord with the first running condition, indicating to switch the screen throwing information of the first application program displayed on the first display module to be displayed on the second display module, wherein the first running condition is a condition which needs to be met when the first display module is thrown.

The vehicle may further obtain a first driving condition that needs to be met by the first display module displaying the screen-throwing information, where the first display module is one of multiple display modules on the vehicle, and it should be noted that, in the embodiment of the present application, the screen-throwing information of the first application program may be screen-throwing information of the application program running on the terminal device to the first display module when the terminal device establishes communication connection with the vehicle, or may be an operation interface of an application program installed on the vehicle itself, or may be a part of the operation interface, or may be collectively referred to as target information.

If the first display module on the vehicle is displaying the screen projection information of the first application program running on the terminal device, the vehicle also acquires the first driving condition which needs to be met by the first display module.

For example, referring to table 10, it is assumed that there are 3 display modules on the vehicle, namely, a "central control screen", "steering wheel screen" and "dashboard screen", and the running information is represented by the parameter "driving speed", and it is assumed that the running condition to be satisfied when the central control screen is projected is "driving speed <30km/h", the running condition to be satisfied when the dashboard screen is projected is "30km/h is less than or equal to driving speed <60km/h", and the running condition to be satisfied when the steering wheel screen is projected is "60km/h is less than or equal to driving speed <100km/h" (i.e., the speed is higher than 100km/h and the driving speed is considered to be too fast, and it is not suitable for projection). Assuming that the first display module of the vehicle is a central control screen, and the screen throwing information of the application program 'QQ' running on the mobile phone is being displayed on the central control screen, the vehicle will acquire the running condition to be met when the central control screen is thrown, for example, as shown in table 10, and the running condition to be met is 'driving speed <30 km/h'.

Watch 10, running condition (driving speed is an example) to be satisfied when different display modules are put on screen

Display module	Running condition (driving speed) to be satisfied
		Center control screen	Driving speed <30km/h
Instrument panel screen	The driving speed is less than or equal to 30km/h and less than or equal to 60km/h
		Steering wheel screen	60Km/h is less than or equal to driving speed <100km/h
......	......

It should be further noted that, in some embodiments of the present application, the screen information of the first application may be an entire application program interface of the first application program, or may be a part of the application program interface of the first application program. As shown in fig. 16 and 17, details are not repeated here.

It should be noted that, in the embodiment of the present application, since the size of the display interface of the terminal device is different from the size of different display modules on the vehicle, the vehicle needs to adapt to the screen size in the screen throwing process, for example, from 6.1 inches of the mobile phone to 12 inches, even larger than 17 inches, of the central control screen displayed on the vehicle.

After the vehicle acquires the self-running information and the first running condition, whether the running information of the vehicle accords with the first running is further judged, and when the running information of the vehicle does not accord with the first running condition, the vehicle switches the screen throwing information to a second display module corresponding to a second running condition which accords with the first running condition for displaying, wherein the second display module is another one of a plurality of display modules on the vehicle.

In some embodiments of the present application, the process of switching the screen-throwing information to the second display module corresponding to the second driving condition corresponding to the first driving condition by the vehicle may specifically be that the vehicle generates a switching instruction (may be referred to as a first switching instruction) firstly, where the first switching instruction is used to instruct the vehicle to switch the screen-throwing information to the second display module, and then the vehicle switches the screen-throwing information to the second display module corresponding to the second driving condition corresponding to the driving information of the vehicle according to the first switching instruction to display.

It should be noted that, in some embodiments of the present application, in addition to the screen-throwing information of the first application program, other information may be displayed on the first display module, for example, an operation interface of the application program installed on the vehicle itself may be used, a part of the operation interface may be referred to as target information, where the first display module displays no screen-throwing information, and in this case, one way to implement screen-cutting is: the vehicle acquires the running information of the vehicle, judges whether the running information of the vehicle meets the first running condition or not, and switches the target information displayed on the first display module to the second display module for display when the running information of the vehicle does not meet the first running condition and the running information of the vehicle meets the second running condition, wherein the first display module and the second display module are respectively two different display modules on the vehicle, the first running condition is a condition which needs to be met when the first display module is projected, and the second running condition is a condition which needs to be met when the second display module is projected.

It should be further noted that, in the embodiment of the present application, since the running information of the vehicle may be represented by various parameters, for example, the driving speed of the vehicle, the type of traffic scene in which the vehicle is located, the number of passengers in the vehicle, the fatigue state of the driver of the vehicle, the distance between the vehicle and the obstacle, and the like. When the driving information is represented by different parameters, the conditions to be met by the switching display are different, and the following description is provided for the convenience of understanding, in the following embodiments of the present application, 3 display modules on the vehicle are taken as examples, and the 3 display modules are respectively illustrated as a "center control screen", "a steering wheel screen", and an "instrument panel screen":

A. the running information of the vehicle is a driving speed of the vehicle.

In the embodiment of the application, when the characterization parameter of the driving information is the driving speed, the driving information of the vehicle is not in accordance with the first driving condition, and the driving information of the vehicle is in accordance with the second driving condition, wherein the first driving condition comprises that the driving speed is in a first driving speed range, the second driving condition comprises that the driving speed is in a second driving speed range, the driving speed of the vehicle is not in the first driving speed range, and the driving speed of the vehicle is in the second driving speed range.

For the sake of understanding, it is assumed that 3 display modules are respectively "center control screen", "steering wheel screen" and "dashboard screen" on the vehicle, and the running information is characterized by the parameter "driving speed", specifically, as shown in table 10, it is assumed that the running condition to be satisfied when the center control screen is projected is "driving speed <30km/h", the running condition to be satisfied when the dashboard screen is projected is "30km/h is less than or equal to driving speed <60km/h", and the running condition to be satisfied when the steering wheel screen is projected is "60km/h is less than or equal to driving speed <100km/h" (i.e., the speed is higher than 100km/h, and the driving speed is considered to be too fast), and the projection is not suitable. In the embodiment of the present application, assuming that the first display module of the vehicle is a central control screen, and the screen-throwing information of the application program "QQ" running on the mobile phone is being displayed on the central control screen, the vehicle will acquire the driving condition to be satisfied when the central control screen is thrown, for example, as shown in table 10, the driving condition to be satisfied is "driving speed <30km/h". When the driving speed of the vehicle is less than 30km/h, the screen-throwing information of the QQ is continuously projected on the central control screen, when the driving speed of the vehicle is 55km/h, the vehicle judges that the driving speed is not consistent with the driving speed required in the driving conditions (namely, the driving speed is less than 30 km/h), the vehicle further determines that the driving speed is 55km/h in the range of less than or equal to 30km/h and less than 60km/h, and the driving conditions of less than or equal to 30km/h and less than 60km/h are driving conditions which are required to be met when the instrument panel screen is projected on the screen, so that the vehicle can switch the screen-throwing information of the QQ to the instrument panel screen for displaying.

It should be noted that the above-mentioned division of the driving speed range in fig. 27 is merely illustrative, and the user may set the driving condition (i.e. the "driving speed" parameter is configurable) to be satisfied by each display module on the vehicle according to the driving habit, the viewing habit, etc., which is not limited herein.

In the above embodiment of the present application, the screen information of the application program running on the terminal device is selected to be projected onto different display modules based on different driving speeds, where the different driving speeds are substantially aimed at the situation of driving safety and low safety, the screen information should be presented on the display module that the driver needs to pay the least attention to see and is easiest to see, for example, when the driving speed is fast, the driver needs to have higher attention at this time, the screen information can be projected onto the screen (such as the steering wheel screen) that the driver can pay the least attention to see, and when the driving speed is slow, the driver can be projected onto the screen (such as the central control screen) that the driver can see by slightly twisting the head because the driving speed is slow.

In the embodiment of the application, when the characterization parameter of the running information is the traffic scene type where the vehicle is located, the running information of the vehicle is not in accordance with the first running condition, and the running information of the vehicle is in accordance with the second running condition, wherein the first running condition comprises that the traffic scene type belongs to the first traffic scene type, the second running condition comprises that the traffic scene type belongs to the second traffic scene type, the traffic scene type where the vehicle is located does not belong to the first traffic scene type, and the traffic scene type where the vehicle is located belongs to the second traffic scene type.

It should be noted that, in the embodiment of the present application, a traffic scene refers to a scene formed by traffic participants (such as vehicles, pedestrians, etc.) and objects (such as traffic signs, obstacle signs, etc.) on a traffic road. As shown in fig. 28, fig. 28 is a typical traffic scene of an intersection in which traffic participants are various vehicles (pedestrians are not shown) and traffic lights, street lamps, zebra crossings, etc. (i.e., objects). It should be noted that the traffic scene may be divided into different types of traffic scenes according to a preset division rule, for example, one division manner may be dividing the traffic scene types into "crossroad", "T-type intersection", "traffic light intersection (displaying red light)", "turning intersection", "straight road", etc., and one division manner may also be dividing the traffic scene types into "expressway", "mountain road", "country road", "city road" etc. according to road conditions and surrounding traffic participants. In the embodiment of the application, the division of the traffic scene type based on the principle is not limited.

For the sake of understanding, the following examples are illustrated by assuming that 3 display modules are provided on a vehicle, namely a central control screen, a steering wheel screen and an instrument panel screen, and running information is characterized by parameters of "traffic scene type where the vehicle is located", specifically, as shown in table 11, assuming that the traffic scene type is divided according to traffic identifications, and the traffic scene type is divided into "crossroad", "T-type intersection", "traffic light intersection (display red light)", "turning intersection", "straight road", and assuming that running conditions to be satisfied when the central control screen is thrown are traffic scene types of "traffic light intersection (display red light)" and "straight road", running conditions to be satisfied when the screen is thrown are traffic scene types of "crossroad" and "T-type intersection", and running conditions to be satisfied when the steering wheel screen is thrown are traffic scene types of "turning intersection". In the embodiment of the application, assuming that the first display module of the vehicle is a central control screen, and the screen throwing information of an application program 'WeChat' running on the mobile phone is being displayed on the central control screen, the vehicle acquires a driving condition to be met when the central control screen is thrown, for example, as shown in table 11, and the driving condition to be met is that the traffic scene type where the vehicle is located is 'traffic light intersection (red light display)' or 'straight road'. When the driver drives the vehicle (or the automatic driving vehicle drives by himself) to a turning intersection, the vehicle judges that the vehicle is at the turning intersection through the self navigation positioning module and/or the sensor module, then the vehicle further judges that the traffic scene of the vehicle is not in accordance with the traffic scene required in the driving condition (namely, the traffic light intersection (displaying red light) or the straight road), and as can be seen from the table 10, the vehicle further determines that the traffic scene of the vehicle belongs to the traffic scene type (namely, the turning intersection) which needs to be met when the steering wheel screen is projected, and therefore, the vehicle can switch the projection screen information of the application program 'WeChat' to the steering wheel screen for displaying.

Table 11, the driving conditions to be satisfied when different display modules are projected (traffic scene type where the vehicle is located is an example)

Display module	Running condition to be satisfied (traffic scene type of vehicle)
		Center control screen	Traffic light crossing (display red light), straight road
Instrument panel screen	Crossroad and T-shaped intersection
		Steering wheel screen	Turning intersection
......	......

It should be noted that the above-mentioned division based on the traffic scene type in which the vehicle is located is only illustrative, and the user may set the driving condition to be satisfied by each display module on the vehicle (i.e. the parameter of "traffic scene type in which the vehicle is located" is configurable) according to driving habit, viewing habit of the screen, etc., which is not limited herein.

In the above embodiment of the present application, the screen-throwing information of the application program running on the terminal device is selected to be thrown onto different display modules based on different traffic scene types where the vehicle is located, the different traffic scene types where the vehicle is located are substantially aimed at and are also driving safety, and the safety is not high, the screen-throwing information should be presented on the display module which is most easily seen with the least cost of the driver, for example, when the vehicle is at an intersection where the red light is lighted, the driver has stopped the vehicle waiting for the red light to turn into a street lamp, at this time, the driver can not need to pay so much attention, the screen-throwing information can be thrown onto a screen (for example, a central control screen) which can be seen by the driver when the driver is at the intersection where the driver is slightly twisted, and when the vehicle is at the intersection where the driver is usually at a high traffic accident, the driver is required to have enough attention, the screen-throwing information can be thrown onto a screen (for example, a steering wheel screen) which can be seen with the least attention of the driver.

In the embodiment of the application, when the characterization parameter of the running information is 'number of passengers in the vehicle', the running information of the vehicle does not accord with the first running condition, and the running information of the vehicle accords with the second running condition, namely, the first running condition comprises the number of passengers in a first passenger number range, the second running condition comprises the number of passengers in a second passenger number range, the number of passengers in the vehicle is not in the first passenger number range, and the number of passengers in the vehicle is in the second passenger number range.

It should be noted that, in the embodiment of the present application, the number of passengers in the vehicle is not inclusive of the driver, for example, when there is only the driver in the vehicle, the number of passengers in the vehicle=0.

For ease of understanding, the following examples illustrate that, assuming that there are a total of 3 display modules on the vehicle, respectively, "center control screen", "steering wheel screen" and "dashboard screen", and that the driving information is characterized by the parameter "number of passengers in the vehicle", as shown in table 12, it is assumed that the driving condition to be satisfied when the center control screen is projected is that the number of passengers in the vehicle is equal to or greater than 1 (e.g., passengers are seated on the passenger's co-vehicle), the driving condition to be satisfied when the dashboard screen is projected is that the number of passengers in the vehicle=0, and the steering wheel screen is not projected. In the embodiment of the application, assuming that the first display module of the vehicle is a center control screen, and the center control screen is displaying the screen throwing information of the application program "WeChat" running on the mobile phone, then the vehicle will acquire the driving condition to be met when the center control screen is thrown, for example, as shown in table 12, the driving condition to be met is that the number of passengers in the vehicle is equal to or greater than 1, for example, the passenger is on the passenger side of the vehicle, when the passenger on the passenger side of the vehicle gets off at a certain moment, only one driver in the vehicle (i.e. the number of passengers in the vehicle=0), then the vehicle will judge that the number of passengers in the vehicle does not accord with the number of passengers in the vehicle required in the driving condition (i.e. the "traffic light crossing (displaying red light)" or "straight road"), and as shown in table 12, the vehicle further determines that the number of passengers in the vehicle belongs to the range of the number of passengers to be met when the dashboard screen is thrown (i.e. the number of passengers in the vehicle=0), so that the vehicle will switch the screen throwing information of the application program "WeChat" to the dashboard screen to be displayed.

Table 12, running conditions to be satisfied when different display modules are projected (number of passengers in vehicle is an example)

Display module	Running condition to be satisfied (number of passengers in vehicle)
		Center control screen	The number of passengers in the vehicle is more than or equal to 1
Instrument panel screen	Number of passengers in vehicle=0
		Steering wheel screen	Non-projection screen
......	......

It should be noted that, in the embodiment of the present application, whether there are passengers in the vehicle, several passengers, what seats the passengers are in the vehicle (e.g., whether the co-driver has passengers) may be obtained based on the camera installed in the vehicle (i.e., based on image recognition), the sensor device installed on the seat, etc., which will not be described herein.

In some embodiments of the present application, the number of passengers in the vehicle may also be combined with other parameters to determine which display module the screen information of the application running on the terminal device is screened to, for example, the application programs with high privacy may be combined, for example, when the number of passengers in the vehicle is greater than or equal to 1, that is, there are other people in the vehicle besides the driver, the application programs with high privacy may be screened to a dashboard screen or a steering wheel screen only seen by the driver when running, and the application programs with low privacy may be screened to a central control screen only seen by the driver and the passengers when the number of passengers in the vehicle is greater than or equal to 1, in consideration of the requirement of common use, the application programs with low privacy may be screened to a central control screen only seen by both the driver and the passengers when running. Referring specifically to table 13, table 13 is merely an exemplary manner, and in some embodiments of the present application, it may be determined which applications or application types belong to applications with high privacy (i.e. the privacy degree is configurable) by the user according to the needs, which is not limited herein.

Table 13, the driving conditions to be satisfied when different display modules are put on screen (privacy is taken into consideration)

It should be noted that the above-mentioned table 12 and table 13 are only schematic based on the division of the number of passengers in the vehicle, and the user may set the running condition to be satisfied by each display module on the vehicle (i.e. the parameter "number of passengers in the vehicle" is configurable) by himself according to driving habit, viewing habit of screen, etc., and in particular, the running condition is not limited herein, for example, some users have low requirement on privacy, consider that passengers in the vehicle can see any screen information of the application running on the terminal device, and some users consider that the application running on the terminal device belongs to privacy, etc.

In the above embodiment of the present application, the screen-throwing information of the application program running on the terminal device is thrown onto different display modules based on the different numbers of passengers in the vehicle, the different numbers of passengers in the vehicle are essentially aimed at the privacy and the commonality of the screen-throwing information, when the application program running on the terminal device belongs to the application program with high privacy (such as WeChat), in order to avoid other passengers from seeing the screen-throwing information, the application program with high privacy can be thrown onto the dashboard screen or the steering wheel screen seen by only the driver, when the application program running on the terminal device belongs to the application program with low privacy (such as Tencent video), and in consideration of the requirement of common use, the application program with low privacy can be thrown onto the central control screen seen by both the driver and the passengers during running.

In the embodiment of the application, when the characterization parameter of the driving information is the fatigue state of the driver of the vehicle, the driving information of the vehicle does not accord with the first driving condition, and the driving information of the vehicle accords with the second driving condition, wherein the first driving condition comprises that the fatigue state of the driver belongs to the first fatigue state, the second driving condition comprises that the fatigue state of the driver belongs to the second fatigue state, the fatigue state of the driver of the vehicle does not belong to the first fatigue state, and the fatigue state of the driver of the vehicle belongs to the second fatigue state.

It should be noted that, in the embodiment of the present application, the fatigue state of the driver of the vehicle may be calculated from the human body state information detected by the sensor module disposed in the vehicle, or may be calculated from the human body state information detected by the wearable device (e.g., smart bracelet, smart watch, etc.) worn on the driver. In some embodiments of the present application, the fatigue state of the driver may be classified according to the number of display modules of the vehicle, for example, if the number of display modules on the vehicle is 3, the fatigue state of the driver may be classified into 3 classes of "fatigue", "sub-fatigue" and "spirit", if the number of display modules on the vehicle is 2, the fatigue state of the driver may be classified into 2 classes of "fatigue" and "spirit", etc., and based on the different fatigue states of the driver, whether the corresponding driving behavior is safe or not may be known.

For ease of understanding, the following examples are illustrated by assuming that there are a total of 3 display modules on the vehicle, respectively, "center control screen", "steering wheel screen", "dashboard screen", and the running information is characterized by the parameter "driver fatigue status", and concretely, as shown in table 14, it is assumed that the running condition to be satisfied when the center control screen is projected is the fatigue status of the driver is "spirit", the running condition to be satisfied when the dashboard screen is projected is the fatigue status of the driver is "sub-fatigue", and the running condition to be satisfied when the steering wheel screen is projected is the fatigue status of the driver is "fatigue". In the embodiment of the present application, assuming that the first display module of the vehicle is a central control screen, and the screen-throwing information of the application program "QQ" running on the mobile phone is being displayed on the central control screen, the vehicle will acquire the driving condition to be satisfied when the central control screen is thrown, for example, as shown in table 14, and the driving condition to be satisfied is that the fatigue state of the driver is "spirit". When the sensor module disposed in the vehicle calculates the fatigue state of the driver as "spirit" based on the detected human body state information of the driver (periodically calculated), or when the wearable device (such as a smart bracelet, a smart watch, etc.) worn on the driver calculates the fatigue state of the driver as "spirit" based on the detected human body state information of the driver, the screen projection information of "QQ" is continuously projected on the central control screen, and in a certain detection period, when the fatigue state of the driver is calculated as "sub-fatigue", the vehicle judges that the fatigue state of the driver does not accord with the fatigue state (i.e., "spirit") of the driver required in the driving condition, as can be seen from table 14, the fatigue state of the driver is required to be satisfied when the dashboard screen is projected, and therefore, the vehicle switches the screen projection information of "QQ" to the dashboard screen for display.

Table 14, running conditions to be satisfied when different display modules are projected (fatigue state of driver is an example)

Display module	Running conditions to be satisfied (fatigue state of driver)
		Center control screen	Fatigue grade "spirit"
Instrument panel screen	Fatigue grade of "subfatigue"
		Steering wheel screen	Fatigue grade of "fatigue"
......	......

It should be noted that the above-mentioned division of the table 14 based on the fatigue state of the driver is merely illustrative, and the user may set the driving condition to be satisfied by each display module on the vehicle (i.e. the "fatigue state of the driver" parameter is configurable) according to the driving habit, the viewing habit, etc., which is not limited herein. For example, in some embodiments of the present application, if the fatigue state of the driver is "fatigue", the driving behavior of the driver may be considered unsafe at this time, the screen information of the application running on the terminal device is not screen-projected, and the vehicle may also remind the driver to stop and rest through the voice module.

In the above embodiment of the present application, the screen information of the application program running on the terminal device is selected to be projected onto different display modules based on different fatigue states of the driver, the different driving speeds are essentially aimed at driving safety, when the fatigue state of the driver is at a high fatigue level, which means that the driving behavior safety at this time is not high, the screen information should be presented on the display module which is most visible and most easy to see with minimal effort required by the driver, for example, when the fatigue state of the driver is "fatigue", and when the driver is required to apply less effort and attention to the vehicle driving, the screen (for example, a steering wheel screen) which can be seen with minimal effort by the driver can be projected on the screen (for example, a central control screen) which can be seen with little effort by the driver when the fatigue state of the driver is "spirit" which indicates that the driver is full at this time.

In the embodiment of the application, when the characterization parameter of the driving information is 'the distance between the vehicle and the obstacle', the driving information of the vehicle does not accord with the first driving condition, and the driving information of the vehicle accords with the second driving condition, wherein the first driving condition comprises that the distance between the vehicle and the obstacle is in a first distance range, the second driving condition comprises that the distance between the vehicle and the obstacle is in a second distance range, the distance between the vehicle and the obstacle is not in the first distance range, and the distance between the vehicle and the obstacle is in the second distance range.

It should be noted that, in the embodiment of the present application, the distance between the vehicle and the obstacle may be calculated based on the sensing information collected by the sensor (e.g., lidar, camera, etc.) disposed on the vehicle, and the distance between the vehicle and each obstacle and the position and location of the obstacle relative to the vehicle may be obtained according to the collected sensing information. As shown in fig. 29, in the traffic scene of the vehicle traveling on the expressway illustrated in fig. 29, an area encircled by a dotted line indicates a safe driving area of the own vehicle, and if there is no obstacle (e.g., surrounding vehicle, pedestrian, roadblock, etc.) within the area, it indicates that the driving environment of the own vehicle is safe, and in fig. 29, distances between the surrounding vehicle and the own vehicle in front, rear, left and right of the own vehicle are 23m, 21m, 2m and 3m, respectively, all outside the safe area, indicating that the driving environment of the own vehicle is safe. If an obstacle appears in a safety area during the driving process of the vehicle, the driving environment of the vehicle is unsafe, and the driver needs to concentrate on carefully driving so as not to collide with the obstacle. The closer the distance between the obstacle and the vehicle is, the shorter the time reserved for the driver to react is, and the greater the risk of collision between the vehicle and the obstacle is, so in the embodiment of the application, the screen projection information of the application program running on the terminal device can be selected to be projected onto different display modules based on different distances between the vehicle and the obstacle.

It should be noted that in some embodiments of the present application, the distance between the vehicle and the obstacle may be the distance between the vehicle and a plurality of obstacles, and the more obstacles, the more the driver is required to concentrate on driving, the distance between the vehicle and the obstacle may also be the distance between the vehicle and the nearest obstacle, if the nearest obstacle is outside the safety area of the vehicle, indicating that other obstacles are also far away from the vehicle, and the driving environment of the vehicle is safe.

For the sake of understanding, the following examples are illustrated by assuming that 3 display modules are respectively "center control screen", "steering wheel screen" and "dashboard screen" on the vehicle, and the running information is characterized by the parameter "distance between the vehicle and the obstacle", specifically as shown in table 15, where h is used to represent the distance between the vehicle and the obstacle, assuming that the running condition to be satisfied when the center control screen is thrown is "h is greater than or equal to 20m", the running condition to be satisfied when the dashboard screen is thrown is "15m is less than or equal to h <20m", and the running condition to be satisfied when the steering wheel screen is thrown is "h <15m". In the embodiment of the application, assuming that the first display module of the vehicle is a central control screen and the screen throwing information of the application program "QQ" running on the mobile phone is being displayed on the central control screen, the vehicle acquires the running condition to be met when the central control screen is thrown, for example, as shown in table 15, and the running condition to be met is "h is equal to or greater than 20m". When the distance between the vehicle and the obstacle is calculated to be 15m less than or equal to h <20m, the vehicle judges that the distance between the vehicle and the obstacle is not consistent with the distance between the vehicle and the obstacle required in the driving condition (namely, the distance between the vehicle and the obstacle is not consistent with h more than or equal to 20 m), and as shown in the table 15, the fatigue state of the driver is that the distance between the vehicle and the obstacle is required to be met when the instrument panel screen is projected, so that the vehicle can switch the screen projection information of the QQ to the instrument panel screen for displaying.

Table 15, running conditions to be satisfied when different display modules are projected (distance between vehicle and obstacle is an example)

Display module	Running condition to be satisfied (distance h between vehicle and obstacle)
		Center control screen	h≥20m
Instrument panel screen	15m≤h<20m
		Steering wheel screen	h<15m
......	......

It should be noted that, in some embodiments of the present application, the distance between the vehicle and the obstacle may be further subdivided in combination with the direction in which the obstacle is located in the vehicle, where the obstacle is located in a different direction of the vehicle, and the requirements on the distance may also be different, for example, refer to fig. 29, where the requirement on the distance between the vehicle and the obstacle may be smaller (for example, 1.5 m) when the obstacle is located in the left or right direction of the vehicle, and where the distance between the vehicle and the obstacle may be larger (for example, 20 m) when the obstacle is located in the front or rear direction of the vehicle due to the possible fast speed of the vehicle during driving, which is specifically referred to table 16, where table 16 is merely an exemplary manner, and in some embodiments of the present application, the distance threshold between the vehicle and the obstacle during the cut-off display may be set by the user according to the needs, which is not limited herein.

Table 16, the driving conditions to be satisfied when different display modules are projected (considering the orientation between the vehicle and the obstacle)

It should be noted that the above-mentioned divisions of the table 15 and the table 16 based on the distance h between the vehicle and the obstacle are merely illustrative, and the user may set the driving condition to be satisfied by each display module on the vehicle (i.e. the "distance between the vehicle and the obstacle" parameter is configurable) according to the driving habit, the viewing habit, and the like, which is not limited herein.

In the above embodiment of the present application, the screen-throwing information of the application program running on the terminal device is selected to be thrown on different display modules based on different distances between the vehicle and the obstacle, the difference between the vehicle and the obstacle is substantially aimed at the driving safety, when the distance between the vehicle and the obstacle is closer, which means that the response time left for the driver is shorter, the risk of the collision between the vehicle and the obstacle is greater, which means that the driving environment of the vehicle is unsafe, the driver is required to concentrate on carefully driving so as to avoid collision with the obstacle, the screen-throwing information can be thrown on a screen (such as a steering wheel screen) which can be seen by the driver with minimum attention, and when the distance between the vehicle and the obstacle is farther, which means that the driving environment of the vehicle is safer, the screen-throwing information can be thrown on a screen (such as a central control screen) which can be seen by the driver with slight turning head.

In the above-mentioned modes a to E, the description is made based on the vehicle running information being a single parameter (e.g., "driving speed", "traffic scene type", "number of passengers in vehicle", "driver fatigue status", "distance between vehicle and obstacle", etc.), and in some embodiments of the present application, each single parameter may be combined with each other to obtain a screen-cut display mode based on the combined parameter, and the screen-cut display process of the combined parameter is similar to that of the single parameter in the above-mentioned modes a to E, which is not repeated here.

In the embodiments shown in fig. 26 to 29, it is explained how, after the terminal device finishes the screen projection (e.g., based on the screen projection mode shown in fig. 8 to 25) of the application program to be screen-projected on the terminal device, the vehicle determines whether the screen-cut display needs to be performed in different driving scenes according to the driving information of the vehicle itself, and the screen-projected method provided in the embodiment corresponding to fig. 26 is that the vehicle implements the screen-cut display function, and in some embodiments of the present application, the terminal device may also implement the screen-cut display function, and the following describes another display information switching method provided in the embodiment of the present application, referring to fig. 30, which is another flow chart of the display information switching method provided in the embodiment of the present application, and specifically includes the following steps:

3001. The terminal equipment sends a first instruction to the vehicle, wherein the first instruction is used for indicating that the screen-throwing information of the first application program is displayed on a first display module of the vehicle.

Firstly, a terminal device sends a first instruction to a vehicle, wherein the first instruction is used for indicating to display screen projection information of a first application program on a first display module of the vehicle, and the first application program can be an application program running on the terminal device.

3002. The terminal device acquires traveling information of the vehicle.

After the vehicle acquires the own running information, the acquired running information of the vehicle is further sent to the terminal device, and if the vehicle periodically acquires the running information of the vehicle, the terminal device also periodically receives the running information of the vehicle sent by the vehicle.

3003. When the running information of the vehicle is not in accordance with the first running condition and the running information of the vehicle is in accordance with the second running condition, the terminal equipment sends a second instruction to the vehicle, wherein the second instruction is used for indicating the information of the first application program to be displayed on a second display module of the vehicle, the first running condition is a condition to be met when the first display module is projected, and the second running condition is a condition to be met when the second display module is projected.

The method comprises the steps that terminal equipment obtains first driving conditions which are required to be met by a first display module displaying screen-throwing information, wherein the first display module is one of a plurality of display modules on a vehicle, and the screen-throwing information is screen-throwing information for throwing a first application program running on the terminal equipment to the first display module under the condition that the terminal equipment is in communication connection with the vehicle.

If the first display module on the vehicle is displaying the screen projection information of the first application program running on the terminal device, the terminal device will also acquire the first driving condition to be met by the first display module.

After the terminal device obtains the running information and the first running condition of the vehicle, it will further determine whether the running information and the first running condition of the vehicle are met, and if the running information and the first running condition of the vehicle are not met, the terminal device will send a second instruction to the vehicle, where the second instruction is used to switch the information of the first application program (such as the running interface of the first application program, or a part of the running interface) to a second display module corresponding to the second running condition met by the first running condition for displaying, where the second display module is another one of the multiple display modules on the vehicle.

It should be noted that, in some embodiments of the present application, a process of the terminal device switching the screen-throwing information to the second display module corresponding to the second driving condition that is consistent with the first driving condition for displaying includes, but is not limited to, the following modes:

In the mode 1, the terminal device firstly terminates screen projection to the first display module on the vehicle, and then projects screen projection information to the second display module corresponding to the second running condition which is consistent with the running information of the vehicle. That is, screen projection to the first display module is terminated, and screen projection to the second display module is resumed.

Mode 2, the terminal device generates a switching instruction (may be referred to as a second switching instruction), and sends the second switching instruction to the vehicle, where the second switching instruction is used to instruct the vehicle to switch the screen-throwing information to a second display module corresponding to a second running condition that accords with the running information of the vehicle for displaying, and after receiving the second switching instruction, the vehicle switches the screen-throwing information to the second display module according to the second switching instruction.

It should be noted that, in the embodiment of the present application, since the driving information of the vehicle may be represented by various parameters, for example, the driving speed of the vehicle, the type of traffic scene in which the vehicle is located, the number of passengers in the vehicle, the fatigue state of the driver of the vehicle, the distance between the vehicle and the obstacle, and the like. When the driving information is represented by different parameters, the conditions to be satisfied by the switching display are different, and the following descriptions are respectively provided:

A. the running information of the vehicle is a driving speed of the vehicle.

The specific process is referred to as a mode a in step 2602, and will not be described herein.

The specific process is referred to as the B mode in step 2602, and will not be described herein.

The specific process is referred to as C in step 2602, and will not be described herein.

The specific process is referred to as the D mode in step 2602, and will not be described herein.

The specific process is referred to as E in step 2602, and will not be described herein.

3004. And the vehicle displays the screen projection information of the first application program on a second display module according to the second instruction.

And the vehicle receives the second instruction, and displays the screen projection information of the first application program on the second display module according to the second instruction.

Similarly, in the above-mentioned modes a to E, the description is made based on the driving information of the vehicle as the single parameters (for example, "driving speed", "traffic scene type", "number of passengers in the vehicle", "fatigue state of the driver", "distance between the vehicle and the obstacle", etc.), and in some embodiments of the present application, the single parameters may be combined with each other to obtain a screen-cut display mode based on the combined parameters, and the screen-cut display process of the combined parameters is similar to that of the single parameters in the above-mentioned modes a to E, which is not repeated herein.

In order to better implement the foregoing solutions according to the embodiments of the present application, referring to fig. 31, fig. 31 is a schematic structural diagram of an apparatus provided in the embodiments of the present application, where the apparatus may be a terminal device or a vehicle, and is not limited herein. The device 3100 comprises an acquisition module 3101 and a screen projection module 3102, wherein the acquisition module 3101 is configured to acquire a first screen projection condition of a first display module on a vehicle, the first screen projection condition may be related to running information of a target vehicle or may be related to feature information of an application program to be projected, and specifically, the first screen projection condition is not limited herein, and the screen projection module 3102 is configured to project screen projection information of the first application program to be projected on a terminal device to the first display module when the first screen projection condition is met, where the first display module is one of a plurality of display modules on the vehicle, and different display modules on the vehicle have different screen projection conditions. The method comprises the steps that when the running information of the vehicle meets the first screen-throwing condition, when the first screen-throwing condition is set according to the characteristic information of the application program to be screened, when the characteristic information of the first application program to be screened on the terminal equipment meets the first screen-throwing condition.

In one possible design, the obtaining module 3101 is specifically configured to obtain a plurality of screen-throwing conditions of a plurality of display modules on the vehicle, where one display module corresponds to one screen-throwing condition, and the screen-throwing condition is set according to feature information of a to-be-thrown application program, for example, if there are 3 different display modules on the target vehicle a, namely, a dashboard screen, a steering wheel screen and a central control screen, respectively, then there are a total of 3 screen-throwing conditions for each display module, namely, a screen-throwing condition 1, a screen-throwing condition 2 and a screen-throwing condition 3, respectively, and the screen-throwing module 3102 is configured to throw screen-throwing information of a first to-be-thrown application program onto a first display module (which may be referred to as a first to-be-thrown application program) on the vehicle when the to-be-thrown application program (may be referred to as the first to-be referred to as first to-be-thrown application program) on the terminal device meets the first display module (may be referred to as first to-be the first to-be-thrown condition) and, in case that the terminal device and the vehicle establishes a communication connection with the vehicle.

In the above embodiment of the present application, the acquiring module 3101 acquires the screen-throwing condition that needs to be satisfied when each display module on the vehicle is thrown (for example, the application program to be thrown on the terminal device belongs to a certain application type, reaches the preset use frequency, etc.), and when the screen-throwing condition is satisfied, the screen-throwing module 3102 throws the display information of the application program to be thrown on the terminal device to the corresponding display module, thereby realizing the reasonable distribution of the display information on the terminal device to different display modules on the vehicle, so that the driver can quickly acquire the information on the terminal device, reducing the probability of distraction of the driver, reducing the interference of the screen-throwing information on the driving of the driver, and further improving the driving safety.

In one possible design, the screen-casting condition may be set according to the running information of the vehicle, in which case, when the first screen-casting condition that the first display module is cast on the target vehicle is satisfied, it includes when the running information of the target vehicle satisfies the first screen-casting condition.

In one possible embodiment, the conditions to be met by the screen are different when the driving information of the vehicle is characterized by different parameters. In one case, the travel information of the vehicle may include a driving speed of the vehicle. The first screen-throwing condition includes that the driving speed of the target vehicle is within a first driving speed range.

In one possible design, the travel information of the vehicle may include a traffic scene type in which the vehicle is located. The first screen throwing condition includes that the traffic scene type of the target vehicle belongs to the first traffic scene type.

In one possible design, the travel information of the vehicle may include the number of passengers in the vehicle. The first screen-throwing condition includes the number of passengers in the target vehicle being within a first passenger number range.

In one possible design, the driving information of the vehicle may include a fatigue state of a driver of the vehicle. The first screen-throwing condition includes that the fatigue state of the driver of the target vehicle belongs to the first fatigue state.

In one possible design, the travel information of the vehicle may include a distance between the vehicle and the obstacle. The first screen-throwing condition includes a distance between the target vehicle and the obstacle being within a first distance range.

In one possible design of the first aspect, the screen-throwing condition may be set according to characteristic information of the application program in addition to being set based on traveling information of the vehicle. In this case, when the first screen-throwing condition that the first display module is thrown on the target vehicle is met, the characteristic information of the first application program to be thrown on the terminal device meets the first screen-throwing condition.

In one possible design, the feature information of the application program may include an application type to which the application program belongs, that is, the screen-throwing condition is that the specific application type corresponds to the specific display module, where in this case, the first screen-throwing condition that the first screen-throwing application program on the terminal device meets that the first display module on the vehicle is thrown includes that the application type of the first screen-throwing condition includes that the application program is a first application type (e.g., social type), and meanwhile, the first screen-throwing application program on the terminal device belongs to the first application type, or may be referred to as that the application type to which the first screen-throwing application program on the terminal device belongs to the application type required in the first screen-throwing condition.

In one possible design, the characteristic information of the application program may include information about a usage frequency of the application program, that is, the condition of dropping the screen corresponds to a specific display module for a specific usage frequency range of the application program on the terminal device, and the usage frequency of the application program on the terminal device may be obtained from a "healthy use mobile phone" or the like of the terminal device, where the first condition of dropping the screen on the terminal device satisfies that the first display module on the vehicle is dropped, and includes that the information about the usage frequency of the application program is within a first usage frequency range (e.g., a high usage frequency range), and the usage frequency of the first application program on the terminal device is within the first usage frequency range.

In one possible design, the feature information of the application program may include both an application type to which the application program belongs and information of a frequency of use of the application program, where in the case that the first to-be-screened application program on the terminal device meets a first screening condition that the first display module is screened on the vehicle, the first to-be-screened application program on the terminal device includes that the application type to which the first to-be-screened application program belongs in an application type required in the first screening condition, and the frequency of use of the first application program on the terminal device is in a frequency range required in the first screening condition.

In the embodiment of the application, the single factors (for example, the application type is a single factor, and the application frequency range of the application program is a single factor) are mutually combined to obtain the dividing result based on the combined factors, so that the conditions required to be met by screen projection are more diversified, and the user experience is improved.

In one possible design, the frequency range of application use on the terminal device may be characterized by 1) the duration of application use on the terminal device, and 2) the number of times the application is started to run on the terminal device.

In one possible design, an application may satisfy the characteristic information of the application required in multiple screen-casting conditions at the same time. For example, the application type "social class" (e.g., "WeChat", "QQ", "short message", etc.) to which the application belongs may be either the application type required in the drop-screen condition 1 or the application type required in the drop-screen condition 2. That is, when the first to-be-screen application on the terminal device satisfies both the first screen-projection condition in which the first display module on the vehicle is projected and the second screen-projection condition in which the second display module on the vehicle is projected, in this case, the screen-projection module 3102 may be configured to project the screen-projection information of the first application to the first display module and the second display module simultaneously, the first display module and the second display module being different two of the plurality of display modules on the vehicle. It should be noted that, in the embodiment of the present application, the terminal device simultaneously projects the projection information of the first application program to be projected onto the first display module and the second display module, where the precondition is that both the first display module and the second display module are not occupied by projection.

In the above embodiment of the present application, it is specifically explained that when a certain application program meets the screen-projection condition that a plurality of display modules are projected, the screen-projection module 3102 projects the application program onto the plurality of display modules, and the user selects which display module to view the screen-projection information, so that flexibility is provided.

In one possible design, an application may satisfy the characteristic information of the application required in multiple screen-casting conditions at the same time. That is, when the first to-be-screen-projected application on the terminal device simultaneously satisfies the first screen projection condition in which the first display module is projected on the vehicle and the second screen projection condition in which the second display module is projected on the vehicle, in this case, the screen projection module 3102 may also be configured to divide the screen projection information of the first application into first screen projection sub-information and second screen projection sub-information according to a preset manner, where the first display module and the second display module are different two of the plurality of display modules on the vehicle, and then, the terminal device projects the first screen projection sub-information and the second screen projection sub-information to the first display module and the second display module, respectively.

In the above embodiment of the present application, it is specifically explained that when a certain application program meets the screen-projection condition that a plurality of display modules are projected, the screen-projection module 3102 correspondingly splits the screen-projection information of the application program into a plurality of screen-projection sub-information, and one screen-projection sub-information corresponds to one display module, so that the user can select which display module to view the screen-projection sub-information, thereby having flexibility.

In one possible design, an application may satisfy the characteristic information of the application required in multiple screen-casting conditions at the same time. That is, when the first to-be-screen-displayed application program on the terminal device simultaneously satisfies a first screen-display condition that a first display module on the vehicle is screen-displayed and a second screen-display condition that a second display module on the vehicle is screen-displayed, in this case, the screen-display module 3102 may be further configured to determine, according to a preset priority, whether the first display module with a high priority is screen-displayed, wherein the first display module and the second display module are two different display modules on the vehicle, and if the first display module is not screen-displayed, the terminal device preferentially screens the screen-display information of the first application program to the first display module, and only if the first display module is screen-displayed, the terminal device screens the screen-display information of the first application program to the second display module.

In the above embodiment of the present application, it is specifically explained that when an application meets the screen-throwing condition that a plurality of display modules are thrown, the screen-throwing module 3102 may further perform selective screen-throwing based on the priority, and preferably throw screen-throwing information onto the display module with high priority, and throw screen onto the display module with the next priority only when the display module with high priority is occupied by the screen-throwing, so that the user can watch the screen-throwing information in an optimal manner in real time according to the mode of the priority, and the influence of the distraction of the user is reduced to the greatest extent.

It should be noted that, in fig. 31, contents such as information interaction and execution process between each module/unit in the apparatus 3100 are based on the same concept as the method embodiment corresponding to fig. 8 in the present application, and specific contents may be referred to the description in the foregoing method embodiment of the present application, which is not repeated herein.

The embodiment of the application further provides a device, which may be a vehicle, and in particular, referring to fig. 32, fig. 32 is a schematic structural diagram of the device provided by the embodiment of the application, where the device 3200 includes an acquisition module 3201 and a screen cutting module 3202, where the acquisition module 3201 is configured to acquire running information of the vehicle, and the screen cutting module 3202 is configured to switch, when the running information of the vehicle does not conform to a first screen throwing condition, screen throwing information of a first application program displayed on a first display module to a second display module for display, where the first screen throwing condition is a condition that needs to be met when the first display module is thrown, and the first display module and the second display module are two different display modules of a plurality of display modules on the vehicle.

In one possible design, the screen-cutting module 3202 is specifically configured to instruct to switch the screen-throwing information of the first application program displayed on the first display module to display on the second display module when the running information of the vehicle does not conform to the first running condition and the running information of the vehicle conforms to the second running condition, where the second running condition is a condition that needs to be met when the second display module is thrown.

In the above embodiment of the present application, after the screen-throwing information on the terminal device has been thrown onto the first display module at the vehicle end, the vehicle may further determine whether to perform screen-throwing display in different driving scenarios according to the driving information of the vehicle, and only if the first screen-throwing condition corresponding to the first display module does not conform to the current driving condition of the vehicle, and if other display modules (e.g., the second display module) conform to the current driving condition of the vehicle, the screen-throwing module 3202 indicates to switch the screen-throwing information of the first application program displayed on the first display module to display on the second display module, that is, may perform dynamic switching between different display modules according to the driving state of the vehicle, so that under any driving condition, the user may view the screen-throwing information in an optimal manner, and user experience is improved.

In one possible design, the travel information of the vehicle may include a driving speed of the vehicle, in which case the travel information of the vehicle does not correspond to the first screen-casting condition and the travel information of the vehicle corresponds to the second screen-casting condition including the first screen-casting condition including the driving speed being within a first driving speed range and the second screen-casting condition including the driving speed being within a second driving speed range, the driving speed of the vehicle not being within the first driving speed range and the driving speed of the vehicle being within the second driving speed range.

In the embodiment of the application, the screen projection information of the application program running on the terminal equipment is selected to be projected onto different display modules based on different driving speeds, so that the driving safety is improved.

In one possible design, the travel information of the vehicle may include a traffic scene type in which the vehicle is located. In this case, the driving information of the vehicle does not accord with the first screen-throwing condition, and the driving information of the vehicle accords with the second screen-throwing condition, the first screen-throwing condition comprises that the traffic scene type belongs to a first traffic scene type, the second screen-throwing condition comprises that the traffic scene type belongs to a second traffic scene type, the traffic scene type of the vehicle does not belong to the first traffic scene type, and the traffic scene type of the vehicle belongs to the second traffic scene type.

In the embodiment of the application, the screen projection information of the application program running on the terminal equipment is selected to be projected onto different display modules based on different traffic scene types of the vehicle, so that the driving safety is improved.

In one possible design, the travel information of the vehicle may include the number of passengers in the vehicle. In this case, the vehicle's travel information is not in compliance with the first screening condition and the vehicle's travel information is in compliance with the second screening condition includes the first screening condition including the number of passengers being in the first passenger number range and the second screening condition including the number of passengers being in the second passenger number range, the number of passengers in the vehicle not being in the first passenger number range and the number of passengers in the vehicle being in the second passenger number range.

In the embodiment of the application, based on the consideration of the privacy and the commonality of the application programs, the number of passengers in the vehicle is different, and the screen-throwing information of the application programs running on the terminal equipment can be selectively thrown on different display modules, so that the user experience is improved.

In one possible design, the driving information of the vehicle may include a fatigue state of a driver of the vehicle. In this case, the running information of the vehicle does not correspond to the first screen-throwing condition, and the running information of the vehicle corresponds to the second screen-throwing condition including that the fatigue state of the driver belongs to the first fatigue state, the second screen-throwing condition including that the fatigue state of the driver belongs to the second fatigue state, the fatigue state of the driver of the vehicle does not belong to the first fatigue state, and the fatigue state of the driver of the vehicle belongs to the second fatigue state.

In the embodiment of the application, the screen projection information of the application program running on the terminal equipment is selected to be projected onto different display modules based on different fatigue states of the driver, so that the driving safety is improved.

In one possible design, the travel information of the vehicle may include a distance between the vehicle and the obstacle. In this case, the driving information of the vehicle is not in conformity with the first screen-throwing condition, and the driving information of the vehicle is in conformity with the second screen-throwing condition including that a distance between the vehicle and the obstacle is in a first distance range, and the second screen-throwing condition includes that a distance between the vehicle and the obstacle is in a second distance range, and the distance between the vehicle and the obstacle is not in the first distance range, and the distance between the vehicle and the obstacle is in the second distance range.

In the embodiment of the application, the screen projection information of the application program running on the terminal equipment is selected to be projected to different display modules based on different distances between the vehicle and the obstacle, so that the probability of collision between the vehicle and the obstacle is reduced, and the driving safety is improved.

In one possible design, the screen-switching module 3202 may be configured to generate a switching instruction (which may be referred to as a first switching instruction) that instructs the vehicle to switch the screen-switching information to the second display module, and then switch the screen-switching information to the second display module corresponding to the second screen-switching condition that corresponds to the driving information of the vehicle according to the first switching instruction for display.

In the above embodiment of the present application, it is specifically described how the screen-cutting module 3202 performs screen-cutting display, and the method is capable of being implemented.

It should be noted that, in fig. 32, the content of information interaction and execution process between each module/unit in the apparatus 3200 provided by the present application, the method embodiment corresponding to fig. 26 in the present application is based on the same concept, and specific content may be referred to the description in the foregoing method embodiment of the present application, which is not repeated herein.

The embodiment of the application further provides a device, which can be a terminal device, and specifically refer to fig. 33, fig. 33 is a schematic structural diagram of the terminal device provided by the embodiment of the application, where the device 3300 includes a first sending module 3301, an obtaining module 3302, and a second sending module 3303, where the first sending module 3301 is configured to send a first instruction to a vehicle, the first instruction is configured to instruct a first display module of the vehicle to display screen information of a first application program, the obtaining module 3302 is configured to obtain running information of the vehicle, the second sending module 3303 is configured to send a second instruction to the vehicle when the running information of the vehicle does not conform to a first screen condition, the second instruction is configured to instruct a second display module of the vehicle to display information of the first application program, the first screen condition is a condition that needs to be met when the first display module is screened, the second screen condition is required to be met when the second display module is screened, and the first display module and the second display module is different from the two modules of the two modules.

In the above embodiment of the present application, after the screen-throwing information on the terminal device is thrown to the display module at the vehicle end, the terminal device may also determine whether screen-cutting display is required in different driving scenarios in combination with the driving information of the vehicle, that is, the terminal device may dynamically switch between different display modules in combination with the driving state of the vehicle, so that the user may watch the screen-throwing information in an optimal manner under any driving information, and user experience is improved.

It should be noted that, in the information interaction and execution process between each module/unit in the apparatus 3300 provided in fig. 33, the method embodiment corresponding to fig. 30 in the present application is based on the same concept, and specific content may be referred to the description in the foregoing method embodiment of the present application, which is not repeated herein.

It should be further noted that, in the embodiments of the present application, the embodiments corresponding to fig. 8 and 30 may be executed based on the terminal devices corresponding to fig. 2 to 6, and the structure of the terminal device may be specifically referred to the descriptions in the terminal devices corresponding to fig. 2 to 6 shown in the foregoing description of the present application, which is not repeated herein.

The embodiment of the present application further provides a vehicle, please refer to fig. 34, fig. 34 is a schematic structural diagram of the vehicle provided by the embodiment of the present application, and for convenience of explanation, only the portion related to the embodiment of the present application is shown, and specific technical details are not disclosed, please refer to the method portion of the embodiment of the present application. The vehicle 3400 may be configured with corresponding modules in the vehicle 3200 described in the corresponding embodiment of fig. 32, for implementing the functions of the vehicle in the corresponding embodiment of fig. 32, specifically, the vehicle 3400 is implemented by one or more servers, where the vehicle 3400 may have relatively large differences due to different configurations or performances, and may include one or more processors 3422, a memory 3432, one or more storage media 3430 (such as one or more mass storage devices) storing application programs 3442 or data 3444. In particular, the processor 3422 may be a central processing unit (central processing units, CPU), an embedded microcontroller, an AI processor, etc., and the type of the processor 3422 is not limited herein, wherein the memory 3432 and the storage medium 3430 may be transitory or persistent storage. The program stored on the storage medium 3430 may include one or more modules (not shown), each of which may include a series of instruction operations on the training device. Still further, the processor 3422 may be configured to communicate with the storage medium 3430 and execute a series of instruction operations in the storage medium 3430 on the vehicle 3400, for example, the processor 3422 may call a series of instruction operations in the storage medium 3430 to perform the steps of compiling a source code to obtain a control flow graph corresponding to the source code, then splitting the obtained control flow graph to obtain a plurality of split sub-graphs, and recompilating the obtained plurality of sub-graphs to obtain a plurality of linear execution sequences, then sequentially simulating the plurality of linear execution sequences, and inserting at least one operator between the plurality of linear execution sequences according to semantics corresponding to the plurality of linear execution sequences to connect the plurality of linear execution sequences into a computational graph.

The vehicle 3400 may also include one or more power supplies 3426, one or more wired or wireless network interfaces 3450, one or more input output interfaces 3458, and/or one or more operating systems 3441, such as Windows Server, mac OS XTM, unixTM, linuxTM, freeBSDTM, and the like.

In the embodiment of the present application, the steps performed by the deep learning framework in the foregoing various processing methods related to the control flow graph may be performed on the processor by calling related codes stored on the storage medium based on the structure shown in the vehicle in fig. 34, which is not described herein in detail.

It should be further noted that the above-described apparatus embodiments are merely illustrative, and that the units described as separate units may or may not be physically separate, and that units shown as units may or may not be physical units, may be located in one place, or may be distributed over a plurality of network units. Some or all of the modules may be selected according to actual needs to achieve the purpose of the solution of this embodiment. In addition, in the drawings of the embodiment of the device provided by the application, the connection relation between the modules represents that the modules have communication connection, and can be specifically implemented as one or more communication buses or signal lines.

From the above description of the embodiments, it will be apparent to those skilled in the art that the present application may be implemented by means of software plus necessary general purpose hardware, or of course by means of special purpose hardware including application specific integrated circuits, special purpose CPUs, special purpose memories, special purpose components, etc. Generally, functions performed by computer programs can be easily implemented by corresponding hardware, and specific hardware structures for implementing the same functions can be varied, such as analog circuits, digital circuits, or dedicated circuits. But a software program implementation is a preferred embodiment for many more of the cases of the present application. Based on such understanding, the technical solution of the present application may be embodied essentially or in a part contributing to the prior art in the form of a software product stored in a readable storage medium, such as a floppy disk, a U-disk, a removable hard disk, a Read Only Memory (ROM), a random access memory (random access memory, RAM), a magnetic disk or an optical disk of a computer, etc., including instructions for causing a computer device (which may be a personal computer, a training device, a network device, etc.) to execute the method according to the embodiments of the present application.

In the above embodiments, it may be implemented in whole or in part by software, hardware, firmware, or any combination thereof. When implemented in software, may be implemented in whole or in part in the form of a computer program product.

The computer program product includes one or more computer instructions. When loaded and executed on a computer, produces a flow or function in accordance with embodiments of the present application, in whole or in part. The computer may be a general purpose computer, a special purpose computer, a computer network, or other programmable apparatus. The computer instructions may be stored in a computer-readable storage medium or transmitted from one computer-readable storage medium to another computer-readable storage medium, for example, the computer instructions may be transmitted from one website, computer, training device, or data center to another website, computer, training device, or data center via a wired (e.g., coaxial cable, optical fiber, digital Subscriber Line (DSL)) or wireless (e.g., infrared, wireless, microwave, etc.). The computer readable storage medium may be any available medium that can be stored by a computer or a data storage device such as a training device, a data center, or the like that contains an integration of one or more available media. The usable medium may be a magnetic medium (e.g., floppy disk, hard disk, tape), an optical medium (e.g., DVD), or a semiconductor medium (e.g., solid state disk (Solid STATE DISK, SSD)), etc.

Claims

1. A screen projection method, comprising:

acquiring a first screen-throwing condition of a first display module on a target vehicle, wherein the acquiring of the first screen-throwing condition of the first display module on the target vehicle comprises acquiring a plurality of screen-throwing conditions of the plurality of display modules on the target vehicle, wherein one display module corresponds to one screen-throwing condition, the first screen-throwing condition is one of the plurality of screen-throwing conditions, the first screen-throwing condition is related to running information of the target vehicle or the first screen-throwing condition is related to characteristic information of an application program to be screened, and the characteristic information of the application program to be screened comprises an application type of the application program to be screened or using frequency information of the application program to be screened;

When the first screen-throwing condition is met, screen-throwing information of a first screen-throwing application program on the terminal equipment is thrown to the first display module, the first display module is one of a plurality of display modules on the target vehicle, and different display modules on the target vehicle have different screen-throwing conditions.

2. The method according to claim 1, wherein the travel information of the target vehicle includes:

a driving speed of the target vehicle;

The first screen-throwing condition includes a driving speed of the target vehicle being within a first driving speed range.

3. The method according to claim 1, wherein the travel information of the target vehicle includes:

the traffic scene type of the target vehicle is located;

the first screen throwing condition comprises that the traffic scene type of the target vehicle belongs to a first traffic scene type.

4. The method according to claim 1, wherein the travel information of the target vehicle includes:

the number of passengers in the target vehicle;

The first screen-throwing condition includes a number of passengers within the target vehicle being within a first passenger number range.

5. The method according to claim 1, wherein the travel information of the target vehicle includes:

a fatigue state of a driver of the target vehicle;

The first screen-throwing condition includes that a fatigue state of a driver of the target vehicle belongs to a first fatigue state, the fatigue state of the driver of the target vehicle being obtained by a sensor module.

6. The method according to claim 1, wherein the travel information of the target vehicle includes:

a distance between the target vehicle and an obstacle;

The first screen-casting condition includes a distance between the target vehicle and an obstacle being within a first distance range.

7. The method of claim 1, wherein the feature information of the application to be screened comprises:

the application type of the application program to be screen-thrown;

the first screen throwing condition comprises that the application type of the application program to be thrown is a first application type;

the when the first screen throwing condition is met includes:

and when the application type of the first to-be-screen application program is the first application type.

8. The method of claim 1, wherein the feature information of the application to be screened comprises:

the use frequency information of the application program to be screen-thrown;

The first screen throwing condition comprises that the use frequency information of the application program to be thrown is in a first use frequency range;

the when the first screen throwing condition is met includes:

And when the use frequency information of the first to-be-screen application program on the terminal equipment is in the first use frequency range.

9. The method according to any one of claims 1-8, further comprising:

and when the first screen projection condition and the second screen projection condition are met, simultaneously projecting the screen projection information of the first application program to be projected to the first display module and the second display module, wherein the second screen projection condition is the screen projection condition corresponding to the second display module, and the first display module and the second display module are different two of the plurality of display modules.

10. The method according to any one of claims 1-8, further comprising:

Dividing the screen projection information of the first application program to be projected into first screen projection sub-information and second screen projection sub-information when the first screen projection condition and the second screen projection condition are met at the same time, wherein the second screen projection condition is the screen projection condition corresponding to a second display module, and the first display module and the second display module are two different display modules;

And respectively projecting the first screen projection sub-information and the second screen projection sub-information to the first display module and the second display module.

11. The method according to any one of claims 1-8, further comprising:

When the first screen-throwing condition and the second screen-throwing condition are met at the same time, only the screen-throwing information of the first screen-throwing application program is thrown to the first display module, the second screen-throwing condition is the screen-throwing condition corresponding to the second display module, the first display module and the second display module are different two of the plurality of display modules, and the first display module is a display module with screen-throwing priority higher than that of the second display module.

12. An apparatus, comprising:

the system comprises an acquisition module, a display module and a display module, wherein the acquisition module is used for acquiring a first screen-throwing condition of a first display module on a target vehicle, wherein the first screen-throwing condition is related to running information of the target vehicle or is related to characteristic information of an application program to be screened;

the acquisition module is specifically configured to acquire a plurality of screen-throwing conditions of a plurality of display modules on the target vehicle, where one display module corresponds to one screen-throwing condition, and the first screen-throwing condition is one of the plurality of screen-throwing conditions;

And the screen throwing module is used for throwing screen throwing information of a first screen throwing application program on the terminal equipment to the first display module when the first screen throwing condition is met, wherein the first display module is one of a plurality of display modules on the target vehicle, and different display modules on the target vehicle have different screen throwing conditions.

13. The apparatus of claim 12, wherein the screen projection module is further configured to:

14. The apparatus of claim 12, wherein the screen projection module is further configured to:

15. The apparatus of claim 12, wherein the screen projection module is further configured to:

16. An apparatus comprising a processor and a memory, the processor coupled to the memory, characterized in that,

The memory is used for storing programs;

The processor configured to execute a program in the memory, causing the apparatus to perform the method of any one of claims 1-11.

17. A computer readable storage medium comprising a program which, when run on a computer, causes the computer to perform the method of any of claims 1-11.

18. A computer program product comprising instructions which, when run on a computer, cause the computer to perform the method of any of claims 1-11.