CN103561308B - A kind of exchange method of smart mobile phone remote-controlled intelligent TV - Google Patents

Abstract

The invention proposes an interactive method for a smart phone to remotely control a smart TV to solve the problem of heavy visual and memory burdens on a user during the process of a smart phone remotely controlling a smart TV. The inventive method sets up interactive modules on the smart phone and the smart TV, and these modules are used for communication, operation control or display processing, and the smart phone controls the smart TV through a wireless channel to realize the operation and information sharing of the smart TV video playback. The method of the present invention can release the line of sight from the screen of the mobile phone during the remote control of the smart TV by the smart phone, enhance the interaction between the smart phone and the smart TV, solve the shortcomings of the existing smart TV remote control equipment, and reduce the production cost of the remote control equipment.

Description

An interactive method for a smart phone to remotely control a smart TV

technical field

The invention relates to an interaction method between intelligent terminals, establishes a novel human-computer interaction model, and uses an intelligent mobile phone to efficiently control an intelligent TV, and belongs to the cross-technical application fields of software engineering, human-computer interaction, and mobile computing.

Background technique

Smart TV has a fully open platform, which can continuously bring rich personalized experience to users. It is equipped with a corresponding operating system. While enjoying ordinary TV content, users can install and uninstall various application software by themselves, and continuously optimize functions. Expanded and upgraded new TV products.

Smartphones have been widely developed at present, and have many application programs. These application programs are different from previous programs, and their focus is to provide users with an interactive platform and provide life services. Smartphone penetration is increasing and most users are increasingly familiar with how to operate it.

In the use of smart TVs, traditional remote control equipment is costly to implement, and it is very troublesome to realize text input. In addition, the operation method is single, which is not suitable for effective control of smart TVs. Controlling smart TVs through smart phones is a promising way. This way is not only convenient for users to operate but also saves costs. More importantly, smart phones have more functions besides communicating with smart TVs. The functions possessed are connected with the smart TV, and the advantages of the two are combined with each other.

The present invention provides an interactive method for a smart phone to remotely control a smart TV. Compared with the traditional remote control composed of buttons, the smart phone controlled by touch is more in line with the user's usage habits, and can realize operations such as sliding and dragging. ; At the same time, the entire mobile phone screen can sense touch actions. Using this control method, users do not have to look for buttons like traditional remote controls, and users can complete operations without looking at the mobile phone screen, which reduces the burden of user sight conversion. At the same time, the user's memory burden is effectively reduced.

Contents of the invention

Technical problem: the interactive method of a smart phone remote control smart TV described in the present invention aims to solve the shortcomings of the existing smart TV remote control equipment, reduce the burden on the user's vision and memory, enhance the interaction between devices, and provide a new interactive method .

Technical solution: According to the present invention, an interactive method for a smart phone to remotely control a smart TV uses a smart phone as a remote control device for a smart TV, and establishes a first communication interaction module CM1, a functional interaction module FM and a playback control module PCM on the smart phone, Establish the second communication interaction module CM2 and the screen display module DM on the smart TV. The interactive modules are relatively independent functional areas on the smart phone or smart TV. These functional areas have communication, operation control or display processing functions. The established The first communication interaction module CM1 and the second communication interaction module CM2 have an inter-device communication function;

The playback control module PCM has the operation control function and playback control function on the smart phone, and the screen display module DM has the screen display processing function on the smart TV;

The first communication interaction module CM1 of the smart phone first accepts the start command of the user, establishes network communication with the second communication interaction module CM2 of the smart TV, and the smart phone starts to start the function interaction module FM, and the first communication interaction module CM1 and the second communication interaction module CM2 establishes a connection in the Wi-Fi LAN;

Smartphone function interaction module FM uses the first communication interaction module CM1 to communicate with smart TV, function interaction module FM accepts and processes external input from the user, and displays information from smart TV on the smart phone screen, and the information includes text and pictures The function interaction module FM starts the soft keyboard of the mobile phone and transmits the text obtained by the smart phone to the first communication interaction module CM1, and the first communication interaction module CM1 processes the data and sends it to the smart TV; in addition, the function interaction module FM provides an external program Access the interface, apply to the mobile device to start the social network program through the interface, and after the mobile device authorizes the use permission, edit the text and picture information and send it to an external network application, and the external network application includes Weibo, WeChat, and social networking;

After receiving the input event, the smart phone function interaction module FM transmits the event information to the playback control module PCM. The playback control module PCM controls the video being played according to the input event, monitors the screen of the mobile phone, and supports touch input events and sensors on the mobile phone. Input event, gesture input event; described touch input event refers to that finger clicks on mobile phone screen, holds down, drags action; Described sensor input event refers to the state change that the acceleration sensor on the mobile phone detects; The above-mentioned gesture input event means that the finger draws graphics on the screen; the playback control module PCM receives changes in external factors to generate playback control commands. External factors include user operations and mobile phone status changes. After processing by module CM1, it is sent to the smart TV;

The second communication interaction module CM2 of the smart TV receives the startup command of the first communication interaction module CM1 of the smart phone, establishes an interactive mode, processes and transmits the information sent by the smart TV screen display module DM, and sends the data generated by the smart TV to the mobile terminal ;

After the smart TV screen display module DM receives the data and commands transmitted by the second communication interaction module CM2, the screen display module DM performs operations in the background of the smart TV, updates and displays the results on the screen, drives the TV screen to change, and at the same time updates the result content Submitted to the second communication interaction module CM2 and then passed to the smart phone; the screen display module DM supports video playback, and starts to play the video after receiving the playback command from the smart phone. The display module DM displays prompt information on the top of the screen, and the information feeds back the operation results;

In the communication between the first communication interaction module CM1 of the smart phone and the second communication interaction module CM2 of the smart TV, the smart phone uses the TCP/IP protocol to communicate with the smart TV through the wireless channel; the TCP protocol completes the transmission of data, and the UDP protocol completes the transmission of commands , the data and commands use the queue data structure and are stored in the memory. When sending, the data or commands are encapsulated into data packets together with the current time. The mobile phone and the TV respectively establish two queues in the memory, one for saving the TCP sending and receiving Data, the other is used to save the command sent and received by UDP. When the first communication interaction module CM1 and the second communication interaction module CM2 send data or commands, they are first stored in the queue of the memory and wait to be sent; after receiving the data or commands, First store in the memory queue, determine the processing order according to the time information in the data packet, and process the earlier one first;

The smart phone function interaction module FM maintains a call monitoring function. When the call time occurs, the function interaction module FM sends a pause command to the smart TV, and then sends the incoming call information to the smart TV. The smart TV screen display module DM pauses the currently playing video on the screen. The caller number is displayed on the top to remind the user that there is an incoming call on the mobile phone; after the user hangs up the phone, the video will play normally and the mobile screen will return to the interactive mode.

The steps included in this method are:

Step 1: The first communication interaction module CM1 of the smart phone sends a startup command,

Step 2: The smart phone detects the network status and makes a judgment based on the current network status. If the Wi-Fi LAN connection between the smart phone and the smart TV fails, the interaction between the smart phone and the smart TV ends. The Wi-Fi LAN connection between the smart TVs is successful, the smart TV agrees to establish a connection, and the interaction between the smart phone and the smart TV is successfully established;

Step 3: The second communication interaction module CM2 of the smart TV receives the commands sent by the smart phone, and establishes an interaction model when receiving the first command;

Step 4: The smart TV screen display module DM establishes a connection with the smart phone function interaction module FM, and interacts according to the aforementioned interaction method; The Wi-Fi LAN connection between the mobile phone and the smart TV fails, and the interaction between the smart phone and the smart TV ends;

Step 5, when the smart phone has an input event and requires a playback operation, the smart TV screen display module DM establishes a connection with the smart phone playback control module PCM to interact, and after the playback operation is completed, enter step 4; in the above process, The smart TV and the smart phone regularly check the network status according to the preset time. If the Wi-Fi LAN connection between the smart phone and the smart TV fails, the smart TV exits the interactive mode, and the establishment of the interaction between the smart phone and the smart TV ends; When the smartphone is not playing, go to step 4;

In step 2, step 4 and step 5, the Wi-Fi local area network connection failure between the smart phone and the smart TV is that the Wi-Fi local area network connection between the smart phone and the smart TV exceeds the preset network delay time, The network delay refers to the waiting time for network data to arrive exceeding a predetermined time value.

Beneficial effects: the present invention provides an interactive method for a smart phone to remotely control a smart TV, which has the following beneficial effects:

(1) In the interactive method for a smart phone remote control smart TV described in the present invention, by using the smart phone to remote control the smart TV, the generation cost of traditional remote control equipment is avoided; After the network is connected, the smart TV can be controlled through the mobile phone software.

(2) In the interactive method of a smart phone remote control smart TV described in the present invention, a friendly human-computer interaction model is provided; compared with a traditional remote controller composed of buttons, a smart phone controlled by a touch mode is more suitable for users At the same time, it is convenient to realize operations such as sliding and dragging; the entire mobile phone screen can sense touch actions. Using this control method, users do not have to look for buttons like traditional remote controls, and users can complete operations without looking at the mobile phone screen, which reduces the burden on users The burden of line-of-sight switching. At the same time, users can easily input Chinese and English to the TV through the mobile phone input method, which overcomes the technical bottleneck of traditional remote control. With a clear user mental model, users can accurately deduce the functions that should be available on each mobile phone interface, reducing the user's memory burden.

(3) In the interactive method for a smart phone to remotely control a smart TV according to the present invention, the characteristics of the two types of equipment are effectively combined, and while watching TV, the user can recommend the content he likes to his friends through the social network .

Description of drawings

Figure 1 is a schematic diagram of communication between a smart phone and a smart TV.

FIG. 2 is a block diagram of an interactive method for a smart phone to remotely control a smart TV.

Figure 3 is a state machine diagram of the interface when the smart phone is running.

Fig. 4 is a flowchart of an interactive method for a smart phone to remotely control a smart TV.

detailed description

The present invention relates to an interaction method between smart terminals, which mainly uses smart phones to control smart TVs, establishes different modules, realizes control operations by touch, releases the line of sight from the screen of the mobile phone, and transfers the information in the smart TV ( screenshots, video messages, etc.) to share to social networks via smartphone. Figure 1 shows a schematic diagram of the communication between a smart phone and a smart TV.

In the specific implementation of the remote control of the smart TV by the smart phone, an interactive module is established on the smart phone and the smart TV. Figure 2 shows a block diagram of the interactive method of the smart phone remote control of the smart TV. The smart phone terminal has three interactive modules: the first communication interaction module CM1, the function interaction module FM, and the playback control module PCM; the smart TV end has two interactive modules: the second communication interaction module CM2, and the screen display module DM.

In the specific implementation of remote control of smart TVs by smart phones, the existing wireless WiFi technology is used to realize communication between devices, and smart phones are bound to smart TVs through IP addresses, as shown in Figure 1. The connection is made in a point-to-point manner. In the specific implementation , TCP and UDP communication protocols are used between devices, UDP transmits commands, and TCP transmits data.

In the specific implementation of the remote control of the smart TV by the smart phone, the smart phone first sends out a control command, and the smart TV responds to the command. During the video playback, the smart phone can obtain relevant information on the smart TV, such as video information, screenshots, etc., for sharing. Throughout the process, users can input Chinese characters or foreign languages through the mobile phone input method, which overcomes the technical bottleneck of traditional remote control.

In a specific implementation, FIG. 3 shows a state machine diagram of a smart phone interface in a typical interaction scenario, and FIG. 4 is a flow chart of an interactive method for a smart phone to remotely control a smart TV. The smart phone receives the user's start, the first communication interaction module CM1 starts the preprocessing work, the smart phone enters a welcome interface, the state S1 in Figure 3, this process achieves two functions: first, prevent the user from accidentally starting the program, avoiding The wrong start of the smart TV; secondly, the first communication interaction module CM1 obtains time to do preprocessing work, which reduces the waiting time of the user. On the welcome interface, the user clicks the button "Start", the first communication interaction module CM1 sends an interaction establishment application to the second communication interaction module CM2, if the Wi-Fi network is normal, the second communication interaction module CM2 receives the command to start the screen display module DM, The interaction is established, the function interaction module FM on the mobile phone is started, and the state of the mobile phone interface enters the video directory interface, the state S2 in Figure 3, which shows the video folders that can be played on the smart TV; in addition, if the Wi-Fi network is abnormal, the interactive Build failed. After the interaction is established, the mobile phone FM module works, the TV screen display module DM works, the first communication interaction module CM1 and the second communication interaction module CM2 are responsible for communication work, after selecting a certain directory on the file directory interface, you can see the directory The playable video below enters the video list interface, state S3 in FIG. 3 . In the file directory and video list interface, we can enter the name of the video we want to find in the search box, click the button "Search" to search, and the results are displayed on the search result interface, the state S4 shown in Figure 3. On the video list interface or the search result interface, we can select a video to view the introduction of the video, that is, enter the video detailed information interface, state S5 in FIG. 2 . During the working process of the mobile terminal functional interaction module FM and the TV terminal screen display module DM, the functional interaction module FM maintains the changes of the mobile terminal, and the screen display module DM maintains the changes of the TV terminal. Each communication needs to detect the network status. 5s, the interaction process ends. In the video detailed information interface, we can view the introduction information related to the video, and enter the playback control interface (state S6 in Figure 2) through the button "Play on TV", in the playback control interface we can realize the video playback Control, so that the mobile phone playback control module PCM starts to work, the playback control module PCM and the screen display module DM of the smart TV are responsible for the interaction process, and the playback control module PCM converts changes in external factors into commands through the first communication interaction module CM1 and the second communication interaction module CM1 The communication interaction module CM2 sends it to the screen display module DM. It is also possible to end the playback of the current video, so that the mobile phone returns to the functional interaction module FM by the playback control module PCM, and the functional interaction module FM and the screen display module DM complete the interactive task. The function interaction module FM and the playback control module PCM of the mobile phone can exit the interaction process.

In the specific implementation of smart phone remote control smart TV, the playback control is realized through touch operation and system keys. The humanized interaction method is used to overcome the defects of traditional remote control methods that only rely on buttons. In addition, touch operation can be realized without eyesight, that is, there is no need to watch the mobile phone interface during operation. The specific control method is as follows:

Step 1: Tap twice on the phone screen with your finger or a touch screen device to realize the pause function, and then tap twice to continue playing;

Step 2: Click on the phone screen with your finger or a touch screen device and then drag it forward to realize the function of moving the playback progress bar forward;

Step 3: Click and drag your finger or touch screen device on the phone screen to realize the function of moving the playback progress bar backwards;

Step 4: When the video is playing, tap the finger or touch screen device on the screen of the mobile phone twice to pause the video, slide forward quickly and then leave the screen to realize the function of fast forwarding by multiples;

Step 5: When the video is playing, tap the finger or the touch screen device on the screen of the mobile phone twice to pause the video, then quickly swipe backwards and then leave the screen to realize the multiple rewind function;

Step 6: Press and hold your finger or touch screen device on the phone screen to pop up a dialog box, and the user can choose social programs and content to share with friends;

Step 7: Slide your finger or touch screen device up and down on the phone screen to increase and decrease the volume; or you can also adjust the volume through the phone's volume keys;

Step 8: Draw a V shape on the phone screen with your finger or a touch screen device to realize the screenshot function; or press the camera button on the phone to take a screenshot.

In the specific implementation of the smart phone remote control smart TV, the smart phone has a call function. When an incoming call event occurs, the smart phone can display the incoming call information to the smart TV in time to prompt the user. The user can make a choice according to the need, answer the call or hang up. drop the phone.

In the specific implementation of the smart phone remote control smart TV, the progress bar implemented by dragging needs to measure the distance from the touch point to the two sides of the screen. When the video is played to 40%, the drag operation occurs, and the distance between the current position of the finger and the rightmost end of the mobile phone screen After 60% of the playback progress is evenly distributed, the distance from the current position of the finger to the leftmost end of the phone screen is evenly distributed to the first 40% of the playback progress.

In the specific implementation of the smart phone remote control smart TV, due to the confusion between the drag operation and the slide operation, the drag operation refers to a moving action after the user's finger or touch screen device taps the screen, and the slide action refers to the movement of the user's finger or touch screen device After tapping the screen, there is a moving action, and then there is a leaving action, so when a sliding operation occurs, a drag operation must occur. To solve this problem, the order in which semaphore control occurs is changed by double-clicking.

In the specific implementation of the remote control of the smart TV by the smart phone, the smart phone has a functional interaction module FM and a playback control module PCM. In the function module, the user looks down at the mobile phone screen to issue commands and receive data returned by the smart TV. The user observes the changes of the TV screen, and the user's sight switches between the two screens. In the playback control module, the user operates the mobile phone to control the playback while watching the TV screen, and does not need to look down at the mobile phone screen, reducing the user's visual burden. In this interactive method, the function module completes the preparatory work before playing the video, and the playback control module completes the video playback control. In the specific implementation, distinguishing between the two types of modules will establish a clear mental model for the user, and the user can accurately infer the functions that should be available on each mobile phone interface, reducing the user's memory burden.

Claims (1)

1. An interactive method for a smart phone remote control smart TV, characterized in that: Set up the first communication interaction module CM1, function interaction module FM and play control module PCM on the smart phone, set up the second communication interaction module CM2 and the screen display module DM on the smart TV, and the interactive module is a smart phone or smart TV. Relatively independent functional areas, these functional areas have communication, operation control or display processing functions, and the established first communication interaction module CM1 and second communication interaction module CM2 have inter-device communication functions; The playback control module PCM has the operation control function and playback control function on the smart phone, and the screen display module DM has the screen display processing function on the smart TV; The first communication interaction module CM1 of the smart phone first accepts the start command of the user, establishes network communication with the second communication interaction module CM2 of the smart TV, and the smart phone starts to start the function interaction module FM, and the first communication interaction module CM1 and the second communication interaction module CM2 establishes a connection in the Wi-Fi LAN; Smartphone function interaction module FM uses the first communication interaction module CM1 to communicate with smart TV, function interaction module FM accepts and processes external input from the user, and displays information from smart TV on the smart phone screen, and the information includes text and pictures The function interaction module FM starts the soft keyboard of the mobile phone and transmits the text obtained by the smart phone to the first communication interaction module CM1, and the first communication interaction module CM1 processes the data and sends it to the smart TV; in addition, the function interaction module FM provides an external program Access the interface, apply to the mobile device to start the social network program through the interface, and after the mobile device authorizes the use permission, edit the text and picture information and send it to an external network application, and the external network application includes Weibo, WeChat, and social networking; After receiving the input event, the smart phone function interaction module FM transmits the event information to the playback control module PCM. The playback control module PCM controls the video being played according to the input event, monitors the screen of the mobile phone, and supports touch input events and sensors on the mobile phone. Input event, gesture input event; described touch input event refers to finger click, hold down, drag action on mobile phone screen; Described sensor input event refers to the state change that the acceleration sensor on the mobile phone detects; The above-mentioned gesture input event means that the finger draws graphics on the screen; the playback control module PCM receives changes in external factors to generate playback control commands. External factors include user operations and mobile phone status changes. After processing by module CM1, it is sent to the smart TV; The second communication interaction module CM2 of the smart TV receives the startup command of the first communication interaction module CM1 of the smart phone, establishes an interactive mode, processes and transmits the information sent by the smart TV screen display module DM, and sends the data generated by the smart TV to the mobile terminal ; After the smart TV screen display module DM receives the data and commands transmitted by the second communication interaction module CM2, the screen display module DM performs operations in the background of the smart TV, updates and displays the results on the screen, drives the TV screen to change, and at the same time updates the result content Submitted to the second communication interaction module CM2 and then passed to the smart phone; the screen display module DM supports video playback, and starts to play the video after receiving the playback command from the smart phone. The display module DM displays prompt information on the top of the screen, and the information feeds back the operation results; In the communication between the first communication interaction module CM1 of the smart phone and the second communication interaction module CM2 of the smart TV, the smart phone uses the TCP/IP protocol to communicate with the smart TV through the wireless channel; the TCP protocol completes the transmission of data, and the UDP protocol completes the transmission of commands , the data and commands use the queue data structure and are stored in the memory. When sending, the data or commands are encapsulated into data packets together with the current time. The mobile phone and the TV respectively establish two queues in the memory, one for saving the TCP sending and receiving Data, the other is used to save the command sent and received by UDP. When the first communication interaction module CM1 and the second communication interaction module CM2 send data or commands, they are first stored in the queue of the memory and wait to be sent; after receiving the data or commands, First store in the memory queue, determine the processing order according to the time information in the data packet, and process the earlier one first; The smart phone function interaction module FM maintains a call monitoring function. When the call information occurs, the function interaction module FM sends a pause command to the smart TV, and then sends the call information to the smart TV. The smart TV screen display module DM pauses the currently playing video on the screen. The caller number is displayed on the top to remind the user that there is an incoming call on the mobile phone; after the user hangs up the phone, the video will play normally and the mobile screen will return to the interactive mode.