CN113641278A

CN113641278A - Control method, control device, electronic equipment and storage medium

Info

Publication number: CN113641278A
Application number: CN202110918533.8A
Authority: CN
Inventors: 谷素军
Original assignee: Vivo Mobile Communication Co Ltd
Current assignee: Vivo Mobile Communication Co Ltd
Priority date: 2021-08-11
Filing date: 2021-08-11
Publication date: 2021-11-12
Also published as: WO2023016372A1

Abstract

The present application relates to the field of communication technologies, and discloses a control method, an apparatus, an electronic device and a storage medium. The method includes: displaying a first function option in a first area of the display screen, and receiving a first input of the first function option by a first operating body; when the distance between the second operating body and the display screen satisfies a preset condition Next, in response to the first input, display N second function options associated with the first function options in the second area of the display screen, where the position of the second area in the display screen is between the second operating body and the display screen Receive the second input from the second operator to the target function option in the second function option; in response to the second input, execute the function corresponding to the target function option. According to the embodiments of the present application, the electronic device can be controlled with both hands, so that the user can perform operation functions conveniently and quickly, thereby greatly improving the operation efficiency of the electronic device.

Description

Control method, control device, electronic equipment and storage medium

Technical Field

The present application belongs to the field of communication technologies, and in particular, to a control method, an apparatus, an electronic device, and a storage medium.

Background

At present, the display screen of the electronic device is increasingly large, and the scenes of painting, working, learning and the like are also increasingly widely applied to the electronic device. When a user uses a large-screen electronic device to perform drawing, working, learning and the like, the user often uses two hands to perform operation, mainly uses one hand to sequentially click to perform operation, for example, in office software WPS, if the user wants to insert a form, the user firstly uses an index finger to select an insertion function, then selects a chart function, and finally selects and inserts several rows and columns, so that one operation can be completed. In performing such operations, the other hand of the user is often used only to hold the device and is not fully utilized, thereby greatly compromising the efficiency of the operation.

Therefore, the existing method for performing control by clicking with one hand in sequence mainly has the following problems: the time required by clicking in sequence by one hand is long, and the overall operation efficiency is low.

Disclosure of Invention

An object of the embodiments of the present application is to provide a control method, an apparatus, an electronic device, and a storage medium, which can solve the problem of low operation efficiency of the existing electronic device.

In order to solve the technical problem, the present application is implemented as follows:

in a first aspect, an embodiment of the present application provides a control method, which is applied to an electronic device with a display screen, and the method includes:

displaying a first function option in a first area of the display screen, and receiving a first input of a first operation body to the first function option;

under the condition that the distance between a second operation body and the display screen meets a preset condition, responding to the first input, and displaying N second function options related to the first function option in a second area of the display screen, wherein the position of the second area in the display screen is related to the position relation between the second operation body and the display screen;

receiving a second input of the second operation body to a target function option in the N second function options;

in response to the second input, executing a function corresponding to the target function option.

In a second aspect, an embodiment of the present application provides a control apparatus, which is applied to an electronic device having a display screen, and the apparatus includes:

the first display module is used for displaying a first function option in a first area of the display screen;

the first receiving module is used for receiving first input of a first operation body to the first function option;

the second display module is used for responding to the first input and displaying N second function options related to the first function option in a second area of the display screen under the condition that the distance between a second operation body and the display screen meets a preset condition, wherein the position of the second area in the display screen is related to the position relation between the second operation body and the display screen;

a second receiving module, configured to receive a second input of a target function option in the N second function options from the second operation body;

and the function execution module is used for responding to the second input and executing the function corresponding to the target function option.

In a third aspect, an embodiment of the present application provides an electronic device, including: a processor, a memory and a program or instructions stored on the memory and executable on the processor, the program or instructions when executed by the processor implementing the steps of any of the above control methods.

In a fourth aspect, the present application provides a readable storage medium, on which a program or instructions are stored, and when the program or instructions are executed by a processor, the program or instructions implement the steps of the control method according to any one of the above items.

In the embodiment of the application, a first function option is displayed in a first area of a display screen of an electronic device, N second function options related to the first function option are displayed in a second area of the display screen in response to a first input of the first operation body to the first function option under the condition that the distance between a second operation body and the display screen meets a preset condition, and the position of the second area in the display screen is related to the position relation between the second operation body and the display screen; and responding to a second input of the second operation body to a target function option in the second function options, and controlling the electronic equipment to execute a function corresponding to the target function option. Borrow this, electronic equipment can realize that first operation body and second operation body cooperation are controlled for the user can conveniently, use electronic equipment's function fast, thereby has improved electronic equipment's operating efficiency by a wide margin, has promoted user experience.

Drawings

Fig. 1 is a schematic flow chart of a control method provided in an embodiment of the present application;

FIG. 2 is a schematic structural diagram of an electronic device mounted ultrasonic sensor provided in an embodiment of the present application;

FIG. 3A is a schematic view of a single-handed holding and a single-handed operation of a two-handed operation gesture;

FIG. 3B is a schematic diagram of a two-handed operation with a two-handed grip of a two-handed operation gesture;

FIG. 4 is a schematic interface diagram of an electronic device according to an embodiment of the present application;

fig. 5 is a second schematic interface diagram of an electronic device according to an embodiment of the present application;

fig. 6 is a second schematic flowchart of a control method according to an embodiment of the present application;

fig. 7 is a third schematic flowchart of a control method according to an embodiment of the present application;

FIG. 8 is a fourth flowchart of a control method according to an embodiment of the present application;

FIG. 9 is one of schematic interface diagrams of an electronic device according to yet another embodiment of the present application;

fig. 10 is a second schematic interface diagram of an electronic device according to another embodiment of the present application;

FIG. 11 is a schematic structural diagram of a control device provided in an embodiment of the present application;

fig. 12 is a schematic structural diagram of an electronic device provided in an embodiment of the present application;

fig. 13 is a schematic structural diagram of an electronic device provided in an embodiment of the present application.

Detailed Description

The technical solutions in the embodiments of the present application will be clearly and completely described below with reference to the drawings in the embodiments of the present application, and it is obvious that the described embodiments are some, but not all, embodiments of the present application. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present application.

The terms first, second and the like in the description and in the claims of the present application are used for distinguishing between similar elements and not necessarily for describing a particular sequential or chronological order. It is to be understood that the data so used is interchangeable under appropriate circumstances such that the embodiments of the application are capable of operation in sequences other than those illustrated or described herein. In addition, "and/or" in the specification and claims means at least one of connected objects, a character "/" generally means that a preceding and succeeding related objects are in an "or" relationship.

The following describes in detail the control method provided in the embodiments of the present application with reference to the accompanying drawings through specific embodiments and application scenarios thereof.

Referring to fig. 1, fig. 1 is a schematic flowchart of a control method provided in an embodiment of the present application, where the method is applied to an electronic device having a display screen, and includes the following steps:

s101, displaying a first function option in a first area of a display screen, and receiving a first input of a first operation body to the first function option.

Optionally, the first operating body is a holding hand for holding the electronic device. The first input may be a click operation, a long press operation, a slide operation, or the like. For example, the user may select the first function option for further operation by holding the first function option with one holding finger of a holding hand for a long time.

Optionally, the first region is a region within a predetermined range corresponding to the first operation body. Optionally, the first function option is displayed near the first operation body, that is, the distance between the first function option and the first operation body is smaller than a predetermined distance threshold, for example, the distance threshold may be set to 3 cm, so that the user can further operate the first function option through the first operation body.

S102, under the condition that the distance between the second operation body and the display screen meets the preset condition, responding to the first input, displaying N second function options related to the first function option in a second area of the display screen, wherein the position of the second area in the display screen is related to the position relation between the second operation body and the display screen.

Optionally, the second operating body includes an operating hand or an operating tool controlled by the operating hand. In the present application, the user can operate the electronic device not only by operating the operating finger of the hand, but also by operating the operating tool held by the hand. Optionally, the operating means comprises a stylus, a ruler, or the like.

Optionally, when the distance value between the second operation body and the display screen is smaller than the first distance value, displaying N second function options associated with the first function option in a second area of the display screen. The N second function options can be selected as next level function options of the first function option. And N is a natural number greater than or equal to 1.

Optionally, the second function option is displayed in a second area, where the second area is an area within a predetermined range corresponding to the second operation body. For example, the second function option is displayed below the operating hand, so that the user can further operate the second function option through the operating hand.

Alternatively, the electronic device may acquire a position, a shape, an action, or a movement trajectory of the second manipulation body. Moreover, the sensing device of the electronic device can sense the position and the action of the finger of the user outside the display screen in a close range, the user can operate the electronic device without directly contacting the display screen, the operations such as clicking and sliding can be realized on the frame and the back of the whole electronic device, and the user can operate the electronic device through an isolated gesture.

Optionally, a spatial coordinate system is established with a central point of a display screen of the electronic device as an origin. Track points (Xn, Yn, Zn) of each finger of the user are obtained, the operation finger of the operation hand of the user can be further identified, and the position of the operation finger at each time point is obtained. Thereby, the moving direction and the track of the operating finger can be judged.

S103, receiving a second input of the second operation body to a target function option in the N second function options.

The second input may be a click operation, a long press operation, a slide operation, or the like.

And S104, responding to the second input, and executing the function corresponding to the target function option.

Optionally, the function corresponding to the target function option includes, but is not limited to, starting an application, executing a specific function in the application, closing the application, and the like.

Optionally, the first operating body is a holding hand for holding the electronic device, and the second operating body includes an operating hand or an operating tool controlled by the operating hand. For example, if the user holds the electronic device with his left hand and operates the electronic device with his right hand, the first operation body is the user's left hand and the second operation body is the user's right hand.

Alternatively, the electronic device may sense the position, the motion, and the shape of the object to be measured by a sensing device such as an ultrasonic sensor or a laser sensor, so as to recognize a holding hand, an operating hand, or an operating tool of the user. The operation tool comprises a stylus, a ruler and the like, and a user can control the operation tool through the operation hand to perform touch operation on a display screen of the electronic equipment.

Wherein the sensing device may be selected as an ultrasonic sensor. Ultrasonic waves encounter impurities or interfaces to produce significant reflections and the formation of reflected echoes, and encounter with moving objects to produce the doppler effect, thus having the ability to sense the position, motion and shape of the object. Ultrasonic sensors have been widely used in electronic devices such as game phones, for example, game phones can realize a position and a mode of a user-defined operation on the phone to provide a better game experience. The electronic device includes, but is not limited to, a mobile phone, a tablet computer, a notebook computer, a palm top computer, a vehicle-mounted electronic device, a wearable device, a netbook or a personal digital assistant, etc.

Alternatively, a plurality of ultrasonic sensors may be mounted on the electronic device, and as shown in fig. 2, eight ultrasonic sensors are mounted on the electronic device in a symmetrical arrangement. The eight ultrasonic sensors can respectively emit ultrasonic waves to an object to be detected, and the accuracy of sensing the object is improved. It is worth reminding that the number of the ultrasonic sensors installed on the electronic equipment is not limited, and a user can set one or any plurality of ultrasonic sensors according to actual requirements.

Alternatively, the sensing device may be a laser sensor, and the position, the motion and the shape of the object to be measured are sensed by using a laser beam emitted and received by the laser sensor, so as to identify a holding hand, an operating hand or an operating tool controlled by the operating hand of the user.

The electronic equipment can sense the position, the action and the shape of an object to be detected, can recognize the holding hand, the operation hand or the operation tool controlled by the operation hand of a user, and further realizes the matching control of two hands.

Optionally, the electronic device automatically activates the sensing device when executing a predetermined application. For example, the electronic device may automatically start the sensing device in the background after starting a target application, such as a drawing application, an office application, or a learning application. Of course, the electronic device may also be used to activate the sensing device by a user entering an instruction; alternatively, the electronic device always turns on the sensing device.

Currently, two main types of two-hand operation gestures are as follows:

(1) one-hand holding and different-hand operation mode: as shown in fig. 3A, a left-handed grip (i.e., the left hand is the gripping hand) and a right-handed thumb or forefinger manipulation (i.e., the right hand is the operating hand) may be included. Of course, the user may also use a right hand grip (i.e., the right hand is the gripping hand), a left thumb or index finger manipulation (i.e., the left hand is the operating hand), etc., as shown in the figure.

(2) Both hands grip, both hands operation mode: as shown in fig. 3B, the operation may further include holding the hands horizontally and operating with the thumbs of the hands; or the hands hold the electric tool vertically and the thumbs operate the electric tool.

According to the application, the two-hand operation gesture can be selected to be a one-hand holding and different-hand operation mode.

Optionally, acquiring the position, the action and/or the shape of the object to be detected by ultrasonic waves; identifying and judging whether the object to be detected accords with a preset holding hand element or an operation body element or not according to the position, the action and/or the shape of the object to be detected; if the object to be detected accords with the holding hand element, identifying the object to be detected as the holding hand; and if the object to be detected accords with the key elements of the operation body, identifying the object to be detected as the operation body.

Optionally, when the user holds the electronic device, at least three fingers of the holding hand of the user are in contact with the frame of the electronic device, and further, the operation posture of the user can be judged according to the number of contact points of the fingers and the frame of the electronic device, that is, which hand holds the device and which hand is used for operation and control can be judged. Specifically, whether the number of contact points of the object to be detected and the frame of the electronic equipment is more than or equal to three is judged according to the position, the action and/or the shape of the object to be detected; if the number of the contact points is more than or equal to three, identifying the object to be detected as the first operation body; and if the number of the contact points is less than three, identifying the object to be detected as the second operation body.

After the judgment is completed, the sensing equipment can be closed, so that the loss of the sensing equipment to system resources is reduced. Of course, the electronic device may also turn on the sensing device all the time.

It should be noted that the holding hand in the present application can also operate the electronic device, but as long as the hand is used for holding the electronic device, even if the hand is also used for operation, the holding hand is still defined as the holding hand. The operation hand is used only for operating the electronic device by fingers or operation tools, and has no holding function.

Fig. 4 to 5 illustrate interfaces of an electronic device according to an embodiment of the present invention, where a menu bar including three functions of a brush, a color, and a tool is displayed near a thumb of a hand, as shown in fig. 4. Next, the function selected by the user, that is, the first function option, is determined. For example, the long-press position of the thumb of the holding hand is sensed on the brush function through ultrasonic waves, which indicates that the brush function is selected by the user, that is, the first function option is the brush function. And if the distance between the operating hand of the user and the display screen is smaller than the preset distance threshold value, displaying various brush type options corresponding to the brush function, namely N second function options, in the area of the display screen below the operating hand by the electronic equipment. As shown in fig. 5, if the electronic device senses that the long-press position of the thumb of the holding hand is in the color function, it indicates that the user selected the color function. And if the electronic equipment identifies that the distance between the operating hand of the user and the display screen is smaller than a preset distance threshold value, displaying various color options corresponding to the color function in the area of the display screen below the operating hand. And if the user wants to select the color, performing next color selection according to the acquired position of the operating finger (such as the index finger) of the operating hand.

In this embodiment, the electronic device can realize the cooperation of the first operation body and the second operation body to be controlled, so that a user can conveniently and quickly use the function of the electronic device, thereby greatly improving the operation efficiency of the electronic device and improving the user experience.

In particular, the embodiment realizes acquisition of the finger position and the displacement direction of the user by using a positioning principle of ultrasonic waves, laser beams or the like, judges the holding hand, the operating hand or the operating tool controlled by the operating hand of the user, and realizes quick touch of functions by matching operation of two hands. The responsibility born by the left hand and the right hand of the user is identified, the use habit of the user is met, and the user can quickly select the desired function in a mode of the operation of matching two hands, so that the operation efficiency of the large-screen electronic equipment in the target scene, such as drawing, working and learning scenes, is improved.

Referring to fig. 6, fig. 6 is a second schematic flowchart of a control method provided in the embodiment of the present application, where the method is applied to an electronic device having a display screen, and includes the following steps:

s601, receiving a pressing operation of the electronic device by the first operating body.

Optionally, the first operating body is a holding hand for holding the electronic device.

Optionally, the pressing operation is a pressing operation of a first operation body (such as a holding finger of a holding hand) on a predetermined trigger area of the electronic device, where the trigger area includes a bezel, a display screen, a back surface, or the like of the electronic device.

For example, a long press of a first operation body of the user on a frame of the electronic device triggers generation of a press operation. The first operation body is mainly used for triggering instructions and entering a two-hand operation mode. Therefore, the operation of the hand for operation can be prevented from being influenced, and the original interaction logic cannot be influenced when the two-hand cooperation operation is realized.

And S602, under the condition that the pressure value of the pressing operation is larger than the preset pressure value, displaying a first function option in a first area of the display screen.

Optionally, this step includes: and acquiring the pressure of the pressing operation, judging whether the pressure of the pressing operation is greater than a preset pressure value, if so, displaying a first function option in a first area of the display screen, and if not, returning to the step S601.

Optionally, when the frame of the electronic device is pressed for a long time by the holding fingers of the holding hand of the user and the pressing pressure is greater than the pressure value, a two-hand operation mode is entered, and the sensing device is started at the same time. Of course, if the sensing device is always in the on state, the step of activating the sensing device can be omitted. If the pressure value is larger than the pressure value, a double-hand operation mode is triggered, namely the double hands are matched for operation and control, and a first function option is displayed.

Optionally, the first function option is displayed in a first area, and the first area is an area within a predetermined range corresponding to the holding hand. Alternatively, the first function option is displayed near the holding hand, i.e. the distance between the first function option and the holding fingers of the holding hand is smaller than a predetermined distance value, for example, the distance value may be set to 3 cm, so that the user can further operate the first function option by the holding fingers of the holding hand.

S603, receiving a first input of the first function option from the first operation body.

S604, under the condition that the distance between the second operation body and the display screen meets the preset condition, responding to the first input, displaying N second function options related to the first function option in a second area of the display screen, wherein the position of the second area in the display screen is related to the position relation between the second operation body and the display screen.

Optionally, the second operating body comprises an operating hand or an operating tool controlled by the operating hand.

And S605, receiving a second input of the second operation body to a target function option in the N second function options.

And S606, responding to the second input, and executing the function corresponding to the target function option.

And S607, canceling the display of the first function option when the first operation body cancels the pressing operation of the electronic equipment.

Optionally, if the electronic device recognizes that the holding finger is removed from the trigger area, the two-hand operation mode is turned off, and the display of the first function option is cancelled. Wherein, when the thumb of the holding hand moves away from the trigger area and is not pressed any more, the electronic equipment exits the two-hand operation mode. Meanwhile, the sensing device can be turned off, and the whole process is finished.

The specific implementation of S603 to S606 may refer to the descriptions in S101 to S104, and is not described herein again.

In this embodiment, the user can press the electronic device through the first operation body and input the first input, and the second operation body inputs the second input to the electronic device, and then the electronic device can realize the cooperation of the first operation body and the second operation body and control, so that the user can conveniently and quickly use the function of the electronic device, thereby greatly improving the operation efficiency of the electronic device.

Referring to fig. 7, fig. 7 is a third schematic flowchart of a control method provided in the embodiment of the present application, where the method is applied to an electronic device having a display screen, and includes the following steps:

s701, displaying a first function option in a first area of a display screen.

S702, a first input of a first function option by a first operation body is received.

Optionally, the first manipulation body includes a holding hand of a user.

And S703, acquiring a distance value between the second operation body and the display screen.

Optionally, the second operation body includes an operation hand of a user or an operation tool controlled by the operation hand. The current distance between the second operation body and the display screen comprises: the current distance between the operating hand of the user and the display screen; or the current distance between the operating tool and the display screen.

Alternatively, the electronic device may sense the position, the motion and the shape of the object to be measured by a sensing device such as an ultrasonic sensor or a laser sensor, so as to identify a distance value between the operating hand or an operating tool controlled by the operating hand and the display screen.

S704, determine whether the distance value is smaller than the first distance value, if so, execute S705, otherwise continue to execute S703.

S705, if the distance value is smaller than the first distance value, responding to the first input, and displaying N second function options related to the first function option in a second area of the display screen. The position of the second region in the display screen is associated with the positional relationship between the second operation body and the display screen.

Optionally, after S705, the method further includes:

and under the condition that the second operation body moves in the horizontal direction parallel to the display screen, controlling the second area of the display screen to cancel the display of the N second function options related to the first function option, and displaying the N second function options related to the first function option in the third area of the display screen.

Optionally, the foregoing steps further include:

and under the conditions that the second operation body moves in the horizontal direction parallel to the display screen and the distance value between the second operation body and the display screen is smaller than the first distance value and larger than the second distance value, controlling the second area of the display screen to cancel the display of the N second function options related to the first function option and displaying the N second function options related to the first function option in the third area of the display screen.

S706, receiving a second input of the second operation body to the target function option in the N second function options.

And S707, responding to the second input, and executing the function corresponding to the target function option.

The specific implementation of S701 to S803 and S706 to S707 may refer to the description in S101 to S105, and is not described herein again.

In one embodiment, the user operates by operating with a hand, and the first distance value is set to 20 mm. First, it is determined whether or not the operating finger of the operating hand of the user is less than 20mm from the display screen. And if the distance is greater than or equal to 20mm, not displaying the second function option on the display screen. And if the distance is less than 20mm, the display screen displays the corresponding N second function options at the position below the operating finger.

In this embodiment, the user can input to the electronic device through the first operation body and input to the electronic device through the second operation body, and then the electronic device can realize the cooperation of the first operation body and the second operation body to control, so that the user can conveniently and quickly use the function of the electronic device, thereby greatly improving the operation efficiency of the electronic device. In particular, in this embodiment, when the distance value between the second operation body and the display screen is smaller than the first distance value, in response to the first input to the first function option by the user, the N second function options associated with the first function option are displayed in the second area of the display screen, so that the user can operate the electronic device without directly touching the display screen. Secondly, in addition, the position of the second area in the display screen is associated with the position relationship between the second operation body and the display screen, so that the operation of a user is facilitated.

Referring to fig. 8, fig. 8 is a fourth schematic flowchart of a control method provided in an embodiment of the present application, where the method is applied to an electronic device having a display screen, and includes the following steps:

s801, displaying a first function option in a first area of a display screen.

S802, a first input of a first function option by a first operation body is received.

Optionally, the first manipulation body includes a holding hand of a user.

And S803, under the condition that the distance between the second operation body and the display screen meets the preset condition, responding to the first input, and displaying N second function options related to the first function option in a second area of the display screen, wherein the position of the second area in the display screen is related to the position relation between the second operation body and the display screen.

Optionally, the second operation body includes an operation hand of a user or an operation tool controlled by the operation hand.

And S804, under the condition that the second operation body moves in the horizontal direction parallel to the display screen, controlling the second area of the display screen to cancel the display of the N second function options related to the first function option, and displaying the N second function options related to the first function option in the third area of the display screen.

Optionally, the electronic device may sense the position, the motion, and the shape of the object to be detected by using a sensing device such as an ultrasonic sensor or a laser sensor, so that a situation that the second operation body moves in a horizontal direction parallel to the display screen in a first direction may be identified.

Optionally, the S804 further includes:

And S805, receiving a second input of the second operation body to a target function option in the N second function options.

And S806, responding to the second input, and executing the function corresponding to the target function option.

The specific implementation of S801 to S803 and S805 to S806 may refer to the description in S101 to S105, and will not be described herein again.

In another embodiment, the user operates by operating with a hand, and the first distance value is set to 20mm and the second distance value is set to 5 mm. First, it is determined whether or not the operating finger of the operating hand of the user is less than 20mm from the display screen. And if the distance is greater than or equal to 20mm, not displaying the second function option on the display screen. And if the distance is less than 20mm, the display screen displays the corresponding N second function options at the position below the operating finger. Further, whether the operating finger of the operating hand of the user is less than 5mm from the display screen is judged. If the distance between the operating finger and the display screen is between 5mm and 20mm, the user moves the operating finger, and the corresponding N second function options move along with the movement of the operating finger. And if the distance between the operating finger and the display screen is less than 5mm, the N second function options are fixed on the display screen and do not move along with the finger any more, so that the user can conveniently perform click operation and the like.

In the prior art, when a user operates an electronic device, a display screen cannot sense finger actions of the user outside the display screen, and cannot be controlled by matching two hands. The whole frame and the back of the electronic equipment can be operated by the ability of sensing the distance and the shape of the object at the electronic equipment, and the finger action and the finger position of a user outside the display screen can be sensed to complete the double-hand cooperation operation so as to improve the overall operation efficiency of the user. Moreover, the user can realize the operation of the electronic equipment without directly contacting the display screen.

To facilitate understanding of the present solution, the following description illustrates specific embodiments of the present application in conjunction with an interface schematic diagram of an electronic device.

Fig. 9 is one of interface schematic diagrams of an electronic device according to yet another embodiment of the present application, where the yet another embodiment is applied to a drawing scenario, except that an operation finger of an operation hand is recognized, so that a second function option is displayed according to a position of the operation finger. The user can also operate through a first operation body, such as a stylus pen shown in fig. 9. According to the position of the first operation body, a second function option appears nearby, and the second function option is function sub-option information in the example. Fig. 10 is a second schematic interface diagram of an electronic device according to another embodiment of the present application, in addition to that, when a user uses a second operation body to perform auxiliary drawing on a large-screen device, for example, a curved ruler, the position of the curved ruler on a display screen is identified, and function sub-option information appears beside the curved ruler.

If the first operation body and the second operation body are used simultaneously, the settable function sub-option information moves along with the position of the first operation body or the second operation body, and when the second operation body is placed on the display screen, the second operation body is moved, and the function sub-option information also moves. Borrow this, the user can realize that first operation body and second operation body cooperation are controlled by electronic equipment for the user can conveniently, use electronic equipment's drawing function fast, thereby has improved electronic equipment's drawing operating efficiency by a wide margin.

In another embodiment, the two-hand operation mode can also customize a shortcut operation gesture corresponding to a specific operation function in a text editing scene. The two-hand operation mode is started, and the options of inserting pictures, inserting shapes and inserting tables (function options) can be executed. If the user uses the thumb and the index finger of the holding hand to be placed at the frame position at the same time, the table inserting function can be started quickly, and the user can select several rows and columns of the table according to the double-finger kneading action formed by combining the thumb and the index finger of the holding hand. When the user moves the position of the operating finger (such as an index finger) of the operating hand, the preview image of the form is inserted into the position where the operating finger stays, and the preview image can be inserted into the text file by clicking the display screen. Therefore, the user can quickly control the electronic equipment through the quick operation gesture.

According to the control method, the electronic equipment can achieve the cooperation and control of the first operation body and the second operation body, so that a user can conveniently and quickly use the functions of the electronic equipment, the operation efficiency of the electronic equipment is greatly improved, and the user experience is improved.

In the control method provided by the embodiment of the present application, the execution main body may be an electronic device, a control apparatus, or a control module in the control apparatus for executing the control method. In the embodiment of the present application, a control device executing a control method is taken as an example, and the control device provided in the embodiment of the present application is described.

Referring to fig. 11, fig. 11 is a schematic structural diagram of a control device provided in an embodiment of the present application, where the control device 1100 is applied to an electronic device having a display screen, and the control device 1100 includes:

the first display module 1101 is configured to display a first function option in a first area of the display screen.

The first receiving module 1102 is configured to receive a first input of a first function option from a first operation body.

A second display module 1103, configured to, in response to the first input, display N second function options associated with the first function option in a second area of the display screen when a distance between the second operation body and the display screen satisfies a preset condition, where a position of the second area in the display screen is associated with a positional relationship between the second operation body and the display screen.

A second receiving module 1104, configured to receive a second input of the target function option in the N second function options from the second operation body.

A function executing module 1105, configured to execute a function corresponding to the target function option in response to the second input.

Optionally, the control device 1100 further includes:

the third receiving module is used for receiving the pressing operation of the first operation body on the electronic equipment before the first function option is displayed in the first area of the display screen;

the first display module 1101 is specifically configured to display a first function option in a first area of the display screen when the pressure value of the pressing operation is greater than a predetermined pressure value;

optionally, the control device 1100 further includes:

and the cancellation display module is used for canceling the display of the first function option under the condition that the first operation body cancels the pressing operation of the electronic equipment after the first function option is displayed in the first area.

Optionally, the second display module 1103 includes:

and the distance acquisition submodule is used for acquiring a distance value between the second operation body and the display screen.

And the display sub-module is used for responding to the first input and displaying N second function options related to the first function option in a second area of the display screen if the distance value is smaller than the first distance value.

Optionally, the control device 1100 further includes:

and the third display module is used for controlling the second area of the display screen to cancel the display of the N second function options related to the first function option and displaying the N second function options related to the first function option in the third area of the display screen under the condition that the second operation body moves in the horizontal direction parallel to the display screen.

Optionally, the third display module is specifically configured to, under the condition that the second operation body is moved in the horizontal direction parallel to the display screen, and the distance value between the second operation body and the display screen is smaller than the first distance value and larger than the second distance value, control the second area of the display screen to cancel displaying the N second function options associated with the first function option, and display the N second function options associated with the first function option in the third area of the display screen.

Optionally, the first operating body is a holding hand for holding the electronic device, and the second operating body includes an operating hand or an operating tool controlled by the operating hand.

The control device 1100 in the embodiment of the present application may be a device, or may be a component, an integrated circuit, or a chip in a terminal. The device can be mobile electronic equipment or non-mobile electronic equipment. By way of example, the mobile electronic device may be a mobile phone, a tablet computer, a notebook computer, a palm top computer, a vehicle-mounted electronic device, a wearable device, an ultra-mobile personal computer (UMPC), a netbook or a Personal Digital Assistant (PDA), and the like, and the non-mobile electronic device may be a server, a Network Attached Storage (NAS), a Personal Computer (PC), a Television (TV), a teller machine or a kiosk, and the like, and the embodiments of the present application are not particularly limited.

The control device 1100 in the embodiment of the present application may be a device having an operating system. The operating system may be an Android (Android) operating system, an ios operating system, or other possible operating systems, and embodiments of the present application are not limited specifically.

The control device 1100 provided in this embodiment of the application can implement each process implemented by the method embodiment of the operations of the electronic device in fig. 1 to fig. 10, and is not described here again to avoid repetition.

The control device 1100 of the embodiment of the application can realize the cooperation and control of the first operation body and the second operation body by the electronic equipment, so that a user can conveniently and quickly use the function of the electronic equipment, the operation efficiency of the electronic equipment is greatly improved, and the user experience is improved.

Optionally, as shown in fig. 12, an electronic device 500 is further provided in this embodiment of the present application, and includes a processor 501, a memory 502, and a program or an instruction stored in the memory 502 and capable of being executed on the processor 501, where the program or the instruction is executed by the processor 501 to implement each process of the above control method embodiment, and can achieve the same technical effect, and no further description is provided here to avoid repetition.

It should be noted that the electronic devices in the embodiments of the present application include the mobile electronic devices and the non-mobile electronic devices described above.

Fig. 13 is a schematic structural diagram of an electronic device implementing an embodiment of the present application.

The electronic device 600 includes, but is not limited to: a radio frequency unit 601, a network module 602, an audio output unit 603, an input unit 604, a sensor 605, a display unit 606, a user input unit 607, an interface unit 608, a memory 609, a processor 610, and the like.

Wherein the processor 610 is configured to:

displaying a first function option in a first area of a display screen;

receiving a first input of a first operation body to a first function option;

and under the condition that the distance between the second operation body and the display screen meets a preset condition, responding to the first input, and displaying N second function options related to the first function option in a second area of the display screen, wherein the position of the second area in the display screen is related to the position relation between the second operation body and the display screen.

Receiving a second input of a second operation body to a target function option in the N second function options;

in response to the second input, a function corresponding to the target function option is executed.

Optionally, before the displaying the first function option in the first area of the display screen, the processor 610 is further configured to:

receiving a pressing operation of the first operation body on the electronic equipment;

the displaying a first function option in a first area of the display screen includes:

displaying a first function option in a first area of the display screen under the condition that the pressure value of the pressing operation is larger than a preset pressure value;

after displaying the first function option in the first area of the display screen, the processor 610 is further configured to:

and under the condition that the first operation body cancels the pressing operation of the electronic equipment, canceling the display of the first function option.

Optionally, in a case that a distance between the second operation body and the display screen satisfies a preset condition, in response to the first input, displaying N second function options associated with the first function option in a second area of the display screen, including:

acquiring a distance value between the second operation body and the display screen;

and if the distance value is smaller than a first distance value, responding to the first input, and displaying N second function options related to the first function option in a second area of the display screen.

Optionally, the processor 610 is further configured to:

and under the condition that the second operation body moves in the horizontal direction parallel to the display screen in the first direction, controlling the second area of the display screen to cancel the display of the N second function options related to the first function option, and displaying the N second function options related to the first function option in the third area of the display screen.

Optionally, the controlling, when the second operation body moves in the horizontal direction parallel to the display screen for the first time, the second area of the display screen to cancel displaying the N second function options associated with the first function option, and displaying the N second function options associated with the first function option in the third area of the display screen includes:

and under the conditions that the second operation body moves in the horizontal direction parallel to the display screen and the distance value between the second operation body and the display screen is smaller than the first distance value and larger than the second distance value, controlling the second area of the display screen to cancel displaying the N second function options related to the first function option and displaying the N second function options related to the first function option in the third area of the display screen.

It should be understood that, in the embodiment of the present application, the radio frequency unit 601 may be used for receiving and sending signals during a message sending and receiving process or a call process, and specifically, receives downlink data from a base station and then processes the received downlink data to the processor 610; in addition, the uplink data is transmitted to the base station. In general, radio frequency unit 601 includes, but is not limited to, an antenna, at least one amplifier, a transceiver, a coupler, a low noise amplifier, a duplexer, and the like. Further, the radio frequency unit 601 may also communicate with a network and other devices through a wireless communication system.

The electronic device provides wireless broadband internet access to the user via the network module 602, such as assisting the user in sending and receiving e-mails, browsing web pages, and accessing streaming media.

The audio output unit 603 may convert audio data received by the radio frequency unit 601 or the network module 602 or stored in the memory 609 into an audio signal and output as sound. Also, the audio output unit 603 may also provide audio output related to a specific function performed by the electronic apparatus 600 (e.g., a call signal reception sound, a message reception sound, etc.). The audio output unit 603 includes a speaker, a buzzer, a receiver, and the like.

The input unit 604 is used to receive audio or video signals. It should be understood that in the embodiment of the present application, the input Unit 604 may include a Graphics Processing Unit (GPU) 6041 and a microphone 6042, and the graphics processing Unit 6041 processes image data of a still picture or a video obtained by an image capturing apparatus (such as a camera) in a video capturing mode or an image capturing mode.

The electronic device 600 also includes at least one sensor 605, such as a light sensor, motion sensor, and other sensors. Specifically, the light sensor includes an ambient light sensor that can adjust the brightness of the display panel 6061 according to the brightness of ambient light, and a proximity sensor that can turn off the display panel 6061 and/or the backlight when the electronic apparatus 600 is moved to the ear. As one type of motion sensor, an accelerometer sensor can detect the magnitude of acceleration in each direction (generally three axes), detect the magnitude and direction of gravity when stationary, and can be used to identify the posture of an electronic device (such as horizontal and vertical screen switching, related games, magnetometer posture calibration), and vibration identification related functions (such as pedometer, tapping); the sensors 605 may also include fingerprint sensors, pressure sensors, iris sensors, molecular sensors, gyroscopes, barometers, hygrometers, thermometers, infrared sensors, etc., which are not described in detail herein.

The display unit 606 is used to display information input by the user or information provided to the user. The Display unit 606 may include a Display panel 6061, and the Display panel 6061 may be configured by a Liquid Crystal Display (LCD), an Organic Light-Emitting Diode (OLED), or the like.

The user input unit 607 may be used to receive input numeric or character information and generate key signal inputs related to user settings and function control of the electronic device. Specifically, the user input unit 607 includes a touch panel 6071 and other input devices 6072. Touch panel 6071, also referred to as a touch screen, may collect touch operations by a user on or near it (e.g., operations by a user on or near touch panel 6071 using a finger, stylus, or any suitable object or accessory). The touch panel 6071 may include two parts of a touch detection device and a touch controller. Other input devices 6072 may include, but are not limited to, a physical keyboard, function keys (e.g., volume control keys, switch keys, etc.), a trackball, a mouse, and a joystick, which are not described in detail herein.

The interface unit 608 is an interface for connecting an external device to the electronic apparatus 600. For example, the external device may include a wired or wireless headset port, an external power supply (or battery charger) port, a wired or wireless data port, a memory card port, a port for connecting a device having an identification module, an audio input/output (I/O) port, a video I/O port, an earphone port, and the like. The interface unit 608 may be used to receive input (e.g., data information, power, etc.) from external devices and transmit the received input to one or more elements within the electronic device 600 or may be used to transmit data between the electronic device 600 and external devices.

The memory 609 may be used to store software programs as well as various data. The memory 609 may mainly include a program storage area and a data storage area, wherein the program storage area may store an operating system, an application program required by at least one function (such as a sound playing function, an image playing function, etc.), and the like; the storage data area may store data (such as audio data, a phonebook, etc.) created according to the use of the cellular phone, and the like. Further, the memory 609 may include high speed random access memory, and may also include non-volatile memory, such as at least one magnetic disk storage device, flash memory device, or other volatile solid state storage device.

The processor 610 is a control center of the electronic device, connects various parts of the whole electronic device by using various interfaces and lines, performs various functions of the electronic device and processes data by running or executing software programs and/or modules stored in the memory 609, and calling data stored in the memory 609, thereby performing overall monitoring of the electronic device. Processor 610 may include one or more processing units; preferably, the processor 610 may integrate an application processor, which mainly handles operating systems, user interfaces, application programs, etc., and a modem processor, which mainly handles wireless communications. It will be appreciated that the modem processor described above may not be integrated into the processor 610.

Those skilled in the art will appreciate that the electronic device 600 may further comprise a power source (e.g., a battery) for supplying power to the various components, and the power source may be logically connected to the processor 610 through a power management system, so as to implement functions of managing charging, discharging, and power consumption through the power management system. The electronic device structure shown in fig. 13 does not constitute a limitation of the electronic device, and the electronic device may include more or less components than those shown, or combine some components, or arrange different components, and thus, the description is omitted here. In the embodiment of the present application, the electronic device includes, but is not limited to, a mobile phone, a tablet computer, a notebook computer, a palm computer, a vehicle-mounted terminal, a wearable device (e.g., a bracelet, glasses), a pedometer, and the like.

The embodiment of the present application further provides a readable storage medium, where a program or an instruction is stored on the readable storage medium, and when the program or the instruction is executed by a processor, the program or the instruction implements each process of the control method embodiment, and can achieve the same technical effect, and in order to avoid repetition, details are not repeated here.

The processor is the processor in the electronic device described in the above embodiment. The readable storage medium includes a computer readable storage medium, such as a Read-Only Memory (ROM), a Random Access Memory (RAM), a magnetic disk or an optical disk, and so on.

The embodiment of the present application further provides a chip, where the chip includes a processor and a communication interface, the communication interface is coupled to the processor, and the processor is configured to execute a program or an instruction to implement each process of the above control method embodiment, and can achieve the same technical effect, and for avoiding repetition, the details are not repeated here.

It should be understood that the chips mentioned in the embodiments of the present application may also be referred to as system-on-chip, system-on-chip or system-on-chip, etc.

It should be noted that, in this document, the terms "comprises," "comprising," or any other variation thereof, are intended to cover a non-exclusive inclusion, such that a process, method, article, or apparatus that comprises a list of elements does not include only those elements but may include other elements not expressly listed or inherent to such process, method, article, or apparatus. Without further limitation, an element defined by the phrase "comprising an … …" does not exclude the presence of other like elements in a process, method, article, or apparatus that comprises the element. Further, it should be noted that the scope of the methods and apparatus of the embodiments of the present application is not limited to performing the functions in the order illustrated or discussed, but may include performing the functions in a substantially simultaneous manner or in a reverse order based on the functions involved, e.g., the methods described may be performed in an order different than that described, and various steps may be added, omitted, or combined. In addition, features described with reference to certain examples may be combined in other examples.

Through the above description of the embodiments, those skilled in the art will clearly understand that the method of the above embodiments can be implemented by software plus a necessary general hardware platform, and certainly can also be implemented by hardware, but in many cases, the former is a better implementation manner. Based on such understanding, the technical solutions of the present application may be embodied in the form of a software product, which is stored in a storage medium (such as ROM/RAM, magnetic disk, optical disk) and includes instructions for enabling a terminal (such as a mobile phone, a computer, a server, an air conditioner, or a network device) to execute the method according to the embodiments of the present application.

While the present embodiments have been described with reference to the accompanying drawings, it is to be understood that the invention is not limited to the precise embodiments described above, which are meant to be illustrative and not restrictive, and that various changes may be made therein by those skilled in the art without departing from the spirit and scope of the invention as defined by the appended claims.

Claims

1. A control method is applied to an electronic device with a display screen, and is characterized by comprising the following steps:

2. The method of claim 1, wherein prior to displaying the first function option in the first region of the display screen, the method further comprises:

after the first function option is displayed in the first area of the display screen, the method further comprises:

3. The method according to claim 1, wherein in the case that the distance between the second operation body and the display screen meets a preset condition, in response to the first input, displaying N second function options associated with the first function option in a second area of the display screen, comprises:

4. The method of claim 1, further comprising:

5. The method according to claim 4, wherein the controlling the second area of the display screen to cancel displaying the N second function options associated with the first function option and to display the N second function options associated with the first function option in the third area of the display screen in the case where the second operation body is moved in the horizontal direction parallel to the display screen by the first movement includes:

6. The method according to claim 1, wherein the first operating body is a holding hand for holding the electronic device, and the second operating body includes an operating hand or an operating tool controlled by the operating hand.

7. A control device applied to an electronic device with a display screen is characterized by comprising:

8. The apparatus of claim 7, further comprising:

the first display module is specifically configured to display a first function option in a first area of the display screen when the pressure value of the pressing operation is greater than a predetermined pressure value;

the device further comprises:

9. The apparatus of claim 7, wherein the second display module comprises:

the distance acquisition submodule is used for acquiring a distance value between the second operation body and the display screen;

and the display sub-module is used for responding to the first input and displaying N second function options related to the first function option in a second area of the display screen if the distance value is smaller than a first distance value.

10. The apparatus of claim 7, further comprising:

and the third display module is used for controlling the second area of the display screen to cancel the display of the N second function options related to the first function option and displaying the N second function options related to the first function option in the third area of the display screen under the condition that the second operation body moves in the horizontal direction parallel to the display screen for the first time.

11. The apparatus according to claim 10, wherein the third display module is specifically configured to, in a case where the second operation body is moved in a horizontal direction parallel to the display screen for the first time and a distance value between the second operation body and the display screen is smaller than a first distance value and larger than a second distance value, control the second area of the display screen to cancel displaying the N second function options associated with the first function option, and display the N second function options associated with the first function option in the third area of the display screen.

12. The apparatus according to claim 7, wherein the first operating body is a holding hand for holding the electronic device, and the second operating body includes an operating hand or an operating tool controlled by the operating hand.

13. An electronic device comprising a processor, a memory, and a program or instructions stored on the memory and executable on the processor, the program or instructions when executed by the processor implementing the steps of the control method according to any one of claims 1 to 6.

14. A readable storage medium, on which a program or instructions are stored, which when executed by a processor implement the steps of the control method according to any one of claims 1 to 6.