CN113010070B - Content selection method and device, electronic equipment and readable storage medium - Google Patents
Content selection method and device, electronic equipment and readable storage medium Download PDFInfo
- Publication number
- CN113010070B CN113010070B CN202110297282.6A CN202110297282A CN113010070B CN 113010070 B CN113010070 B CN 113010070B CN 202110297282 A CN202110297282 A CN 202110297282A CN 113010070 B CN113010070 B CN 113010070B
- Authority
- CN
- China
- Prior art keywords
- content selection
- fingerprint feature
- input
- track
- offset
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
- G06F3/0484—Interaction techniques based on graphical user interfaces [GUI] for the control of specific functions or operations, e.g. selecting or manipulating an object, an image or a displayed text element, setting a parameter value or selecting a range
- G06F3/04842—Selection of displayed objects or displayed text elements
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
- G06F3/0487—Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser
- G06F3/0488—Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser using a touch-screen or digitiser, e.g. input of commands through traced gestures
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V40/00—Recognition of biometric, human-related or animal-related patterns in image or video data
- G06V40/10—Human or animal bodies, e.g. vehicle occupants or pedestrians; Body parts, e.g. hands
- G06V40/12—Fingerprints or palmprints
- G06V40/13—Sensors therefor
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V40/00—Recognition of biometric, human-related or animal-related patterns in image or video data
- G06V40/10—Human or animal bodies, e.g. vehicle occupants or pedestrians; Body parts, e.g. hands
- G06V40/12—Fingerprints or palmprints
- G06V40/1365—Matching; Classification
Landscapes
- Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- Human Computer Interaction (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- General Engineering & Computer Science (AREA)
- Multimedia (AREA)
- User Interface Of Digital Computer (AREA)
- Position Input By Displaying (AREA)
Abstract
The embodiment of the application provides a content selection method and device, electronic equipment and a readable storage medium, and belongs to the technical field of touch screens. The content selection method comprises the following steps: receiving a first input to a screen of an electronic device; in response to a first input, identifying a first trajectory generated by the first input; under the condition that the first track is not changed within a preset time length, extracting fingerprint feature points corresponding to the first input; determining a content selection area according to the first track; the content selection area is adjusted according to the first fingerprint feature of the fingerprint feature point. Therefore, under the condition that the operable area of the user is smaller than the visible area, the required content can be accurately selected, the deviation of the selection behavior caused by the shaking of fingers or the fact that the required content is not displayed in the same screen is prevented, even the interruption of the selection behavior is prevented, the flexibility and the accuracy of content selection operation are improved, and the use experience of content selection is optimized.
Description
Technical Field
The present disclosure relates to the field of touch screen technologies, and in particular, to a content selection method, a content selection apparatus, an electronic device, and a readable storage medium.
Background
In the related art, most of the current screen touch interaction is implemented based on a contact point calculated from a contact area between a finger and a screen. When a finger moves at the edge of the screen, since the calculation of the touch point of the finger often needs averaging, for example, the midpoint of the direction of each touch point is calculated, the moving distance of the touch point is often smaller than the actual moving distance of the finger, so that the touch interaction is very inaccurate. Particularly for the selection of long text, if the content to be selected is larger than one screen, the finger can only be slid to the edge of the screen to wait for the selection area to reach the target position, and at the moment, the finger is easy to be broken at the edge of the screen, so that the selection action is interrupted. In addition, the operation is carried out on a mobile phone with a curved screen or a mobile phone with a mobile phone shell, so that the operable area of fingers of a user is smaller than the visible area, and the situation that the edge content is difficult to select is caused.
The above conditions make the content selection operation on the touch device less accurate, which is not favorable for the user to select the required content, and the experience is poor.
Disclosure of Invention
The embodiment of the application provides a content selection method, a content selection device, electronic equipment and a readable storage medium, which can accurately detect the change of a finger motion state by detecting fingerprint characteristics, are beneficial to identifying the operation intention of a user and improve the content selection accuracy.
In a first aspect, an embodiment of the present application provides a content selection method, including:
receiving a first input to a screen of an electronic device;
in response to a first input, identifying a first trajectory generated by the first input;
under the condition that the first track is not changed within a preset time length, extracting fingerprint feature points corresponding to the first input;
determining a content selection area according to the first track;
the content selection area is adjusted according to the first fingerprint feature of the fingerprint feature point.
In a second aspect, an embodiment of the present application provides a content selection apparatus, including:
the receiving module is used for receiving a first input to a screen of the electronic equipment;
the identification module is used for responding to the first input and identifying a first track generated by the first input; under the condition that the first track is not changed within a preset time length, extracting fingerprint feature points corresponding to the first input;
the determining module is used for determining a content selection area according to the first track;
and the adjusting module is used for adjusting the content selecting area according to the first fingerprint characteristics of the fingerprint characteristic points.
In a third aspect, an embodiment of the present application provides an electronic device, including a processor, a memory, and a program or instructions stored on the memory and executed on the processor, where the program or instructions, when executed by the processor, implement the steps of the content selection method as provided in the first aspect.
In a fourth aspect, embodiments of the present application provide a readable storage medium, on which a program or instructions are stored, which when executed by a processor implement the steps of the content selection method as provided in the first aspect.
In a fifth aspect, an embodiment of the present application provides a chip, where the chip includes a processor and a communication interface, where the communication interface is coupled to the processor, and the processor is configured to execute a program or instructions to implement the steps of the content selection method as provided in the first aspect.
In an embodiment of the application, a content selection method includes receiving a first input to a screen of an electronic device; in response to a first input, identifying a first trajectory generated by the first input; under the condition that the first track is not changed within a preset time length, extracting fingerprint feature points corresponding to the first input; determining a content selection area according to the first track; the content selection area is adjusted according to the first fingerprint feature of the fingerprint feature point. When a user selects content, in addition to detecting a first track generated by a first input of the user to a screen, fingerprint features generated when the first input is in contact with the screen are detected at the same time. The content selection area covered by the first track is adjusted through the change of the fingerprint characteristics. Therefore, under the condition that the user operable area is smaller than the visual area, the required content can be accurately selected, and the deviation of the selection behavior caused by the shaking of fingers or the fact that the required content is not displayed in the same screen is prevented, and even the selection behavior is interrupted. And then the flexibility and the accuracy of the content selection operation are improved, and the use experience of the content selection is optimized.
Drawings
FIG. 1 shows one of the flow diagrams of a content selection method according to one embodiment of the present application;
FIG. 2 shows a second flowchart of a content selection method according to an embodiment of the present application;
FIG. 3 shows a third flowchart of a content selection method according to an embodiment of the present application;
FIG. 4 shows a fourth flowchart of a content selection method according to an embodiment of the present application;
FIG. 5 shows a fifth flowchart of a content selection method according to an embodiment of the present application;
FIG. 6 shows six of a flow chart of a method of content selection according to an embodiment of the present application;
FIG. 7 shows a seventh flowchart of a content selection method according to an embodiment of the present application;
FIG. 8 illustrates one of the screen display diagrams of an electronic device according to one embodiment of the present application;
FIG. 9 shows a second schematic screen display of an electronic device according to an embodiment of the present application;
FIG. 10 shows a third schematic screen display of an electronic device according to an embodiment of the present application;
FIG. 11 shows a block diagram of a content selection apparatus according to an embodiment of the present application;
FIG. 12 shows a block diagram of an electronic device according to an embodiment of the present application;
fig. 13 shows a hardware configuration block diagram of an electronic device according to an embodiment of the present application.
Detailed Description
In order that the above objects, features and advantages of the present application can be more clearly understood, the present application will be described in further detail with reference to the accompanying drawings and detailed description. It should be noted that the embodiments and features of the embodiments of the present application may be combined with each other without conflict.
In the following description, numerous specific details are set forth in order to provide a thorough understanding of the present application, however, the present application may be practiced in other ways than those described herein, and therefore the scope of the present application is not limited by the specific embodiments disclosed below.
A content selection method, a content selection apparatus, an electronic device, and a readable storage medium according to some embodiments of the present application are described below with reference to fig. 1 to 13.
In an embodiment of the present application, fig. 1 shows one of flowcharts of a content selection method of the embodiment of the present application, including:
102, receiving a first input to a screen of an electronic device;
in this embodiment, the content selection method is applicable to electronic devices, including but not limited to mobile terminals, tablet computers, notebook computers, wearable devices, vehicle-mounted terminals, and the like. The first input includes, but is not limited to, a click input, a slide input, a press input. Of course, the first input may also be other operations of the electronic device by the user, and the operation manner in the embodiment of the present application is not particularly limited, and may be any realizable manner.
106, under the condition that the first track is not changed within a preset time length, extracting fingerprint feature points corresponding to the first input;
the preset time duration can be reasonably set according to the operation habit of the user, for example, the preset time duration is 0s, 0.2s, 0.8s, 1s, 2s, and the like.
In this embodiment, after receiving a first input to the screen by the user, the electronic device identifies a first track generated by the first input, that is, a track of movement of a finger with respect to the contact surface of the screen. If the change of the first track is not detected within the preset time, the actual moving distance of the finger is smaller or the movement of the finger is finished, so that the touch point for forming the first track is not deviated, and the fingerprint feature point of the first input finger at the moment is extracted.
The fingerprint comprises fingerprint lines, the fingerprint lines can be continuous or discontinuous, and break points, bifurcation points and turning points formed by interruption, bifurcation and turning of the fingerprint lines are fingerprint feature points, namely the acquisition positions of the fingerprint features on the finger. The fingerprint feature points can provide the determination information of fingerprint uniqueness, and the fingerprint features comprise the direction of fingerprint lines (line nodes can face a certain direction), the curvature of the fingerprint lines (describing the speed of change of the direction of the fingerprint lines), the positions of the fingerprint feature points (which can be identified by x and y coordinates), and the like.
the content selection area may include text content, image content, graphic content, audio/video content, and the like.
In this embodiment, the content selection area covered by the first trajectory is adjusted by a change of the first fingerprint feature of the fingerprint feature points. Therefore, under the condition that the operable area of the user is smaller than the visible area, the required content can be accurately selected, and the deviation of the selection behavior caused by the shaking of fingers or the fact that the required content is not displayed in the same screen, even the interruption of the selection behavior, can be prevented. And then the flexibility and the accuracy of the content selection operation are improved, and the use experience of the content selection is optimized.
In one embodiment of the present application, as shown in fig. 2, step 110, adjusting the content selection area according to the first fingerprint feature of the fingerprint feature point includes:
In this embodiment, it is considered that in the case where the operable area of the user's finger is smaller than the visible area, a problem of difficulty in selecting edge content may be caused. Therefore, when the change of the first track is not detected within the preset time length, the first fingerprint characteristics of the fingerprint characteristic points are periodically collected, the offset between the first fingerprint characteristics of the fingerprint characteristic points at the current sampling moment and the first fingerprint characteristics of the fingerprint characteristic points at the previous sampling moment is calculated, whether the first fingerprint characteristics change or not is judged through the offset, namely whether the fingerprint characteristic points obviously move or not is judged, and the range of the content selection area is correspondingly adjusted according to the offset.
In one embodiment of the present application, as shown in fig. 3, the step 108 of determining a content selection area according to the first track includes:
in this embodiment, after the user's finger contacts the electronic device, a plurality of contact points can be identified, a first track is formed by connecting the plurality of contact points, and a first contact point and a last contact point in the first track, that is, a first contact point generated by the finger contacting the screen, and a last contact point before the finger separating from the screen, are searched.
Wherein the size information includes: the line length, line spacing, character spacing, column width, column spacing, line number, column number, character length, character width and the like of the content displayed on the screen can embody the information of the size of the content box where the content is located.
In this embodiment, the contents displayed in the screen have a specific line pitch, column width, character pitch, and the like, and the size information is determined in advance in accordance with the contents displayed in the screen. And correcting the reference area of the content rows and columns covered by the connecting line of the head contact point and the tail contact point by using the size information to determine a content selection area. Therefore, the content selection area is aligned with the content through the size information, the problem of content selection missing caused by the fact that the contact point is located on the content is avoided, and the completeness of content selection is guaranteed.
For example, if the user needs to select 8 characters displayed on the screen, each character being 5mm long, the total length of the 8 characters is 40mm, and the length of the resulting first trace is 39mm due to problems such as deviation in recognition of a contact point caused by a contact area of the user's finger with the screen. If the length of the first track is directly taken as the length of the content selection area, part of the last character is located outside the content selection area, so that the result of content selection is inconsistent with the actual requirement. For this purpose, the length of the first track is taken as the length of the reference area, and the length of the reference area is corrected to 40mm according to each character length, resulting in the length of the final content selection area, so that the content selection area can contain the complete characters.
In one embodiment of the present application, as shown in fig. 4, step 204, adjusting the content selection area according to the offset includes:
in this embodiment, if the detected offset amount is smaller than the first offset threshold, which indicates that the first fingerprint feature has not changed much, the content selection area determined by the first fingerprint feature does not need to be adjusted. If the offset is greater than or equal to the first offset threshold, the fingerprint feature point is obviously moved, namely the finger is offset, and then the first displacement of the movement of the fingerprint feature point is calculated according to the offset and the offset direction.
In this embodiment, the tail contact point in the first track is moved according to the moving distance and the moving direction of the first displacement, so as to further adjust the position corresponding to the tail contact point of the first track on the identified screen. Thereby expanding the content selection area determined by the leading contact point and the trailing contact point of the first trajectory by the first displacement. When the user selects the content, the judgment of the fingerprint moving distance can be additionally added and the content can be selected besides the selection according to the moving distance of the finger touch point. Therefore, the required content is selected accurately, the flexibility and the accuracy of content selection operation are improved, and the use experience of content selection is optimized.
Wherein the first displacement comprises a movement distance and a movement direction. It is understood that, according to a specific usage scenario, the moving distance in the first displacement may be a fixed value, or may be determined according to a preset corresponding relationship between the offset and the moving distance, that is, the content additionally selected based on the fingerprint movement may be content with the same length as the moving distance of the fingerprint, or content with a fixed length.
It can be understood that, after the tail contact point is moved according to the fingerprint feature point, the content selection area can be corrected through the size information, so that the content to be selected by the user can be completely in the content selection area.
Specifically, for example, as shown in fig. 8, when a finger moves at the edge of the screen 800, a reference area 802 corresponding to a first trajectory generated by a contact point of the finger is displayed on the screen 800, a contact surface between the finger and the screen 800 and a movement area 804 of the contact point obtained by calculation are not significantly changed when the finger is turned over, but a fingerprint feature point caused by an additional movement of the fingerprint is significantly displaced due to the turning of the finger, a fingerprint feature displacement area 806 is determined by the displacement, and a final content selection area is obtained by combining an alignment area 808 of a text displaying size information of content, the reference area 802, and the fingerprint feature displacement area 806.
In one embodiment of the present application, as shown in fig. 5, the step 204 of adjusting the content selection area according to the offset includes:
In this embodiment, new contact points are continuously generated along with the continuous change of the first input, and the first track is formed by connecting a plurality of contact points, that is, the contact points on the first track have a sequential connection order according to the time of the contact points. Based on the sequence, when a second displacement between the tail contact point and a previous contact point of the tail contact point in the first track is larger than or equal to a displacement threshold, the tail contact point has a larger displacement relative to the previous contact point, namely the position change of the tail contact point and the previous contact point is abnormal, and a tail contact point identification error caused by the fact that a user finger adheres to a screen may exist; under the condition of periodically collecting the first fingerprint features of the fingerprint feature points, if the offset between the first fingerprint feature of the fingerprint feature point at the current sampling moment and the first fingerprint feature of the fingerprint feature point at the previous sampling moment is detected to be less than or equal to a second offset threshold value, the fingerprint feature points are obviously offset; the area between the first contact point and the previous contact point is determined as a reference area, and the reference area is corrected according to the size information of the content displayed by the electronic device to form a content selection area. That is, when the contact point is changed obviously but the fingerprint feature point is not changed obviously, the identified tail contact point is discarded, and the former contact point is used as the basis for determining the content selection area. Therefore, the problem that the tail contact point is not located at a required position due to the fact that the finger moves up/down when the first input is finished is solved, the content selection area is changed, and the accuracy of content selection is improved.
It will be appreciated that the position of the trailing contact point may also be moved by the offset of the first fingerprint feature prior to determining the second displacement between the trailing contact point and the previous contact point. That is, the tail contact point used to determine whether the contact point has changed significantly may be the tail contact point that moves after being corrected by the offset amount, or the tail contact point that is the first trajectory of movement before being corrected.
Specifically, for example, as shown in fig. 9, when the content selection operation is about to end, the finger starts to lift up, and at this time, the contact area 902 of the finger with the screen 800 is reduced, and the tail contact 810 detected by the contact area 902 at the time of ending the selection may move up, so that a part of the selected content selection area 820 is deselected, thereby affecting the use experience. For this reason, when the position of the tail contact 810 changes but the position of the fingerprint feature does not change, such that the content that has been selected previously and may not be in the current content selection area 820 will still remain in the selected state, with reference to the fingerprint.
In one embodiment of the present application, as shown in FIG. 6, identifying 104 a first trajectory resulting from a first input includes:
in this embodiment, after receiving a first input by a user, a contact area when a user's finger makes contact with the screen is identified. If the contact area is larger than or equal to the area threshold value, the contact position is effective contact, and a plurality of contact points corresponding to the first input on the screen are calculated according to the contact area and a preset contact rule. Thereby avoiding content selection errors caused by false touches.
The preset contact rule may be that the contact point is a center point of the contact surface where the contact area is located, or the contact point is any point on the contact profile where the contact area is located, which is not limited in this application.
And 606, connecting the contact points in sequence according to a preset sequence to generate a first track.
The preset sequence may be a sequence according to the moving direction of the first input, or may be a time sequence.
In this embodiment, a plurality of contact points are connected according to a preset order to form a first trajectory so as to determine a content selection area selected by the user according to the first trajectory.
In one embodiment of the present application, the content selection method further includes: a content selection area is displayed on the screen.
In the embodiment, the content selection area is displayed, so that the user can intuitively perceive the content selection area selected by finger operation, the content selection area is conveniently adjusted in time, and the content selection efficiency is improved.
In an embodiment of the present application, fig. 7 shows a seventh flowchart of a content selection method of the embodiment of the present application, including:
in this embodiment, considering that the content to be selected is longer than the range of the screen display, the finger can only be slid to the edge of the screen to automatically slide to the target position in the area waiting for selection. When the finger waits at the edge of the screen, the touch is easily broken, so that the selection is interrupted, and the user can only select again, which seriously affects the use experience of the user. Therefore, according to the second fingerprint feature of the target fingerprint feature point corresponding to the second input, a response mode of the auxiliary selection instruction is configured, namely the auxiliary selection instruction corresponding to the second fingerprint feature can be executed only when the second fingerprint feature is acquired. The expansion of content selection is triggered through the second fingerprint characteristics, so that auxiliary selection under the scene that long texts or fingers are inconvenient to move is achieved, and richer operation functions are expanded.
The auxiliary selection instruction can be reasonably set according to the content selection scene, for example, the functions of long pressing, dragging and the like of the content can be realized by using a specific fingerprint for touch operation, and the flexibility and the efficiency of operation are improved.
In step 708, in the case that the similarity between the first fingerprint feature and the second fingerprint feature is greater than or equal to the similarity threshold, the content selection area is adjusted according to the auxiliary selection instruction and the offset.
In this embodiment, when the similarity between the first fingerprint feature and the second fingerprint feature is greater than or equal to the similarity threshold, which indicates that the first input meets the trigger condition of the auxiliary selection instruction, the content selection area is adjusted according to the auxiliary selection instruction and the changed offset of the first fingerprint feature. Therefore, a plurality of complex operations are realized by utilizing fingerprint change, the content selection mode is simplified, the flexibility and the high efficiency of the content selection operation are enhanced, and various requirements of users are met.
For example, the auxiliary selection instruction is to increase or decrease the content selection area, a correspondence between an offset amount and a content selection area variation amount is preset, the content selection area variation amount is 2mm when the offset amount is 0.2mm, the content selection area is determined to be increased when the position of the fingerprint feature point which is not covered by the content selection area is shifted, and the content selection area is determined to be decreased when the position of the fingerprint feature point which is covered by the content selection area is shifted.
For example, the user may bind a fingerprint that the user wants to use, such as a fingerprint of the middle finger of the left hand, to the corresponding auxiliary selection operation in advance. When the user selects content, if the fingerprint currently touched for use is identified as a pre-bound fingerprint, the fingerprint may be used to perform an additional operation, for example, as shown in fig. 10, when a normal selection operation is performed on the screen 800, a fingerprint contact state is additionally detected. For example, the area 902 of the finger print does not move relative to the screen 800, but the area of the portion of the contact area 902 in contact with the screen 800 changes, that is, when the finger rolls, the text can be expanded and selected. When the coordinates of the fingerprint feature points change, that is, when the finger performs a scrolling operation in any direction, based on the currently selected content selection area 820, the expansion is continued in the corresponding direction according to the expansion amount corresponding to the offset of the fingerprint features, and when the coordinates of the fingerprint feature points return to the coordinates before the change, that is, when the finger returns to the state when the touch starts, the expansion is stopped. In the process of the above expansion based on the fingerprint contact state, if the relative movement of the finger and the screen 800 occurs simultaneously, that is, a new first trajectory is generated, a content selection behavior corresponding to the finger movement is simultaneously triggered.
In one embodiment of the present application, as shown in fig. 11, a content selection apparatus 1000 includes: the receiving module 1002, the receiving module 1002 is configured to receive a first input to a screen of an electronic device; an identifying module 1004, the identifying module 1004 being configured to identify, in response to a first input, a first trajectory generated by the first input; under the condition that the first track is not changed within a preset time length, extracting fingerprint feature points corresponding to the first input; a determining module 1006, wherein the determining module 1006 is configured to determine the content selection area according to the first track; an adjusting module 1008, the adjusting module 1008 being configured to adjust the content selection area according to a first fingerprint feature of the fingerprint feature point.
Optionally, the adjusting module 1008 is further configured to calculate an offset between the first fingerprint feature of the fingerprint feature point at the current sampling time and the first fingerprint feature of the fingerprint feature point at the previous sampling time; the content selection area is adjusted according to the offset.
Optionally, the adjusting module 1008 is further configured to calculate a first displacement according to the offset amount when the offset amount is greater than or equal to the first offset threshold; the trailing contact of the first track on the screen is moved according to the first displacement.
Optionally, the determining module 1006 is further configured to determine a head contact point and a tail contact point of the first track on the screen; determining an area between the head contact point and the tail contact point as a reference area; the content selection apparatus 1000 further includes: and a correcting module (not shown in the figure) for correcting the reference area according to the size information of the content displayed by the electronic device to form a content selection area.
Optionally, the adjusting module 1008 is further configured to determine, when a second displacement between the tail contact point and a previous contact point of the tail contact point in the first track is greater than or equal to the displacement threshold and the offset is less than or equal to a second offset threshold, an area between the head contact point and the previous contact point as a reference area, and correct the reference area according to size information of content displayed by the electronic device to form a content selection area.
Optionally, the receiving module 1002 is further configured to receive a second input to the screen of the electronic device; the identification module 1004 is further configured to, in response to a second input, extract a target fingerprint feature point corresponding to the second input; the content selection apparatus 1000 further includes: an association module (not shown in the figure) for associating the second fingerprint feature of the stored target fingerprint feature point with a content selection instruction of the electronic device; the adjusting module 1008 is further configured to adjust the content selection area according to the auxiliary selection instruction and the offset in a case that a similarity between the first fingerprint feature and the second fingerprint feature is greater than or equal to a similarity threshold.
Optionally, the identifying module 1004 is further configured to identify a contact area between the first input and the screen; under the condition that the contact area is larger than or equal to the area threshold, determining a plurality of contact points corresponding to first input on a screen according to the contact area and a preset contact rule; the content selection apparatus 1000 further includes: and a generating module (not shown in the figure), configured to sequentially connect the multiple contact points according to a preset sequence, so as to generate a first track.
Optionally, the content selecting apparatus 1000 further includes: and a display module (not shown in the figure) for displaying the content selection area on the screen.
In this embodiment, when each module of the content selection apparatus 1000 executes its respective function, the steps of the content selection method in any of the above embodiments are implemented, so that the content selection apparatus also includes all the beneficial effects of the content selection method in any of the above embodiments, which are not described herein again.
The content selection apparatus in the embodiment of the present application may be an apparatus, and may also be a component, an integrated circuit, or a chip in a terminal. The device can be mobile electronic equipment or non-mobile electronic equipment. By way of example, the mobile electronic device may be a mobile phone, a tablet computer, a notebook computer, a palm top computer, a vehicle-mounted electronic device, a wearable device, an ultra-mobile personal computer (UMPC), a netbook or a Personal Digital Assistant (PDA), and the like, and the non-mobile electronic device may be a server, a Network Attached Storage (NAS), a Personal Computer (PC), a Television (TV), a teller machine or a self-service machine, and the like, and the embodiments of the present application are not particularly limited.
The management device of the application program in the embodiment of the present application may be a device having an operating system. The operating system may be an Android operating system, an ios operating system, or other possible operating systems, which is not specifically limited in the embodiment of the present application.
In one embodiment of the present application, as shown in fig. 12, there is provided an electronic device 1100, including: the processor 1104, the memory 1102 and a program or an instruction stored in the memory 1102 and executable on the processor 1104, wherein the program or the instruction implements the steps of the content selection method provided in any of the embodiments described above when executed by the processor 1104, and therefore, the electronic device 1100 includes all the advantages of the content selection method provided in any of the embodiments described above, which are not described herein again.
Fig. 13 is a schematic diagram of a hardware structure of an electronic device 1200 for implementing an embodiment of the present application. The electronic device 1200 includes, but is not limited to: radio frequency unit 1202, network module 1204, audio output unit 1206, input unit 1208, sensors 1210, display unit 1212, user input unit 1214, interface unit 1216, memory 1218, processor 1220, and the like.
Those skilled in the art will appreciate that the electronic device 1200 may further comprise a power supply (e.g., a battery) for supplying power to the various components, and the power supply may be logically connected to the processor 1220 via a power management system, so as to manage charging, discharging, and power consumption management functions via the power management system. The electronic device structure shown in fig. 13 does not constitute a limitation of the electronic device, and the electronic device may include more or less components than those shown, or combine some components, or a different arrangement of components. In the embodiment of the present application, the electronic device includes, but is not limited to, a mobile terminal, a tablet computer, a notebook computer, a palm computer, a vehicle-mounted electronic device, a wearable device, a pedometer, and the like.
Wherein the user input unit 1214 is used for receiving a first input to the screen of the electronic device; processor 1220 is configured to, in response to a first input, identify a first trajectory generated by the first input; under the condition that the first track is not changed within a preset time length, extracting fingerprint feature points corresponding to the first input; determining a content selection area according to the first track; the content selection area is adjusted according to the first fingerprint feature of the fingerprint feature point.
Further, the processor 1220 is further configured to calculate an offset between the first fingerprint feature of the fingerprint feature point at the current sampling time and the first fingerprint feature of the fingerprint feature point at the previous sampling time; and adjusting the content selection area according to the offset.
Further, the processor 1220 is further configured to calculate a first displacement according to the offset amount if the offset amount is greater than or equal to the first offset threshold; the trailing contact of the first track on the screen is moved according to the first displacement.
Further, the processor 1220 is further configured to determine a leading contact point and a trailing contact point of the first trace on the screen; determining an area between the head contact point and the tail contact point as a reference area; and correcting the reference area according to the size information of the content displayed by the electronic equipment to form a content selection area.
Further, the processor 1220 is further configured to determine, when a second displacement between the tail contact point and a previous contact point of the tail contact point in the first trace is greater than or equal to a displacement threshold and the displacement amount is less than or equal to a second displacement threshold, an area between the head contact point and the previous contact point as a reference area, and correct the reference area according to size information of content displayed by the electronic device to form a content selection area.
Further, the user input unit 1214 is also used for receiving a second input to the screen of the electronic device; processor 1220 is further configured to, in response to the second input, extract target minutiae corresponding to the second input; associating and storing a second fingerprint feature of the target fingerprint feature point and a content selection instruction of the electronic equipment; and in the case that the similarity between the first fingerprint feature and the second fingerprint feature is greater than or equal to the similarity threshold, adjusting the content selection area according to the auxiliary selection instruction and the offset.
Further, the processor 1220 is further configured to identify a contact area between the first input and the screen; under the condition that the contact area is larger than or equal to the area threshold, calculating a plurality of contact points corresponding to a first input on a screen according to the contact area and a preset contact rule; and connecting the contact points in sequence to generate a first track.
Further, the display unit 1212 is used to display a content selection area on the screen.
It should be understood that, in the embodiment of the present application, the radio frequency unit 1202 may be used for transceiving information or transceiving signals during a call, and in particular, receiving downlink data of a base station or sending uplink data to the base station. Radio frequency unit 1202 includes, but is not limited to, an antenna, at least one amplifier, a transceiver, a coupler, a low noise amplifier, a duplexer, and the like.
The network module 1204 provides wireless broadband internet access to the user, such as assisting the user in sending and receiving e-mails, browsing web pages, and accessing streaming media.
The audio output unit 1206 may convert audio data received by the radio frequency unit 1202 or the network module 1204 or stored in the memory 1218 into an audio signal and output as sound. Also, the audio output unit 1206 may provide audio output related to a specific function performed by the electronic apparatus 1200 (e.g., a call signal reception sound, a message reception sound, and the like). The audio output unit 1206 includes a speaker, a buzzer, a receiver, and the like.
The input unit 1208 is used to receive audio or video signals. The input Unit 1208 may include a Graphics Processing Unit (GPU) 5082 and a microphone 5084, and the Graphics processor 5082 processes image data of still pictures or video obtained by an image capturing device (such as a camera) in a video capture mode or an image capture mode. The processed image frames may be displayed on the display unit 1212 or stored in the memory 1218 (or other storage medium) or transmitted via the radio frequency unit 1202 or the network module 1204. The microphone 5084 may receive sound and may be capable of processing the sound into audio data, and the processed audio data may be converted into a format output transmittable to a mobile communication base station via the radio frequency unit 1202 in case of a phone call mode.
The electronic device 1200 also includes at least one sensor 1210, such as a fingerprint sensor, a pressure sensor, an iris sensor, a molecular sensor, a gyroscope, a barometer, a hygrometer, a thermometer, an infrared sensor, a light sensor, a motion sensor, and others.
The display unit 1212 is used to display information input by the user or information provided to the user. The display unit 1212 may include a display panel 5122, and the display panel 5122 may be configured in the form of a liquid crystal display, an organic light emitting diode, or the like.
The user input unit 1214 may be used to receive input numeric or character information and generate key signal inputs related to user settings and function control of the electronic device. Specifically, the user input unit 1214 includes a touch panel 5142 and other input devices 5144. Touch panel 5142, also referred to as a touch screen, can collect touch operations by a user on or near it. The touch panel 5142 may include two parts of a touch detection device and a touch controller. The touch detection device detects the touch direction of a user, detects a signal brought by touch operation and transmits the signal to the touch controller; the touch controller receives touch information from the touch sensing device, converts the touch information into touch point coordinates, and sends the touch point coordinates to the processor 1220 to receive and execute commands sent by the processor 1220. Other input devices 5144 may include, but are not limited to, a physical keyboard, function keys (e.g., volume control keys, switch keys, etc.), a trackball, a mouse, and a joystick, which will not be described in detail herein.
Further, the touch panel 5142 can be overlaid on the display panel 5122, and when the touch panel 5142 detects a touch operation thereon or nearby, the touch operation can be transmitted to the processor 1220 to determine the type of touch event, and then the processor 1220 can provide a corresponding visual output on the display panel 5122 according to the type of touch event. The touch panel 5142 and the display panel 5122 can be provided as two separate components or can be integrated into one component.
The interface unit 1216 is an interface for connecting an external device to the electronic apparatus 1200. For example, the external device may include a wired or wireless headset port, an external power supply (or battery charger) port, a wired or wireless data port, a memory card port, a port for connecting a device having an identification module, an audio input/output (I/O) port, a video I/O port, an earphone port, and the like. The interface unit 1216 may be used to receive input (e.g., data information, power, etc.) from an external device and transmit the received input to one or more elements within the electronic apparatus 1200 or may be used to transmit data between the electronic apparatus 1200 and the external device.
The processor 1220 performs various functions of the electronic device 1200 and processes data by running or executing applications and/or modules stored within the memory 1218 and by invoking data stored within the memory 1218 to thereby provide an overall monitoring of the electronic device 1200. Processor 1220 may include one or more processing units; the processor 1220 may integrate an application processor, which mainly handles operations for content selection, user interface, application programs, etc., and a modem processor, which mainly handles operations for content selection.
In an embodiment of the present application, a readable storage medium is provided, on which a program or instructions are stored, which when executed by a processor implement the steps of the content selection method as provided in any of the above embodiments.
In this embodiment, the readable storage medium can implement each process of the content selection method provided in the embodiments of the present application, and can achieve the same technical effect, and is not described herein again to avoid repetition.
The processor is the processor in the communication device in the above embodiment. Readable storage media, including computer-readable storage media, such as Read-Only Memory (ROM), Random Access Memory (RAM), magnetic or optical disks, etc.
The embodiment of the present application further provides a chip, where the chip includes a processor and a communication interface, the communication interface is coupled to the processor, and the processor is configured to execute a program or an instruction to implement each process of the foregoing content selection method embodiment, and the same technical effect can be achieved.
It should be understood that the chips mentioned in the embodiments of the present application may also be referred to as system-on-chip, system-on-chip or system-on-chip, etc.
It should be noted that, in this document, the terms "comprises," "comprising," or any other variation thereof, are intended to cover a non-exclusive inclusion, such that a process, method, article, or apparatus that comprises a list of elements does not include only those elements but may include other elements not expressly listed or inherent to such process, method, article, or apparatus. Without further limitation, an element defined by the phrase "comprising an … …" does not exclude the presence of other like elements in a process, method, article, or apparatus that comprises the element. Further, it should be noted that the scope of the methods and apparatuses in the embodiments of the present application is not limited to performing the functions in the order illustrated or discussed, but may include performing the functions in a substantially simultaneous manner or in a reverse order based on the functions recited, e.g., the described methods may be performed in an order different from that described, and various steps may be added, omitted, or combined. In addition, features described with reference to certain examples may be combined in other examples.
Through the description of the foregoing embodiments, it is clear to those skilled in the art that the method of the foregoing embodiments may be implemented by software plus a necessary general hardware platform, and certainly may also be implemented by hardware, but in many cases, the former is a better implementation. Based on such understanding, the technical solutions of the present application may be embodied in the form of a software product, which is stored in a storage medium (such as ROM/RAM, magnetic disk, optical disk) and includes instructions for enabling a terminal (such as a mobile phone, a computer, a server, an air conditioner, or a network device) to execute the methods of the embodiments of the present application.
While the present embodiments have been described with reference to the accompanying drawings, it is to be understood that the invention is not limited to the precise embodiments described above, which are meant to be illustrative and not restrictive, and that various changes may be made therein by those skilled in the art without departing from the spirit and scope of the invention as defined by the appended claims.
The above description is only a preferred embodiment of the present application and is not intended to limit the present application, and various modifications and changes may be made to the present application by those skilled in the art. Any modification, equivalent replacement, improvement and the like made within the spirit and principle of the present application shall be included in the protection scope of the present application.
Claims (8)
1. A method for content selection, comprising:
receiving a first input to a screen of an electronic device;
in response to the first input, identifying a first trajectory generated by the first input;
under the condition that the first track is not changed within a preset time length, extracting fingerprint feature points corresponding to the first input;
determining a content selection area according to the first track;
adjusting the content selection area according to the first fingerprint characteristics of the fingerprint characteristic points;
the determining a content selection area according to the first track includes:
determining a leading contact point and a trailing contact point of the first track on the screen;
determining an area between the head contact point and the tail contact point as a reference area;
correcting the reference area according to the size information of the content displayed by the electronic equipment to form the content selection area;
the adjusting the content selection area according to the first fingerprint feature of the fingerprint feature point includes: adjusting the content selection area according to the offset;
before the adjusting the content selection area according to the first fingerprint feature of the fingerprint feature point, the method further includes:
receiving a second input to a screen of the electronic device;
in response to the second input, extracting a target fingerprint feature point corresponding to the second input;
the second fingerprint characteristic of the target fingerprint characteristic point and an auxiliary selection instruction of the electronic equipment are stored in an associated mode;
the adjusting the content selection area according to the offset includes:
and in the case that the similarity between the first fingerprint feature and the second fingerprint feature is greater than or equal to a similarity threshold, adjusting the content selection area according to an auxiliary selection instruction and the offset.
2. The content selection method of claim 1, wherein the adjusting the content selection area according to the first fingerprint feature of the fingerprint feature point further comprises:
calculating the offset between the first fingerprint feature of a current sample time fingerprint feature point and the first fingerprint feature of a previous sample time fingerprint feature point.
3. The method of claim 2, wherein the adjusting the content selection area according to the offset comprises:
under the condition that the offset is greater than or equal to a first offset threshold value, calculating first displacement between the fingerprint feature point at the current sampling moment and the fingerprint feature point at the previous sampling moment according to the offset;
moving a trailing contact of the first track on the screen in accordance with the first displacement.
4. The method of claim 2, wherein the adjusting the content selection area according to the offset comprises:
and under the condition that the second displacement between the tail contact point and the previous contact point of the tail contact point in the first track is greater than or equal to a displacement threshold value and the offset is less than or equal to a second offset threshold value, determining an area between the head contact point and the previous contact point as the reference area, and correcting the reference area according to the size information to form the content selection area.
5. The content selection method of any one of claims 1 to 4, wherein the identifying a first track generated by the first input comprises:
identifying a contact area between the first input and the screen;
determining a plurality of contact points corresponding to the first input on the screen according to the contact area and a preset contact rule under the condition that the contact area is larger than or equal to an area threshold value;
and sequentially connecting the contact points according to a preset sequence to generate the first track.
6. A content selection apparatus, comprising:
the receiving module is used for receiving a first input to a screen of the electronic equipment;
the identification module is used for responding to the first input and identifying a first track generated by the first input; under the condition that the first track is not changed within a preset time length, extracting fingerprint feature points corresponding to the first input;
a determining module, configured to determine a content selection area according to the first track;
the adjusting module is used for adjusting the content selection area according to the first fingerprint characteristics of the fingerprint characteristic points;
the determining a content selection area according to the first track includes:
determining a leading contact point and a trailing contact point of the first track on the screen;
determining an area between the head contact point and the tail contact point as a reference area;
correcting the reference area according to the size information of the content displayed by the electronic equipment to form the content selection area;
the adjusting the content selection area according to the first fingerprint feature of the fingerprint feature point includes: adjusting the content selection area according to the offset;
before the adjusting the content selection area according to the first fingerprint feature of the fingerprint feature point, the method further includes:
receiving a second input to a screen of the electronic device;
in response to the second input, extracting target fingerprint feature points corresponding to the second input;
associating and storing a second fingerprint feature of the target fingerprint feature point and an auxiliary selection instruction of the electronic equipment;
the adjusting the content selection area according to the offset includes:
and in the case that the similarity between the first fingerprint feature and the second fingerprint feature is greater than or equal to a similarity threshold, adjusting the content selection area according to an auxiliary selection instruction and the offset.
7. An electronic device comprising a processor, a memory and a program or instructions stored on the memory and executable on the processor, the program or instructions when executed by the processor implementing the steps of the content selection method of any one of claims 1 to 5.
8. A readable storage medium, on which a program or instructions are stored, which when executed by a processor implement the steps of the content selection method according to any one of claims 1 to 5.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202110297282.6A CN113010070B (en) | 2021-03-19 | 2021-03-19 | Content selection method and device, electronic equipment and readable storage medium |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202110297282.6A CN113010070B (en) | 2021-03-19 | 2021-03-19 | Content selection method and device, electronic equipment and readable storage medium |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN113010070A CN113010070A (en) | 2021-06-22 |
| CN113010070B true CN113010070B (en) | 2022-08-23 |
Family
ID=76403463
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202110297282.6A Active CN113010070B (en) | 2021-03-19 | 2021-03-19 | Content selection method and device, electronic equipment and readable storage medium |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN113010070B (en) |
Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN102331872A (en) * | 2011-05-30 | 2012-01-25 | 广州视睿电子科技有限公司 | Method and device for realizing mouse middle key effect on touch screen |
| CN105843511A (en) * | 2016-04-06 | 2016-08-10 | 上海斐讯数据通信技术有限公司 | Touch screen display content selection method and system |
| CN106886692A (en) * | 2017-03-23 | 2017-06-23 | 北京金山安全软件有限公司 | Application program using method and device and electronic equipment |
| CN108414193A (en) * | 2018-03-28 | 2018-08-17 | 京东方科技集团股份有限公司 | The detection zone localization method and device of display screen |
| CN108874260A (en) * | 2018-05-30 | 2018-11-23 | 维沃移动通信有限公司 | A kind of text handling method and terminal device |
Family Cites Families (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US9773020B2 (en) * | 2001-07-05 | 2017-09-26 | NEXRF Corp. | System and method for map based exploration |
-
2021
- 2021-03-19 CN CN202110297282.6A patent/CN113010070B/en active Active
Patent Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN102331872A (en) * | 2011-05-30 | 2012-01-25 | 广州视睿电子科技有限公司 | Method and device for realizing mouse middle key effect on touch screen |
| CN105843511A (en) * | 2016-04-06 | 2016-08-10 | 上海斐讯数据通信技术有限公司 | Touch screen display content selection method and system |
| CN106886692A (en) * | 2017-03-23 | 2017-06-23 | 北京金山安全软件有限公司 | Application program using method and device and electronic equipment |
| CN108414193A (en) * | 2018-03-28 | 2018-08-17 | 京东方科技集团股份有限公司 | The detection zone localization method and device of display screen |
| CN108874260A (en) * | 2018-05-30 | 2018-11-23 | 维沃移动通信有限公司 | A kind of text handling method and terminal device |
Also Published As
| Publication number | Publication date |
|---|---|
| CN113010070A (en) | 2021-06-22 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN108762954B (en) | Object sharing method and mobile terminal | |
| CN110618969B (en) | Icon display method and electronic equipment | |
| CN108960120B (en) | Fingerprint identification processing method and electronic equipment | |
| CN107783747B (en) | Interface display processing method and mobile terminal | |
| CN108763540B (en) | File browsing method and terminal | |
| CN108475161A (en) | Display methods and terminal | |
| CN107608606A (en) | A kind of image display method, mobile terminal and computer-readable recording medium | |
| CN112698735B (en) | Information input method and device and electronic equipment | |
| CN109753202B (en) | Screen capturing method and mobile terminal | |
| CN110795189A (en) | Application starting method and electronic equipment | |
| CN109032380B (en) | Character input method and terminal | |
| CN110795002A (en) | Screenshot method and terminal equipment | |
| CN108509108B (en) | Application icon arrangement method and mobile terminal | |
| CN111273827B (en) | Text processing method and electronic equipment | |
| CN110333803B (en) | Multimedia object selection method and terminal equipment | |
| CN110941469A (en) | Application body-splitting creating method and terminal equipment thereof | |
| CN110888569A (en) | Content selection control method and electronic equipment | |
| CN107967086B (en) | Icon arrangement method and device for mobile terminal and mobile terminal | |
| CN111638831B (en) | Content fusion method and device and electronic equipment | |
| CN113010070B (en) | Content selection method and device, electronic equipment and readable storage medium | |
| CN110647506B (en) | Picture deleting method and terminal equipment | |
| CN109828710B (en) | Image processing method and mobile terminal | |
| CN109327605B (en) | Display control method and device and mobile terminal | |
| CN108958603B (en) | Operation mode control method and mobile terminal | |
| CN107741826B (en) | Browsing history information calling method and device and mobile terminal |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |