WO2020019683A1 - 一种输入方法、装置和电子设备 - Google Patents

一种输入方法、装置和电子设备 Download PDF

Info

Publication number
WO2020019683A1
WO2020019683A1 PCT/CN2019/071010 CN2019071010W WO2020019683A1 WO 2020019683 A1 WO2020019683 A1 WO 2020019683A1 CN 2019071010 W CN2019071010 W CN 2019071010W WO 2020019683 A1 WO2020019683 A1 WO 2020019683A1
Authority
WO
WIPO (PCT)
Prior art keywords
image
drawn
drawn image
information
electronic device
Prior art date
Application number
PCT/CN2019/071010
Other languages
English (en)
French (fr)
Inventor
韩秦
Original Assignee
北京搜狗科技发展有限公司
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 北京搜狗科技发展有限公司 filed Critical 北京搜狗科技发展有限公司
Publication of WO2020019683A1 publication Critical patent/WO2020019683A1/zh

Links

Images

Classifications

    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/02—Input arrangements using manually operated switches, e.g. using keyboards or dials
    • G06F3/023—Arrangements for converting discrete items of information into a coded form, e.g. arrangements for interpreting keyboard generated codes as alphanumeric codes, operand codes or instruction codes
    • G06F3/0233—Character input methods
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/02—Input arrangements using manually operated switches, e.g. using keyboards or dials
    • G06F3/023—Arrangements for converting discrete items of information into a coded form, e.g. arrangements for interpreting keyboard generated codes as alphanumeric codes, operand codes or instruction codes
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
    • G06F3/0484—Interaction techniques based on graphical user interfaces [GUI] for the control of specific functions or operations, e.g. selecting or manipulating an object, an image or a displayed text element, setting a parameter value or selecting a range
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
    • G06F3/0484—Interaction techniques based on graphical user interfaces [GUI] for the control of specific functions or operations, e.g. selecting or manipulating an object, an image or a displayed text element, setting a parameter value or selecting a range
    • G06F3/04845—Interaction techniques based on graphical user interfaces [GUI] for the control of specific functions or operations, e.g. selecting or manipulating an object, an image or a displayed text element, setting a parameter value or selecting a range for image manipulation, e.g. dragging, rotation, expansion or change of colour
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
    • G06F3/0487—Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser
    • G06F3/0488—Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser using a touch-screen or digitiser, e.g. input of commands through traced gestures
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
    • G06F3/0487—Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser
    • G06F3/0488—Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser using a touch-screen or digitiser, e.g. input of commands through traced gestures
    • G06F3/04883—Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser using a touch-screen or digitiser, e.g. input of commands through traced gestures for inputting data by handwriting, e.g. gesture or text
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T11/00—2D [Two Dimensional] image generation
    • G06T11/80—Creating or modifying a manually drawn or painted image using a manual input device, e.g. mouse, light pen, direction keys on keyboard

Definitions

  • the present invention relates to the technical field of input methods, and in particular, to an input method, device, and electronic device.
  • the functions of input methods are also increasing, including many personalized functions such as hand-drawn expressions, that is, users can hand-draw a pattern on the keyboard, and then output the hand-drawn pattern; but the user ’s hand-drawn level is uneven Inconsistent, sometimes the pattern drawn by the user cannot accurately express the user's intention, causing the user to repeatedly redraw, which is inefficient.
  • An embodiment of the present invention provides an input method to improve image input efficiency.
  • an embodiment of the present invention further provides an input device and an electronic device to ensure the implementation and application of the above method.
  • an embodiment of the present invention discloses an input method, which specifically includes: obtaining an input method of drawing trajectory information of a keyboard area thereof, and displaying a corresponding drawing image according to the drawing trajectory information; An associated image; displaying the associated image.
  • the identifying at least one associated image corresponding to the drawn image includes: using a recognition model to identify at least one associated image corresponding to the drawn image.
  • the using the recognition model to identify at least one associated image corresponding to the drawn image includes: inputting drawing trajectory information of the drawn image into the recognition model, and determining a plurality of reference images; according to the reference image, Determining at least one associated image corresponding to the drawn image.
  • determining at least one associated image corresponding to the drawn image according to the reference image includes: obtaining associated data, wherein the associated data includes: context information and / or user behavior data; according to the Associated data, at least one associated image corresponding to the drawn image is selected from the reference image.
  • determining at least one associated image corresponding to the drawn image according to the reference image includes: ranking each reference image according to similarity information corresponding to each reference image; and selecting a top image with the highest similarity information.
  • N reference images are used as related images, where N is an integer greater than 0.
  • the method further includes: receiving an editing operation for the drawn image, and editing the drawn image to obtain a corresponding edited image.
  • the step of identifying at least one associated image corresponding to the drawn image further includes: determining the edited image as an associated image corresponding to the drawn image.
  • An embodiment of the present invention also discloses an input device, which specifically includes: an information acquisition module for acquiring a drawing trajectory information of a keyboard area of an input method, and displaying a corresponding drawing image according to the drawing trajectory information; Identifying at least one associated image corresponding to the drawn image; an image display module, configured to display the associated image.
  • the image recognition module is configured to use a recognition model to identify at least one associated image corresponding to the drawn image.
  • the image recognition module includes: an information calculation module for inputting drawing trajectory information of the drawn image into a recognition model to determine a plurality of reference images; and a first image determination module for using the reference An image, and determine at least one associated image corresponding to the drawn image.
  • the first image determination module is specifically configured to obtain associated data, where the associated data includes: context information and / or user behavior data; and selecting the selected image from the reference image according to the associated data.
  • the at least one associated image corresponding to the drawing image is described.
  • the first image determination module is specifically configured to sort the reference images according to the similarity information corresponding to each reference image; select the first N reference images with the highest similarity information as the associated images, where N Is an integer greater than 0.
  • the apparatus further includes: an editing module, configured to receive an editing operation for the drawn image, and edit the drawn image to obtain a corresponding edited image.
  • an editing module configured to receive an editing operation for the drawn image, and edit the drawn image to obtain a corresponding edited image.
  • the image recognition module includes: a second image determination module, configured to determine the edited image as an associated image corresponding to the drawn image.
  • An embodiment of the present invention also discloses a readable storage medium, which is characterized in that when an instruction in the storage medium is executed by a processor of an electronic device, the electronic device is capable of executing the device according to any one of the embodiments of the present invention Input method.
  • An embodiment of the present invention also discloses an electronic device including a memory and one or more programs, wherein the one or more programs are stored in the memory and configured to be executed by one or more processors.
  • one or more programs include instructions for: input method to obtain the drawing trajectory information of its keyboard area, and display the corresponding drawing image according to the drawing trajectory information; identify at least one associated image corresponding to the drawing image; The associated image is described.
  • the identifying at least one associated image corresponding to the drawn image includes: using a recognition model to identify at least one associated image corresponding to the drawn image.
  • the using the recognition model to identify at least one associated image corresponding to the drawn image includes: inputting drawing trajectory information of the drawn image into the recognition model, and determining a plurality of reference images; according to the reference image, Determining at least one associated image corresponding to the drawn image.
  • determining at least one associated image corresponding to the drawn image according to the reference image includes: obtaining associated data, wherein the associated data includes: context information and / or user behavior data; according to the Associated data, at least one associated image corresponding to the drawn image is selected from the reference image.
  • determining at least one associated image corresponding to the drawn image according to the reference image includes: ranking each reference image according to similarity information corresponding to each reference image; and selecting a top image with the highest similarity information.
  • N reference images are used as related images, where N is an integer greater than 0.
  • the method before identifying at least one associated image corresponding to the drawn image, the method further includes an instruction for performing the following operations: receiving an editing operation for the drawn image, and editing the drawn image to obtain a corresponding Edit the image.
  • the step of identifying at least one associated image corresponding to the drawn image further includes an instruction for performing the following operation: determining the edited image as an associated image corresponding to the drawn image.
  • the input method of the embodiment of the present invention can obtain the drawing trajectory information of its keyboard area, display the corresponding drawn image according to the drawing trajectory information, and then identify at least one associated image corresponding to the drawn image and display the associated image for the user to select ; Further, when the user is not satisfied with drawing the image, an image corresponding to the intention can be selected for input from the associated image of the drawing image without redrawing, which improves the input efficiency of the image.
  • FIG. 1 is a flowchart of steps in an input method embodiment of the present invention
  • FIG. 2 is a schematic diagram showing a drawing area of an input method keyboard area according to an embodiment of the present invention
  • FIG. 3 is a schematic diagram of an associated image display interface according to an embodiment of the present invention.
  • FIG. 4 is a schematic diagram of an associated image and drawing image display interface according to an embodiment of the present invention.
  • FIG. 6 is a schematic diagram of a drawing image display interface according to an embodiment of the present invention.
  • FIG. 8 is a schematic diagram of an editing interface for drawing an image according to an embodiment of the present invention.
  • FIG. 9 is a structural block diagram of an input device embodiment of the present invention.
  • FIG. 10 is a structural block diagram of an alternative embodiment of an input device according to the present invention.
  • Fig. 11 is a structural block diagram of an electronic device for input according to an exemplary embodiment
  • Fig. 12 is a schematic structural diagram of an electronic device for input according to another exemplary embodiment of the present invention.
  • One of the core concepts of the embodiments of the present invention is that after the input method determines a drawn image drawn by a user, the associated image corresponding to the drawn image can be identified, and then the associated image is displayed; further, the user is provided with an association that may satisfy his intention.
  • An image so that when a user is not satisfied with drawing an image, he can select an image that matches his intention from the displayed related images without redrawing, which improves the input efficiency of the image.
  • FIG. 1 there is shown a flowchart of steps of an input method embodiment of the present invention, which may specifically include the following steps:
  • Step 102 The input method obtains the drawing trajectory information of the keyboard area, and displays the corresponding drawing image according to the drawing trajectory information.
  • the input method may provide a function of hand-drawn patterns, so that a user may input a pattern drawn by drawing in a keyboard region of the input method; wherein, during a process of drawing by a user in the keyboard region, input
  • the keyboard area of the method can receive the user's drawing operation, and then record the drawing trajectory information corresponding to the drawing operation, such as the coordinates of each pixel point corresponding to the drawing operation.
  • the input method can display the trajectory drawn by the user in real time. Therefore, after acquiring the drawing trajectory information, the input method can draw a corresponding trajectory in the keyboard area according to the drawing trajectory information to obtain a drawn image.
  • the pixels corresponding to the coordinates of each pixel are connected in order to display the corresponding drawn image.
  • the drawing image displayed by the input method on the keyboard area is continuously updated, that is, after the input method receives the user's drawing operation, it can draw a new trajectory on the basis of the original drawing image to obtain a new drawing image.
  • the image drawn by the input method on its keyboard area is the pattern drawn by the user.
  • Step 104 Identify at least one associated image corresponding to the drawn image.
  • Step 106 Display the associated image.
  • one or more associated images corresponding to the drawn image may be identified; for example, features of the drawn image may be extracted, and then the corresponding associated image may be determined according to the extracted features.
  • the associated image may be an image having similar characteristics to the drawn image. For example, the user draws a puppy.
  • the associated image may be a picture of various dogs, or the limb motion or facial expression of the puppy drawn with the user. And other similar pictures of animals; of course, the associated image may also be a modified drawn image.
  • an image related to the currently drawn trajectory is continuously identified based on the currently drawn trajectory.
  • the image related to the currently drawn trajectory may include multiple types, such as an image predicted by the user based on the currently drawn trajectory, for example, the user wants to draw a sheep, and after drawing the head of the sheep ,
  • the input method can give a drawn image of the sheep; or an associated image of the image that the user wants to draw, for example, after predicting that the user wants to draw the drawn image of the sheep, determine the associated image of the sheep such as pictures of various types of sheep such as "Xiao "En sheep", "pleasant sheep” and other pictures; for example, to identify related images related to the drawn trajectory, for example, to identify related images based on the trajectory of the sheep's head, such as expression packs of various sheep's heads.
  • the related image where the area used to display the related image can be referred to as the related display area, which can be set according to requirements, such as the candidate area of the input method, or the image display provided by the application.
  • the present invention does not limit this.
  • the user when the user is dissatisfied with drawing an image, he can select an image that matches the intent from the displayed related images, which can reduce the number of times the user draws an image that meets the intent for input, and improves the efficiency of image input.
  • FIG. 3 it is an example of displaying an associated image of the present invention, wherein the drawn image corresponding to the associated image is the drawn image in FIG. 2.
  • the embodiment of the present invention can also display a drawing image, wherein the area where the drawing image is displayed may be referred to as a drawing display area, and the drawing display area may be associated with the display.
  • the areas are the same or different.
  • FIG. 4 it is an example of displaying related images and drawn images according to the present invention.
  • the drawn display area is different from the associated display area, 1 is a drawn image, and 2 is a related image.
  • the input method of the embodiment of the present invention can obtain the drawing trajectory information of its keyboard area, display the corresponding drawn image according to the drawing trajectory information, and then identify at least one associated image corresponding to the drawn image and display the associated image, so as to For users to choose; further, when the user is not satisfied with drawing the image, they can select an image that matches the intention from the associated image of the drawing image for input without redrawing, which improves the input efficiency of the image.
  • a recognition model may be used for recognition processing to determine at least one associated image corresponding to the drawn image, as follows:
  • FIG. 5 a flowchart of steps of an alternative embodiment of an input method according to the present invention is shown, which may specifically include the following steps:
  • Step 502 The input method obtains the drawing trajectory information of the keyboard area, and displays the corresponding drawing image according to the drawing trajectory information.
  • the input method when a user draws a pattern in the keyboard area of the input method, the input method can obtain corresponding drawing trajectory information, and according to the drawing trajectory information, the corresponding drawing image is displayed in real time in the keyboard area.
  • predictions or associations of images that the user has drawn can be continuously predicted, and the images that the user wants to draw based on the currently drawn trajectory are predicted and associated with the associated images, or The associated image of the track; after the user finishes drawing, the user's final drawn image can be determined, and then the associated image corresponding to the drawn image is identified according to the final drawn image.
  • the input method may actively perform an operation of identifying at least one associated image corresponding to the drawn image, or may perform an operation of identifying at least one associated image corresponding to the drawn image according to a search operation of a user. Therefore, after the input method determines the final drawn image, one way is to eliminate the need to display the drawn image in the drawn display area, but directly associate with the drawn image to determine at least one associated image corresponding to the drawn image; another One way is to display the drawn image in a drawn display area such as a candidate area, and then the user can perform a search operation on the drawn image, such as clicking the search button 3 in FIG. 6. After the input method receives the search operation, it can query the Draw at least one associated image corresponding to the image.
  • a recognition model can be used to identify at least one associated image corresponding to the drawn image.
  • the recognition model can be identified in multiple ways. One of the recognition methods can be based on Recognition of the drawing trajectory information of the drawn image can be specifically performed through steps 504 and 508; another recognition method can be based on the drawing image for recognizing, specifically through steps 506 and 508.
  • Step 504 Input the drawing trajectory information of the drawing image into a recognition model, and determine a plurality of reference images.
  • the drawing trajectory information of the drawn image may be input into the recognition model, and then the drawing trajectory information Match with the trajectory feature points of each reference image, and calculate the similarity information of the drawn trajectory information and each reference image.
  • the reference image may be a local image or a network image.
  • the reference image may be a history drawing image of the user or a history drawing image of another user, which is not limited in the present invention.
  • a plurality of reference images are selected from all the reference images, for example, the first few reference images with high similarity are selected; and then the associated image is determined according to the reference images, that is, step 508 is performed.
  • Step 506 Input the drawn image into an image model, and determine a plurality of reference images.
  • the drawing image may be input into an image model, and the drawing image is matched with each reference image.
  • the similarity information of the drawn image and each reference image is calculated separately.
  • a plurality of reference images are selected from the reference images according to the similarity information, and then determined based on the reference images, that is, step 508 is performed.
  • Step 508 Determine at least one associated image corresponding to the drawn image according to the reference image.
  • sub-step 82- Substep 84 implements:
  • Sub-step 82 Sort each reference image according to the similarity information corresponding to each reference image.
  • Sub-step 84 Select the first N reference images with the highest similarity information as related images, where N is an integer greater than 0.
  • the similarity information may be directly proportional to the similarity, that is, the larger the similarity information is, the larger the similarity is, and vice versa; therefore, each reference image may be descended according to the similarity information corresponding to each reference image. Sort, and then select the top N reference images with the highest similarity information as related images, where N is an integer greater than 0; and then select the top N reference images that are most similar to the drawn image.
  • the similarity information may also be inversely proportional to the similarity. Then, according to the similarity information corresponding to each reference image, the reference images may be sorted in ascending order, and then the first N reference images with the lowest similarity information are selected as the association. image. Therefore, one or more associated images corresponding to the drawn image can be identified through the recognition model.
  • association data may include context information and / or user behavior data, where the context information may be used to reflect a user's drawing intention, and the user behavior data may be a user Reflect user habits; among them, it can be realized by sub-step 92-sub-step 94:
  • Sub-step 92 Acquire association data, where the association data includes context information and / or user behavior data.
  • the context information may include local information and / or peer information;
  • the user behavior data may be behavior data of the user or behavior data of all users on the entire network.
  • Sub-step 94 Select at least one related image corresponding to the drawn image from the reference image according to the related data.
  • the reference image includes sheep in multiple cartoons, sketch sheep, and Picasso-style sheep.
  • the obtained context information is "You give I draw a Picasso-style sheep ", you can identify Picasso-style sheep as the associated image.
  • the reference image includes pictures of a mouse in the cartoon "Black Sheriff", a mouse in "Cat and Mouse”, a mouse in "Ninja Turtle” and a mouse in real life.
  • the contextual information is "I think the mouse in the cartoon is super cute", then the mice in the cartoons "Black Cat Sheriff", “Cat and Mouse” and “Ninja Turtle” can be determined as the related information.
  • the embodiment of the present invention may also determine an associated image based on user behavior data.
  • the reference image includes the middle smiling face of four expression packs of A, B, C, and D, and the user selects the A expression pack according to the user behavior data.
  • the frequency of Chinese pictures is much higher than the frequency of selecting pictures in other emoticons, so the smiling faces in A emoticons can be used as associated images.
  • the embodiment of the present invention may also determine the associated image by combining context information and user behavior data.
  • Step 510 Display the associated image.
  • Step 512 Receive a screen-up operation, and screen-up or send an associated image corresponding to the screen-up operation.
  • the related image may be displayed; for example, the related image may be displayed according to similarity information corresponding to each related image, such as similarity information. High related images are displayed before related images with low similarity information.
  • the associated display area and the drawing display area are the same, the drawn image can be used as the first candidate for the first screen, and the associated image can be used as the other candidate for the first screen.
  • the specific options can be set according to requirements, and the invention does not limit this. .
  • the user can perform a screen-on operation on the related image.
  • the related image can be displayed on the corresponding screen.
  • Edit box you can also send the associated image.
  • the user may also perform an on-screen operation on the drawn image.
  • the associated image corresponding to the drawn image can be identified, and the associated image can be displayed, and then when the user is not satisfied with the drawn image, a suitable image can be selected from the associated image. Images without redrawing, improving the efficiency of image input.
  • a recognition model may be used to identify the associated image corresponding to the drawn image.
  • One way to identify the associated image is to input the drawing trajectory information of the drawn image into the recognition model and calculate them separately.
  • the similarity information of the drawing trajectory information and each reference image determines at least one associated image corresponding to the drawn image according to each reference image and corresponding similarity information; further, the accuracy of the associated image recognition can be improved, and the displayed Associated images can better meet user intent, not only further improve the efficiency of image input, but also improve the user experience.
  • the reference images are sorted according to the similarity information corresponding to each reference image, and similarity is selected.
  • the top N reference images with the highest degree of information are used as related images; that is, the selected related images with high similarity are drawn to further improve the user experience.
  • the user may not be satisfied with some parts of the drawn pattern, such as the color of the line, the size of a part, the arc of a line segment, etc .; therefore, the input method can provide
  • the editing function enables users to perform editing operations on the drawn image to modify the drawn image, thereby eliminating the need to redraw and further improving the input efficiency of the pattern.
  • FIG. 7 a flowchart of steps in an optional embodiment of an input method according to the present invention is shown, which may specifically include the following steps:
  • Step 702 The input method obtains the drawing trajectory information of the keyboard area, and displays the corresponding drawing image according to the drawing trajectory information.
  • This step is similar to the above step 502, and is not repeated here.
  • the input method may also provide an editing function for a drawn image, so that when a user is not satisfied with the drawn image, the drawn image may be modified by editing the drawn image. Therefore, after the input method determines the user's final drawn image, the drawn image can be displayed in the drawn display area, such as the candidate area, so that the user can edit the drawn image.
  • Step 704 Receive an editing operation for the drawn image, and edit the drawn image to obtain a corresponding edited image.
  • the user when the user determines that the drawn image needs to be edited, the user may first perform an operation of displaying the corresponding editing interface for the drawn image, such as clicking the edit button 4 in FIG. 6; after the input method receives the operation, it may
  • the editing interface corresponding to the drawn image is shown in FIG. 8, which is an example of the editing interface corresponding to the drawn image, and the drawn image is the drawn image in FIG. 2.
  • the user can perform editing operations in the editing interface.
  • the editing operations include multiple operations, such as erasing operations, line drawing operations, color filling, and so on.
  • the input method receives the user's editing operations, and can then perform operations corresponding to the editing operations. Edit information, edit the drawn image, and then obtain an edited image. Therefore, the user can modify the drawn pattern by editing the drawn image without redrawing, further improving the input efficiency of the image.
  • Step 706 Determine the edited image as an associated image corresponding to the drawn image.
  • Step 708 Display the associated image.
  • Step 710 Receive an on-screen operation, and perform an on-screen operation or send an associated image corresponding to the on-screen operation.
  • the edited image may be determined as an associated image and then displayed; further, the user may perform an on-screen operation on the edited image, and the input method may use the The editing image is displayed on the screen, or the editing image is sent; of course, the associated image can also be saved.
  • the associated display area and the drawing display area may be the same. Therefore, when the drawing display area displays the image, the edited image and the drawn image may be displayed at the same time, and of course, the edited image may be used to replace the drawing. Image, that is, only the edited image is displayed in the drawing display area.
  • the edited image may also be directly displayed on the screen or sent, and may be specifically set according to requirements, which is not limited in the embodiment of the present invention.
  • the input method determines to draw the image, on the one hand, it can determine the edited image based on the user's edit operation, and determine the edited image as the associated image, and on the other hand, it can be based on the user's search operation (Or associating) identifying the associated image corresponding to the drawn image; further, the associated image corresponding to the drawn image may include an edited image and an image identified according to a search operation (or association).
  • the associated image of the edited image may also be identified.
  • the edited image may be directly associated and the associated image corresponding to the edited image may be identified.
  • the associated image corresponding to the edited image may be identified according to a user's search operation for the edited image.
  • the associated image of the edited image may then be displayed, and of course, the edited image may also be displayed; the invention does not limit this.
  • the input method obtains the drawing trajectory information of the keyboard area
  • the corresponding drawing image can be displayed according to the drawing trajectory information, and then the drawing image can be processed according to the editing operation for the drawing image.
  • the edited image is edited, and the edited image is determined as an associated image and displayed; further, the user can edit the drawn image.
  • the edited drawn image can be generated to meet the intended purpose. Image without redrawing, which further improves the input efficiency of the image.
  • an information acquisition module 902 may specifically include the following modules: an information acquisition module 902, an image recognition module 904, and an image display module 906, where:
  • An information acquisition module 902 is configured to use an input method to obtain drawing trajectory information of a keyboard area thereof, and display a corresponding drawing image according to the drawing trajectory information;
  • An image recognition module 904 configured to identify at least one associated image corresponding to the drawn image
  • An image display module 906 is configured to display the associated image.
  • the apparatus further includes: an editing module 908, configured to receive an editing operation for the drawn image, and edit the drawn image to obtain a corresponding edited image.
  • the image recognition module 904 is configured to use a recognition model to identify at least one associated image corresponding to the drawn image.
  • the image recognition module 904 includes an information calculation module 9042, a first image determination module 9044, and a second image determination module 9046.
  • An information calculation module 9042 configured to input drawing trajectory information of the drawn image into a recognition model, and determine multiple reference images;
  • a first image determination module 9044 is configured to determine at least one associated image corresponding to the drawn image according to the reference image.
  • a second image determination module 9048 is configured to determine the edited image as an associated image corresponding to the drawn image.
  • the first image determining module 9044 is configured to sort each reference image according to the similarity information corresponding to each reference image; select the first N reference images with the highest similarity information as the associated images, where N is greater than An integer of 0.
  • the first image determining module 9044 is specifically configured to obtain associated data, where the associated data includes: context information and / or user behavior data; and based on the associated data, selecting the drawn image from the reference image Corresponding at least one associated image.
  • the input method of the embodiment of the present invention can obtain the drawing trajectory information of its keyboard area, display the corresponding drawn image according to the drawing trajectory information, and then identify at least one associated image corresponding to the drawn image and display the associated image for the user to select ; Further, when the user is not satisfied with drawing the image, an image corresponding to the intention can be selected for input from the associated image of the drawing image without redrawing, which improves the input efficiency of the image.
  • the description is relatively simple.
  • the related parts refer to the description of the method embodiment.
  • Fig. 11 is a structural block diagram of an electronic device 1100 for inputting according to an exemplary embodiment.
  • the electronic device 1100 may be a mobile phone, a computer, a digital broadcasting terminal, a messaging device, a game console, a tablet device, a medical device, a fitness device, a personal digital assistant, and the like.
  • the electronic device 1100 may include one or more of the following components: a processing component 1102, a memory 1104, a power component 1106, a multimedia component 1108, an audio component 1110, an input / output (I / O) interface 1112, and a sensor component 1114 , And communication component 1116.
  • the processing component 1102 generally controls overall operations of the electronic device 1100, such as operations associated with display, telephone calls, data communications, camera operations, and recording operations.
  • the processing element 1102 may include one or more processors 1120 to execute instructions to complete all or part of the steps of the method described above.
  • the processing component 1102 may include one or more modules to facilitate interaction between the processing component 1102 and other components.
  • the processing component 1102 may include a multimedia module to facilitate the interaction between the multimedia component 1108 and the processing component 1102.
  • the memory 1104 is configured to store various types of data to support operation at the device 1100. Examples of such data include instructions for any application or method for operating on the electronic device 1100, contact data, phone book data, messages, pictures, videos, and the like.
  • the memory 1104 may be implemented by any type of volatile or non-volatile storage device or a combination thereof, such as static random access memory (SRAM), electrically erasable programmable read-only memory (EEPROM), Programming read-only memory (EPROM), programmable read-only memory (PROM), read-only memory (ROM), magnetic memory, flash memory, magnetic disk or optical disk.
  • SRAM static random access memory
  • EEPROM electrically erasable programmable read-only memory
  • EPROM Programming read-only memory
  • PROM programmable read-only memory
  • ROM read-only memory
  • magnetic memory flash memory
  • flash memory magnetic disk or optical disk.
  • the power component 1106 provides power to various components of the electronic device 1100.
  • the power component 1106 may include a power management system, one or more power sources, and other components associated with generating, managing, and distributing power for the electronic device 1100.
  • the multimedia component 1108 includes a screen that provides an output interface between the electronic device 1100 and a user.
  • the screen may include a liquid crystal display (LCD) and a touch panel (TP). If the screen includes a touch panel, the screen may be implemented as a touch screen to receive an input signal from a user.
  • the touch panel includes one or more touch sensors to sense touch, swipe, and gestures on the touch panel. The touch sensor may not only sense a boundary of a touch or slide action, but also detect duration and pressure related to the touch or slide operation.
  • the multimedia component 1108 includes a front camera and / or a rear camera. When the electronic device 1100 is in an operation mode, such as a shooting mode or a video mode, the front camera and / or the rear camera can receive external multimedia data. Each front camera and rear camera can be a fixed optical lens system or have focal length and optical zoom capabilities.
  • the audio component 1110 is configured to output and / or input audio signals.
  • the audio component 1110 includes a microphone (MIC).
  • the microphone is configured to receive an external audio signal.
  • the received audio signal may be further stored in the memory 1104 or transmitted via the communication component 1116.
  • the audio component 1110 further includes a speaker for outputting audio signals.
  • the I / O interface 1112 provides an interface between the processing component 1102 and a peripheral interface module.
  • the peripheral interface module may be a keyboard, a click wheel, a button, or the like. These buttons may include, but are not limited to: a home button, a volume button, a start button, and a lock button.
  • the sensor component 1114 includes one or more sensors for providing various aspects of the electronic device 1100 with a state assessment.
  • the sensor component 1114 can detect the on / off state of the device 1100 and the relative positioning of the components.
  • the component is the display and keypad of the electronic device 1100.
  • the sensor component 1114 can also detect the electronic device 1100 or a component of the electronic device 1100 The position of the electronic device 1100 changes, the presence or absence of the user's contact with the electronic device 1100, the orientation or acceleration / deceleration of the electronic device 1100, and the temperature change of the electronic device 1100.
  • the sensor assembly 1114 may include a proximity sensor configured to detect the presence of nearby objects without any physical contact.
  • the sensor component 1114 may also include a light sensor, such as a CMOS or CCD image sensor, for use in imaging applications.
  • the sensor component 1114 may further include an acceleration sensor, a gyroscope sensor, a magnetic sensor, a pressure sensor, or a temperature sensor.
  • the communication component 1116 is configured to facilitate wired or wireless communication between the electronic device 1100 and other devices.
  • the electronic device 1100 can access a wireless network based on a communication standard, such as WiFi, 2G or 3G, or a combination thereof.
  • the communication section 1114 receives a broadcast signal or broadcast-related information from an external broadcast management system via a broadcast channel.
  • the communication component 1114 further includes a near field communication (NFC) module to facilitate short-range communication.
  • the NFC module can be implemented based on radio frequency identification (RFID) technology, infrared data association (IrDA) technology, ultra wideband (UWB) technology, Bluetooth (BT) technology, and other technologies.
  • RFID radio frequency identification
  • IrDA infrared data association
  • UWB ultra wideband
  • Bluetooth Bluetooth
  • the electronic device 1100 may be implemented by one or more application specific integrated circuits (ASICs), digital signal processors (DSPs), digital signal processing devices (DSPDs), programmable logic devices (PLDs), Implementation of a programming gate array (FPGA), controller, microcontroller, microprocessor, or other electronic component to perform the above method.
  • ASICs application specific integrated circuits
  • DSPs digital signal processors
  • DSPDs digital signal processing devices
  • PLDs programmable logic devices
  • FPGA programming gate array
  • controller microcontroller, microprocessor, or other electronic component to perform the above method.
  • a non-transitory computer-readable storage medium including instructions such as a memory 1104 including instructions, may be provided.
  • the instructions may be executed by the processor 1120 of the electronic device 1100 to complete the foregoing method.
  • the non-transitory computer-readable storage medium may be a ROM, a random access memory (RAM), a CD-ROM, a magnetic tape, a floppy disk, an optical data storage device, and the like.
  • a non-transitory computer-readable storage medium when an instruction in the storage medium is executed by a processor of an electronic device, enables the electronic device to execute an input method, the method includes: the input method obtains Drawing trajectory information, displaying a corresponding drawing image according to the drawing trajectory information; identifying at least one associated image corresponding to the drawing image; and displaying the associated image.
  • the identifying at least one associated image corresponding to the drawn image includes: using a recognition model to identify at least one associated image corresponding to the drawn image.
  • the using the recognition model to identify at least one associated image corresponding to the drawn image includes: inputting drawing trajectory information of the drawn image into the recognition model, and determining a plurality of reference images; according to the reference image, Determining at least one associated image corresponding to the drawn image.
  • determining at least one associated image corresponding to the drawn image according to the reference image includes: obtaining associated data, wherein the associated data includes: context information and / or user behavior data; according to the Associated data, at least one associated image corresponding to the drawn image is selected from the reference image.
  • determining at least one associated image corresponding to the drawn image according to the reference image includes: ranking each reference image according to similarity information corresponding to each reference image; and selecting a top image with the highest similarity information.
  • N reference images are used as related images, where N is an integer greater than 0.
  • the method further includes: receiving an editing operation for the drawn image, and editing the drawn image to obtain a corresponding edited image.
  • the step of identifying at least one associated image corresponding to the drawn image further includes: determining the edited image as an associated image corresponding to the drawn image.
  • Fig. 12 is a schematic structural diagram of an electronic device 1200 for input according to another exemplary embodiment of the present invention.
  • the electronic device 1200 may be a server, and the server may have a large difference due to different configurations or performance, and may include one or more central processing units (CPUs) 1222 (for example, one or more processors) And a memory 1232, one or more storage media 1230 (eg, one or more storage devices) storing application programs 1242 or data 1244.
  • the memory 1232 and the storage medium 1230 may be temporary storage or persistent storage.
  • the program stored in the storage medium 1230 may include one or more modules (not shown in the figure), and each module may include a series of instruction operations on the server.
  • the central processing unit 1222 may be configured to communicate with the storage medium 1230 and execute a series of instruction operations in the storage medium 1230 on the server.
  • the server may also include one or more power sources 1226, one or more wired or wireless network interfaces 1250, one or more input-output interfaces 1258, one or more keyboards 1256, and / or, one or more operating systems 1241, For example, Windows ServerTM, Mac OSXTM, UnixTM, LinuxTM, FreeBSDTM and so on.
  • An electronic device includes a memory and one or more programs, one or more programs stored in the memory, and configured to be executed by one or more processors.
  • the one or more programs include Instructions for performing the following operations: the input method obtains the drawing trajectory information of its keyboard area, and displays the corresponding drawn image according to the drawing trajectory information; identifies at least one associated image corresponding to the drawn image; and displays the associated image.
  • the identifying at least one associated image corresponding to the drawn image includes: using a recognition model to identify at least one associated image corresponding to the drawn image.
  • the using the recognition model to identify at least one associated image corresponding to the drawn image includes: inputting drawing trajectory information of the drawn image into the recognition model, and determining a plurality of reference images; according to the reference image, Determining at least one associated image corresponding to the drawn image.
  • determining at least one associated image corresponding to the drawn image according to the reference image includes: obtaining associated data, wherein the associated data includes: context information and / or user behavior data; according to the Associated data, at least one associated image corresponding to the drawn image is selected from the reference image.
  • determining at least one associated image corresponding to the drawn image according to the reference image includes: ranking each reference image according to similarity information corresponding to each reference image; and selecting a top image with the highest similarity information.
  • N reference images are used as related images, where N is an integer greater than 0.
  • the method before identifying at least one associated image corresponding to the drawn image, the method further includes an instruction for performing the following operations: receiving an editing operation for the drawn image, and editing the drawn image to obtain a corresponding Edit the image.
  • the step of identifying at least one associated image corresponding to the drawn image further includes an instruction for performing the following operation: determining the edited image as an associated image corresponding to the drawn image.
  • Embodiments of the present invention are described with reference to flowcharts and / or block diagrams of methods, terminal devices (systems), and computer program products according to embodiments of the present invention. It should be understood that each process and / or block in the flowcharts and / or block diagrams, and combinations of processes and / or blocks in the flowcharts and / or block diagrams can be implemented by computer program instructions.
  • These computer program instructions may be provided to a processor of a general purpose computer, special purpose computer, embedded processor, or other programmable data processing terminal device to produce a machine, such that the instructions executed by the processor of the computer or other programmable data processing terminal device Means are generated for implementing the functions specified in one or more of the flowcharts and / or one or more of the block diagrams.
  • These computer program instructions may also be stored in a computer-readable memory capable of directing a computer or other programmable data processing terminal device to work in a specific manner, such that the instructions stored in the computer-readable memory produce a manufactured article including the instruction means, the The instruction device implements the functions specified in one or more flowcharts and / or one or more blocks of the block diagram.
  • These computer program instructions can also be loaded onto a computer or other programmable data processing terminal device, so that a series of operating steps can be performed on the computer or other programmable terminal device to produce a computer-implemented process, so that the computer or other programmable terminal device can
  • the instructions executed on the steps provide steps for implementing the functions specified in one or more of the flowcharts and / or one or more of the block diagrams.

Landscapes

  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • General Engineering & Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Human Computer Interaction (AREA)
  • User Interface Of Digital Computer (AREA)

Abstract

一种输入方法、装置和电子设备，其中，所述方法包括：输入法获取其键盘区域的绘制轨迹信息，依据所述绘制轨迹信息展示对应的绘制图像（102）；识别所述绘制图像对应的至少一个关联图像（104）；展示所述关联图像（106）；进而当用户不满意绘制图像时，可以从绘制图像的关联图像中选取符合意图的图像进行输入，而无需重新绘制，提高了图像的输入效率。

Description

一种输入方法、装置和电子设备
本申请要求在中国申请的申请号为201810828947.X、申请日为2018年7月25日发明名称为“一种输入方法、装置和电子设备”的发明专利申请的全部优先权。
技术领域
本发明涉及输入法技术领域，特别是涉及一种输入方法、装置和电子设备。
背景技术
随着计算机技术的发展，诸如手机、平板电脑等电子设备越来越普及，给人们的生活、学习、工作带来了极大的便利。这些电子设备通常安装有输入法应用程序(简称输入法)，使得用户可使用该输入法进行信息输入。
随着使用输入法用户的不断增加，输入法的功能也越来越多，其中包括很多个性化功能如手绘表情，即用户可以在键盘中手绘图案，然后输出该手绘图案；但用户手绘水平参差不齐，可能有时候用户绘制的图案不能准确的表达用户的意图，使得用户需要反复重新绘制，效率低。
发明内容
本发明实施例提供一种输入方法，以提高图像的输入效率。
相应的，本发明实施例还提供了一种输入装置和一种电子设备，用以保证上述方法的实现及应用。
为了解决上述问题，本发明实施例公开了一种输入方法，具体包括：输入法获取其键盘区域的绘制轨迹信息，依据所述绘制轨迹信息展示对应的绘制图像；识别所述绘制图像对应的至少一个关联图像；展示所述关联图像。
可选地，所述识别所述绘制图像对应的至少一个关联图像，包括：采用识别模型识别所述绘制图像对应的至少一个关联图像。
可选地，所述采用识别模型识别所述绘制图像对应的至少一个关联图像，包括：将所述绘制图像的绘制轨迹信息输入至识别模型中，确定多个参考图像；依据所述参考图像，确定所述绘制图像对应的至少一个关联图像。
可选地，所述依据所述参考图像，确定所述绘制图像对应的至少一个关联图像，包括：获取关联数据，其中，所述关联数据包括：上下文信息和/或用户行为数据；依据所述关联数据，从所述参考图像中选取所述绘制图像对应的至少一个关联图像。
可选地，所述依据所述参考图像，确定所述绘制图像对应的至少一个关联图像，包括：依据各参考图像对应的相似度信息，对各参考图像进行排序；选取相似度信息最高的前N个参考图像作为关联图像，其中，N是大于0的整数。
可选地，在所述识别所述绘制图像对应的至少一个关联图像之前，所述方法还包括：接收针对所述绘制图像的编辑操作，对所述绘制图像进行编辑得到对应的编辑图 像。
可选地，所述识别所述绘制图像对应的至少一个关联图像的步骤，还包括：将所述编辑图像确定为所述绘制图像对应的关联图像。
本发明实施例还公开了一种输入装置，具体包括：信息获取模块，用于输入法获取其键盘区域的绘制轨迹信息，依据所述绘制轨迹信息展示对应的绘制图像；图像识别模块，用于识别所述绘制图像对应的至少一个关联图像；图像展示模块，用于展示所述关联图像。
可选地，所述图像识别模块，用于采用识别模型识别所述绘制图像对应的至少一个关联图像。
可选地，所述图像识别模块包括：信息计算模块，用于将所述绘制图像的绘制轨迹信息输入至识别模型中，确定多个参考图像；第一图像确定模块，用于依据所述参考图像，确定所述绘制图像对应的至少一个关联图像。
可选地，所述第一图像确定模块，具体用于获取关联数据，其中，所述关联数据包括：上下文信息和/或用户行为数据；依据所述关联数据，从所述参考图像中选取所述绘制图像对应的至少一个关联图像。
可选地，所述第一图像确定模块，具体用于依据各参考图像对应的相似度信息，对各参考图像进行排序；选取相似度信息最高的前N个参考图像作为关联图像，其中，N是大于0的整数。
可选地，所述装置还包括：编辑模块，用于接收针对所述绘制图像的编辑操作，对所述绘制图像进行编辑得到对应的编辑图像。
可选地，所述图像识别模块包括：第二图像确定模块，用于将所述编辑图像确定为所述绘制图像对应的关联图像。
本发明实施例还公开了一种可读存储介质，其特征在于，当所述存储介质中的指令由电子设备的处理器执行时，使得电子设备能够执行如本发明实施例任一所述的输入方法。
本发明实施例还公开了一种电子设备，包括有存储器，以及一个或者一个以上的程序，其中一个或者一个以上程序存储于存储器中，且经配置以由一个或者一个以上处理器执行所述一个或者一个以上程序包含用于进行以下操作的指令：输入法获取其键盘区域的绘制轨迹信息，依据所述绘制轨迹信息展示对应的绘制图像；识别所述绘制图像对应的至少一个关联图像；展示所述关联图像。
可选地，所述识别所述绘制图像对应的至少一个关联图像，包括：采用识别模型识别所述绘制图像对应的至少一个关联图像。
可选地，所述采用识别模型识别所述绘制图像对应的至少一个关联图像，包括：将所述绘制图像的绘制轨迹信息输入至识别模型中，确定多个参考图像；依据所述参考图像，确定所述绘制图像对应的至少一个关联图像。
可选地，所述依据所述参考图像，确定所述绘制图像对应的至少一个关联图像，包括：获取关联数据，其中，所述关联数据包括：上下文信息和/或用户行为数据；依据所述关联数据，从所述参考图像中选取所述绘制图像对应的至少一个关联图像。
可选地，所述依据所述参考图像，确定所述绘制图像对应的至少一个关联图像，包括：依据各参考图像对应的相似度信息，对各参考图像进行排序；选取相似度信息最高的前N个参考图像作为关联图像，其中，N是大于0的整数。
可选地，在所述识别所述绘制图像对应的至少一个关联图像之前，还包含用于进行以下操作的指令：接收针对所述绘制图像的编辑操作，对所述绘制图像进行编辑得到对应的编辑图像。
可选地，所述识别所述绘制图像对应的至少一个关联图像的步骤，还包含用于进行以下操作的指令：将所述编辑图像确定为所述绘制图像对应的关联图像。
本发明实施例包括以下优点：
本发明实施例的输入法可以获取其键盘区域的绘制轨迹信息，依据所述绘制轨迹信息展示对应的绘制图像，然后识别所述绘制图像对应的至少一个关联图像并展示关联图像，以供用户选择；进而当用户不满意绘制图像时，可以从绘制图像的关联图像中选取符合意图的图像进行输入，而无需重新绘制，提高了图像的输入效率。
附图说明
图1是本发明的一种输入方法实施例的步骤流程图；
图2是本发明实施例的一种输入法键盘区域展示绘制图像的示意图；
图3是本发明实施例的一种关联图像展示界面的示意图；
图4是本发明实施例的一种关联图像和绘制图像展示界面的示意图；
图5是本发明的一种输入方法可选实施例的步骤流程图；
图6是本发明实施例的一种绘制图像展示界面的示意图；
图7是本发明的一种输入方法可选实施例的步骤流程图；
图8是本发明实施例的一种绘制图像的编辑界面示意图；
图9是本发明的一种输入装置实施例的结构框图；
图10是本发明的一种输入装置可选实施例的结构框图；
图11根据一示例性实施例示出的一种用于输入的电子设备的结构框图；
图12是本发明根据另一示例性实施例示出的一种用于输入的电子设备的结构示意图。
具体实施方式
为使本发明的上述目的、特征和优点能够更加明显易懂，下面结合附图和具体实施方式对本发明作进一步详细的说明。
本发明实施例的核心构思之一是，输入法确定用户绘制的绘制图像后，可以识别所述绘制图像对应的关联图像，然后再展示所述关联图像；进而为用户提供可能满足其意图的关联图像，从而用户在不满意绘制图像时，可从展示的关联图像中选取符合其意图的图像，而无需重新绘制，提高了图像的输入效率。
参照图1，示出了本发明的一种输入方法实施例的步骤流程图，具体可以包括如下步骤：
步骤102、输入法获取其键盘区域的绘制轨迹信息，依据所述绘制轨迹信息展示对应的绘制图像。
本发明实施例中，所述输入法可提供手绘图案的功能，进而用户可通过在输入法的键盘区域进行绘制，输入其绘制的图案；其中，在用户在键盘区域进行绘制的过程中，输入法的键盘区域可接收到用户的绘制操作，然后记录所述绘制操作对应的绘制轨迹信息，如绘制操作对应的各像素点坐标。在用户执行绘制操作的过程中，输入法可实时的显示用户绘制的轨迹，因此输入法在获取绘制轨迹信息后，可以依据所述绘制轨迹信息，在键盘区域绘制对应的轨迹，得到绘制图像。例如按照记录的像素点坐标的顺序，依次连接各像素点坐标对应的像素点，进而实现展示对应的绘制图像。其中，在用户结束绘制之前，输入法在键盘区域展示的绘制图像是不断更新的，即输入法接收到用户绘制操作后，可在原有绘制图像的基础上绘制新的轨迹，得到新的绘制图像，直到用户结束绘制。如图2所示，输入法在其键盘区域的绘制图像即为用户绘制的图案。
步骤104、识别所述绘制图像对应的至少一个关联图像。
步骤106、展示所述关联图像。
本发明实施例在确定用户完成图像的绘制后，可识别所述绘制图像对应的一个或多个关联图像；例如可以提取绘制图像的特征，然后依据提取的特征，确定对应的关联图像。其中，所述关联图像可以是与绘制图像具有相似特征的图像，例如用户绘制了一只小狗，关联图像可以是各种狗的图片，也可以是与用户绘制小狗的肢体动作或面部表情等类似的其他动物的图片；当然所述关联图像也可以是修改后的绘制图像。当然本发明实施例也可以在用户绘制的过程中，不断的基于当前已绘制的轨迹，识别出与当前已绘制的轨迹相关的图像。其中，所述与当前已绘制的轨迹相关的图像可以包括多种，如基于当前已绘制的轨迹预测的用户想要绘制的图像，例如用户想画一只羊，当画出羊的头部后，输入法可以给出羊的绘制图像；又如用户想要绘制的图像的关联图像，例如预测用户想要绘制羊的绘制图像后，确定羊的关联图像如各种类型羊的图片如“肖恩羊”、“喜羊羊”等图片；还例如识别与已绘制的轨迹相关的关联图像，例如基于羊头部的轨迹识别关联图像如各种羊头部的表情包等。
然后对所述关联图像进行展示，其中，用于展示所述关联图像的区域可称为关联展示区域，具体可以按照需求设置，如可以是输入法的候选区，也可以是应用提供的图像展示区等，本发明对此不作限制。进而用户在不满意绘制图像时，可以从展示的关联图像中选取到符合意图的图像，从而能够减少用户为输入满足意图的图像的绘制次数，提高了图像输入效率。如图3所示，是本发明一个展示关联图像的示例，其中，所述关联图像对应的绘制图像是图2中的绘制图像。
很多用户为了增加聊天的趣味性，很可能选择绘制图像，因此本发明实施例还可以展示绘制图像，其中，可将展示绘制图像的区域称为绘制展示区域，所述绘制展示区域可以与关联展示区域相同，也可不同。如图4所示，是本发明一个展示关联图像和绘制图像的示例，其中，绘制展示区域和关联展示区域不同，1是绘制图像，2是关联图像。
综上，本发明实施例的输入法可以获取其键盘区域的绘制轨迹信息，依据所述绘制轨迹信息展示对应的绘制图像，然后识别所述绘制图像对应的至少一个关联图像并展示 关联图像，以供用户选择；进而当用户不满意绘制图像时，可以从绘制图像的关联图像中选取符合意图的图像进行输入，而无需重新绘制，提高了图像的输入效率。
本发明另一个实施例中，可采用识别模型进行识别处理，确定所述绘制图像对应的至少一个关联图像，具体如下：
参照图5，示出了本发明的一种输入方法可选实施例的步骤流程图，具体可以包括如下步骤：
步骤502、输入法获取其键盘区域的绘制轨迹信息，依据所述绘制轨迹信息展示对应的绘制图像。
本发明实施例中，用户在输入法的键盘区域绘制图案的过程中，输入法可以获取对应的绘制轨迹信息，并依据所述绘制轨迹信息，在键盘区域实时的展示对应的绘制图像。本发明实施例可以在用户绘制过程中，不断的对用户已绘制的图像进行预测或联想，基于当前已绘制的轨迹预测的用户想要绘制的图像并联想其关联图像，或者，联想当前已绘制的轨迹的关联图像；也可以在用户结束绘制后，再确定用户最终的绘制图像，然后依据最终的绘制图像识别该绘制图像对应的关联图像。本发明实施例中，输入法可主动执行识别所述绘制图像对应的至少一个关联图像的操作，也可以依据用户的搜索操作执行所述识别所述绘制图像对应的至少一个关联图像的操作。因此输入法在确定最终的绘制图像后，一种方式是，可无需将该绘制图像在绘制展示区域展示，而是直接依据该绘制图像进行联想，确定该绘制图像对应的至少一个关联图像；另一种方式是可在绘制展示区域如候选区域展示该绘制图像，进而用户可针对该绘制图像执行搜索操作，如点击图6中的搜索按钮3，输入法接收到搜索操作后，可查询所述绘制图像对应的至少一个关联图像。
其中，在联想或查询的过程中，均可以采用识别模型识别所述绘制图像对应的至少一个关联图像；其中，所述识别模型识别的方式包括多种，其中，一种识别方式可以是，依据所述绘制图像的绘制轨迹信息进行识别，具体可通过步骤504和步骤508实现；另一种识别方式可以是，依据所述绘制图像进行识别，具体可通过步骤506和步骤508实现。
步骤504、将所述绘制图像的绘制轨迹信息输入至识别模型中，确定多个参考图像。
本发明实施例中，若所述识别模型是依据所述绘制图像对应的绘制轨迹信息进行识别的，则可将所述绘制图像的绘制轨迹信息输入至识别模型中，然后将所述绘制轨迹信息与各参考图像的轨迹特征点进行匹配，计算所述绘制轨迹信息与各参考图像的相似度信息。其中，所述参考图像可以是本地图像，也可以是网络图像，当然还可以是该用户历史绘制图像或其他用户的历史绘制图像，本发明对此不作限制。然后依据所述相似度信息，从全部参考图像中选取出其中多个参考图像，例如选取相似度高的前几个参考图像；再依据所述参考图像确定关联图像，即执行步骤508。
步骤506、将所述绘制图像输入至图像模型中，确定多个参考图像。
本发明实施例中，若所述识别模型是依据所述绘制图像对应的绘制轨迹进行识别的，则可将所述绘制图像输入至图像模型中，将所述绘制图像与各参考图像进行匹配， 分别计算所述绘制图像与各参考图像的相似度信息。然后依据所述相似度信息，从参考图像中选取多个参考图像，再依据所述参考图像确定，即执行步骤508。
步骤508、依据所述参考图像，确定所述绘制图像对应的至少一个关联图像。
本发明实施例中，确定所述绘制图像对应的至少一个关联图像的方式包括多种，其中，一种方式是依据各参考图像与绘制图像的相似度确定关联图像，其中，可由子步骤82-子步骤84实现：
子步骤82、依据各参考图像对应的相似度信息，对各参考图像进行排序。
子步骤84、选取相似度信息最高的前N个参考图像作为关联图像，其中，N是大于0的整数。
本发明实施例中，所述相似度信息可以是与相似度成正比，即相似度信息越大，相似度越大，反之；因此可依据各参考图像对应的相似信息，对各参考图像进行降序排序，然后选取相似度信息最高的前N个参考图像作为关联图像，其中，N是大于0的整数；进而可以选取出与绘制图像最相似的前N个参考图像。当然，所述相似度信息也可以与相似度成反比，则可依据各参考图像对应的相似度信息，对各参考图像进行升序排序，然后再选取相似度信息最低的前N个参考图像作为关联图像。因此通过识别模型可以识别出所述绘制图像对应的一个或多个关联图像。
另一种方式是依据关联数据确定关联图像，其中，所述关联数据可以包括上下文信息和/或用户行为数据，其中，所述上下文信息可以用于体现用户绘制意图，所述用户行为数据可用户体现用户习惯；其中，可由子步骤92-子步骤94实现：
子步骤92、获取关联数据，所述关联数据包括上下文信息和/或用户行为数据。若当前处于聊天应用中，所述上下文信息可以包括本端信息和/或对端信息；所述用户行为数据可以是该用户的行为数据，也可以是全网所有用户的行为数据。
子步骤94、依据所述关联数据，从所述参考图像中选取所述绘制图像对应的至少一个关联图像。
本发明实施例中，可以依据上下文信息确定至少一个关联图像，本发明的一个示例中，参考图像包括多个动画片中的羊、素描羊和毕加索风格的羊，获取的上下文信息是“你给我画个毕加索风格的羊”，则可以将毕加索风格的羊确定为关联图像。本发明的另一示例中，参考图像包括动画片《黑猫警长》中的老鼠、《猫与老鼠》中的老鼠、《忍者神龟》中的老鼠和现实生活中老鼠的图片，获取的上下文信息是“我觉得动画片中老鼠超级可爱”，则可以将动画片《黑猫警长》、《猫和老鼠》和《忍者神龟》中的老鼠，均确定为关联信息。本发明实施例也可以依据用户行为数据确定关联图像，本发明的又一个示例中，参考图像包括A、B、C、D四个表情包的中笑脸，根据用户行为数据确定用户选择A表情包中图片的频次，远高于选择其他表情包中图片的频次，则可以将A表情包中笑脸作为关联图像。当然本发明实施例还可以结合上下文信息和用户行为数据，来确定关联图像。
步骤510、展示所述关联图像。
步骤512、接收上屏操作，上屏或发送所述上屏操作对应的关联图像。
本发明实施例中，在识别出所述绘制图像的关联图像后，可对所述关联图像进行展 示；例如，可按照各关联图像对应的相似度信息，对关联图像进行展示，如相似度信息高的关联图像排在相似度信息低的关联图像之前展示。又例如，若关联展示区域和绘制展示区域相同，可将绘制图像作为首屏的第一个候选项，将关联图像作为首屏的其他候选项，具体可按照需求设置，本发明对此不作限制。
然后用户在确定需要输入至编辑框，或者，想要发送的关联图像后，可针对该关联图像执行上屏操作，输入法接收到所述上屏操作后，可将该关联图像上屏至对应的编辑框，也可发送该关联图像。当然，若显示了绘制图像，用户也可针对所述绘制图像执行上屏操作。
本发明实施例中，输入法在确定绘制图像后，可以识别所述绘制图像对应的关联图像，并展示所述关联图像，进而在用户不满意绘制图像时，可以从关联图像中选取符合意图的图像，而无需重新绘制，提高了图像的输入效率。
其次，本发明实施例中，可采用识别模型识别所述绘制图像对应的关联图像；其中，一种识别关联图像的方式是，将所述绘制图像的绘制轨迹信息输入至识别模型中，分别计算所述绘制轨迹信息与各参考图像的相似度信息，依据各参考图像和对应的相似度信息，确定所述绘制图像对应的至少一个关联图像；进而能提高关联图像识别的准确率，使得展示的关联图像能够更好的满足用户意图，不仅进一步提高了图像输入效率，还提高了用户体验。
进一步，本发明实施例在依据各参考图像和对应的相似度信息，确定所述绘制图像对应的至少一个关联图像时，依据各参考图像对应的相似度信息，对各参考图像进行排序，选取相似度信息最高的前N个参考图像作为关联图像；即选取出于绘制图像相似度高的关联图像，进一步提高了用户体验。
本发明另一个实施例中，用户可能对其绘制的图案的某些部分不是很满意，例如线条的颜色，某个部分的大小，某条线段额度弧度等等；因此输入法可提供绘制图像的编辑功能，进而用户可对绘制图像执行编辑操作，以实现对绘制图像的修改，从而无需重新绘制，进一步提高了图案的输入效率。
参照图7、示出了本发明的一种输入方法可选实施例的步骤流程图，具体可以包括如下步骤：
步骤702、输入法获取其键盘区域的绘制轨迹信息，依据所述绘制轨迹信息展示对应的绘制图像。
该步骤与上述步骤502类似，在此不再赘述。
本发明实施例中，输入法还可以提供对绘制图像的编辑功能，便于用户对其绘制图像不满意时，可以通过对绘制图像的编辑，修改绘制图像。因此输入法在确定用户最终的绘制图像后，可在绘制展示区域如候选区显示所述绘制图像，以便于用户对所述绘制图像进行编辑。
步骤704、接收针对所述绘制图像的编辑操作，对所述绘制图像进行编辑得到对应的编辑图像。
本发明实施例中，用户确定需要对绘制图像进行编辑时，可以先针对所述绘制图像执行展示对应编辑界面的操作，如点击图6中的编辑按钮4；输入法接收到该操作后， 可展示所述绘制图像对应的编辑界面，如图8所示，是绘制图像对应编辑界面的一个示例，其绘制图像是图2中的绘制图像。进而用户可在编辑界面中执行编辑操作，所述编辑操作包括多种，如擦除操作、线条绘制操作、颜色填充等等，输入法接收用户的编辑操作，然后可依据所述编辑操作对应的编辑信息，对所述绘制图像进行编辑，进而得到编辑图像。从而用户可以通过对绘制图像的编辑，修改已绘制的图案，而无需重新绘制，进一步提高了图像的输入效率。
步骤706、将所述编辑图像确定为所述绘制图像对应的关联图像。
步骤708、展示所述关联图像。
步骤710、接收上屏操作，上屏或发送所述上屏操作对应的关联图像。
本发明实施例中，输入法在确定用户完成对绘制图像的编辑后，可将编辑图像确定为关联图像，然后对其进行展示；进而用户可以针对编辑图像执行上屏操作，输入法可将所述编辑图像上屏，或者发送所述编辑图像；当然还可以保存关联图像。
本发明一个可选的实施例中，所述关联展示区域和绘制展示区域可以是相同的，因此在绘制展示区域展示图像时，可同时展示编辑图像和绘制图像，当然也可以采用编辑图像替换绘制图像，即在绘制展示区域只展示编辑图像。当然，本发明实施例中，在将所述编辑图像确定为关联图像后，也可直接将所述编辑图像上屏或发送，具体可按照需求设置，本发明实施例对此不作限制。
当然，本发明的一个可选实施例中，输入法在确定绘制图像后，一方面可依据用户的编辑操作确定编辑图像，并将编辑图像确定为关联图像，另一方面可以依据用户的搜索操作(或联想)识别所述绘制图形对应的关联图像；进而使得绘制图像对应的关联图像可包括编辑图像和依据搜索操作(或联想)识别出的图像。
此外，本发明的一个可选实施例中，输入法在确定编辑图像后，还可以识别编辑图像的关联图像，如可直接对所述编辑图像进行联想，识别所述编辑图像对应的关联图像，也可以在关联展示区域展示所述编辑图像后，依据用户针对编辑图像的搜索操作，识别所述编辑图像对应的关联图像。然后可对所述编辑图像的关联图像进行展示，当然也可以展示编辑图像；本发明对此不作限制。
综上，本发明实施例中，输入法在获取键盘区域的绘制轨迹信息，可依据所述绘制轨迹信息展示对应的绘制图像，然后可依据针对所述绘制图像的编辑操作，对所述绘制图像进行编辑的到编辑图像，再将所述编辑图像确定为关联图像并展示；进而用户可以对绘制图像进行编辑，在用户不满意绘图图像时，可通过对将绘制图像的编辑生成能够满足意图的图像，而无需重新绘制，从而进一步提高了图像的输入效率。
需要说明的是，对于方法实施例，为了简单描述，故将其都表述为一系列的动作组合，但是本领域技术人员应该知悉，本发明实施例并不受所描述的动作顺序的限制，因为依据本发明实施例，某些步骤可以采用其他顺序或者同时进行。其次，本领域技术人员也应该知悉，说明书中所描述的实施例均属于优选实施例，所涉及的动作并不一定是本发明实施例所必须的。
参照图9，示出了本发明的一种输入装置实施例的结构框图，具体可以包括如下模块：信息获取模块902、图像识别模块904和图像展示模块906，其中，
信息获取模块902，用于输入法获取其键盘区域的绘制轨迹信息，依据所述绘制轨迹信息展示对应的绘制图像；
图像识别模块904，用于识别所述绘制图像对应的至少一个关联图像；
图像展示模块906，用于展示所述关联图像。
参照图10，示出了本发明的一种输入装置可选实施例的结构框图。本发明一个可选的实施例中，所述装置还包括：编辑模块908，用于接收针对所述绘制图像的编辑操作，对所述绘制图像进行编辑得到对应的编辑图像。
本发明一个可选的实施例中，所述图像识别模块904，用于采用识别模型识别所述绘制图像对应的至少一个关联图像。
本发明一个可选的实施例中，所述图像识别模块904包括：信息计算模块9042、第一图像确定模块9044和第二图像确定模块9046，其中，
信息计算模块9042，用于将所述绘制图像的绘制轨迹信息输入至识别模型中，确定多个参考图像；
第一图像确定模块9044，用于依据所述参考图像，确定所述绘制图像对应的至少一个关联图像。
第二图像确定模块9048，用于将所述编辑图像确定为所述绘制图像对应的关联图像。
其中，所述第一图像确定模块9044，用于依据各参考图像对应的相似度信息，对各参考图像进行排序；选取相似度信息最高的前N个参考图像作为关联图像，其中，N是大于0的整数。
所述第一图像确定模块9044，具体用于获取关联数据，其中，所述关联数据包括：上下文信息和/或用户行为数据；依据所述关联数据，从所述参考图像中选取所述绘制图像对应的至少一个关联图像。
本发明实施例的输入法可以获取其键盘区域的绘制轨迹信息，依据所述绘制轨迹信息展示对应的绘制图像，然后识别所述绘制图像对应的至少一个关联图像并展示关联图像，以供用户选择；进而当用户不满意绘制图像时，可以从绘制图像的关联图像中选取符合意图的图像进行输入，而无需重新绘制，提高了图像的输入效率。
对于装置实施例而言，由于其与方法实施例基本相似，所以描述的比较简单，相关之处参见方法实施例的部分说明即可。
图11是根据一示例性实施例示出的一种用于输入的电子设备1100的结构框图。例如，电子设备1100可以是移动电话，计算机，数字广播终端，消息收发设备，游戏控制台，平板设备，医疗设备，健身设备，个人数字助理等。
参照图11，电子设备1100可以包括以下一个或多个组件：处理组件1102，存储器1104，电力组件1106，多媒体组件1108，音频组件1110，输入/输出(I/O)的接口1112，传感器组件1114，以及通信组件1116。
处理组件1102通常控制电子设备1100的整体操作，诸如与显示，电话呼叫，数据通信，相机操作和记录操作相关联的操作。处理元件1102可以包括一个或多个处理器1120来执行指令，以完成上述的方法的全部或部分步骤。此外，处理组件1102可以包 括一个或多个模块，便于处理组件1102和其他组件之间的交互。例如，处理部件1102可以包括多媒体模块，以方便多媒体组件1108和处理组件1102之间的交互。
存储器1104被配置为存储各种类型的数据以支持在设备1100的操作。这些数据的示例包括用于在电子设备1100上操作的任何应用程序或方法的指令，联系人数据，电话簿数据，消息，图片，视频等。存储器1104可以由任何类型的易失性或非易失性存储设备或者它们的组合实现，如静态随机存取存储器(SRAM)，电可擦除可编程只读存储器(EEPROM)，可擦除可编程只读存储器(EPROM)，可编程只读存储器(PROM)，只读存储器(ROM)，磁存储器，快闪存储器，磁盘或光盘。
电力组件1106为电子设备1100的各种组件提供电力。电力组件1106可以包括电源管理***，一个或多个电源，及其他与为电子设备1100生成、管理和分配电力相关联的组件。
多媒体组件1108包括在所述电子设备1100和用户之间的提供一个输出接口的屏幕。在一些实施例中，屏幕可以包括液晶显示器(LCD)和触摸面板(TP)。如果屏幕包括触摸面板，屏幕可以被实现为触摸屏，以接收来自用户的输入信号。触摸面板包括一个或多个触摸传感器以感测触摸、滑动和触摸面板上的手势。所述触摸传感器可以不仅感测触摸或滑动动作的边界，而且还检测与所述触摸或滑动操作相关的持续时间和压力。在一些实施例中，多媒体组件1108包括一个前置摄像头和/或后置摄像头。当电子设备1100处于操作模式，如拍摄模式或视频模式时，前置摄像头和/或后置摄像头可以接收外部的多媒体数据。每个前置摄像头和后置摄像头可以是一个固定的光学透镜***或具有焦距和光学变焦能力。
音频组件1110被配置为输出和/或输入音频信号。例如，音频组件1110包括一个麦克风(MIC)，当电子设备1100处于操作模式，如呼叫模式、记录模式和语音识别模式时，麦克风被配置为接收外部音频信号。所接收的音频信号可以被进一步存储在存储器1104或经由通信组件1116发送。在一些实施例中，音频组件1110还包括一个扬声器，用于输出音频信号。
I/O接口1112为处理组件1102和***接口模块之间提供接口，上述***接口模块可以是键盘，点击轮，按钮等。这些按钮可包括但不限于：主页按钮、音量按钮、启动按钮和锁定按钮。
传感器组件1114包括一个或多个传感器，用于为电子设备1100提供各个方面的状态评估。例如，传感器组件1114可以检测到设备1100的打开/关闭状态，组件的相对定位，例如所述组件为电子设备1100的显示器和小键盘，传感器组件1114还可以检测电子设备1100或电子设备1100一个组件的位置改变，用户与电子设备1100接触的存在或不存在，电子设备1100方位或加速/减速和电子设备1100的温度变化。传感器组件1114可以包括接近传感器，被配置用来在没有任何的物理接触时检测附近物体的存在。传感器组件1114还可以包括光传感器，如CMOS或CCD图像传感器，用于在成像应用中使用。在一些实施例中，该传感器组件1114还可以包括加速度传感器，陀螺仪传感器，磁传感器，压力传感器或温度传感器。
通信组件1116被配置为便于电子设备1100和其他设备之间有线或无线方式的通 信。电子设备1100可以接入基于通信标准的无线网络，如WiFi，2G或3G，或它们的组合。在一个示例性实施例中，通信部件1114经由广播信道接收来自外部广播管理***的广播信号或广播相关信息。在一个示例性实施例中，所述通信部件1114还包括近场通信(NFC)模块，以促进短程通信。例如，在NFC模块可基于射频识别(RFID)技术，红外数据协会(IrDA)技术，超宽带(UWB)技术，蓝牙(BT)技术和其他技术来实现。
在示例性实施例中，电子设备1100可以被一个或多个应用专用集成电路(ASIC)、数字信号处理器(DSP)、数字信号处理设备(DSPD)、可编程逻辑器件(PLD)、现场可编程门阵列(FPGA)、控制器、微控制器、微处理器或其他电子元件实现，用于执行上述方法。
在示例性实施例中，还提供了一种包括指令的非临时性计算机可读存储介质，例如包括指令的存储器1104，上述指令可由电子设备1100的处理器1120执行以完成上述方法。例如，所述非临时性计算机可读存储介质可以是ROM、随机存取存储器(RAM)、CD-ROM、磁带、软盘和光数据存储设备等。
一种非临时性计算机可读存储介质，当所述存储介质中的指令由电子设备的处理器执行时，使得电子设备能够执行一种输入方法，所述方法包括：输入法获取其键盘区域的绘制轨迹信息，依据所述绘制轨迹信息展示对应的绘制图像；识别所述绘制图像对应的至少一个关联图像；展示所述关联图像。
可选地，所述识别所述绘制图像对应的至少一个关联图像，包括：采用识别模型识别所述绘制图像对应的至少一个关联图像。
可选地，所述采用识别模型识别所述绘制图像对应的至少一个关联图像，包括：将所述绘制图像的绘制轨迹信息输入至识别模型中，确定多个参考图像；依据所述参考图像，确定所述绘制图像对应的至少一个关联图像。
可选地，所述依据所述参考图像，确定所述绘制图像对应的至少一个关联图像，包括：获取关联数据，其中，所述关联数据包括：上下文信息和/或用户行为数据；依据所述关联数据，从所述参考图像中选取所述绘制图像对应的至少一个关联图像。
可选地，所述依据所述参考图像，确定所述绘制图像对应的至少一个关联图像，包括：依据各参考图像对应的相似度信息，对各参考图像进行排序；选取相似度信息最高的前N个参考图像作为关联图像，其中，N是大于0的整数。
可选地，在所述识别所述绘制图像对应的至少一个关联图像之前，所述方法还包括：接收针对所述绘制图像的编辑操作，对所述绘制图像进行编辑得到对应的编辑图像。
可选地，所述识别所述绘制图像对应的至少一个关联图像的步骤，还包括：将所述编辑图像确定为所述绘制图像对应的关联图像。
图12是本发明根据另一示例性实施例示出的一种用于输入的电子设备1200的结构示意图。该电子设备1200可以是服务器，该服务器可因配置或性能不同而产生比较大的差异，可以包括一个或一个以***处理器(central processing units，CPU)1222(例如，一个或一个以上处理器)和存储器1232，一个或一个以上存储应用程序1242或数据1244的存储介质1230(例如一个或一个以上海量存储设备)。其中，存储器1232和存储介质 1230可以是短暂存储或持久存储。存储在存储介质1230的程序可以包括一个或一个以上模块(图示没标出)，每个模块可以包括对服务器中的一系列指令操作。更进一步地，中央处理器1222可以设置为与存储介质1230通信，在服务器上执行存储介质1230中的一系列指令操作。
服务器还可以包括一个或一个以上电源1226，一个或一个以上有线或无线网络接口1250，一个或一个以上输入输出接口1258，一个或一个以上键盘1256，和/或，一个或一个以上操作***1241，例如Windows ServerTM，Mac OS XTM，UnixTM,LinuxTM，FreeBSDTM等等。
一种电子设备，包括有存储器，以及一个或者一个以上的程序，其中一个或者一个以上程序存储于存储器中，且经配置以由一个或者一个以上处理器执行所述一个或者一个以上程序包含用于进行以下操作的指令：输入法获取其键盘区域的绘制轨迹信息，依据所述绘制轨迹信息展示对应的绘制图像；识别所述绘制图像对应的至少一个关联图像；展示所述关联图像。
可选地，所述识别所述绘制图像对应的至少一个关联图像，包括：采用识别模型识别所述绘制图像对应的至少一个关联图像。
可选地，所述采用识别模型识别所述绘制图像对应的至少一个关联图像，包括：将所述绘制图像的绘制轨迹信息输入至识别模型中，确定多个参考图像；依据所述参考图像，确定所述绘制图像对应的至少一个关联图像。
可选地，所述依据所述参考图像，确定所述绘制图像对应的至少一个关联图像，包括：获取关联数据，其中，所述关联数据包括：上下文信息和/或用户行为数据；依据所述关联数据，从所述参考图像中选取所述绘制图像对应的至少一个关联图像。
可选地，所述依据所述参考图像，确定所述绘制图像对应的至少一个关联图像，包括：依据各参考图像对应的相似度信息，对各参考图像进行排序；选取相似度信息最高的前N个参考图像作为关联图像，其中，N是大于0的整数。
可选地，在所述识别所述绘制图像对应的至少一个关联图像之前，还包含用于进行以下操作的指令：接收针对所述绘制图像的编辑操作，对所述绘制图像进行编辑得到对应的编辑图像。
可选地，所述识别所述绘制图像对应的至少一个关联图像的步骤，还包含用于进行以下操作的指令：将所述编辑图像确定为所述绘制图像对应的关联图像。
本说明书中的各个实施例均采用递进的方式描述，每个实施例重点说明的都是与其他实施例的不同之处，各个实施例之间相同相似的部分互相参见即可。
本发明实施例是参照根据本发明实施例的方法、终端设备(***)、和计算机程序产品的流程图和/或方框图来描述的。应理解可由计算机程序指令实现流程图和/或方框图中的每一流程和/或方框、以及流程图和/或方框图中的流程和/或方框的结合。可提供这些计算机程序指令到通用计算机、专用计算机、嵌入式处理机或其他可编程数据处理终端设备的处理器以产生一个机器，使得通过计算机或其他可编程数据处理终端设备的处理器执行的指令产生用于实现在流程图一个流程或多个流程和/或方框图一个方框或多个方框中指定的功能的装置。
这些计算机程序指令也可存储在能引导计算机或其他可编程数据处理终端设备以特定方式工作的计算机可读存储器中，使得存储在该计算机可读存储器中的指令产生包括指令装置的制造品，该指令装置实现在流程图一个流程或多个流程和/或方框图一个方框或多个方框中指定的功能。
这些计算机程序指令也可装载到计算机或其他可编程数据处理终端设备上，使得在计算机或其他可编程终端设备上执行一系列操作步骤以产生计算机实现的处理，从而在计算机或其他可编程终端设备上执行的指令提供用于实现在流程图一个流程或多个流程和/或方框图一个方框或多个方框中指定的功能的步骤。
尽管已描述了本发明实施例的优选实施例，但本领域内的技术人员一旦得知了基本创造性概念，则可对这些实施例做出另外的变更和修改。所以，所附权利要求意欲解释为包括优选实施例以及落入本发明实施例范围的所有变更和修改。
最后，还需要说明的是，在本文中，诸如第一和第二等之类的关系术语仅仅用来将一个实体或者操作与另一个实体或操作区分开来，而不一定要求或者暗示这些实体或操作之间存在任何这种实际的关系或者顺序。而且，术语“包括”、“包含”或者其任何其他变体意在涵盖非排他性的包含，从而使得包括一系列要素的过程、方法、物品或者终端设备不仅包括那些要素，而且还包括没有明确列出的其他要素，或者是还包括为这种过程、方法、物品或者终端设备所固有的要素。在没有更多限制的情况下，由语句“包括一个……”限定的要素，并不排除在包括所述要素的过程、方法、物品或者终端设备中还存在另外的相同要素。
以上对本发明所提供的一种输入方法、一种输入装置和一种电子设备，进行了详细介绍，本文中应用了具体个例对本发明的原理及实施方式进行了阐述，以上实施例的说明只是用于帮助理解本发明的方法及其核心思想；同时，对于本领域的一般技术人员，依据本发明的思想，在具体实施方式及应用范围上均会有改变之处，综上所述，本说明书内容不应理解为对本发明的限制。

Claims (22)

  1. 一种输入方法，其特征在于，包括：
    输入法获取其键盘区域的绘制轨迹信息，依据所述绘制轨迹信息展示对应的绘制图像；
    识别所述绘制图像对应的至少一个关联图像；
    展示所述关联图像。
  2. 根据权利要求1所述的方法，其特征在于，所述识别所述绘制图像对应的至少一个关联图像，包括：
    采用识别模型识别所述绘制图像对应的至少一个关联图像。
  3. 根据权利要求2所述的方法，其特征在于，所述采用识别模型识别所述绘制图像对应的至少一个关联图像，包括：
    将所述绘制图像的绘制轨迹信息输入至识别模型中，确定多个参考图像；
    依据所述参考图像，确定所述绘制图像对应的至少一个关联图像。
  4. 根据权利要求3所述的方法，其特征在于，所述依据所述参考图像，确定所述绘制图像对应的至少一个关联图像，包括：
    获取关联数据，其中，所述关联数据包括：上下文信息和/或用户行为数据；
    依据所述关联数据，从所述参考图像中选取所述绘制图像对应的至少一个关联图像。
  5. 根据权利要求3所述的方法，其特征在于，所述依据所述参考图像，确定所述绘制图像对应的至少一个关联图像，包括：
    依据各参考图像对应的相似度信息，对各参考图像进行排序；
    选取相似度信息最高的前N个参考图像作为关联图像，其中，N是大于0的整数。
  6. 根据权利要求2所述的方法，其特征在于，在所述识别所述绘制图像对应的至少一个关联图像之前，所述方法还包括：
    接收针对所述绘制图像的编辑操作，对所述绘制图像进行编辑得到对应的编辑图像。
  7. 根据权利要求6所述的方法，其特征在于，所述识别所述绘制图像对应的至少一个关联图像的步骤，还包括：
    将所述编辑图像确定为所述绘制图像对应的关联图像。
  8. 一种输入装置，其特征在于，包括：
    信息获取模块，用于输入法获取其键盘区域的绘制轨迹信息，依据所述绘制轨迹信息展示对应的绘制图像；
    图像识别模块，用于识别所述绘制图像对应的至少一个关联图像；
    图像展示模块，用于展示所述关联图像。
  9. 根据权利要求8所述的装置，其特征在于，
    所述图像识别模块，用于采用识别模型识别所述绘制图像对应的至少一个关联图像。
  10. 根据权利要求9所述的装置，其特征在于，所述图像识别模块包括：
    信息计算模块，用于将所述绘制图像的绘制轨迹信息输入至识别模型中，确定多个参考图像；
    第一图像确定模块，用于依据所述参考图像，确定所述绘制图像对应的至少一个关 联图像。
  11. 根据权利要求10所述的装置，其特征在于，
    所述第一图像确定模块，具体用于获取关联数据，其中，所述关联数据包括：上下文信息和/或用户行为数据；依据所述关联数据，从所述参考图像中选取所述绘制图像对应的至少一个关联图像。
  12. 根据权利要求10所述的装置，其特征在于，
    所述第一图像确定模块，具体用于依据各参考图像对应的相似度信息，对各参考图像进行排序；选取相似度信息最高的前N个参考图像作为关联图像，其中，N是大于0的整数。
  13. 根据权利要求9所述的装置，其特征在于，所述装置还包括：
    编辑模块，用于接收针对所述绘制图像的编辑操作，对所述绘制图像进行编辑得到对应的编辑图像。
  14. 根据权利要求13所述的装置，其特征在于，所述图像识别模块包括：
    第二图像确定模块，用于将所述编辑图像确定为所述绘制图像对应的关联图像。
  15. 一种可读存储介质，其特征在于，当所述存储介质中的指令由电子设备的处理器执行时，使得电子设备能够执行如方法权利要求1-7任一所述的输入方法。
  16. 一种电子设备，其特征在于，包括有存储器，以及一个或者一个以上的程序，其中一个或者一个以上程序存储于存储器中，且经配置以由一个或者一个以上处理器执行所述一个或者一个以上程序包含用于进行以下操作的指令：
    输入法获取其键盘区域的绘制轨迹信息，依据所述绘制轨迹信息展示对应的绘制图像；
    识别所述绘制图像对应的至少一个关联图像；
    展示所述关联图像。
  17. 根据权利要求16所述的电子设备，其特征在于，所述识别所述绘制图像对应的至少一个关联图像，包括：
    采用识别模型识别所述绘制图像对应的至少一个关联图像。
  18. 根据权利要求17所述的电子设备，其特征在于，所述采用识别模型识别所述绘制图像对应的至少一个关联图像，包括：
    将所述绘制图像的绘制轨迹信息输入至识别模型中，确定多个参考图像；
    依据所述参考图像，确定所述绘制图像对应的至少一个关联图像。
  19. 根据权利要求18所述的电子设备，其特征在于，所述依据所述参考图像，确定所述绘制图像对应的至少一个关联图像，包括：
    获取关联数据，其中，所述关联数据包括：上下文信息和/或用户行为数据；
    依据所述关联数据，从所述参考图像中选取所述绘制图像对应的至少一个关联图像。
  20. 根据权利要求18所述的电子设备，其特征在于，所述依据所述参考图像，确定所述绘制图像对应的至少一个关联图像，包括：
    依据各参考图像对应的相似度信息，对各参考图像进行排序；
    选取相似度信息最高的前N个参考图像作为关联图像，其中，N是大于0的整数。
  21. 根据权利要求17所述的电子设备，其特征在于，在所述识别所述绘制图像对应的至少一个关联图像之前，还包含用于进行以下操作的指令：
    接收针对所述绘制图像的编辑操作，对所述绘制图像进行编辑得到对应的编辑图像。
  22. 根据权利要求21所述的电子设备，其特征在于，所述识别所述绘制图像对应的至少一个关联图像的步骤，还包含用于进行以下操作的指令：
    将所述编辑图像确定为所述绘制图像对应的关联图像。
PCT/CN2019/071010 2018-07-25 2019-01-09 一种输入方法、装置和电子设备 WO2020019683A1 (zh)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
CN201810828947.XA CN110764627B (zh) 2018-07-25 2018-07-25 一种输入方法、装置和电子设备
CN201810828947.X 2018-07-25

Publications (1)

Publication Number Publication Date
WO2020019683A1 true WO2020019683A1 (zh) 2020-01-30

Family

ID=69180221

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2019/071010 WO2020019683A1 (zh) 2018-07-25 2019-01-09 一种输入方法、装置和电子设备

Country Status (2)

Country Link
CN (1) CN110764627B (zh)
WO (1) WO2020019683A1 (zh)

Families Citing this family (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN113535015A (zh) * 2020-04-17 2021-10-22 北京搜狗科技发展有限公司 一种信息推荐方法、装置和电子设备
CN111857913A (zh) * 2020-07-03 2020-10-30 Oppo广东移动通信有限公司 息屏图像生成方法、装置、电子设备和可读存储介质
CN112099645A (zh) * 2020-09-04 2020-12-18 北京百度网讯科技有限公司 一种输入图像的生成方法、装置、电子设备及存储介质
CN112269522A (zh) * 2020-10-27 2021-01-26 维沃移动通信（杭州）有限公司 图像处理方法、装置、电子设备和可读存储介质
CN115494966A (zh) * 2021-06-18 2022-12-20 北京搜狗科技发展有限公司 绘制处理方法、装置和机器可读介质

Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN105183316A (zh) * 2015-08-31 2015-12-23 百度在线网络技术（北京）有限公司 一种生成颜文字的方法和装置
CN105677059A (zh) * 2015-12-31 2016-06-15 广东小天才科技有限公司 一种表情图片输入方法及***
CN107122113A (zh) * 2017-03-31 2017-09-01 北京小米移动软件有限公司 生成图片的方法及装置
CN107209631A (zh) * 2015-01-09 2017-09-26 三星电子株式会社 用于显示图像的用户终端及其图像显示方法

Family Cites Families (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101789130A (zh) * 2009-12-24 2010-07-28 中兴通讯股份有限公司 终端设备使用自绘制图画的方法及装置
US9141200B2 (en) * 2012-08-01 2015-09-22 Apple Inc. Device, method, and graphical user interface for entering characters
CN104461099A (zh) * 2013-09-24 2015-03-25 邓桂成 一种手写简笔字输入方法和***
CN108287857B (zh) * 2017-02-13 2021-02-26 腾讯科技（深圳）有限公司 表情图片推荐方法及装置

Patent Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN107209631A (zh) * 2015-01-09 2017-09-26 三星电子株式会社 用于显示图像的用户终端及其图像显示方法
CN105183316A (zh) * 2015-08-31 2015-12-23 百度在线网络技术（北京）有限公司 一种生成颜文字的方法和装置
CN105677059A (zh) * 2015-12-31 2016-06-15 广东小天才科技有限公司 一种表情图片输入方法及***
CN107122113A (zh) * 2017-03-31 2017-09-01 北京小米移动软件有限公司 生成图片的方法及装置

Also Published As

Publication number Publication date
CN110764627B (zh) 2023-11-10
CN110764627A (zh) 2020-02-07

Similar Documents

Publication Publication Date Title
US10923118B2 (en) Speech recognition based audio input and editing method and terminal device
WO2020019683A1 (zh) 一种输入方法、装置和电子设备
WO2020134556A1 (zh) 图像风格迁移方法、装置、电子设备及存储介质
CN108038102B (zh) 表情图像的推荐方法、装置、终端及存储介质
WO2020019873A1 (zh) 图像处理方法、装置、终端及计算机可读存储介质
CN104133956B (zh) 处理图片的方法及装置
JP2017531330A (ja) ピクチャ処理方法および装置
WO2018157631A1 (zh) 多媒体资源处理方法及装置
CN106485567B (zh) 物品推荐方法及装置
CN104123339A (zh) 图像管理方法及装置
WO2016206295A1 (zh) 字符确定方法及装置
CN109670077A (zh) 视频推荐方法、装置和计算机可读存储介质
CN110244860B (zh) 一种输入方法、装置和电子设备
CN111046210A (zh) 一种信息推荐方法、装置和电子设备
CN104268151A (zh) 联系人分组方法及装置
WO2022111458A1 (zh) 图像拍摄方法和装置、电子设备及存储介质
WO2022134390A1 (zh) 标注方法及装置、电子设备和存储介质
CN106447747B (zh) 图像处理方法及装置
CN110096165A (zh) 一种联想方法、装置和电子设备
CN109145151B (zh) 一种视频的情感分类获取方法及装置
CN113870195A (zh) 目标贴图检测模型的训练、贴图检测方法及装置
TW201423453A (zh) 影像搜尋系統及方法
CN106534965A (zh) 获取视频信息的方法及装置
CN111273786A (zh) 智能输入方法及装置
CN111831132A (zh) 一种信息推荐方法、装置和电子设备

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 19841741

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 19841741

Country of ref document: EP

Kind code of ref document: A1