WO2014094614A1 - 信息处理方法和信息处理设备 - Google Patents
信息处理方法和信息处理设备 Download PDFInfo
- Publication number
- WO2014094614A1 WO2014094614A1 PCT/CN2013/089778 CN2013089778W WO2014094614A1 WO 2014094614 A1 WO2014094614 A1 WO 2014094614A1 CN 2013089778 W CN2013089778 W CN 2013089778W WO 2014094614 A1 WO2014094614 A1 WO 2014094614A1
- Authority
- WO
- WIPO (PCT)
- Prior art keywords
- information
- electronic device
- call
- processing object
- determining
- Prior art date
Links
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/017—Gesture based interaction, e.g. based on a set of recognized hand gestures
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N7/00—Television systems
- H04N7/14—Systems for two-way working
- H04N7/141—Systems for two-way working between two video terminals, e.g. videophone
- H04N7/147—Communication arrangements, e.g. identifying the communication as a video-communication, intermediate storage of the signals
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
- G06F3/0484—Interaction techniques based on graphical user interfaces [GUI] for the control of specific functions or operations, e.g. selecting or manipulating an object, an image or a displayed text element, setting a parameter value or selecting a range
- G06F3/04845—Interaction techniques based on graphical user interfaces [GUI] for the control of specific functions or operations, e.g. selecting or manipulating an object, an image or a displayed text element, setting a parameter value or selecting a range for image manipulation, e.g. dragging, rotation, expansion or change of colour
Definitions
- the present invention relates to the field of information processing, and more particularly, to an information processing method and an information processing apparatus. Background technique
- the present invention provides an information processing method and an information processing device, which can utilize call information generated during a call, for example, generate associated information suitable for a caller, thereby further enhancing the application value of the call, enriching User experience.
- an information processing method is provided, which is applied to a first electronic device, where the information processing method includes: during a process in which the first electronic device and the second electronic device make a call, Call information generated by the call, determining a processing object; acquiring association information associated with the processing object; and performing an operation based on the association information.
- And acquiring the association information associated with the processing object includes: sending the processing object to a remote server; and receiving association information from the remote server, where the association information is processed by the remote server Information obtained in association with the processing object obtained by the analysis.
- the acquiring the association information associated with the processing object includes: analyzing the processing object to determine the association information.
- the call information is information of a video screen
- the determining the processing object includes: detecting an input operation of the user; and determining a processing object from the video screen based on the input operation.
- the detecting an input operation of the user includes: detecting an input operation for selecting an area in the video screen; and determining the processing object includes: placing the video screen with the area The corresponding partial video picture is determined as the processing object.
- the detecting the input operation of the user includes: detecting a click operation for clicking on the video screen; and determining the processing object includes: the video based on a specific location in the video screen corresponding to the click operation
- the picture is subjected to image segmentation to obtain a partial video picture including the specific position; and the partial video picture is determined as a processing object.
- the detecting an input operation of the user includes: performing image recognition on the video screen to determine a plurality of candidate objects; detecting a user selecting operation of at least one of the plurality of candidate objects; and determining the processing
- the object includes: determining the selected at least one candidate object as the processing object based on the selection operation.
- the call information is information of a static picture
- the determining the processing object further includes: performing image recognition on the static picture to divide the static picture into a plurality of areas; and from the plurality of areas based on a predetermined criterion Determining the target area; and determining, according to the target area, the information that the call information is a dynamic picture, the determining the processing object further includes: identifying the dynamic picture to identify that the user is in the call a specific action made in the process; and determining the process object based on the particular action.
- the call information is information of audio
- the determining the processing object comprises: performing audio recognition on the audio to determine a processing object.
- the determining the processing object further includes: determining a plurality of candidate objects based on the call information; detecting a user selecting operation of at least one of the plurality of candidate objects; and selecting the selected one based on the selecting operation At least one candidate object is determined as the processing object.
- an information processing device which is applied to a first electronic device, where the information processing device includes: a determining unit, in a process in which the first electronic device and the second electronic device make a call Determining a processing object based on the call information generated by the call; acquiring unit, acquiring association information associated with the processing object; and executing unit, performing an operation based on the association information.
- the obtaining unit includes: a sending unit that sends the processing object to a remote server; and a receiving unit that receives related information from the remote server, where the related information is analyzed by the remote server by processing the processing object And the obtained information associated with the processing object.
- the obtaining unit includes: an analyzing unit, analyzing the processing object to determine the Associated information.
- the call information is information of a video screen
- the determining unit includes: a detecting unit that detects an input operation of the user; and a first processing object determining unit that determines a processing object from the video screen based on the input operation.
- the detecting unit is configured to detect an input operation for selecting an area in the video picture; and, the first processing object determining unit is configured to display a part of the video corresponding to the area The screen is determined to be the processing object.
- the detecting unit is configured to detect a click operation for clicking on the video screen; and the first processing object determining unit includes: an image dividing unit, based on a specific position in the video screen corresponding to the click operation, Performing image segmentation on the video picture to obtain a partial video picture including the specific position; and an object determining unit that determines the partial video picture as a processing object.
- the detecting unit includes: an identifying unit, performing image recognition on the video screen to determine a plurality of candidate objects; and selecting a detecting unit to detect a user selecting operation of at least one of the plurality of candidate objects; and
- the first processing object determining unit is configured to determine the selected at least one candidate object as the processing object based on the selecting operation.
- the determining unit further includes: a static picture identifying unit, performing image recognition on the still picture to divide the static picture into a plurality of areas; the target area determining unit, based on the predetermined a criterion of determining a target area from the plurality of areas; and a second processing object determining unit that determines the processing object based on the target area.
- the call information is information of a dynamic picture
- the determining unit further includes: a dynamic picture recognition unit, identifying the dynamic picture to identify a specific action made by the user during the call; and a third process
- the object determining unit determines, based on the specific action, the information that the processing is audio for the call information, and the determining unit comprises: an audio recognition unit that performs audio recognition on the audio to determine a processing object.
- the determining unit further includes: a candidate object determining unit, determining a plurality of candidate objects based on the call information; selecting a detecting unit, detecting a user selecting operation of at least one of the plurality of candidate objects; and fourth processing object a determining unit that determines the selected at least one candidate object as the processing object based on the selecting operation.
- an information processing method is provided, which is applied to a server.
- the information processing method includes: acquiring, during the conversation between the first electronic device and the second electronic device, the call information generated by the call from the first electronic device and/or the second electronic device; Calling information, determining a processing object; analyzing the processing object to acquire association information associated with the processing object; and performing an operation based on the association information.
- the call information is information of a video screen
- the determining the processing object includes: receiving input trajectory information sent by at least one of the first electronic device and the second electronic device, where the input trajectory information is The at least one of the first electronic device and the second electronic device is generated by detecting an input operation of the user; and determining a processing object based on the input trajectory information.
- the input trajectory information is obtained by detecting at least one of the first electronic device and the second electronic device by detecting an input operation for selecting an area in the video screen; Determining the processing object includes: determining a partial video picture corresponding to the area in the video picture as a processing object.
- the input trajectory information is obtained by detecting a click operation for clicking on the video screen by the at least one of the first electronic device and the second electronic device; and the determining processing object includes: Performing image segmentation on the video frame to obtain a partial video frame including the specific location based on a specific position in the video screen corresponding to the click operation; and determining the partial video image as a processing target.
- the information processing method further includes: performing image recognition on the video screen to determine a plurality of candidate objects; and transmitting the plurality of candidate objects to the at least the first electronic device and the second electronic device And the input trajectory information is obtained by the at least one of the first electronic device and the second electronic device by detecting a user selecting operation of at least one of the plurality of candidate objects
- the determining the processing object further includes: determining the selected at least one candidate object as the processing object based on the selecting operation.
- the call information is information of a video screen
- the determining processing object includes: performing image recognition on the video screen to divide the static picture into a plurality of regions; and from the plurality of regions based on a predetermined criterion Determining the target area; and determining, according to the target area, the information that the processing is the dynamic picture of the call information, the determining the processing object further comprising: performing the specific action; and determining, according to the specific action
- the processing object is audio information
- the determining the processing object comprises: performing audio recognition on the audio to determine a processing object.
- the determining the processing object further includes: determining a plurality of candidate objects based on the call information; transmitting the plurality of candidate objects to at least one of the first electronic device and the second electronic device; receiving the A user of the at least one of the first electronic device and the second electronic device is configured to select selection information of the at least one candidate object; and determine the selected at least one candidate object as the based based on the selection information The processing object.
- Object information of a plurality of objects is pre-stored in the server, and object information of each object is stored in association with attribute information for indicating an attribute of the object; and the acquisition is associated with the processing object
- the associated information includes: analyzing the processing object to determine an attribute of the processing object; determining, according to an attribute of the processing object, corresponding attribute information in the stored attribute information; and determining an attribute corresponding to the The object information associated with the information is determined as the associated information.
- an information processing device which is applied to a server, and the information processing device includes: a call information acquiring unit, in a process of a call between the first electronic device and the second electronic device, The first electronic device and/or the second electronic device acquires call information generated by the call; the determining unit determines a processing object based on the call information; and the associated information acquiring unit analyzes the processed object to Acquiring association information associated with the processing object; and an execution unit performing an operation based on the association information.
- the call information is information of a video screen
- the determining unit includes: a receiving unit, receiving input track information sent by at least one of the first electronic device and the second electronic device, where the input track information is The at least one of the first electronic device and the second electronic device is generated by detecting an input operation of a user; and the first processing object determining unit determines a processing object based on the input trajectory information.
- the input trajectory information is obtained by detecting at least one of the first electronic device and the second electronic device by detecting an input operation for selecting an area in the video screen;
- the first processing object determining unit is configured to determine a partial video picture corresponding to the area in the video picture as a processing object.
- the input trajectory information is obtained by detecting at least one of the first electronic device and the second electronic device by detecting a click operation for clicking on the video screen; and, the first processing object is determined
- the unit includes: an image segmentation unit, based on the view corresponding to the click operation a specific position in the frequency picture, image segmentation of the video picture to obtain a partial video picture including the specific position; and an object determining unit that determines the partial video picture as a processing object.
- the information processing device further includes: an identification unit that performs image recognition on the video screen to determine a plurality of candidate objects; and a transmitting unit that transmits the plurality of candidate objects to the first electronic device and the second electronic The at least one of the devices; and the input trajectory information is that the at least one of the first electronic device and the second electronic device detects at least one candidate of the plurality of candidate objects by detecting a user Obtained by the selection operation of the object; the first processing object determining unit is configured to determine the selected at least one candidate object as the processing object based on the selecting operation.
- the call information is information of a video screen
- the determining unit comprises: a static picture recognition unit that performs image recognition on the video picture to divide the static picture into multiple regions; a target area determining unit, based on the predetermined a criterion of determining a target area from the plurality of areas; and a second processing object determining unit that determines the processing object based on the target area.
- the call information is information of a dynamic picture
- the determining unit includes: a dynamic picture recognition unit that identifies the dynamic picture to identify a specificity made by an object in the dynamic picture during the call And a third processing object determining unit that determines the processing object based on the specific motion.
- the call information is audio information
- the determining unit comprises: an audio recognition unit that performs audio recognition on the audio to determine a processing object.
- the determining unit includes: a candidate object determining unit, determining a plurality of candidate objects based on the call information; and sending, by the sending unit, the plurality of candidate objects to the first electronic device and the second electronic device At least one; a receiving unit, a user receiving the at least one of the first electronic device and the second electronic device for selecting selection information of at least one candidate object; and a fourth processing object determining unit, based on the Selecting information, and determining the selected at least one candidate object as the processing object.
- Object information of a plurality of objects is pre-stored in the server, and object information of each object is stored in association with attribute information for indicating an attribute of the object; and the association information acquiring unit includes: attribute determination a unit, the processing object is analyzed to determine an attribute of the processing object; the attribute information determining unit determines, according to an attribute of the processing object, corresponding attribute information in the stored attribute information; and an object information determining unit, Corresponding genus The object information associated with the sex information is determined as the associated information.
- an information processing method is provided, which is applied to a first electronic device, where the information processing method includes: in a process of performing a multimedia call between the first electronic device and the second electronic device Determining a processing object based on the call information generated by the call; acquiring association information associated with the processing object; and performing an operation based on the association information.
- Acquiring the association information associated with the processing object includes: transmitting the processing object to a remote server; and receiving association information from the remote server, the association information being analyzed by the remote server by processing the processing object And the obtained information associated with the processing object.
- Obtaining the association information associated with the processing object includes: analyzing the processing object to determine the association information.
- Performing the operation based on the association information includes: generating a prompt icon for prompting the user to view, the prompt icon for linking to the associated information; and displaying the prompt icon.
- the call is an audio call
- performing the operation based on the associated information includes: detecting whether the first electronic device is connected to a display device; and when detecting that the first electronic device is connected to a display device, The association information is output to the display device, and the display device performs display based on the associated information.
- the call is a video call
- performing the operation based on the associated information includes: combining an image based on the associated information with an image of the video call to generate a combined image; and displaying the combined image.
- the performing the operation based on the association information includes at least one of: displaying the association information; storing the association information; and transmitting the association information to at least one of a remote server and the second electronic device.
- the information processing method further includes: determining whether the current time satisfies the first predetermined condition; and when determining that the current time satisfies the first predetermined condition, performing display based on the associated information.
- the information processing method further includes: determining, when the first electronic device performs network access, whether the network access satisfies a second predetermined condition; and when the network access satisfies a second predetermined In the case of a condition, display based on the associated information is performed.
- the information processing method further includes: detecting environment information of the first electronic device; determining whether the environment information satisfies a third predetermined condition; When the environmental information satisfies the third predetermined condition, display based on the related information is performed.
- Performing the display based on the associated information includes: displaying at least one of the associated information and a prompt icon, wherein the prompt icon is used to link to the associated information.
- an information processing device which is applied to a first electronic device, where the information processing device includes: a determining unit, where the first electronic device performs a multimedia call with the second electronic device And determining, according to the call information generated by the call, the processing object; the acquiring unit, acquiring the association information associated with the processing object; and the executing unit, performing the operation based on the association information.
- the obtaining unit includes: a sending unit that sends the processing object to a remote server; and a receiving unit that receives related information from the remote server, where the related information is analyzed by the remote server by processing the processing object And the obtained information associated with the processing object.
- the obtaining unit includes: an analyzing unit that analyzes the processing object to determine the related information.
- the execution unit includes: an icon generating unit that generates a prompt icon for prompting the user to view, the prompt icon is used to link to the associated information; and an icon display unit that displays the prompt icon.
- the call is an audio call
- the execution unit includes: a first detecting unit, detecting whether the first electronic device is connected to a display device; and an output unit, when detecting the first electronic device and a display device When connected, the related information is output to the display device, and the display device performs display based on the related information.
- the call is a video call
- the execution unit includes: a combining unit that combines an image based on the associated information with an image of the video call to generate a combined image; and a combined image display unit that displays the combination image.
- the execution unit is configured to perform at least one of: displaying the associated information; storing the associated information; and transmitting the associated information to at least one of a remote server and the second electronic device.
- the execution unit further includes: a first determining unit, after storing the association information, determining whether the current time meets the first predetermined condition; The execution unit is configured to perform display based on the association information when it is determined that the current time satisfies the first predetermined condition.
- the execution unit further includes: a second determining unit, after storing the association information, when the first electronic device performs network access, determining the location Whether the network access satisfies the second predetermined condition; and, the execution unit is configured to perform display based on the association information when the network access satisfies the second predetermined condition.
- the information processing device further includes: an environment information detection unit, after storing the association information, detecting environment information of the first electronic device; a third determining unit, determining whether the environmental information satisfies a third predetermined condition; and, the executing unit is configured to perform display based on the related information when the environmental information satisfies a third predetermined condition.
- the execution unit is configured to display at least one of the associated information and a prompt icon for linking to the associated information.
- an information processing method is provided, which is applied to a server, where the information processing method includes: during a call between a first electronic device and a second electronic device, from the first electronic Obtaining, by the device and/or the second electronic device, call information generated by the call; determining a processing object based on the call information; analyzing the processing object to acquire associated information associated with the processing object; An operation based on the associated information is performed.
- Performing the operation based on the association information includes at least one of: storing the association information; transmitting the association information to at least one of the first electronic device and the second electronic device based on a predetermined policy.
- the transmitting the association information to the first electronic device or the second electronic device based on a predetermined policy comprises: receiving a request from at least one of the first electronic device and the second electronic device And transmitting the association information to the electronic device in the first electronic device and the second electronic device for request in response to the request.
- Sending the association information to the first electronic device or the second electronic device based on a predetermined policy includes: transmitting the association information to the first electronic device and the second electronic device to send Electronic device for call information.
- the call information includes audio information
- the sending the association information to the first electronic device or the second electronic device based on a predetermined policy includes: performing semantic analysis on the audio to determine the association Which one of the first electronic device and the second electronic device is suitable for the information; and transmitting the associated information to the electronic device determined to be suitable in the first electronic device and the second electronic device .
- Object information of a plurality of objects is pre-stored in the server, and object information of each object is stored in association with attribute information for indicating an attribute of the object; and the acquisition is associated with the processing object
- the associated information includes: analyzing the processing object to determine an attribute of the processing object; determining, according to an attribute of the processing object, corresponding attribute information in the stored attribute information; and determining an attribute corresponding to the The object information associated with the information is determined as the associated information.
- an information processing device which is applied to a server, where the information processing device includes: an acquiring unit, in a process of a call between a first electronic device and a second electronic device, Receiving, by the first electronic device and/or the second electronic device, call information generated by the call; determining unit, determining a processing object based on the call information; analyzing unit, analyzing the processed object, to obtain the Processing associated information associated with the object; and an execution unit that performs an operation based on the associated information.
- the execution unit is configured to perform at least one of: storing the association information; transmitting the association information to at least one of the first electronic device and the second electronic device based on a predetermined policy.
- the execution unit includes: a receiving unit, receiving the a request of at least one of an electronic device and the second electronic device; and a transmitting unit, responsive to the request, transmitting the association information to the first electronic device and the second electronic device for request Electronic equipment.
- the execution unit is configured to transmit the association information to the first electronic device or the second electronic device based on a predetermined policy
- the execution unit is configured to send the association information to the An electronic device that transmits call information in the first electronic device and the second electronic device.
- the call information includes information of the audio, where the execution unit is configured to send the association information to the first electronic device or the second electronic device based on a predetermined policy, the execution unit includes: a semantic analysis unit, performing semantic analysis on the audio to determine which one of the first electronic device and the second electronic device is suitable for the associated information; and transmitting unit, sending the associated information to the The first electronic device and the second electronic device are determined to be suitable electronic devices.
- Object information of a plurality of objects is pre-stored in the server, and object information of each object The information is stored in association with the attribute information for indicating the attribute of the object; and the acquiring unit includes: an attribute determining unit that analyzes the processing object to determine an attribute of the processing object; And determining, according to an attribute of the processing object, corresponding attribute information in the stored attribute information; and the object information determining unit determining the object information associated with the corresponding attribute information as the related information.
- the processing object is determined based on the call information generated by the call, and the association information associated with the processing object is acquired, thereby enabling an operation based on the associated information, such as Display, store or forward, etc. Therefore, the information processing method and the information processing device of the embodiment of the present invention can utilize the call information generated during the call, thereby further improving the application value of the call and greatly enriching the user experience in addition to the communication purpose. . DRAWINGS
- FIG. 1 is a flowchart illustrating an information processing method according to a first embodiment of the present invention
- FIG. 2 is a block diagram illustrating a main configuration of an information processing device according to a first embodiment of the present invention
- FIG. 3 is a flowchart illustrating an information processing method according to a second embodiment of the present invention
- FIG. 4 is a block diagram illustrating a main configuration of an information processing device according to a second embodiment of the present invention
- 5A-5C are schematic diagrams showing the display of a first electronic device to which the information processing method of the embodiment of the present invention is applied;
- Fig. 6 is another schematic diagram showing the first electronic device to which the information processing method of the embodiment of the present invention is applied. detailed description
- the information processing method and the information processing device of the embodiment of the present invention are applied to an environment in which the first electronic device and the second electronic device make a call.
- the first electronic device and the second electronic device may be electronic devices having communication functions such as a fixed telephone, a mobile phone, a tablet computer, a personal computer, and the like.
- the communication may be conventional voice communication (such as via a fixed telephone), video communication (such as via a video chat application), or text communication (such as via an instant message (text chat) application).
- the types of the first electronic device and the second electronic device may be the same or different.
- the call between the first electronic device and the second electronic device can be performed by a server (hereinafter, also referred to as a remote server as appropriate) via a network such as the Internet. That is, the first electronic device and one of the second electronic devices send call information to the server, and the server forwards the call information to the first electronic device and the second Another of the electronic devices.
- a server hereinafter, also referred to as a remote server as appropriate
- the conversation between the first electronic device and the second electronic device can also be directly performed without forwarding via the server.
- an embodiment of the present invention is described by taking communication between two electronic devices of a first electronic device and a second electronic device as an example.
- the information processing method and the information processing apparatus of the embodiments of the present invention can be applied to a scenario in which communication is performed between more than two electronic devices.
- the information processing method and the information processing device of the embodiments of the present invention may be applied to any one of the first electronic device and the second electronic device, and may also be applied to the server.
- information processing methods and information processing apparatuses in the above various cases will be separately described.
- the information processing method is applied to either or both of the first electronic device and the second electronic device.
- the information processing method is applied to the first electronic device.
- the first electronic device and the second electronic device are in the process of making a call.
- step S101 the information processing method determines a processing target based on call information generated by the call.
- the determination of the processing object may be implemented by detecting an input operation actively performed by the user, or may be realized by automatically analyzing and identifying the call information by the information processing method.
- the call includes a video call
- the call information includes information of a video picture.
- the user specifies the processing object by performing an input operation on the video screen.
- the information processing method of the embodiment of the present invention determines the processing object specified by the user by detecting an input operation performed by the user on the video screen. More specifically, for example, in the first example, the user can select an area in the video picture. Accordingly, the information processing method of the embodiment of the present invention detects an input operation for selecting an area in the video picture. Thereafter, the information processing method determines a partial video picture corresponding to the area in the video picture as a processing target.
- a user may click on a particular location in the video frame. Accordingly, the information processing method of the embodiment of the present invention detects a click operation for clicking on the video screen.
- the information processing method performs image segmentation on the video screen based on a specific position in the video picture corresponding to the click operation to obtain a partial video picture including the specific position.
- the technique of image segmentation of the video image by the information processing method is known to those skilled in the art and will not be described in detail herein.
- the information processing method determines the partial video picture as a processing object.
- the information processing method of the first video picture may be an image recognition another 1 J, to determine a plurality of candidate objects.
- the information processing method may determine the candidate objects using various image recognition algorithms known in the art, and will not be described in detail herein.
- the information processing method may present information about the candidate object to the user for selection by the user. Thereafter, the information processing method detects a user's selection operation of at least one of the plurality of candidate objects. And, when detecting a user's selection operation on the at least one candidate object, the information processing method determines the selected at least one candidate object as the processing object based on the selection operation.
- the call information includes information of a still picture.
- the information processing method performs image recognition on the still picture to divide the still picture into a plurality of areas.
- the information processing method divides the static picture into a plurality of mutually disjoint areas according to features such as gray scale, color, space texture, geometry, etc., so that the features exhibit consistency or similarity in the same area. And there are significant differences between different regions.
- the information processing method may perform image segmentation using various algorithms such as a threshold-based method, a cluster-based method, a region- and edge-based method, a global optimization-based method, and the like.
- the information processing method determines a target area from the plurality of areas based on a predetermined criterion.
- the information processing method may determine a target area from the plurality of areas based on criteria of a plurality of areas of saliency, pre-trained user interest, area position, area size, and the like.
- the above criteria for determining the target area and the corresponding algorithms are merely examples.
- the information processing method of the embodiment of the present invention can determine the target area by using various other standards and corresponding algorithms known to those skilled in the art, and will not be described herein.
- the information processing method determines the processing object based on the target area. Specifically, for example, the information processing method may analyze a video picture of the target area to determine a processing object. For example, the information processing method may determine a processing object by identifying a video picture of the target area to determine its object type. For another example, the image is subjected to fuzzy matching to determine a processing object.
- the above method of determining an object to be processed based on the target area is merely an example.
- the information processing method of the embodiment of the present invention can determine the processing object by using various other methods known to those skilled in the art, and will not be described in detail herein.
- the call information includes information of a dynamic picture.
- the information processing method may identify the dynamic picture to identify a specific action made by the user during the call. For example, the information processing method can recognize an action made by the user during this time period by performing recognition similar to that described above on a dynamic picture composed of a plurality of temporally consecutive frames.
- the information processing method may determine the processing object based on the specific action. For example, the information processing method may determine a processing object based on the specific action based on a table of association relationships between the action and the processing object stored in advance.
- the call information includes information of audio.
- the information processing method may perform audio recognition on the audio to determine a processing object.
- the information processing method may determine whether there is an audio clip matching the predetermined keyword in the audio. When it is judged that there is an audio segment matching the predetermined keyword in the audio, the information processing method determines the audio segment as the processing target.
- the information processing method may perform semantic analysis on the audio and determine a processing object based on a result of the semantic analysis.
- the information processing method can perform audio recognition on the audio by various algorithms known in the art, and will not be described in detail herein.
- the information processing method of the embodiment of the present invention can combine the active input of the user with the automatic identification of the electronic device.
- the information processing method may determine a plurality of candidate objects based on the call information. Thereafter, the information processing method may present the plurality of candidate objects to the user, and detect a user's selection operation on at least one of the plurality of candidate objects. Next, the information processing method determines the selected at least one candidate object as the processing object based on the selection operation.
- the call information includes text information.
- the information processing method may perform text recognition on the text to determine a processing object.
- the information processing method may determine whether there is a text segment matching the predetermined keyword in the text. When it is judged that there is a text segment matching the predetermined keyword in the text, the information processing method determines the text segment as the processing object.
- the information processing method may perform semantic analysis on the text and determine a processing object based on a result of the semantic analysis.
- the information processing method can perform text recognition on the text using various algorithms known in the art, and will not be described in detail herein.
- step S101 the information processing method determines the processing target based on the call information generated by the call.
- step S102 the information processing method acquires association information associated with the processing object.
- the information processing method may send the processing object to a remote server, and the remote server analyzes the processing object. Thereafter, the information processing method receives the associated information from the remote server.
- the association information is information associated with the processing object obtained by the remote server by analyzing the processing object.
- the remote server can obtain the associated information by various methods.
- object information of a plurality of objects may be stored in advance in the remote server, and object information of each object is stored in association with the attribute information.
- the attribute information is used to represent attributes of the object, such as clothing, buildings, and the like.
- the remote server After receiving the processing object sent by the information processing method, the remote server analyzes the processing object to determine an attribute of the processing object. Thereafter, the remote server determines corresponding attribute information in the stored attribute information based on the attribute of the processing object, and determines object information associated with the corresponding attribute information as the related information.
- the information processing method may locally analyze the processing object to determine the associated information. In this case, the information processing method may locally store the object information of the plurality of objects and the attribute information in advance.
- the information processing method may analyze the processing object to determine an attribute of the processing object. Thereafter, the information processing method determines corresponding attribute information in the stored attribute information based on the attribute of the processed object, and determines object information associated with the corresponding attribute information as the associated information.
- the information processing method After the association information is determined, the information processing method performs an operation based on the association information in step S103.
- the processing object is determined based on the call information generated by the call, the association information associated with the processing object is acquired, and an operation based on the association information is performed.
- the information processing method of the first embodiment of the present invention it is possible to utilize the call information generated during the call, thereby further enhancing the application value of the call in addition to the communication purpose, and greatly enriching the user experience.
- the terminal side ie, the first electronic device and/or the second electronic device side
- the terminal side can respond to the user based on the call information.
- the input operation determines the processing object, and the processing object can be automatically determined, and the above two methods can also be combined.
- an information processing apparatus 200 includes: a determining unit 201, an obtaining unit 202, and an executing unit 203.
- the determining unit 201 determines a processing target based on the call information generated by the call during the call between the first electronic device and the second electronic device.
- the obtaining unit 202 acquires association information associated with the processing object.
- the execution unit 203 performs execution based on the associated letter Interest operation.
- the acquisition unit 202 includes a transmitting unit and a receiving unit (not shown).
- the transmitting unit transmits the processing object to a remote server.
- the receiving unit receives associated information from the remote server.
- the association information is information associated with the processing object obtained by the remote server by analyzing the processing object.
- the acquisition unit 202 includes an analysis unit (not shown) that analyzes the processing object to determine the associated information.
- the information processing device 200 determines a processing object by detecting an input operation actively performed by the user.
- the call information includes information of a video screen
- the determining unit 201 includes a detecting unit and a first processing object determining unit (not shown).
- the detecting unit detects an input operation of the user.
- the first processing object determining unit determines a processing object from the video screen based on the input operation.
- the detecting unit is configured to detect an input operation for selecting an area in the video picture.
- the first processing target determining unit is configured to determine a partial video screen corresponding to the region in the video screen as a processing target.
- the detection unit is configured to detect a click operation for clicking on the video frame.
- the first processing object determining unit includes: an image dividing unit that performs image segmentation on the video image to obtain a portion including the specific location based on a specific position in the video screen corresponding to the click operation a video screen; and an object determining unit that determines the partial video picture as a processing object.
- the information processing device 200 further includes an identification unit (not shown) that performs image recognition on the video screen to determine a plurality of candidate objects.
- the detecting unit includes: a selection detecting unit that detects a user's selection operation of at least one of the plurality of candidate objects.
- the first processing object determining unit is configured to determine the selected at least one candidate object as the processing object based on the selection operation.
- the information processing device 200 determines a processing object by automatically analyzing the call information.
- the call information includes information of a still picture.
- the determining unit 201 further includes a still picture recognizing unit, a target area determining unit, and a second processing object determining unit (not shown).
- the static picture recognition unit performs image recognition on the static picture to The static picture is divided into a plurality of areas.
- the target area determining unit determines a target area from the plurality of areas based on a predetermined criterion.
- the second processing object determining unit determines the processing object based on the target area.
- the call information includes information of a dynamic picture.
- the determining unit 201 further includes a dynamic picture recognizing unit and a third processing object determining unit (not shown).
- the dynamic picture recognition unit identifies the dynamic picture to identify a specific action made by the user during the call.
- the third processing object determining unit determines the processing pair based on the specific action.
- the call information includes information of audio.
- the determining unit 201 includes an audio recognizing unit that performs audio recognition on the audio to determine a processing object.
- the information processing device 200 determines a processing object by detecting an input operation actively performed by the user and automatically analyzing the call information.
- the determining unit 201 further includes a candidate object determining unit, a selection detecting unit, and a fourth processing object determining unit.
- the candidate object determining unit determines a plurality of candidate objects based on the call information.
- the selection detecting unit detects a user's selection operation of at least one of the plurality of candidate objects.
- the fourth processing object determining unit determines the selected at least one candidate object as the processing object based on the selecting operation.
- the call information includes text information.
- the information processing device 200 can perform text recognition on the text to determine a processing object.
- the information processing device of the first embodiment of the present invention it is possible to utilize the call information generated during the call, thereby further enhancing the application value of the call in addition to the communication purpose, and greatly enriching the user experience.
- the information processing device of the first embodiment of the present invention on the terminal side (ie, the first electronic device and/or the second electronic device side), based on the call information, it is responsive to the user.
- the input operation determines the processing object, and the processing object can be automatically determined, and the above two methods can also be combined.
- the information processing apparatus provides various ways to benefit
- the call information is used to further enrich the user experience.
- an information processing method and an information processing apparatus are provided. Unlike the information processing method and the information processing device according to the first embodiment of the present invention, in the second embodiment of the present invention, the information processing method and the information processing device are applied to the server side instead of the terminal side.
- the first electronic device and the second electronic device are in the process of making a call.
- step S301 the information processing method acquires call information generated by a call from the first electronic device and/or the second electronic device.
- the call information is generated during a call between the first electronic device and the second electronic device, and is sent by the at least one of the first electronic device and the second electronic device to the server.
- the call information may be audio information, video information, text information, or the like, or may be any combination of the above information.
- step S302 the information processing method determines a processing object based on the call information.
- the determination of the processing target can be realized by detecting an input operation actively performed by the user, or can be realized by automatically analyzing and recognizing the call information by the information processing method.
- the call includes a video call
- the call information includes information of a video picture.
- the user specifies the processing object by performing an input operation on the video screen.
- the information processing method of the embodiment of the present invention determines the processing object specified by the user by obtaining information of the input operation performed by the user on the video screen.
- the information processing method receives input trajectory information transmitted by at least one of the first electronic device and the second electronic device.
- the electronic device that transmits the input track information and the electronic device that sends the call information in the above step S301 may be the same electronic device or different electronic devices.
- the input trajectory information is generated by detecting at least one of the first electronic device and the second electronic device by detecting an input operation of a user.
- the input trajectory information may include The information of a series of tracks formed by a plurality of track points may also include information of tracks formed by a single track point.
- the input trajectory information may be information generated by detecting a sliding gesture of the user, or may be detected by Information generated by the user's click operation.
- the electronic device transmitting the input track information in the first electronic device and the second electronic device may also transmit information such as the size of a display screen of the electronic device.
- the information processing method determines a processing object based on the input trajectory information.
- a user such as the first electronic device can select an area in the video picture. Accordingly, the first electronic device forms input trajectory information by detecting an input operation for selecting an area in the video picture. Thereafter, the first electronic device determines that the input track information and the electronic device parameter information of the first electronic device are transmitted to the partial video picture to be the processing object.
- a user such as a first electronic device, can click on a particular location in the video frame. Accordingly, the first electronic device forms input trajectory information by detecting a click operation for clicking on the video screen. Thereafter, the first electronic device transmits the input track information to the server.
- the information processing method determines, based on the input trajectory information, which position (i.e., the specific position) the input trajectory information corresponds to in the video picture. Thereafter, the information processing method performs image segmentation on the video picture to obtain a partial video picture including the specific position, and determines the partial video picture as a processing object. Also, the information processing method can perform the above operations based on various image segmentation algorithms known in the art, and will not be described in detail herein.
- the information processing method can determine the processing object by combining the user's active input with the automatic analysis of the server.
- the information processing method may perform image recognition on the video screen to determine a plurality of candidate objects. Thereafter, the information processing method may transmit a plurality of candidate objects to at least one of the first electronic device and the second electronic device for selection by a user. The at least one of the first electronic device and the second electronic device detects a user selection operation of at least one of the plurality of candidate objects, generates corresponding input trajectory information, and sends the information to the server .
- the server is based on selection information obtained by detecting the selection operation (ie, The input trajectory information as described above) determines the selected at least one candidate object as the processing object.
- the call information includes information of a static picture.
- the information processing method performs image recognition on the still picture to divide the still picture into a plurality of areas.
- those skilled in the art can use various algorithms to perform image segmentation, which will not be described in detail herein.
- the information processing method determines a target area from the plurality of areas based on a predetermined criterion.
- a target area from the plurality of areas based on a predetermined criterion.
- those skilled in the art can use various standards and corresponding algorithms to determine the target area, which will not be described in detail herein.
- the information processing method determines the processing object based on the target area. Specifically, for example, the information processing method may analyze a video picture of the target area to determine a processing object. For example, the information processing method may determine a processing object by identifying a video picture of the target area to determine its object type. For another example, the image is subjected to fuzzy matching to determine a processing object.
- the above method of determining an object to be processed based on the target area is merely an example.
- the information processing method of the embodiment of the present invention can determine the processing object by using various other methods known to those skilled in the art, and will not be described in detail herein.
- the call information includes information of a dynamic picture.
- the information processing method may identify the dynamic picture to identify a specific action made by the user during the call. For example, the information processing method can recognize an action made by the user during this time period by performing recognition similar to that described above on a dynamic picture composed of a plurality of temporally consecutive frames.
- the information processing method may determine the processing object based on the specific action. For example, the information processing method may determine a processing object based on the specific action based on a table of association relationships between the action and the processing object stored in advance.
- the call information includes information of audio.
- the information processing method may perform audio recognition on the audio to determine a processing object.
- the information processing method may determine whether there is an audio clip matching the predetermined keyword in the audio. When it is judged that there is an audio piece matching the predetermined keyword in the audio In the case of a segment, the information processing method determines the audio segment as a processing object.
- the information processing method may perform semantic analysis on the audio and determine a processing object based on a result of the semantic analysis.
- the information processing method can perform audio recognition on the audio using various algorithms known in the art, and will not be described in detail herein.
- the information processing method of the embodiment of the present invention can combine the active input of the user with the automatic recognition of the electronic device.
- the information processing method determines a plurality of candidate objects based on the call information, and sends the plurality of candidate objects to the first electronic device and the second electronic device. At least one of them.
- the electronic device receiving the candidate object detects a selection operation by the user for selecting at least one candidate object, and transmits selection information generated by the selection operation to the server.
- the information processing method receives the selection information, and determines the selected at least one candidate object as the processing object based on the selection information.
- the call information includes text information.
- the information processing method may perform text recognition on the text to determine a processing object.
- the information processing method may determine whether there is a text segment matching the predetermined keyword in the text. When it is judged that there is a text segment matching the predetermined keyword in the text, the information processing method determines the text segment as the processing object.
- the information processing method may perform semantic analysis on the text and determine a processing object based on a result of the semantic analysis.
- the information processing method can perform text recognition on the text using various algorithms known in the art, and will not be described in detail herein.
- step S302 the information processing method determines the processing target based on the received call information.
- step S303 the information processing method analyzes the processing object to acquire association information associated with the processing object.
- object information of a plurality of objects is pre-stored in the server, and object information of each object is stored in association with the attribute information.
- the attribute information is used to represent an attribute of the object.
- the information processing method analyzes the processing object based on an association relationship between the object information and the attribute information, for example, to determine an attribute of the processing object. Thereafter, the The information processing method determines corresponding attribute information in the stored attribute information based on an attribute of the processing object. For example, the attribute information can be divided into different categories. The information processing method may determine attribute information of the stored attribute information that belongs to the same category or a corresponding category as the attribute of the processing object as the corresponding attribute information. Next, the information processing method determines object information associated with the corresponding attribute information as the association information.
- the attribute information includes information of a plurality of attributes. After the information processing method determines a certain attribute of the processing object, other attribute information of the processing object may be directly determined as the related information.
- step S304 the information processing method performs an operation based on the associated information.
- the information processing method may store the association information, and the association information may be sent to at least one of the first electronic device and the second electronic device.
- the information processing method may store the association information, and the association information may be sent to at least one of the first electronic device and the second electronic device.
- the processing object is determined based on the call information generated by the call, the association information associated with the processing object is acquired, and an operation based on the association information is performed.
- the information processing method of the second embodiment of the present invention it is possible to utilize the call information generated during the call, thereby further enhancing the application value of the call in addition to the communication purpose, and greatly enriching the user experience.
- the processing target on the server side, based on the call information, the processing target can be determined in response to an input operation by the user, and the processing target can be automatically determined, and the above-described A combination of the two approaches.
- the information processing method of the second embodiment of the present invention a plurality of ways are provided to utilize the call information, thereby further enriching the user experience. Further, in the case where the processing capability on the electronic device side is limited, the information processing method according to the second embodiment of the present invention can reduce the processing load on the electronic device side, which is particularly advantageous.
- information processing applied to a server according to a second embodiment of the present invention will be described with reference to FIG. Equipment.
- the information processing apparatus 400 of the embodiment of the present invention includes a call information acquisition unit 401, a determination unit 402, an association information acquisition unit 403, and an execution unit 404.
- the call information acquiring unit 401 acquires call information generated by the call from the first electronic device and/or the second electronic device during a call between the first electronic device and the second electronic device.
- the determining unit 402 determines a processing object based on the call information.
- the association information acquisition unit 403 analyzes the processing object to acquire association information associated with the processing object.
- the execution unit 404 performs an operation based on the associated information.
- the call information is information of a video screen.
- the determining unit 402 includes a receiving unit and a first processing object determining unit (not shown).
- the receiving unit receives electronic device parameter information and input trajectory information transmitted by at least one of the first electronic device and the second electronic device.
- the input trajectory information is generated by detecting at least one of the first electronic device and the second electronic device by detecting an input operation of the user.
- the first processing object determining unit determines a processing object based on the electronic device parameter information and the input trajectory information.
- the input trajectory information is that the at least one of the first electronic device and the second electronic device detects for selecting an area in the video picture Enter the operation and get it.
- the first processing object determining unit is configured to determine, as the processing object, a partial video picture corresponding to the area in the video picture based on the electronic device parameter information.
- the input trajectory information is obtained by detecting at least one of the first electronic device and the second electronic device by detecting a click operation for clicking on the video screen.
- the first processing object determining unit includes an image dividing unit and an object determining unit.
- the image segmentation unit performs image segmentation on the video image based on the electronic device parameter information and based on a specific position in the video image corresponding to the click operation to obtain a partial video image including the specific location .
- the object determining unit determines the partial video picture as a processing pair.
- the information processing apparatus 400 further includes an identifying unit and a transmitting unit (not shown).
- the identification unit performs image recognition on the video screen to determine a plurality of candidate objects.
- the transmitting unit transmits a plurality of candidate objects to the at least one of the first electronic device and the second electronic device.
- the input trajectory information is that the at least one of the first electronic device and the second electronic device detects at least one candidate of the plurality of candidate objects by detecting a user Obtained by the selection operation of the object.
- the first processing object determining unit is configured to determine the selected at least one candidate object as the processing object based on the electronic device parameter information and based on the selecting operation.
- the call information is information of a video picture.
- the determining unit 402 includes a still picture recognizing unit, a target area determining unit, and a second processing object determining unit.
- the still picture recognition unit performs image recognition on the video picture to divide the still picture into a plurality of areas.
- the target area determining unit determines a target area from the plurality of areas based on a predetermined criterion.
- the second processing object determining unit determines the processing object based on the target area.
- the call information is information of a dynamic picture.
- the determining unit 402 includes a dynamic picture recognition unit and a third processing object determination unit.
- the dynamic picture recognition unit identifies the dynamic picture to identify a specific action made by an object in the dynamic picture during the call.
- the third processing object determining unit determines the processing object based on the specific action.
- the call information is information of audio.
- the determining unit 402 includes an audio recognizing unit that performs audio recognition on the audio to determine a processing object.
- the determining unit 402 includes a candidate object determining unit, a transmitting unit, a receiving unit, and a fourth processing object determining unit (not shown).
- the candidate object determining unit determines a plurality of candidate objects based on the call information.
- the transmitting unit transmits the plurality of candidate objects to at least one of the first electronic device and the second electronic device.
- the receiving unit receives a selection information of a user of the at least one of the first electronic device and the second electronic device for selecting at least one candidate object.
- the fourth processing object determining unit determines the selected at least one candidate object as the processing object based on the selection information.
- the object information of the plurality of objects is pre-stored in the server.
- the object information of each object is stored in association with the attribute information for indicating the attribute of the object.
- the association information acquisition unit 403 includes an attribute determination unit, an attribute information determination unit, and an object information determination unit (not shown).
- the attribute determining unit analyzes the processing object to determine an attribute of the processing object.
- the attribute information determining unit determines the attribute information corresponding to the stored attribute information based on the attribute of the processing object.
- the object information determining unit determines object information associated with the corresponding attribute information as the related information.
- the information processing device of the second embodiment of the present invention it is possible to utilize the call information generated during the call, thereby further enhancing the application value of the call in addition to the communication purpose, and greatly enriching the user experience.
- the processing target on the server side, based on the call information, the processing target can be determined in response to the input operation of the user, and the processing target can be automatically determined, and the above-described A combination of the two approaches.
- the information processing apparatus of the second embodiment of the present invention a plurality of ways are provided to utilize the call information, thereby further enriching the user experience. Further, in the case where the processing capability on the electronic device side is limited, the information processing device according to the second embodiment of the present invention can reduce the processing load on the electronic device side, which is particularly advantageous.
- an information processing method and an information processing device applied to a terminal side which, after acquiring the association information as described above, can perform various types including immediate output, storage, forwarding, and the like. operating.
- the flow of the information processing method of the third embodiment of the present invention is similar to the flow of the information processing method of the first embodiment of the present invention. That is, the information processing method also includes: determining, in the process of the multimedia call between the first electronic device and the second electronic device, the processing object based on the call information generated by the call; acquiring and processing Association information associated with the object; and performing an operation based on the associated information.
- the information processing method may transmit the processing object to a remote server, and the remote server obtains the analysis by analyzing the processing object.
- the associated information is described, and the associated information is sent to the first electronic device.
- the information processing method may also analyze the processing object locally to determine the associated information.
- the information processing method outputs the associated information during the call, or outputs the associated information immediately after the call ends.
- the information processing method may generate a prompt icon for prompting the user to view, and display the prompt icon.
- the prompt icon is used to link to the associated information. Thereafter, when it is detected that the user clicks on the prompt icon, the information processing method accesses the associated information.
- the call is an audio call.
- the information processing method detects whether the first electronic device is connected to a display device.
- the display device may be an external display device, or may be a display unit included in the first electronic device itself but in a disabled state.
- the information processing method can obtain information about the above connection, for example, by detecting a corresponding connection pin of the first electronic device.
- the information processing method outputs the association information to the display device when detecting that the first electronic device is connected to a display device. Thereby, display based on the associated information is performed by the display device.
- the call is a video call.
- the information processing method combines an image based on the associated information with an image of the video call to generate a combined image, and displays the combined image.
- the image based on the associated information may be an image displaying various forms of content such as a picture, a text, and the like.
- the associated information is not immediately output.
- the information processing method stores the associated information in, for example, a local memory. Thereafter, the information processing method outputs the association information only when it is judged that the predetermined condition is satisfied.
- the information processing method determines whether the current time satisfies the first predetermined condition. For example, the information processing method determines whether the current time is a time preset by the electronic device or the user. For another example, the information processing method determines whether the time interval between the current time and the call end time is a time interval preset by the electronic device or the user. For another example, the information processing method determines whether the time interval between the current time and the call end time is greater than a time interval preset by the electronic device or the user. Thereafter, when it is judged that the current time satisfies the first predetermined condition, the information processing method performs display based on the association information.
- the first pre-described above The conditions are only examples. Those skilled in the art can completely design other various conditions as the first predetermined condition as needed.
- the information processing method determines whether the network access satisfies a second predetermined condition when the first electronic device performs network access. For example, the information processing method determines that the information processing method locally stores in advance a correspondence destination between the association information and the network access destination. Thereafter, when it is judged that the network access satisfies the second predetermined condition, the information processing method performs display based on the association information.
- the second predetermined condition described above is merely an example. Those skilled in the art can design other various conditions as the second predetermined condition as needed.
- the information processing method may further detect environmental information of the first electronic device.
- the environmental information includes, for example, location information of the first electronic device, weather information of the environment in which it is located, temperature information, and the like.
- the information processing method determines whether the environmental information satisfies a third predetermined condition.
- location information for example, the information processing method determines whether the first electronic device arrives at the electronic device or a location preset by the user.
- the information processing method locally stores a comparison table between the related information and the location information in advance. The information processing method determines whether the first electronic device is in a position corresponding to the associated information based on the location information. The judgment of other kinds of environmental information is similar to this and will not be described in detail here.
- the information processing method performs display based on the associated information.
- the third predetermined condition described above is merely an example. Those skilled in the art can design other various conditions as the third predetermined condition as needed.
- the information processing method does not immediately output the associated information during the call and after the call ends.
- the information processing method transmits the association information to at least one of a remote server and the second electronic device.
- the remote server and/or the second electronic device may, for example, store the associated information or output the associated information.
- the display processing may display the related information itself or a prompt icon for connecting to the related information.
- the call information determines a processing object, acquires association information associated with the processing object, and performs an operation based on the association information.
- the information processing method of the third embodiment of the present invention it is possible to utilize the call information generated during the call, thereby further enhancing the application value of the call in addition to the communication purpose, and greatly enriching the user experience.
- the association information may be stored, and when the predetermined condition is satisfied at a later time, the output of the association information is triggered, and the The associated information is output to the server and/or the second electronic device for processing.
- the configuration of the information processing device is similar to that of the information processing device of the first embodiment of the present invention, that is, it also includes a determining unit, an obtaining unit, and an executing unit.
- the determining unit determines the processing object based on the call information generated by the call during the multimedia call between the first electronic device and the second electronic device.
- the acquiring unit acquires association information associated with the processing object.
- the execution unit performs an operation based on the associated information.
- the obtaining unit may include: a sending unit that sends the processing object to a remote server; and a receiving unit that receives related information from the remote server, where the association The information is information associated with the processing object obtained by the remote server by analyzing the processing object.
- the obtaining unit may include: an analyzing unit, analyzing the processing object to determine the related information.
- the execution unit is configured to perform at least one of: displaying the associated information; storing the associated information; and transmitting the associated information to a remote server and the second electronic device At least one of them.
- the execution unit may include an icon generating unit and an icon display unit.
- the icon generating unit generates a prompt icon for prompting the user to view, and the prompt icon is used to link to the related information.
- the icon display unit displays the prompt icon.
- the call is an audio call.
- the execution unit may include a first detection unit and an output unit. The first detecting unit detects whether the first electronic device is connected to a display device. The output unit outputs the related information to the display device when detecting that the first electronic device is connected to a display device, and the display device performs display based on the related information.
- the call is a video call.
- the execution unit may include a combination unit and a combined image display unit.
- the combining unit combines an image based on the associated information with an image of the video call to generate a combined image.
- the combined image display unit displays the combined image.
- the information processing device further includes a first determination unit that, after storing the association information, determines whether the current time satisfies the first predetermined condition.
- the execution unit is configured to perform display based on the associated information when it is determined that the current time satisfies the first predetermined condition.
- the information processing device further includes: a second determining unit, after storing the associated information, when the first electronic When the device performs network access, it is determined whether the network access meets the second predetermined condition.
- the execution unit is configured to perform display based on the association information when the network access satisfies a second predetermined condition.
- the information processing device further includes: an environment information detecting unit, after storing the association information, detecting the first electronic Environmental information of the device; and a third determining unit that determines whether the environmental information satisfies a third predetermined condition.
- the execution unit is configured to perform display based on the association information when the environmental information satisfies a third predetermined condition.
- the execution unit may be configured to display at least one of the association information and a prompt icon for linking to the association information.
- the information processing device of the third embodiment of the present invention it is possible to utilize the call information generated during the call, thereby further enhancing the application value of the call in addition to the communication purpose, and greatly enriching the user experience.
- the association information may be stored, and when the predetermined condition is satisfied at a later time, the output of the association information is triggered, and the The associated information is output to the server and/or the second electronic device for processing.
- the information processing apparatus provides a plurality of ways to output the related information, which facilitates the user to customize differently according to the situation, thereby further enriching the user's body.
- an information processing method and an information processing apparatus applied to a server which can perform various operations including immediate output, storage, forwarding, and the like after acquiring the association information as described above.
- the flow of the information processing method of the fourth embodiment of the present invention is similar to the flow of the information processing method of the second embodiment of the present invention. That is, the information processing method also includes: acquiring, during the conversation between the first electronic device and the second electronic device, the call information generated by the call from the first electronic device and/or the second electronic device; Determining a processing object based on the call information; analyzing the processing object to acquire association information associated with the processing object; and performing an operation based on the association information.
- the server may store object information of a plurality of objects in advance, and the object information of each object is stored in association with attribute information for indicating attributes of the object.
- the information processing method may analyze the processing object to determine an attribute of the processing object, determine corresponding attribute information in the stored attribute information based on an attribute of the processing object, and compare the attribute with the corresponding attribute The object information associated with the information is determined as the associated information.
- the association information may be stored, for example, for output later.
- the information processing method may also send the association information to at least one of the first electronic device and the second electronic device based on a predetermined policy. More specifically, in the first example, the information processing method receives a request from at least one of the first electronic device and the second electronic device. The request is for requesting the server to send the association information. In this example, it is assumed that the information processing method receives a request from a first electronic device. Thus, the information processing method transmits the association information to the electronic device in the first electronic device and the second electronic device for request, in response to the request, that is, the first in this example Electronic equipment.
- the information processing method does not have to transmit the associated information in response to an additional request from the first electronic device or the second electronic device.
- the information processing method arbitrarily transmits the association information to the electronic device that transmits the call information in the first electronic device and the second electronic device.
- the call information includes information of audio.
- the information processing method performs semantic analysis on the audio to determine which of the first electronic device and the second electronic device the associated information is suitable for.
- the techniques for performing semantic analysis by the information processing method are known to those skilled in the art and will not be described in detail herein.
- the information processing method transmits the association information to the electronic device determined to be suitable among the first electronic device and the second electronic device.
- the call information includes information of text.
- the information processing method performs semantic analysis on the text to determine which of the first electronic device and the second electronic device the associated information is suitable for.
- the techniques for performing semantic analysis by the information processing method are known to those skilled in the art and will not be described in detail herein.
- the information processing method transmits the association information to the electronic device determined to be suitable among the first electronic device and the second electronic device.
- the processing object is determined based on the call information generated by the call, the association information associated with the processing object is acquired, and an operation based on the association information is performed.
- the information processing method of the fourth embodiment of the present invention it is possible to utilize the call information generated during the call, thereby further enhancing the application value of the call in addition to the communication purpose, and greatly enriching the user experience.
- the related information may be stored to be delayed, or the related information may be sent to an appropriate electronic device according to various different policies. Further processing is performed by the electronic device that received the associated information.
- the configuration of the information processing apparatus is similar to that of the information processing apparatus of the second embodiment of the present invention, that is, it also includes an acquisition unit, a determination unit, an analysis unit, and an execution unit.
- the acquiring unit acquires call information generated by the call from the first electronic device and/or the second electronic device during a call between the first electronic device and the second electronic device.
- the determining unit determines a processing object based on the call information.
- the analysis unit analyzes the processing object to acquire association information associated with the processing object.
- the execution unit performs an operation based on the associated information.
- object information of a plurality of objects may be stored in advance in the server, and object information of each object is stored in association with attribute information for indicating attributes of the object.
- the acquisition unit includes an attribute determination unit, an attribute information determination unit, and an object information determination unit.
- the attribute determining unit analyzes the processing object to determine a property of the processing object.
- the attribute information determining unit determines corresponding attribute information in the stored attribute information based on the attribute of the processing object.
- the object information determining unit determines object information associated with the corresponding attribute information as the related information.
- the execution unit is configured to perform at least one of: storing the association information; transmitting the association information to the first electronic device and the At least one of the second electronic devices.
- the execution unit includes: a receiving unit, receiving the a request of at least one of an electronic device and the second electronic device; and a transmitting unit that transmits the associated information to the first electronic device and the first in response to the request The electronic device that makes the request in the two electronic devices.
- the execution unit is configured to transmit the association information to an electronic device that transmits call information in the first electronic device and the second electronic device.
- the call information includes information of audio.
- the execution unit includes: a semantic analysis unit that performs semantic analysis on the audio to determine which one of the first electronic device and the second electronic device is suitable for the associated information; and a sending unit The association information is sent to the electronic device determined to be suitable among the first electronic device and the second electronic device.
- the call information includes information of text.
- the execution unit includes: a semantic analysis unit, performing semantic analysis on the text to determine which one of the first electronic device and the second electronic device is suitable for the associated information; and a sending unit The association information is sent to the electronic device determined to be suitable among the first electronic device and the second electronic device.
- the information processing device of the fourth embodiment of the present invention it is possible to utilize the call information generated during the call, thereby further enhancing the application value of the call in addition to the communication purpose, and greatly enriching the user experience.
- the related information may be stored to delay output, or the related information may be sent to an appropriate electronic device according to various different policies. Further processing is performed by the electronic device that received the associated information.
- FIGS. 5A to 5C are diagrams showing the display on the display screen 500 of the first electronic device to which the information processing method of the embodiment of the present invention is applied.
- the display screen 500 is divided into two areas: a first area 501 and a second area 502.
- An image of a user (hereinafter, referred to as a first user as appropriate) of the first electronic device that is gathered by the first electronic device by, for example, an image collection unit of a front camera is displayed in the first area 501.
- the second area 502 displays an image of a user (hereinafter, referred to as a second user as appropriate) of the second electronic device that the second electronic device has gathered by, for example, an image collection unit of the camera.
- the display screen 500 of the first electronic device is a touch display screen.
- the information processing method and the information processing device of the embodiments of the present invention can be equally applied to electronic devices that are not touch input.
- the first user has an interest in the top of the second user in the video communication with the second user, and circled the area 503 corresponding to the top on the display screen 500 by gesture .
- the information processing method detects the above operation of the user, and determines a part of the video picture corresponding to the area 503 in the video picture as a processing target.
- the first user can also click on any of the areas in the display on the display screen 500 by the gesture.
- the information processing method performs image segmentation on a video picture to obtain a partial video picture including the position, as also shown in 503.
- the information processing method may also automatically perform image recognition on the video screen to divide the video screen into a plurality of regions, for example, an area 503 corresponding to the top, an area 504 corresponding to the pants, and a shoe.
- the information processing method determines the region 503 in the plurality of regions as the processing target based on a predetermined criterion, for example, based on the saliency of the region.
- the information processing method may also combine the above-described user input with the manner of automatic determination. That is, the information processing method may first automatically perform image recognition on the video screen to determine a plurality of candidate objects, such as a top 503, pants 504, and shoes 505, and present the plurality of candidate objects to the first user.
- the manner of presentation is not limited.
- the information processing method may display a partial video picture corresponding to the areas 503, 504, and 505 in a thumbnail form in an appropriate position in the display screen 500.
- the information processing method may be in the area 503, A cue mark is displayed near 504 and 505, and so on. Thereafter, the information processing method detects a user's selection operation of at least one of the plurality of candidate objects, and determines the selected at least one candidate object as the processing object based on the selection operation.
- the information processing method acquires association information associated with the processing object and performs an operation based on the association information. Specifically, in this scenario, for example, the information processing method determines the brand of the top by image analysis, thereby obtaining attribute information such as the price, fabric, and origin of the top as related information. Further, for example, the information processing method determines the brand of the top by image analysis, and thereby obtains information such as other tops of the same brand as the top as related information.
- the manner in which the information processing method described above determines the associated information is merely an example.
- the information processing method After the association information is obtained, in an embodiment, the information processing method generates a prompt icon for prompting the user to view, the prompt icon is used to link to the associated information, and the prompt icon is displayed. This is shown as icon 508 in Figure 5B.
- the information processing method generates an image based on the association information, as shown by 509 in FIG. 5C, combining it with an image of the video call to generate a combined image, and displaying the image Combine images.
- the information processing method does not output the information immediately, but stores it in the local storage, or sends it to at least the server and the second electronic device.
- the information processing method may display the association information or an icon for prompting access to the associated information when it is determined that the current time satisfies the first predetermined condition.
- the information processing method may display the related information or use when determining whether the network access meets a second predetermined condition, for example, when determining that the destination of the network access is a shopping website.
- a second predetermined condition for example, when determining that the destination of the network access is a shopping website.
- the information processing method may detect environmental information of the first electronic device, such as location information of the first electronic device.
- environmental information such as location information of the first electronic device.
- the information processing method determines that the environmental information satisfies a third predetermined condition, for example, when it is determined that the first electronic device is located in a shopping mall, the associated information or an icon for prompting access to the associated information is displayed.
- FIGS. 5A-5C illustrate that the first user performs a video call with the second user of the second electronic device through the front camera of the first electronic device, and the processing object corresponds to the second user.
- the information processing method and the information processing device of the embodiment of the present invention are also applicable to the first user performing a video call with the second user of the second electronic device through the rear camera of the first electronic device, and the processing object is The case of an object in the video screen corresponding to the first user.
- Figure 6 shows the display diagram in this case.
- the display screen 600 is divided into two areas: a first area 601 and a second area 602.
- the first area 601 displays an image of the first electronic device side that is collected by the first electronic device through, for example, an image capturing unit of the rear camera.
- the second area 602 displays an image of the second electronic device side collected by the second electronic device through, for example, an image collection unit of the camera.
- the first user wishes to describe to the second user the building in the vicinity of the area in which it is located, but does not know various information such as the name of the building.
- the first user can obtain various related information such as the name, the building age, and the like of the building through the information processing method of the embodiment of the present invention, and the processing thereof is similar to the above, and will not be described in detail herein.
- the information processing method and the information processing device in the embodiment of the present invention can utilize the call information generated during the call, thereby further improving the application value of the call and greatly enriching the user experience.
- the processing object can be determined in response to the input operation of the user on the electronic device side, and the processing object can be automatically determined, and the above two modes can also be combined. . Therefore, the information processing method and the information processing apparatus of the embodiments of the present invention provide various ways to utilize the call information, thereby further enriching the user's experience.
- the above determination The process of the object can also be performed on the server side, so that when the processing capability on the electronic device side is limited, the processing load on the electronic device side can be reduced, and the processing efficiency on the electronic device side can be improved.
- the electronic device may also store the related information, and trigger the output of the related information when the predetermined condition is satisfied at a later time, and may also The associated information is output to the server and/or the second electronic device for processing. Therefore, it is convenient for users to customize differently according to the situation, thereby further enriching the user experience.
- the related information may be stored to delay output, or the related information may be sent to an appropriate electronic according to various different policies.
- the device performs further processing by the electronic device that receives the associated information. Therefore, various ways are provided to output the related information to different electronic devices, so that the service provider can customize differently according to the situation.
- FIGS. 1 through 6 an information processing method and an information processing apparatus according to an embodiment of the present invention have been described with reference to FIGS. 1 through 6.
- first ... unit and second unit are merely convenient for distinguishing in description, and do not mean that they must be realized as physically separated two. Or multiple units. In fact, the unit may be implemented as a unit as a whole or as a plurality of units, as needed.
- the unit/module can be implemented in software for execution by various types of processors.
- an identified executable code module can comprise one or more physical or logical blocks of computer instructions, which can be constructed, for example, as an object, procedure, or function. Nonetheless, the executable code of the identified modules need not be physically located together, but may include different instructions stored in different bits. When these instructions are logically combined, they constitute the unit/module and implement the unit. / Module's stated purpose.
- the unit/module can be implemented by software, considering the level of the existing hardware process, the unit/module that can be implemented by software can be constructed by a person skilled in the art without considering the cost.
- the hardware circuit includes conventional Very Large Scale Integration (VLSI) circuits or gate arrays and existing semiconductors such as logic chips, transistors, or other discrete components. Modules can also be implemented with programmable hardware devices such as field programmable gate arrays, programmable array logic, programmable logic devices, and the like.
- VLSI Very Large Scale Integration
Landscapes
- Engineering & Computer Science (AREA)
- General Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- Human Computer Interaction (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Multimedia (AREA)
- Signal Processing (AREA)
- User Interface Of Digital Computer (AREA)
Abstract
Description
Claims
Priority Applications (2)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
US14/388,722 US10126821B2 (en) | 2012-12-20 | 2013-12-18 | Information processing method and information processing device |
DE112013006130.9T DE112013006130T5 (de) | 2012-12-20 | 2013-12-18 | Informationsverarbeitungsverfahren und Informationsverarbeitungsvorrichtung |
Applications Claiming Priority (8)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CN201210559888.3 | 2012-12-20 | ||
CN201210560705.X | 2012-12-20 | ||
CN201210560832.X | 2012-12-20 | ||
CN201210560832.XA CN103888426B (zh) | 2012-12-20 | 信息处理方法和信息处理设备 | |
CN201210559888.3A CN103888494B (zh) | 2012-12-20 | 2012-12-20 | 信息处理方法和信息处理设备 |
CN201210560705.XA CN103888423B (zh) | 2012-12-20 | 2012-12-20 | 信息处理方法和信息处理设备 |
CN201210560726.1 | 2012-12-20 | ||
CN201210560726.1A CN103888425B (zh) | 2012-12-20 | 2012-12-20 | 信息处理方法和信息处理设备 |
Publications (1)
Publication Number | Publication Date |
---|---|
WO2014094614A1 true WO2014094614A1 (zh) | 2014-06-26 |
Family
ID=50977602
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
PCT/CN2013/089778 WO2014094614A1 (zh) | 2012-12-20 | 2013-12-18 | 信息处理方法和信息处理设备 |
Country Status (3)
Country | Link |
---|---|
US (1) | US10126821B2 (zh) |
DE (1) | DE112013006130T5 (zh) |
WO (1) | WO2014094614A1 (zh) |
Families Citing this family (2)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN104754277B (zh) * | 2013-12-27 | 2018-04-27 | 联想(北京)有限公司 | 信息处理设备及信息处理方法 |
CN108469937B (zh) * | 2014-03-26 | 2020-11-20 | 联想(北京)有限公司 | 一种信息处理方法及电子设备 |
Citations (3)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN101015208A (zh) * | 2004-09-09 | 2007-08-08 | 松下电器产业株式会社 | 通信终端及其通信方法 |
CN101888519A (zh) * | 2009-05-14 | 2010-11-17 | 华为技术有限公司 | 共享桌面内容的方法和智能设备 |
US20120302167A1 (en) * | 2011-05-24 | 2012-11-29 | Lg Electronics Inc. | Mobile terminal |
Family Cites Families (11)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
JP2002271507A (ja) | 2001-03-08 | 2002-09-20 | Matsushita Electric Ind Co Ltd | テレビ電話端末を用いた広告提供方法及び該広告提供方法に用いるテレビ電話端末、並びにプログラムを格納した媒体 |
JP2003158729A (ja) | 2001-11-22 | 2003-05-30 | Mitsubishi Electric Corp | テレビ電話装置 |
CN100479356C (zh) | 2002-08-02 | 2009-04-15 | 中国科学院上海微***与信息技术研究所 | 一种基于微机电***技术制作的光分插复用器 |
JP2004153779A (ja) | 2002-09-04 | 2004-05-27 | Nec Corp | 通信端末装置、電話機、発信者情報通知システム及びそれに用いる発信者情報通知方法並びそのプログラム |
EP1788809A1 (en) * | 2004-09-09 | 2007-05-23 | Matsushita Electric Industrial Co., Ltd. | Communication terminal and communication method thereof |
US8199184B2 (en) * | 2007-11-06 | 2012-06-12 | Cisco Technology, Inc. | Visually enhancing a conference |
US20090157426A1 (en) * | 2007-12-12 | 2009-06-18 | Mckesson Financial Holdings Limited | Methods, apparatuses & computer program products for facilitating efficient distribution of data within a system |
CN101296450A (zh) | 2008-05-27 | 2008-10-29 | 深圳华为通信技术有限公司 | 通信信息的管理方法及其终端 |
CN102479024A (zh) | 2010-11-24 | 2012-05-30 | 国基电子(上海)有限公司 | 手持装置及其用户界面构建方法 |
CN102655544A (zh) | 2011-03-01 | 2012-09-05 | 联想(北京)有限公司 | 一种发起通信的方法及通信终端 |
US9197848B2 (en) * | 2012-06-25 | 2015-11-24 | Intel Corporation | Video conferencing transitions among a plurality of devices |
-
2013
- 2013-12-18 WO PCT/CN2013/089778 patent/WO2014094614A1/zh active Application Filing
- 2013-12-18 DE DE112013006130.9T patent/DE112013006130T5/de active Pending
- 2013-12-18 US US14/388,722 patent/US10126821B2/en active Active
Patent Citations (3)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN101015208A (zh) * | 2004-09-09 | 2007-08-08 | 松下电器产业株式会社 | 通信终端及其通信方法 |
CN101888519A (zh) * | 2009-05-14 | 2010-11-17 | 华为技术有限公司 | 共享桌面内容的方法和智能设备 |
US20120302167A1 (en) * | 2011-05-24 | 2012-11-29 | Lg Electronics Inc. | Mobile terminal |
Also Published As
Publication number | Publication date |
---|---|
DE112013006130T5 (de) | 2015-10-22 |
US20150286280A1 (en) | 2015-10-08 |
US10126821B2 (en) | 2018-11-13 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
CN106605224B (zh) | 信息搜索方法、装置、电子设备及服务器 | |
CN107341185B (zh) | 信息显示的方法及装置 | |
EP3221817B1 (en) | Screenshot based indication of supplemental information | |
CN104066009B (zh) | 节目识别方法、装置、终端、服务器及*** | |
US10712936B2 (en) | First electronic device and information processing method applicable to first or second electronic device comprising a first application | |
KR20170096042A (ko) | 공유된 관심사를 갖는 메시지들의 갤러리 | |
WO2020044099A1 (zh) | 一种基于对象识别的业务处理方法和装置 | |
US20150085146A1 (en) | Method and system for storing contact information in an image using a mobile device | |
JP6143973B2 (ja) | 電話着信に対する返信方法、装置、端末、プログラム及び記録媒体 | |
WO2017219497A1 (zh) | 消息生成方法及装置 | |
JP7231638B2 (ja) | 映像に基づく情報取得方法及び装置 | |
WO2016082461A1 (zh) | 推荐信息获取方法、终端及服务器 | |
CN110580486A (zh) | 一种数据处理方法、装置、电子设备和可读介质 | |
US20100275120A1 (en) | Processing of fields in motion picture videos or still photos | |
JP2004164180A (ja) | 情報処理装置、通信処理装置、および方法、並びにコンピュータ・プログラム | |
CN107665447B (zh) | 信息处理方法和信息处理设备 | |
CN103986845A (zh) | 信息处理方法和信息处理设备 | |
CN103888423B (zh) | 信息处理方法和信息处理设备 | |
WO2014094614A1 (zh) | 信息处理方法和信息处理设备 | |
CN117459662A (zh) | 一种视频播放方法、识别方法、装置、设备及存储介质 | |
CN106886541B (zh) | 一种数据搜索方法、装置以及一种用于数据搜索的装置 | |
CN106470215B (zh) | 用户终端、服务器、未关注场景的消息推送***及方法 | |
CN111797746A (zh) | 人脸识别方法、装置及计算机可读存储介质 | |
CN111897474A (zh) | 文件处理方法和电子设备 | |
CN111526380A (zh) | 视频处理方法、装置、服务器、电子设备及存储介质 |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
121 | Ep: the epo has been informed by wipo that ep was designated in this application |
Ref document number: 13864566 Country of ref document: EP Kind code of ref document: A1 |
|
WWE | Wipo information: entry into national phase |
Ref document number: 14388722 Country of ref document: US |
|
WWE | Wipo information: entry into national phase |
Ref document number: 112013006130 Country of ref document: DE Ref document number: 1120130061309 Country of ref document: DE |
|
122 | Ep: pct application non-entry in european phase |
Ref document number: 13864566 Country of ref document: EP Kind code of ref document: A1 |