CN105338282A - Information processing method and electronic equipment - Google Patents
Information processing method and electronic equipment Download PDFInfo
- Publication number
- CN105338282A CN105338282A CN201410283199.3A CN201410283199A CN105338282A CN 105338282 A CN105338282 A CN 105338282A CN 201410283199 A CN201410283199 A CN 201410283199A CN 105338282 A CN105338282 A CN 105338282A
- Authority
- CN
- China
- Prior art keywords
- information
- electronic equipment
- image information
- image
- type
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
Landscapes
- Information Transfer Between Computers (AREA)
- Telephonic Communication Services (AREA)
Abstract
The invention discloses an information processing method applied to first electronic equipment. The electronic equipment contains an image collection unit. The method comprises: image collection is carried out on an operating body of first electronic equipment by the image collection unit to obtain first image information; image information of at least one predetermined sub area in the first image information is analyzed to obtain second image information, and the second image information is parsed to generate first information corresponding to the first image information; and the first information and the first image information are sent to second electronic equipment. In addition, the invention also discloses electronic equipment.
Description
Technical field
The present invention relates to video communication technology, particularly relate to a kind of information processing method and electronic equipment.
Background technology
The application of current video communication is very extensive, the video communication generally adopted at present is: an electronic equipment collection is just after the image and voice messaging of the user of video communication, send to the opposite end electronic equipment of video communication, described opposite end electronic equipment carries out image display and voice broadcast after receiving image and voice messaging.And under some scene, user needs to carry out video communication under quiet environment, that is, electronic equipment can not gather voice messaging or cannot collect voice messaging; So, in such a scenario, how to ensure normal video communication, namely ensure that the normal language of video communication both sides is mutual, this is technical problem urgently to be resolved hurrily at present.
Summary of the invention
For solving the technical problem of existing existence, the embodiment of the present invention is expected to provide a kind of information processing method and electronic equipment.
Embodiments provide a kind of information processing method, be applied to the first electronic equipment, described electronic equipment comprises image acquisition units, and described method comprises:
Carry out IMAQ by the operating body of described image acquisition units to described first electronic equipment, obtain the first image information;
The image information extracting at least one predetermined sub-region in described first image information is analyzed, and obtains the second image information, resolves described second image information, generates the first information of corresponding described first image information;
The described first information and described first image information are sent to the second electronic equipment.
The embodiment of the present invention additionally provides a kind of information processing method, is applied to the second electronic equipment, and described method comprises:
Receive the first image information of the first electronic equipment transmission and the first information corresponding with described first image information;
By described first image information of unit display that displays the play, and the pattern residing for described second electronic equipment, the synchronous described first information playing match-type.
The embodiment of the present invention additionally provides a kind of first electronic equipment, comprising:
Image acquisition units, for carrying out IMAQ to the operating body of described first electronic equipment, obtains the first image information;
Information acquisition unit, analyzes for the image information extracting at least one predetermined sub-region in described first image information, obtains the second image information, resolves described second image information, generates the first information of corresponding described first image information;
Information transmitting unit, for being sent to the second electronic equipment by the described first information and described first image information.
The embodiment of the present invention additionally provides a kind of second electronic equipment, comprising:
Information receiving unit, for receiving the first image information of the first electronic equipment transmission and the first information corresponding with described first image information;
Display the play unit, for showing described first image information, and the pattern residing for described second electronic equipment, the synchronous described first information playing match-type.
A kind of information processing method that the embodiment of the present invention provides and electronic equipment, when electronic equipment be in cannot gather voice, still can by the lip reading recognition technology to collection image, the lip reading of the user of electronic equipment is expressed and is translated as the opposite end that corresponding word and/or voice messaging send to video communication, enable the user of opposite end understand the semantic meaning representation of the user of electronic equipment, thus ensure normally carrying out of video communication.The embodiment of the present invention proposes a kind of new video communication mode, is a kind of experience completely newly.
Accompanying drawing explanation
Fig. 1 is the flow chart of the information processing method of the embodiment of the present invention one;
Fig. 2 is the flow chart of the information processing method of the embodiment of the present invention two;
Fig. 3 is the composition structural representation of the first electronic equipment of the embodiment of the present invention three;
Fig. 4 is the composition structural representation of the second electronic equipment of the embodiment of the present invention four;
Fig. 5 is the composition structural representation of the electronic equipment of the embodiment of the present invention five.
Embodiment
Below in conjunction with the drawings and specific embodiments, the technical solution of the present invention is further elaborated.
Embodiment one
For realizing the normal video communication under squelch, the embodiment of the present invention one provides a kind of information processing method, and the method is applied in the first electronic equipment, and described first electronic equipment comprises image acquisition units; In the present embodiment, the first electronic equipment refers in particular to the electronic equipment of the IMAQ transmitting terminal in video communication.As shown in Figure 1, the method comprises:
Step 101, carries out IMAQ by image acquisition units to the operating body of the first electronic equipment, obtains the first image information.
The operating body of described first electronic equipment, refers to that described first electronic equipment of operation carries out the user of video communication.First electronic equipment carries out IMAQ by its image acquisition units to the user that described first electronic equipment of operation carries out video communication, obtains the first image information.It should be noted that, image acquisition units is mainly the facial image information gathering user, that is, mainly comprises the facial image information of user in described first image information.
Step 102, the image information extracting at least one predetermined sub-region in the first image information is analyzed, and obtains the second image information, resolves the second image information, generates the first information of corresponding first image information.
Preferably, the first electronic equipment can carry out sub-zone dividing to the first image information, and extracts the image information of at least one predetermined sub-region from the first image information dividing subregion; Image characteristic analysis and lip image recognition are carried out to extracted image information, and according to the result of described image characteristic analysis and lip image recognition, generates the second image information.What mainly comprise in the second image information is the lip image information identified.
Wherein, the image information of at least one predetermined sub-region is extracted from the first image information dividing subregion, following mode can be adopted realize: carry out facial characteristics identification to the first image information dividing subregion, extract the image information of the subregion identified shared by gained facial characteristics.
Preferably, described parsing second image information, generate the first information of corresponding first image information, comprise: inquire about predetermined Image Database according to the second image information, obtain the 3rd image information of mating with the second image information in Image Database, and obtain the first information corresponding to the 3rd image information; Wherein, Image Database comprises the mapping relations of the 3rd image information and the first information.
Wherein, the first information is the first information of literal type and/or the first information of sound-type, that is, both can be the mapping relations comprising the 3rd image information and corresponding Word message in described Image Database, also can be the mapping relations comprising the 3rd image information and corresponding voice messaging, can also be the mapping relations comprising the 3rd image information and corresponding Word message and voice messaging.The 3rd image information in described Image Database, refers to the lip image information corresponding to various lip reading, and that is, what store in described Image Database is various lip reading and the mapping relations of corresponding word and/or pronunciation.So, according to the second image information query image information bank, word and/or the pronunciation of the lip reading corresponding with the second image information can be obtained.
Step 103, is sent to the second electronic equipment by the first information and the first image information.
Preferably, the pattern of the first electronic equipment residing for the second electronic equipment, if the second electronic equipment is in first mode, then sends the first information of the first image information and literal type to the second electronic equipment;
If the second electronic equipment is in the second pattern, then send the first information of the first image information and sound-type to the second electronic equipment;
If the second electronic equipment is in three-mode, then send the first information of the first image information and literal type and sound-type to the second electronic equipment.
Wherein, in the flrst mode, the second electronic equipment allows to show corresponding Word message in broadcasting first image information simultaneously, under the second electronic equipment is in squelch; Under the second mode, the second electronic equipment allows to play corresponding voice messaging in broadcasting first image information simultaneously; In a third mode, the second electronic equipment allows show corresponding Word message in broadcasting first image information simultaneously and play corresponding voice messaging.Pattern residing for second electronic equipment, can be obtained from the second electronic equipment by the first electronic equipment, concrete, can be that the second electronic equipment is initiatively supplied to the first electronic equipment, also can be that the second electronic equipment is supplied to the first electronic equipment according to the request of the first electronic equipment.
Preferably, described the first information and the first image information are sent to the second electronic equipment, comprise: the first image information of each frame of continuous print and the first information of correspondence thereof are sent to the second electronic equipment.That is, in video communication, first electronic equipment is the first image information that continuous print gathers multiframe, so, for the first image information of each frame gathered, first electronic equipment all needs to perform the operation in abovementioned steps 102 and 103, thus the first electronic equipment sends to the second electronic equipment is the first image information of continuous multiple frames and the described first information corresponding respectively with the first image information of each frame.
By embodiments of the invention one, when the first electronic equipment be in cannot gather voice, first electronic equipment still can by the lip reading recognition technology to collection image, the lip reading of the user of the first electronic equipment is expressed and is translated as corresponding word and/or voice messaging sends to the second electronic equipment, enable the user of the second electronic equipment understand the semantic meaning representation of the user of the first electronic equipment, thus ensure normally carrying out of video communication.
Embodiment two
Embodiments of the invention two additionally provide a kind of information processing method, are applied to the second electronic equipment, and in the present embodiment, the second electronic equipment image information of refering in particular in video communication receives the electronic equipment of display end.As shown in Figure 2, the method comprises:
Step 201, receives the first image information of the first electronic equipment transmission and the first information corresponding with the first image information.
The first information that second electronic equipment receives can be the Word message corresponding with the first image information and/or voice messaging.In implementation process, the first electronic equipment sends the first information of which kind of type to the second electronic equipment, is determined on a case-by-case basis.
Step 202, shows the first image information by the unit that displays the play, and the pattern residing for the second electronic equipment, the synchronous first information playing match-type.
Preferably, after receiving the first image information and the first information, the second electronic equipment needs to judge which kind of video communication pattern self is currently in; If the second electronic equipment is in first mode, then the second electronic equipment is except showing the first image information by the unit that displays the play, the Word message that also simultaneous display is corresponding with the first image information; If the second electronic equipment is in the second pattern, then the second electronic equipment is except showing the first image information by the unit that displays the play, the voice messaging that also synchronous broadcasting is corresponding with the first image information; If the second electronic equipment is in three-mode, then the second electronic equipment is except showing the first image information by the unit that displays the play, the Word message that also simultaneous display is corresponding with the first image information, and the voice messaging that synchronous broadcasting is corresponding with the first image information.
Preferably, the first information of described broadcasting match-type, comprising: according to the first image information and the first information of each frame of continuous print received, continuous print plays the first information corresponding with the first image information of each frame.That is, in video communication, first electronic equipment is the first image information that continuous print gathers multiframe, so, for the first image information of each frame gathered, first electronic equipment all needs to perform the operation in abovementioned steps 102 and 103, thus the first electronic equipment sends to the second electronic equipment is the first image information of continuous multiple frames and the described first information corresponding respectively with the first image information of each frame; So corresponding, the first image information and the first information of what the second electronic equipment received is also successive frame, the second electronic equipment needs the first image information showing successive frame, and continuous print plays the first information corresponding with the first image information of each frame.
By embodiments of the invention two, when the first electronic equipment be in cannot gather voice, first electronic equipment still can by the lip reading recognition technology to collection image, the lip reading of the user of the first electronic equipment is expressed and is translated as corresponding word and/or voice messaging sends to the second electronic equipment, and the user of the second electronic equipment also can understand the semantic meaning representation of the user of the first electronic equipment according to the word received and/or voice messaging, thus ensure normally carrying out of video communication.
Embodiment three
The information processing method of the corresponding embodiment of the present invention one, embodiments of the invention three additionally provide a kind of first electronic equipment, and described first electronic equipment refers to the electronic equipment of the IMAQ transmitting terminal in video communication.As shown in Figure 3, this first electronic equipment comprises:
Image acquisition units 10, for carrying out IMAQ to the operating body of the first electronic equipment, obtains the first image information;
Information acquisition unit 20, analyzes for the image information extracting at least one predetermined sub-region in the first image information, obtains the second image information, resolves the second image information, generates the first information of corresponding first image information;
Information transmitting unit 30, for being sent to the second electronic equipment by the first information and the first image information.
Preferably, information acquisition unit 20 is further used for, and carries out sub-zone dividing to the first image information, and extracts the image information of at least one predetermined sub-region from the first image information dividing subregion; Image characteristic analysis and lip image recognition are carried out to extracted image information, and according to the result of image characteristic analysis and lip image recognition, generates the second image information.What mainly comprise in the second image information is the lip image information identified.
Wherein, the image information of at least one predetermined sub-region is extracted from the first image information dividing subregion, following mode can be adopted realize: carry out facial characteristics identification to the first image information dividing subregion, extract the image information of the subregion identified shared by gained facial characteristics.
Preferably, information acquisition unit 20 is further used for, and inquires about predetermined Image Database according to the second image information, obtains the 3rd image information of mating with the second image information in Image Database, and obtains the first information corresponding to the 3rd image information;
Wherein, Image Database comprises the mapping relations of the 3rd image information and the first information.
The 3rd image information in Image Database, refers to the lip image information corresponding to various lip reading, and that is, what store in described Image Database is various lip reading and the mapping relations of corresponding word and/or pronunciation.So, according to the second image information query image information bank, word and/or the pronunciation of the lip reading corresponding with the second image information can be obtained.
Preferably, the shown first information is the first information of literal type and/or the first information of sound-type;
Described information transmitting unit 30 is further used for,
According to the pattern residing for the second electronic equipment, when the second electronic equipment is in first mode, send the first information of the first image information and corresponding literal type to the second electronic equipment;
When the second electronic equipment is in the second pattern, send the first information of the first image information and corresponding sound-type to described second electronic equipment;
When described second electronic equipment is in three-mode, send the first information of the first image information and corresponding word and sound-type to described second electronic equipment.
Wherein, in the flrst mode, the second electronic equipment allows to show corresponding Word message in broadcasting first image information simultaneously, under the second electronic equipment is in squelch; Under the second mode, the second electronic equipment allows to play corresponding voice messaging in broadcasting first image information simultaneously; In a third mode, the second electronic equipment allows show corresponding Word message in broadcasting first image information simultaneously and play corresponding voice messaging.Pattern residing for second electronic equipment, can be obtained from the second electronic equipment by the first electronic equipment, concrete, can be that the second electronic equipment is initiatively supplied to the first electronic equipment, also can be that the second electronic equipment is supplied to the first electronic equipment according to the request of the first electronic equipment.
Preferably, information transmitting unit 30 is further used for, and the first image information of each frame of continuous print and the first information of correspondence thereof are sent to the second electronic equipment.
By embodiments of the invention three, when the first electronic equipment be in cannot gather voice, first electronic equipment still can by the lip reading recognition technology to collection image, the lip reading of the user of the first electronic equipment is expressed and is translated as corresponding word and/or voice messaging sends to the second electronic equipment, enable the user of the second electronic equipment understand the semantic meaning representation of the user of the first electronic equipment, thus ensure normally carrying out of video communication.
It should be noted that, above-mentioned image acquisition units 10 can be realized by the camera of the first electronic equipment, information acquisition unit 20 can by the central processing unit (CPU of the first electronic equipment, CentralProcessingUnit), microprocessor (MPU, MicroProcessingUnit), digital signal processor (DSP, or programmable logic array (FPGA DigitalSignalProcessor), Field-ProgrammableGateArray) realize, information transmitting unit 30 can be realized by the communication function chip of the first electronic equipment.
Embodiment four
The information processing method of the corresponding embodiment of the present invention two, embodiments of the invention four additionally provide a kind of second electronic equipment, and the second electronic equipment refers to that the image information in video communication receives the electronic equipment of display end.As shown in Figure 4, this second electronic equipment comprises:
Information receiving unit 40, for receiving the first image information of the first electronic equipment transmission and the first information corresponding with the first image information;
Display the play unit 50, for showing the first image information, and the pattern residing for the second electronic equipment, the synchronous first information playing match-type.
Wherein, the first information that the second electronic equipment receives can be the Word message corresponding with the first image information and/or voice messaging.In implementation process, the first electronic equipment sends the first information of which kind of type to the second electronic equipment, is determined on a case-by-case basis.
Preferably, the unit 50 that displays the play is further used for,
When the second electronic equipment is in first mode, the first information of synchronization display words type;
When the second electronic equipment is in the second pattern, the synchronous first information playing sound-type;
When the second electronic equipment is in three-mode, the first information of synchronization display words type, and the synchronous first information playing sound-type.
That is, after information receiving unit 40 receives the first image information and the first information, the unit 50 that displays the play needs judgement second electronic equipment is current is in for which kind of video communication pattern; If the second electronic equipment is in first mode, then display the play unit 50 except showing the first image information, the Word message that also simultaneous display is corresponding with the first image information; If the second electronic equipment is in the second pattern, then display the play unit 50 except showing the first image information, the voice messaging that also synchronous broadcasting is corresponding with the first image information; If the second electronic equipment is in three-mode, then display the play unit 50 except showing the first image information, the Word message that also simultaneous display is corresponding with the first image information, and the voice messaging that synchronous broadcasting is corresponding with the first image information.
Preferably, the unit 50 that displays the play is further used for, and according to the first image information and the first information of each frame of continuous print received, continuous print plays the first information corresponding with the first image information of each frame.
By embodiments of the invention four, when the first electronic equipment be in cannot gather voice, first electronic equipment still can by the lip reading recognition technology to collection image, the lip reading of the user of the first electronic equipment is expressed and is translated as corresponding word and/or voice messaging sends to the second electronic equipment, and the user of the second electronic equipment also can understand the semantic meaning representation of the user of the first electronic equipment according to the word received and/or voice messaging, thus ensure normally carrying out of video communication.
It should be noted that, above-mentioned information receiving unit 40 can be realized by the communication function chip of the second electronic equipment, and the unit 50 that displays the play can be realized jointly by the display of the second electronic equipment and CPU, MPU, DSP or FPGA.
Also it should be noted that, in actual applications, the image information that an electronic equipment in video communication should gather local terminal usually sends to opposite end, and the image information that also will receive opposite end transmission shows at local terminal; That that is, an electronic equipment in practical application can possess the function of first electronic equipment of above-described embodiment three and the second electronic functionalities of embodiment four simultaneously.
Embodiment five
The present embodiment provides a kind of electronic equipment simultaneously possessing the first electronic functionalities and the second electronic functionalities, and as shown in Figure 5, this electronic equipment comprises:
Image acquisition units 10, for carrying out IMAQ to the operating body of video communication local terminal, obtains the first image information;
Information acquisition unit 20, analyzes for the image information extracting at least one predetermined sub-region in the first image information, obtains the second image information, resolves the second image information, generates the first information of corresponding first image information;
Information transmitting unit 30, for being sent to the electronic equipment of video communication opposite end by the first information and the first image information.
Preferably, information acquisition unit 20 is further used for, and carries out sub-zone dividing to the first image information, and extracts the image information of at least one predetermined sub-region from the first image information dividing subregion; Image characteristic analysis and lip image recognition are carried out to extracted image information, and according to the result of image characteristic analysis and lip image recognition, generates the second image information.What mainly comprise in the second image information is the lip image information identified.
Preferably, information acquisition unit 20 is further used for, and inquires about predetermined Image Database according to the second image information, obtains the 3rd image information of mating with the second image information in Image Database, and obtains the first information corresponding to the 3rd image information;
Wherein, Image Database comprises the mapping relations of the 3rd image information and the first information.
Preferably, the shown first information is the first information of literal type and/or the first information of sound-type;
Described information transmitting unit 30 is further used for,
According to the pattern residing for the electronic equipment of video communication opposite end, when opposite end is in first mode, send the first information of the first image information and corresponding literal type to opposite end;
When opposite end is in the second pattern, send the first information of the first image information and corresponding sound-type to opposite end;
When opposite end is in three-mode, send the first information of the first image information and corresponding word and sound-type to opposite end.
Preferably, information transmitting unit 30 is further used for, and the first image information of each frame of continuous print and the first information of correspondence thereof is sent to the electronic equipment of video communication opposite end.
This electronic equipment also comprises:
Information receiving unit 40, the first image information that the electronic equipment for receiver, video Correspondent Node sends and the first information corresponding with the first image information;
Display the play unit 50, for showing the first image information, and the pattern residing for opposite end, the synchronous first information playing match-type.
Preferably, the unit 50 that displays the play is further used for,
When opposite end is in first mode, the first information of synchronization display words type;
When opposite end is in the second pattern, the synchronous first information playing sound-type;
When opposite end is in three-mode, the first information of synchronization display words type, and the synchronous first information playing sound-type.
Preferably, the unit 50 that displays the play is further used for, and according to the first image information and the first information of each frame of continuous print received, continuous print plays the first information corresponding with the first image information of each frame.
It should be noted that, above-mentioned image acquisition units 10 can be realized by the camera of electronic equipment, information acquisition unit 20 can be realized by CPU, MPU, DSP or FPGA of electronic equipment, information transmitting unit 30 and information receiving unit 40 can be realized by the communication function chip of electronic equipment, and the unit 50 that displays the play can be realized jointly by the display of electronic equipment and CPU, MPU, DSP or FPGA.
Illustrate again below and the information processing method of the embodiment of the present invention and electronic equipment elaborated further.
Embodiment six
In embodiments of the invention six, under first electronic equipment is in squelch, namely can not carry out voice collecting, the second electronic equipment is in first mode, be preset with Image Database in first electronic equipment, Image Database comprises the mapping relations of lip reading information and corresponding Word message.Information processing method in video communication mainly comprises:
1, the first electronic equipment carries out IMAQ by its image acquisition units to this end subscriber, obtains the first image information; For each frame first image information obtained, the image information extracting at least one predetermined sub-region in the first image information carries out image characteristic analysis and lip image recognition, obtains the lip image information identified; Lip image information according to identifying inquires about predetermined Image Database, obtains the Word message corresponding to lip reading information (also for representing the various image informations of lip) matched in image data base;
2, the first electronic equipment knows that the second electronic equipment is in first mode, thus the first image information of each frame of continuous print and the Word message of correspondence thereof are sent to the second electronic equipment; Or the first image information of each frame of continuous print and the Word message of correspondence thereof without the need to knowing the pattern residing for the second electronic equipment, and are directly sent to the second electronic equipment by the first electronic equipment;
3, the second electronic equipment receives from the first image information of the first electronic equipment and Word message, judge that the second electronic equipment is current and be in first mode, thus shown the first image information of each frame by its unit continuous print that displays the play, and the Word message that simultaneous display is corresponding with the first image information of each frame.
Embodiment seven
In embodiments of the invention seven, under first electronic equipment is in squelch, namely can not carry out voice collecting, the second electronic equipment is in the second pattern, be preset with Image Database in first electronic equipment, Image Database comprises the mapping relations of lip reading information and corresponding Word message.Information processing method in video communication mainly comprises:
1, the first electronic equipment carries out IMAQ by its image acquisition units to this end subscriber, obtains the first image information; For each frame first image information obtained, the image information extracting at least one predetermined sub-region in the first image information carries out image characteristic analysis and lip image recognition, obtains the lip image information identified; Lip image information according to identifying inquires about predetermined Image Database, obtains the Word message corresponding to lip reading information (also for representing the various image informations of lip) matched in image data base;
2, the first electronic equipment knows that the second electronic equipment is in the second pattern, thus the Word message of the first image information of each frame corresponding is converted to corresponding voice messaging, and the first image information of each frame of continuous print and the voice messaging of correspondence thereof are sent to the second electronic equipment; Or, first electronic equipment is without the need to knowing the pattern residing for the second electronic equipment, and directly the first image information of each frame of continuous print and the Word message of correspondence thereof are sent to the second electronic equipment, second electronic equipment judges self to be in the second pattern, thus the Word message of the first image information of each frame of correspondence received is converted to corresponding voice messaging;
3, the second electronic equipment is in the second pattern, is shown the first image information of each frame by its unit continuous print that displays the play, and the voice messaging that synchronous broadcasting is corresponding with the first image information of each frame.
Embodiment eight
In embodiments of the invention eight, under first electronic equipment is in squelch, namely can not carry out voice collecting, the second electronic equipment is in three-mode, be preset with Image Database in first electronic equipment, Image Database comprises the mapping relations of lip reading information and corresponding Word message.Information processing method in video communication mainly comprises:
1, the first electronic equipment carries out IMAQ by its image acquisition units to this end subscriber, obtains the first image information; For each frame first image information obtained, the image information extracting at least one predetermined sub-region in the first image information carries out image characteristic analysis and lip image recognition, obtains the lip image information identified; Lip image information according to identifying inquires about predetermined Image Database, obtains the Word message corresponding to lip reading information (also for representing the various image informations of lip) matched in image data base;
2, the first electronic equipment knows that the second electronic equipment is in three-mode, thus the Word message of the first image information of each frame corresponding is converted to corresponding voice messaging, and the first image information of each frame of continuous print and the word of correspondence thereof and voice messaging are sent to the second electronic equipment; Or, first electronic equipment is without the need to knowing the pattern residing for the second electronic equipment, and directly the first image information of each frame of continuous print and the Word message of correspondence thereof are sent to the second electronic equipment, second electronic equipment judges that self is in three-mode, thus the Word message of the first image information of each frame of correspondence received is converted to corresponding voice messaging;
3, the second electronic equipment is in three-mode, the first image information of each frame is shown by its unit continuous print that displays the play, the Word message that simultaneous display is corresponding with the first image information of each frame, and the voice messaging that synchronous broadcasting is corresponding with the first image information of each frame.
By embodiments of the invention six, seven, eight, when the first electronic equipment be in cannot gather voice, first electronic equipment still can by the lip reading recognition technology to collection image, the lip reading of the user of the first electronic equipment is expressed and is translated as corresponding word and/or voice messaging sends to the second electronic equipment, and the user of the second electronic equipment also can understand the semantic meaning representation of the user of the first electronic equipment according to the word received and/or voice messaging, thus ensure normally carrying out of video communication.
In addition, in a preferred embodiment, the first electronic equipment can record the time of generating character information, and according to the sequencing of time, generated Word message this locality is saved as text chat record; Second electronic equipment can record the time receiving Word message, and according to the sequencing of time, received Word message this locality is saved as text chat record.
Second electronic equipment can also be recorded to the content of voice broadcast, and the time of record recording, sort to each section of recording according to the sequencing of time, this locality saves as voice-enabled chat record.
In several embodiment provided by the present invention, should be understood that, disclosed method, device and electronic equipment, can realize by another way.Apparatus embodiments described above is only schematic, such as, the division of described unit, be only a kind of logic function to divide, actual can have other dividing mode when realizing, and as: multiple unit or assembly can be in conjunction with, maybe can be integrated into another system, or some features can be ignored, or do not perform.In addition, the coupling each other of shown or discussed each part or direct-coupling or communication connection can be by some interfaces, and the indirect coupling of equipment or unit or communication connection can be electrical, machinery or other form.
The above-mentioned unit illustrated as separating component or can may not be and physically separates, and the parts as unit display can be or may not be physical location, namely can be positioned at a place, also can be distributed in multiple network element; Part or all of unit wherein can be selected according to the actual needs to realize the object of the present embodiment scheme.
In addition, each functional unit in various embodiments of the present invention can all be integrated in a processing unit, also can be each unit individually as a unit, also can two or more unit in a unit integrated; Above-mentioned integrated unit both can adopt the form of hardware to realize, and the form that hardware also can be adopted to add SFU software functional unit realizes.
One of ordinary skill in the art will appreciate that: all or part of step realizing said method embodiment can have been come by the hardware that program command is relevant, aforesaid program can be stored in a computer read/write memory medium, this program, when performing, performs the step comprising said method embodiment; And aforesaid storage medium comprises: movable storage device, read-only memory (ROM, Read-OnlyMemory), random access memory (RAM, RandomAccessMemory), magnetic disc or CD etc. various can be program code stored medium.
Or, if the above-mentioned integrated unit of the embodiment of the present invention using the form of software function module realize and as independently production marketing or use time, also can be stored in a computer read/write memory medium.Based on such understanding, the technical scheme of the embodiment of the present invention can embody with the form of software product the part that prior art contributes in essence in other words, this computer software product is stored in a storage medium, comprises some instructions and performs all or part of of method described in each embodiment of the present invention in order to make a computer equipment (can be personal computer, server or the network equipment etc.).And aforesaid storage medium comprises: movable storage device, ROM, RAM, magnetic disc or CD etc. various can be program code stored medium.
The above; be only the specific embodiment of the present invention, but protection scope of the present invention is not limited thereto, is anyly familiar with those skilled in the art in the technical scope that the present invention discloses; change can be expected easily or replace, all should be encompassed within protection scope of the present invention.Therefore, protection scope of the present invention should be as the criterion with the protection range of described claim.
The above, be only preferred embodiment of the present invention, be not intended to limit protection scope of the present invention.
Claims (10)
1. an information processing method, is applied to the first electronic equipment, and described electronic equipment comprises image acquisition units, and described method comprises:
Carry out IMAQ by the operating body of described image acquisition units to described first electronic equipment, obtain the first image information;
The image information extracting at least one predetermined sub-region in described first image information is analyzed, and obtains the second image information, resolves described second image information, generates the first information of corresponding described first image information;
The described first information and described first image information are sent to the second electronic equipment.
2. information processing method according to claim 1, it is characterized in that, in described extraction first image information, the image information of at least one predetermined sub-region is analyzed, and obtains the second image information, comprising:
Sub-zone dividing is carried out to described first image information, and extract the image information of at least one predetermined sub-region from the first image information dividing subregion;
Image characteristic analysis and lip image recognition are carried out to extracted image information, and according to the result of described image characteristic analysis and lip image recognition, generates the second image information.
3. information processing method according to claim 1, it is characterized in that, described parsing second image information, generates the first information of corresponding first image information, comprising:
Inquire about predetermined Image Database according to described second image information, obtain the 3rd image information of mating with described second image information in described Image Database, and obtain the first information corresponding to described 3rd image information;
Wherein, described Image Database comprises the mapping relations of the 3rd image information and the first information.
4. information processing method according to claim 3, it is characterized in that, the described first information is the first information of literal type and/or the first information of sound-type;
Described second electronic equipment that is sent to by the first information comprises:
According to the pattern residing for described second electronic equipment, if described second electronic equipment is in first mode, then send the first information of literal type to described second electronic equipment;
If described second electronic equipment is in the second pattern, then send the first information of sound-type to described second electronic equipment;
If described second electronic equipment is in three-mode, then send the first information of literal type and sound-type to described second electronic equipment.
5. information processing method according to any one of Claims 1-4, is characterized in that, described the first information and the first image information is sent to the second electronic equipment, comprising:
Described first image information of each frame of continuous print and the first information of correspondence thereof are sent to described second electronic equipment.
6. an information processing method, is applied to the second electronic equipment, and described method comprises:
Receive the first image information of the first electronic equipment transmission and the first information corresponding with described first image information;
By described first image information of unit display that displays the play, and the pattern residing for described second electronic equipment, the synchronous described first information playing match-type.
7. information processing method according to claim 6, is characterized in that, described pattern residing for the second electronic equipment, and the synchronous first information playing match-type, comprising:
If described second electronic equipment is in first mode, then the described first information of synchronization display words type;
If described second electronic equipment is in the second pattern, then synchronously play the described first information of sound-type;
If described second electronic equipment is in three-mode, then the described first information of synchronization display words type, and the synchronous described first information playing sound-type.
8. information processing method according to claim 6 or 7, is characterized in that, the first information of described broadcasting match-type, comprising:
According to described first image information and the first information of each frame of continuous print received, continuous print plays the described first information corresponding with the first image information of each frame described.
9. first electronic equipment, comprising:
Image acquisition units, for carrying out IMAQ to the operating body of described first electronic equipment, obtains the first image information;
Information acquisition unit, analyzes for the image information extracting at least one predetermined sub-region in described first image information, obtains the second image information, resolves described second image information, generates the first information of corresponding described first image information;
Information transmitting unit, for being sent to the second electronic equipment by the described first information and described first image information.
10. second electronic equipment, comprising:
Information receiving unit, for receiving the first image information of the first electronic equipment transmission and the first information corresponding with described first image information;
Display the play unit, for showing described first image information, and the pattern residing for described second electronic equipment, the synchronous described first information playing match-type.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201410283199.3A CN105338282B (en) | 2014-06-23 | 2014-06-23 | A kind of information processing method and electronic equipment |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201410283199.3A CN105338282B (en) | 2014-06-23 | 2014-06-23 | A kind of information processing method and electronic equipment |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN105338282A true CN105338282A (en) | 2016-02-17 |
| CN105338282B CN105338282B (en) | 2019-07-26 |
Family
ID=55288530
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201410283199.3A Active CN105338282B (en) | 2014-06-23 | 2014-06-23 | A kind of information processing method and electronic equipment |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN105338282B (en) |
Cited By (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN107071328A (en) * | 2016-12-16 | 2017-08-18 | 维沃移动通信有限公司 | A kind of video calling processing method and mobile terminal |
| CN107087133A (en) * | 2017-03-24 | 2017-08-22 | 宇龙计算机通信科技(深圳)有限公司 | A kind of method of controlling security and terminal device |
| CN110213431A (en) * | 2019-04-30 | 2019-09-06 | 维沃移动通信有限公司 | Message method and mobile terminal |
Citations (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20060204033A1 (en) * | 2004-05-12 | 2006-09-14 | Takashi Yoshimine | Conversation assisting device and conversation assisting method |
| CN101510256A (en) * | 2009-03-20 | 2009-08-19 | 深圳华为通信技术有限公司 | Mouth shape language conversion method and device |
-
2014
- 2014-06-23 CN CN201410283199.3A patent/CN105338282B/en active Active
Patent Citations (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20060204033A1 (en) * | 2004-05-12 | 2006-09-14 | Takashi Yoshimine | Conversation assisting device and conversation assisting method |
| CN101510256A (en) * | 2009-03-20 | 2009-08-19 | 深圳华为通信技术有限公司 | Mouth shape language conversion method and device |
Cited By (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN107071328A (en) * | 2016-12-16 | 2017-08-18 | 维沃移动通信有限公司 | A kind of video calling processing method and mobile terminal |
| CN107071328B (en) * | 2016-12-16 | 2019-12-03 | 维沃移动通信有限公司 | A kind of video calling processing method and mobile terminal |
| CN107087133A (en) * | 2017-03-24 | 2017-08-22 | 宇龙计算机通信科技(深圳)有限公司 | A kind of method of controlling security and terminal device |
| CN107087133B (en) * | 2017-03-24 | 2020-07-03 | 宇龙计算机通信科技(深圳)有限公司 | Safety control method and terminal equipment |
| CN110213431A (en) * | 2019-04-30 | 2019-09-06 | 维沃移动通信有限公司 | Message method and mobile terminal |
Also Published As
| Publication number | Publication date |
|---|---|
| CN105338282B (en) | 2019-07-26 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN104618806A (en) | Method, device and system for acquiring comment information of video | |
| CN108304368B (en) | Text information type identification method and device, storage medium and processor | |
| CN104902343B (en) | A kind of method, server and the terminal of transmission and playing audio-video and message | |
| CN109036416B (en) | Simultaneous interpretation method and system, storage medium and electronic device | |
| CN104936035A (en) | Barrage processing method and system | |
| US9606975B2 (en) | Apparatus and method for automatically generating visual annotation based on visual language | |
| CN113301430A (en) | Video clipping method, video clipping device, electronic equipment and storage medium | |
| CN111883168B (en) | Voice processing method and device | |
| CN104881486A (en) | Method, terminal equipment and system for querying information | |
| CN106571942B (en) | Configuration data updating method, client and server | |
| CN110149551B (en) | Media file playing method and device, storage medium and electronic device | |
| CN111182359A (en) | Video preview method, video frame extraction method, video processing device and storage medium | |
| CN112053692B (en) | Speech recognition processing method, device and storage medium | |
| CN107547922B (en) | Information processing method, device, system and computer readable storage medium | |
| CN105338282A (en) | Information processing method and electronic equipment | |
| CN105049999A (en) | Demonstration method of sound box subgroups, local server, mobile terminal and system | |
| CN103475532A (en) | Hardware detection method and system thereof | |
| CN112752134A (en) | Video processing method and device, storage medium and electronic device | |
| KR20160131730A (en) | System, Apparatus and Method For Processing Natural Language, and Computer Readable Recording Medium | |
| CN112820273B (en) | Wake-up judging method and device, storage medium and electronic equipment | |
| CN104602099A (en) | Subtitle display method and device | |
| CN111312260A (en) | Human voice separation method, device and equipment | |
| CN103763087A (en) | Information processing method and electronic devices | |
| CN113411544A (en) | Video fragment file sending method and device, storage medium and electronic device | |
| CN104853232A (en) | Television channel updating method and device |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| C10 | Entry into substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |