CN108712441A - Information processing method, device and terminal - Google Patents

Information processing method, device and terminal Download PDF

Info

Publication number
CN108712441A
CN108712441A CN201810558475.0A CN201810558475A CN108712441A CN 108712441 A CN108712441 A CN 108712441A CN 201810558475 A CN201810558475 A CN 201810558475A CN 108712441 A CN108712441 A CN 108712441A
Authority
CN
China
Prior art keywords
audio
frequency information
terminal
ims network
called terminal
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Granted
Application number
CN201810558475.0A
Other languages
Chinese (zh)
Other versions
CN108712441B (en
Inventor
王鑫
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
China United Network Communications Group Co Ltd
Original Assignee
China United Network Communications Group Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by China United Network Communications Group Co Ltd filed Critical China United Network Communications Group Co Ltd
Priority to CN201810558475.0A priority Critical patent/CN108712441B/en
Publication of CN108712441A publication Critical patent/CN108712441A/en
Application granted granted Critical
Publication of CN108712441B publication Critical patent/CN108712441B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Classifications

    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04LTRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L65/00Network arrangements, protocols or services for supporting real-time applications in data packet communication
    • H04L65/40Support for services or applications
    • H04L65/401Support for services or applications wherein the services involve a main real-time session and one or more additional parallel real-time or time sensitive sessions, e.g. white board sharing or spawning of a subconference
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04LTRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L65/00Network arrangements, protocols or services for supporting real-time applications in data packet communication
    • H04L65/10Architectures or entities
    • H04L65/1016IP multimedia subsystem [IMS]

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Computer Networks & Wireless Communication (AREA)
  • Signal Processing (AREA)
  • Telephonic Communication Services (AREA)

Abstract

A kind of information processing method of present invention offer, device and terminal, this method, including:In calling terminal and called terminal carry out internet protocol multi-media system IMS voice call process, the picture transfer request that the calling terminal is sent is received;Wherein, the calling terminal is picture transmitting terminal, and the called terminal is picture receiving terminal;It is asked according to the picture transfer, convolutional code and data queue's order information is sent to the calling terminal;The audio-frequency information that the calling terminal is sent is received, the audio-frequency information is converted to by Target Photo, convolutional code and data queue's order information;The audio-frequency information is transmitted to the called terminal by the IMS network of called terminal.So that calling terminal directly can carry out picture transfer in IMS voice call process by call interface, called terminal directly receives picture in call interface, and whole operation is simple, and user experience is good.

Description

Information processing method, device and terminal
Technical field
The present invention relates to a kind of field of communication technology more particularly to information processing method, device and terminals.
Background technology
It is the most common way kept in touch in people's life to carry out voice communication using portable terminal.
Currently, the speech business (Voice over Long Term Evolution, VOLTE) of Long Term Evolution and nothing The speech business (Voice over Wireless Fidelity, VOWIFI) of line LAN can only support basic speech to converse, When user carries out voice communication, the transmission of picture can not be carried out at the same time.If carrying out picture transfer, need to rely on other The application of picture transfer is supported to complete.
But in communication process, operation other application software, which carries out picture transfer, can influence the voice communication matter of terminal Amount, and whole process is cumbersome, user experience is bad.
Invention content
A kind of information processing method of present invention offer, device and terminal, it is directly logical in IMS voice call process to realize It crosses call interface and carries out picture transfer, easy to operate, user experience is good.
In a first aspect, the embodiment of the present invention provides a kind of information processing method, including:
In calling terminal and called terminal carry out internet protocol multi-media system IMS voice call process, institute is received State the picture transfer request of calling terminal transmission;Wherein, the calling terminal is picture transmitting terminal, and the called terminal is picture Receiving terminal;
It is asked according to the picture transfer, convolutional code and data queue's order information is sent to the calling terminal;
The audio-frequency information that the calling terminal is sent is received, the audio-frequency information is by Target Photo, convolutional code and number It is converted to according to queue order information;
The audio-frequency information is transmitted to described be called by the internet protocol multi-media system IMS network of called terminal Terminal.
Optionally, it is asked according to the picture transfer, convolutional code and data queue's order is sent to the calling terminal After information, further include:
By the convolutional code and data queue order information synchronize be sent to the IMS network of the called terminal, to pass through The convolutional code and data queue's order information are sent to the called terminal by the IMS network of the called terminal.
Optionally, after receiving the audio-frequency information that the calling terminal is sent, further include:
The audio-frequency information and the convolutional code are subjected to auto-correlation computation;
If obtained auto-correlation computation result is more than predetermined threshold value, it is determined that the audio-frequency information has arrived at described called Terminal;
Audio-frequency information decoding indication signals are sent to the called terminal by the IMS network of the called terminal, so that After the called terminal carries out inverse transformation by the convolutional code and data queue's order information to the audio-frequency information, obtain The Target Photo.
Optionally, the audio-frequency information is transmitted to by the internet protocol multi-media system IMS network of called terminal After the called terminal, further include:
Receive the signal enhancing request that the IMS network of the called terminal is sent;
After the audio-frequency information and/or call voice are carried out signal enhancing processing, again through the IMS of called terminal Forwarded gives the called terminal.
Second aspect, the embodiment of the present invention provide a kind of information processing method, including:
Calling terminal with called terminal during carrying out internet protocol multi-media system IMS voice communications, to institute The internet protocol multi-media system IMS network for stating calling terminal sends picture transfer request;
Receive the convolutional code and data queue's order information that the IMS network of calling terminal is sent;
Conversion process is carried out to Target Photo using the convolutional code and data queue's order information, obtains corresponding audio Information;
The audio-frequency information is sent to the IMS network of the calling terminal.
Optionally, conversion process is carried out to Target Photo using the convolutional code and data queue's order information, obtained pair The audio-frequency information answered, including:
Target Photo is digitally converted, corresponding initial number matrix is obtained;
According to data queue's order information, the convolutional code is inserted into the initial number matrix, mesh is obtained Mark character matrix;
It is corresponding audio-frequency information by the target number matrix conversion according to default rule.
Optionally, the convolutional code and data queue's order information be used to identify the audio-frequency information start time point and End time point.
The third aspect, the embodiment of the present invention provide a kind of information processing method, including:
Called terminal receives the Internet protocol of the called terminal during carrying out voice communication with calling terminal The audio-frequency information of multimedia system IMS network forwarding;Wherein, the audio-frequency information is the target figure sent by the calling terminal What the convolutional code and data queue's order information that the IMS network of piece and calling terminal is sent were converted to;
Analyzing processing is carried out to the audio-frequency information, obtains corresponding Target Photo.
Optionally, in the audio-frequency information for the internet protocol multi-media system IMS network forwarding for receiving the called terminal Before, further include:
Receive the convolutional code and data queue's order information of the IMS network forwarding of the called terminal.
Optionally, described that analyzing processing is carried out to the audio-frequency information, corresponding Target Photo is obtained, including:
Receive the audio-frequency information decoding indication signals of the IMS network forwarding of the called terminal;
Effective audio-frequency information is digitally converted, target number matrix is obtained;
The convolutional code in the target number matrix is removed according to data queue's order information, obtains initial number square Battle array;
Inversion process is carried out to the initial number matrix, obtains corresponding Target Photo.
Optionally, carry out analyzing processing to the audio-frequency information further includes before obtaining corresponding Target Photo:
Signal to Noise Ratio (SNR) monitoring is carried out to the audio-frequency information and call voice respectively;
If the SNR of the audio-frequency information and/or the call voice is less than threshold value, pass through the IMS of called terminal Network sends signal enhancing request to the IMS network of calling terminal;So that the IMS network of the calling terminal is by the audio After information and/or call voice carry out signal enhancing processing, it is transmitted to again through the IMS network of called terminal described called Terminal.
Fourth aspect, the embodiment of the present invention provide a kind of internet protocol multi-media system IMS network, including:Using clothes The channels access point APN for device AS and the application server AS and calling terminal foundation communication connection of being engaged in;Wherein:
The application server AS is used to execute information processing method as described in relation to the first aspect.
5th aspect, the embodiment of the present invention provide a kind of information processing unit, including:
Sending module is used for during carrying out internet protocol multi-media system IMS voice communications with called terminal, Picture transfer request is sent to the internet protocol multi-media system IMS network of calling terminal;
Receiving module, for receiving the convolutional code and data queue's order information that the IMS network of calling terminal is sent;
Processing module, for carrying out conversion process to Target Photo using the convolutional code and data queue's order information, Obtain corresponding audio-frequency information;
Sending module is additionally operable to for the audio-frequency information to be sent to the IMS network of the calling terminal.
Optionally, the processing module, is specifically used for:
Target Photo is digitally converted, corresponding initial number matrix is obtained;
According to data queue's order information, the convolutional code is inserted into the initial number matrix, mesh is obtained Mark character matrix;
It is corresponding audio-frequency information by the target number matrix conversion according to default rule.
Optionally, the convolutional code and data queue's order information be used to identify the audio-frequency information start time point and End time point.
6th aspect, the embodiment of the present invention provide a kind of information processing unit, including:
Receiving module, for during carrying out voice communication with calling terminal, receiving the internet protocol of called terminal Discuss the audio-frequency information of multimedia system IMS network forwarding;Wherein, the audio-frequency information is the target sent by the calling terminal What the convolutional code and data queue's order information that the IMS network of picture and calling terminal is sent were converted to;
Processing module obtains corresponding Target Photo for carrying out analyzing processing to the audio-frequency information.
Optionally, receiving module is additionally operable in the internet protocol multi-media system IMS network for receiving the called terminal Before the audio-frequency information of forwarding, the convolutional code and data queue's order information of the IMS network forwarding of the called terminal are received.
Optionally, the processing module, is specifically used for:
Receive the audio-frequency information decoding indication signals of the IMS network forwarding of the called terminal;
Effective audio-frequency information is digitally converted, target number matrix is obtained;
The convolutional code in the target number matrix is removed according to data queue's order information, obtains initial number square Battle array;
Inversion process is carried out to the initial number matrix, obtains corresponding Target Photo.
Optionally, further include:
Module is monitored, for carrying out analyzing processing to the audio-frequency information, before obtaining corresponding Target Photo, respectively Signal to Noise Ratio (SNR) monitoring is carried out to the audio-frequency information and call voice;
If the SNR of the audio-frequency information and/or the call voice is less than threshold value, pass through the IMS of called terminal Network sends signal enhancing request to the IMS network of calling terminal;So that the IMS network of the calling terminal is by the audio After information and/or call voice carry out signal enhancing processing, it is transmitted to again through the IMS network of called terminal described called Terminal.
7th aspect, the embodiment of the present invention provide a kind of terminal, including:
Memory, for storing program;
Processor, the described program for executing memory storage, when described program is performed, the processor For executing the method as described in any one of second aspect and/or the third aspect.
Eighth aspect, the embodiment of the present invention provide a kind of computer readable storage medium, including:Computer program, when it When running on computers so that computer executes any method in first aspect, second aspect, the third aspect.
Information processing method, device and terminal provided by the invention, by being interconnected in calling terminal and called terminal In fidonetFido multimedia system IMS voice call process, the picture transfer request that the calling terminal is sent is received;Wherein, institute It is picture transmitting terminal to state calling terminal, and the called terminal is picture receiving terminal;It is asked according to the picture transfer, to the master Terminal is made to send convolutional code and data queue's order information;Receive the audio-frequency information that the calling terminal is sent, the audio letter Breath is converted to by Target Photo, convolutional code and data queue's order information;The audio-frequency information is passed through called whole The IMS network at end is transmitted to the called terminal.So that calling terminal can directly pass through in IMS voice call process Call interface carries out picture transfer, and called terminal directly receives picture in call interface, and whole operation is simple, and user experience is good.
Description of the drawings
In order to more clearly explain the embodiment of the invention or the technical proposal in the existing technology, to embodiment or will show below There is attached drawing needed in technology description to be briefly described, it should be apparent that, the accompanying drawings in the following description is this hair Some bright embodiments for those of ordinary skill in the art without having to pay creative labor, can be with Obtain other attached drawings according to these attached drawings.
Fig. 1 is the schematic diagram of an application scenarios of the invention;
Fig. 2 is the flow chart for the information processing method that the embodiment of the present invention one provides;
Fig. 3 is the flow chart of information processing method provided by Embodiment 2 of the present invention;
Fig. 4 is the flow chart for the information processing method that the embodiment of the present invention three provides;
Fig. 5 is the flow chart for the information processing method that the embodiment of the present invention four provides;
Fig. 6 is the structural schematic diagram for the information processing unit that the embodiment of the present invention five provides;
Fig. 7 is the structural schematic diagram for the information processing unit that the embodiment of the present invention six provides;
Fig. 8 is the structural schematic diagram for the terminal that the embodiment of the present invention seven provides.
Specific implementation mode
In order to make the object, technical scheme and advantages of the embodiment of the invention clearer, below in conjunction with the embodiment of the present invention In attached drawing, technical scheme in the embodiment of the invention is clearly and completely described, it is clear that described embodiment is A part of the embodiment of the present invention, instead of all the embodiments.Based on the embodiments of the present invention, those of ordinary skill in the art The every other embodiment obtained without making creative work, shall fall within the protection scope of the present invention.
Term " first ", " second ", " third " in description and claims of this specification and above-mentioned attached drawing, " The (if present)s such as four " are for distinguishing similar object, without being used to describe specific sequence or precedence.It should manage The data that solution uses in this way can be interchanged in the appropriate case, so that the embodiment of the present invention described herein for example can be to remove Sequence other than those of illustrating or describe herein is implemented.In addition, term " comprising " and " having " and theirs is any Deformation, it is intended that cover it is non-exclusive include, for example, containing the process of series of steps or unit, method, system, production Product or equipment those of are not necessarily limited to clearly to list step or unit, but may include not listing clearly or for this The intrinsic other steps of processes, method, product or equipment or unit a bit.
Technical scheme of the present invention is described in detail with specifically embodiment below.These specific implementations below Example can be combined with each other, and same or analogous concept or process may be repeated no more in some embodiments.
Hereinafter, the part term in the application is explained, in order to those skilled in the art understand that:
1) speech business (Voice over Long Term Evolution, VOLTE) of Long Term Evolution is interconnection The speech business of fidonetFido multimedia system (Internet Protocol Multimedia Subsystem, IMS).It is one Kind of IP data transmission technologies, are not necessarily to 2G/3G nets, whole service bearers on 4G networks, it can be achieved that data with speech business same Unification under one network.IMS is a kind of completely new multimedia service form, it disclosure satisfy that present terminal client it is more novel, The demand of more diversified multimedia service.
2) speech business (Voice over Wireless Fidelity, VOWIFI) of WLAN, is to pass through nothing Line local area network realizes the technology of voice and video transmission.
Fig. 1 is the schematic diagram of an application scenarios of the invention, as shown in Figure 1, being established between calling terminal 1 and called terminal 2 When voice or video calling, the calling terminal 1 and called terminal 2 may not need and initiate picture transfer by other application. Specifically, picture is converted to audio-frequency information and sent by picture initiating terminal during receiving terminal holding call with picture Terminal is received to the picture.So as to directly carry out picture transfer, quilt by call interface in IMS voice call process Terminal 2 is made directly to receive picture in call interface, whole operation is simple, and user experience is good.
How the technical solution of technical scheme of the present invention and the application is solved with specifically embodiment below above-mentioned Technical problem is described in detail.These specific embodiments can be combined with each other below, for same or analogous concept Or process may repeat no more in certain embodiments.Below in conjunction with attached drawing, the embodiment of the present invention is described.
Fig. 2 is the flow chart for the information processing method that the embodiment of the present invention one provides, as shown in Fig. 2, in the present embodiment Method may include:
S101, in calling terminal and called terminal carry out IMS voice call process, receive what the calling terminal was sent Picture transfer is asked.
In the present embodiment, using the calling terminal as picture transmitting terminal, the called terminal is as picture receiving terminal.And The terminal device that user is applicable in can both be used as picture transmitting terminal, can also be used as picture receiving terminal.In conjunction with Fig. 1, work as caller When terminal and called terminal keep voice communication, calling terminal can be sent out to voice traffic services device side (such as IMS core net) Picture transfer is sent to ask.For example, calling terminal carries out picture addition in call interface by triggering add file labeled button.
Specifically, it is specifically described by taking IMS speech businesses as an example.First, the user A of calling terminal dials IMS core The voice call of net, flow are that caller user's registration IMS identifies (IMPU/IMPI/VOLTE), are sent out to Session Border Controll SBC Request is sent, then sending registration to call session control function (Call Session Control Function, CSCF) asks It asks, finally issues MMTEL application servers (Application Server, AS) audio and video call business control of calling subscribe Unit establishes calling connection with the user B of called terminal.In the communication process of calling terminal and called terminal, calling terminal User A by the operation in call interface to IMS core net send picture transfer request.
Specifically, calling terminal corresponds to the IMS network of a calling terminal, called terminal one called terminal of correspondence IMS network, calling terminal are communicated by the channels access point APN IMS with the foundation of the application server AS of IMS, and called terminal passes through The channels access point APN IMS are communicated with the foundation of the application server AS of IMS.Calling terminal is by the channels APN to calling terminal The AS of IMS network initiates call request, and by the AS of the IMS network of calling terminal by the IMS network of called terminal establish with Communication between called terminal.It is established after called terminal receives calling, between calling terminal and called terminal and confirms character ACK (Acknowledgement) it connects, calling terminal starts IMS voice communications with called terminal.
S102, it is asked according to the picture transfer, convolutional code and data queue's order information is sent to the calling terminal.
In the present embodiment, after the IMS network of calling terminal receives the picture transfer request of calling terminal transmission, respectively Convolutional code and data queue's order information are sent to the IMS network of the calling terminal and called terminal.It is with IMS speech businesses , it is stored with convolutional code and data queue's order information in the application server AS of IMS core net;Specifically, application server AS issues convolutional code S and convolutional code S is inserted into data queue order D., optionally, in AS have more set convolutional codes for difference User.
S103, receive the audio-frequency information that the calling terminal is sent, the audio-frequency information be by Target Photo, convolutional code with And data queue order information is converted to.
Optionally, after receiving the audio-frequency information that the calling terminal is sent, further include:
The audio-frequency information and the convolutional code are subjected to auto-correlation computation;
If obtained auto-correlation computation result is more than predetermined threshold value, it is determined that the audio-frequency information has arrived at described called Terminal;
Audio-frequency information decoding indication signals are sent to the called terminal by the IMS network of the called terminal, so that After the called terminal carries out inverse transformation by the convolutional code and data queue's order information to the audio-frequency information, obtain The Target Photo.
In the present embodiment, after audio-frequency information and convolutional code are carried out auto-correlation computation, auto-correlation computation can be obtained as a result, If auto-correlation computation result is more than predetermined threshold value or obvious peak value occurs in auto-correlation computation result, illustrate the audio letter Breath has arrived at the called terminal.
In the present embodiment, calling terminal is by the convolutional code and data queue's order information that receive to target to be transmitted Picture obtains target number matrix after being digitally converted, then believe the target number matrix conversion at corresponding audio Breath.
S104, the audio-frequency information is transmitted to the called terminal by the IMS network of called terminal.
In the present embodiment, the audio-frequency information that the calling terminal received is sent is transmitted to institute by the IMS network of called terminal State called terminal.
Optionally, it is asked according to the picture transfer, convolutional code and data queue's order is sent to the calling terminal After information, further include:
By the convolutional code and data queue order information synchronize be sent to the IMS network of the called terminal, to pass through The convolutional code and data queue's order information are sent to the called terminal by the IMS network of the called terminal.
The audio-frequency information is transmitted to described be called by the internet protocol multi-media system IMS network of called terminal After terminal, further include:
Receive the signal enhancing request that the IMS network of the called terminal is sent;
After the audio-frequency information and/or call voice are carried out signal enhancing processing, again through the mutual of called terminal Networking protocol multimedia system IMS network is transmitted to the called terminal.
In the present embodiment, audio-frequency information and call voice may will receive in transmission process the interference of external environment and be drawn Enter noise.Signal to Noise Ratio (SNR) (Signal To Noise by called terminal to the audio-frequency information and call voice that receive at this time Ratio it) is monitored, when Signal to Noise Ratio (SNR) is less than threshold value, then calling terminal is needed to carry out audio-frequency information and call voice Signal enhancing processing.
The present embodiment, by carrying out internet protocol multi-media system IMS voice communications in calling terminal and called terminal In the process, the picture transfer request that the calling terminal is sent is received;Wherein, the calling terminal is picture transmitting terminal, described Called terminal is picture receiving terminal;It is asked according to the picture transfer, convolutional code and data queue is sent to the calling terminal Order information;The audio-frequency information that the calling terminal is sent is received, the audio-frequency information is by Target Photo, convolutional code and number It is converted to according to queue order information;The audio-frequency information is transmitted to the called end by the IMS network of called terminal End.So that calling terminal directly can carry out picture transfer in IMS voice call process by call interface, it is called eventually End directly receives picture in call interface, and whole operation is simple, and user experience is good.
Fig. 3 is the flow chart of information processing method provided by Embodiment 2 of the present invention, as shown in figure 3, in the present embodiment Method may include:
S201, calling terminal with called terminal during carrying out IMS voice communications, to the IMS of the calling terminal Network sends picture transfer request.
In the present embodiment, using the calling terminal as picture transmitting terminal, the called terminal is as picture receiving terminal.And The terminal device that user is applicable in can both be used as picture transmitting terminal, can also be used as picture receiving terminal.In conjunction with Fig. 1, work as caller When terminal and called terminal keep voice communication, calling terminal can send picture transfer request to the IMS network of calling terminal. For example, calling terminal carries out picture addition in call interface by triggering add file labeled button.
S202, convolutional code and data queue's order information that the IMS network of calling terminal is sent are received.
In the present embodiment, calling terminal receives the convolutional code and data queue time that the application server AS of IMS network is sent Sequence information, wherein convolutional code and data queue's order information are stored in the application server AS in IMS network.
S203, conversion process is carried out to Target Photo using the convolutional code and data queue's order information, is corresponded to Audio-frequency information.
In the present embodiment, Target Photo can be digitally converted, obtain corresponding initial number matrix;According to institute Data queue's order information is stated, the convolutional code is inserted into the initial number matrix, target number matrix is obtained;According to The target number matrix conversion is corresponding audio-frequency information by default rule.The convolutional code and data queue's order letter Cease the start time point and end time point for identifying the audio-frequency information.
S204, the IMS network that the audio-frequency information is sent to the calling terminal.
In the present embodiment, target number matrix can be converted to different frequency " too " sound, beeping sound by caller end End is sent to IMS core net.
The present embodiment, by during carrying out voice communication with called terminal, sending picture transfer to IMS network and asking It asks;Receive the convolutional code and data queue's order information that the IMS network is sent;Using the convolutional code and data queue's order Information carries out conversion process to Target Photo, obtains corresponding audio-frequency information;The audio-frequency information is sent to the IMS nets Network.So that calling terminal directly can carry out picture transfer in IMS voice call process by call interface, without borrowing Help other application, whole operation process simple.
Fig. 4 is the flow chart for the information processing method that the embodiment of the present invention three provides, as shown in figure 4, in the present embodiment Method may include:
S301, called terminal receive the interconnection of the called terminal during carrying out voice communication with calling terminal The audio-frequency information of fidonetFido multimedia system IMS network forwarding.
In the present embodiment, called terminal may be used also before received internet protocol multimedia system IMS sends audio-frequency information First to receive the convolutional code and data queue's order information that the IMS systems are sent.Wherein, the audio-frequency information is calling terminal Target Photo is converted to by convolutional code and data queue's order information.
S302, analyzing processing is carried out to the audio-frequency information, obtains corresponding Target Photo.
In the present embodiment, the audio-frequency information decoding indication signals of the IMS network forwarding of the called terminal can be received;It is right Effective audio-frequency information is digitally converted, and obtains target number matrix;It is removed according to data queue's order information Convolutional code in the target number matrix, obtains initial number matrix;Inversion process is carried out to the initial number matrix, Obtain corresponding Target Photo.
Specifically, the convolutional code that can be sent the IMS network carries out auto-correlation computation processing with the audio-frequency information, Obtain the start time point and end time point of the audio data;According to the start time point and end time point to described Audio-frequency information extracts, and obtains effective audio-frequency information;Effective audio-frequency information is digitally converted, number of targets is obtained Word matrix;The convolutional code and data queue's order information at the target number matrix preamble and postorder position are removed, is obtained just Beginning character matrix;Inversion process is carried out to the initial number matrix, obtains corresponding Target Photo.
Optionally, carry out analyzing processing to the audio-frequency information further includes before obtaining corresponding Target Photo:
Signal to Noise Ratio (SNR) monitoring is carried out to the audio-frequency information and call voice respectively;
If the SNR of the audio-frequency information and/or the call voice is less than threshold value, pass through the IMS of called terminal Network sends signal enhancing request to the IMS network of calling terminal;So that the IMS network of the calling terminal is by the audio After information and/or call voice carry out signal enhancing processing, it is transmitted to again through the IMS network of called terminal described called Terminal.
In the present embodiment, called terminal is by receiving the monitoring of audio-frequency information and the signal-to-noise ratio of call voice to weigh Data quality.It is less than threshold value in the SNR of the audio-frequency information and/or the call voice, then passes through called terminal IMS network sent to the IMS network of calling terminal signal enhancing request;So that the IMS network of the calling terminal will It is more again through the Internet protocol of called terminal after the audio-frequency information and/or call voice carry out signal enhancing processing Media system IMS network is transmitted to the called terminal.It thereby may be ensured that the audio-frequency information and call that called terminal receives The quality of voice.
The present embodiment, by with calling terminal carry out voice communication during, received internet protocol multimedia system IMS network of uniting sends audio-frequency information;Wherein, the audio-frequency information is by Target Photo and convolutional code and data queue's order information It is converted to;Analyzing processing is carried out to the audio-frequency information, obtains corresponding Target Photo.So that called terminal can be with Picture is directly received in call interface, without other application, whole operation is simple, and user experience is good.
The embodiment of the present invention also provides a kind of internet protocol multi-media system IMS network, including:Application server AS, And the application server AS establishes the channels access point APN of communication connection with calling terminal;Wherein:The application server AS is used to execute the information processing method described in Fig. 2.
The present embodiment can execute method shown in Fig. 2, particular technique principle and realization process, method shown in Figure 3 In associated description, details are not described herein again.
Fig. 5 is the flow chart for the information processing method that the embodiment of the present invention four provides, as shown in figure 5, in the present embodiment Method may include:
Step 1:Calling terminal sends call request to calling terminal IMS network;
Step 2:The call request is sent to called whole by calling terminal IMS network by the IMS network of called terminal End;
Step 3:Called terminal receives call request, to establish the voice communication between calling terminal and called terminal;
Step 4:Calling terminal initiates picture transfer request to calling terminal IMS network;
Step 5:Calling terminal IMS network sends convolutional code and data team to the IMS network of calling terminal and called terminal Row order information;
Step 6:Convolutional code and data queue's order information are sent to called terminal by the IMS network of called terminal;
Step 7:Target Photo is converted to audio by calling terminal by the convolutional code and data queue's order information to be believed Breath;
Step 8:The audio-frequency information is sent to calling terminal IMS network by calling terminal;
Step 9:The audio-frequency information is sent to the IMS network of called terminal by calling terminal IMS network;
In the present embodiment, the IMS network of audio-frequency information and voice communication synchronous transfer to called terminal.
Step 10:Convolutional code and audio-frequency information are carried out auto-correlation computation by calling terminal IMS network, and are transported according to auto-correlation It calculates result and determines whether audio-frequency information reaches called terminal;
Step 11:Calling terminal IMS network sends audio-frequency information decoding by the IMS network of called terminal to called terminal Indication signal;
Step 12:Called terminal carries out signal-to-noise ratio monitoring to the audio-frequency information and call voice that receive, if signal-to-noise ratio is small In or equal to threshold value, 13 are thened follow the steps;
If signal-to-noise ratio is more than threshold value, 14 are thened follow the steps;
Step 13:By the IMS network of called terminal signal enhancing request is sent to the IMS network of calling terminal;So that The IMS network of the calling terminal is obtained by after the audio-frequency information and/or call voice progress signal enhancing processing, is led to again The internet protocol multi-media system IMS network for crossing called terminal is transmitted to the called terminal;
Step 14:Audio-frequency information is decoded, to obtain corresponding Target Photo.
The present embodiment can execute method shown in Fig. 2~Fig. 4, particular technique principle and realization process, shown in Figure 3 Associated description in method, details are not described herein again.
Fig. 6 is the structural schematic diagram for the information processing unit that the embodiment of the present invention five provides, as shown in fig. 6, the present embodiment In device may include:
Sending module 10, in the process for carrying out internet protocol multi-media system IMS voice communications with called terminal In, send picture transfer request to the internet protocol multi-media system IMS network of calling terminal;
Receiving module 20, for receiving the convolutional code and data queue's order information that the IMS network of calling terminal is sent;
Processing module 30, for being carried out at conversion to Target Photo using the convolutional code and data queue's order information Reason, obtains corresponding audio-frequency information;
Sending module 10 is additionally operable to for the audio-frequency information to be sent to the IMS network of the calling terminal.
Optionally, the processing module 30, is specifically used for:
Target Photo is digitally converted, corresponding initial number matrix is obtained;
According to data queue's order information, the convolutional code is inserted into the initial number matrix, mesh is obtained Mark character matrix;
It is corresponding audio-frequency information by the target number matrix conversion according to default rule.
Optionally, the convolutional code and data queue's order information be used to identify the audio-frequency information start time point and End time point.
The present embodiment can execute method shown in Fig. 3, particular technique principle and realization process, method shown in Figure 3 In associated description, details are not described herein again.
Fig. 7 is the structural schematic diagram for the information processing unit that the embodiment of the present invention six provides, as shown in fig. 7, the present embodiment In device may include:
Receiving module 40, for during carrying out voice communication with calling terminal, receiving the internet of called terminal The audio-frequency information of Protocol Multimedia System IMS network forwarding;Wherein, the audio-frequency information is the mesh sent by the calling terminal Mark on a map piece and calling terminal the convolutional code that sends of IMS network and data queue's order information is converted to;
Processing module 50 obtains corresponding Target Photo for carrying out analyzing processing to the audio-frequency information.
Optionally, receiving module 40 are additionally operable in the internet protocol multi-media system IMS nets for receiving the called terminal Before the audio-frequency information of network forwarding, the convolutional code and data queue's order information of the IMS network forwarding of the called terminal are received.
Optionally, the processing module 50, is specifically used for:
Receive the audio-frequency information decoding indication signals of the IMS network forwarding of the called terminal;
Effective audio-frequency information is digitally converted, target number matrix is obtained;
The convolutional code in the target number matrix is removed according to data queue's order information, obtains initial number square Battle array;
Inversion process is carried out to the initial number matrix, obtains corresponding Target Photo.
Optionally, device shown in Fig. 7 further includes:
Module 60 is monitored, for carrying out analyzing processing to the audio-frequency information, before obtaining corresponding Target Photo, point It is other that Signal to Noise Ratio (SNR) monitoring is carried out to the audio-frequency information and call voice;
If the SNR of the audio-frequency information and/or the call voice is less than threshold value, pass through the IMS of called terminal The signal enhancing request that network is sent to the IMS network of calling terminal;So that the IMS network of the calling terminal is by the sound After frequency information and/or call voice carry out signal enhancing processing, again through the internet protocol multi-media system of called terminal System IMS network is transmitted to the called terminal.
The present embodiment can execute method shown in Fig. 4, particular technique principle and realization process, method shown in Figure 4 In associated description, details are not described herein again.
Fig. 8 is the structural schematic diagram for the terminal that the embodiment of the present invention seven provides, as shown in figure 8, the terminal in the present embodiment 70 include:Processor 71 and memory 72;
Memory 72, for storing computer program (application program, function module as realized above- mentioned information processing method Deng), computer instruction etc., above-mentioned computer program, computer instruction etc. can be with partitioned storages in one or more memories In 72.And above-mentioned computer program, computer instruction, data etc. can be called by processor 71.
Processor 71, the computer program for executing the storage of the memory 72, to realize that above-described embodiment relates to And method in each step.The specific associated description that may refer in previous methods embodiment.Wherein, memory 72, place Reason device 71 can be of coupled connections by bus 77.
The present embodiment can execute the technical solution in above-mentioned Fig. 3, method shown in Fig. 4, realize process and technology effect Fruit is similar with the above method, and details are not described herein again.
In addition, the embodiment of the present application also provides a kind of computer readable storage medium, deposited in computer readable storage medium Computer executed instructions are contained, when at least one processor of user equipment executes the computer executed instructions, user equipment Execute above-mentioned various possible methods.
Wherein, computer-readable medium includes computer storage media and communication media, and wherein communication media includes being convenient for Any medium of computer program is transmitted from a place to another place.Storage medium can be general or specialized computer Any usable medium that can be accessed.A kind of illustrative storage medium is coupled to processor, to enable a processor to from this Read information, and information can be written to the storage medium.Certainly, storage medium can also be the composition portion of processor Point.Pocessor and storage media can be located in ASIC.In addition, the ASIC can be located in user equipment.Certainly, processor and Storage medium can also be used as discrete assembly and be present in communication equipment.
One of ordinary skill in the art will appreciate that:Realize that all or part of step of above-mentioned each method embodiment can lead to The relevant hardware of program instruction is crossed to complete.Program above-mentioned can be stored in a computer read/write memory medium.The journey When being executed, execution includes the steps that above-mentioned each method embodiment to sequence;And storage medium above-mentioned includes:ROM, RAM, magnetic disc or The various media that can store program code such as person's CD.
Finally it should be noted that:The above embodiments are only used to illustrate the technical solution of the present invention., rather than its limitations;To the greatest extent Present invention has been described in detail with reference to the aforementioned embodiments for pipe, it will be understood by those of ordinary skill in the art that:Its according to So can with technical scheme described in the above embodiments is modified, either to which part or all technical features into Row equivalent replacement;And these modifications or replacements, various embodiments of the present invention technology that it does not separate the essence of the corresponding technical solution The range of scheme.

Claims (20)

1. a kind of information processing method, which is characterized in that including:
In calling terminal and called terminal carry out internet protocol multi-media system IMS voice call process, the master is received Cry the picture transfer request that terminal is sent;Wherein, the calling terminal is picture transmitting terminal, and the called terminal receives for picture End;
It is asked according to the picture transfer, convolutional code and data queue's order information is sent to the calling terminal;
The audio-frequency information that the calling terminal is sent is received, the audio-frequency information is by Target Photo, convolutional code and data team Row order information is converted to;
The audio-frequency information is transmitted to the called end by the internet protocol multi-media system IMS network of called terminal End.
2. according to the method described in claim 1, it is characterized in that, being asked according to the picture transfer, to caller end After end sends convolutional code and data queue's order information, further include:
By the convolutional code and data queue order information synchronize be sent to the IMS network of the called terminal, it is described to pass through The convolutional code and data queue's order information are sent to the called terminal by the IMS network of called terminal.
3. according to the method described in claim 1, it is characterized in that, receive audio-frequency information that the calling terminal is sent it Afterwards, further include:
The audio-frequency information and the convolutional code are subjected to auto-correlation computation;
If obtained auto-correlation computation result is more than predetermined threshold value, it is determined that the audio-frequency information has arrived at the called end End;
Audio-frequency information decoding indication signals are sent to the called terminal by the IMS network of the called terminal, so that institute It states after called terminal carries out inverse transformation by the convolutional code and data queue's order information to the audio-frequency information, obtains described Target Photo.
4. method according to any one of claim 1-3, which is characterized in that the audio-frequency information is passed through called terminal Internet protocol multi-media system IMS network be transmitted to after the called terminal, further include:
Receive the signal enhancing request that the IMS network of the called terminal is sent;
After the audio-frequency information and/or call voice are carried out signal enhancing processing, again through the internet of called terminal Protocol Multimedia System IMS network is transmitted to the called terminal.
5. a kind of information processing method, which is characterized in that including:
Calling terminal with called terminal during carrying out internet protocol multi-media system IMS voice communications, to the master The internet protocol multi-media system IMS network of terminal is made to send picture transfer request;
Receive the convolutional code and data queue's order information that the IMS network of calling terminal is sent;
Conversion process is carried out to Target Photo using the convolutional code and data queue's order information, obtains corresponding audio letter Breath;
The audio-frequency information is sent to the IMS network of the calling terminal.
6. according to the method described in claim 5, it is characterized in that, using the convolutional code and data queue's order information to mesh Piece of marking on a map carries out conversion process, obtains corresponding audio-frequency information, including:
Target Photo is digitally converted, corresponding initial number matrix is obtained;
According to data queue's order information, the convolutional code is inserted into the initial number matrix, number of targets is obtained Word matrix;
It is corresponding audio-frequency information by the target number matrix conversion according to default rule.
7. method according to claim 5 or 6, which is characterized in that the convolutional code and data queue's order information are used for Identify the start time point and end time point of the audio-frequency information.
8. a kind of information processing method, which is characterized in that including:
Called terminal receives the more matchmakers of Internet protocol of the called terminal during carrying out voice communication with calling terminal The audio-frequency information of system system IMS network forwarding;Wherein, the audio-frequency information is the Target Photo sent by the calling terminal, And the convolutional code that sends of the IMS network of calling terminal and data queue order information are converted to;
Analyzing processing is carried out to the audio-frequency information, obtains corresponding Target Photo.
9. according to the method described in claim 8, it is characterized in that, in the internet protocol multi-media for receiving the called terminal Before the audio-frequency information of system IMS network forwarding, further include:
Receive the convolutional code and data queue's order information of the IMS network forwarding of the called terminal.
10. according to the method described in claim 9, it is characterized in that, it is described to the audio-frequency information carry out analyzing processing, obtain Corresponding Target Photo, including:
Receive the audio-frequency information decoding indication signals of the IMS network forwarding of the called terminal;
Effective audio-frequency information is digitally converted, target number matrix is obtained;
The convolutional code in the target number matrix is removed according to data queue's order information, obtains initial number matrix;
Inversion process is carried out to the initial number matrix, obtains corresponding Target Photo.
11. according to the method described in any one of claim 8-10, which is characterized in that carried out at analysis to the audio-frequency information It manages, before obtaining corresponding Target Photo, further includes:
Signal to Noise Ratio (SNR) monitoring is carried out to the audio-frequency information and call voice respectively;
If the SNR of the audio-frequency information and/or the call voice is less than threshold value, pass through the IMS network of called terminal Signal enhancing request is sent to the IMS network of calling terminal;So that the IMS network of the calling terminal is by the audio-frequency information And/or after call voice carries out signal enhancing processing, the called end is transmitted to again through the IMS network of called terminal End.
12. a kind of internet protocol multi-media system IMS network, which is characterized in that including:Application server AS and described Application server AS establishes the channels access point APN of communication connection with calling terminal;Wherein:
The application server AS is used to execute the information processing method as described in any one of claim 1-4.
13. a kind of information processing unit, which is characterized in that including:
Sending module is used for during carrying out internet protocol multi-media system IMS voice communications with called terminal, to master The internet protocol multi-media system IMS network of terminal is made to send picture transfer request;
Receiving module, for receiving the convolutional code and data queue's order information that the IMS network of calling terminal is sent;
Processing module is obtained for carrying out conversion process to Target Photo using the convolutional code and data queue's order information Corresponding audio-frequency information;
Sending module is additionally operable to for the audio-frequency information to be sent to the IMS network of the calling terminal.
14. device according to claim 13, which is characterized in that the processing module is specifically used for:
Target Photo is digitally converted, corresponding initial number matrix is obtained;
According to data queue's order information, the convolutional code is inserted into the initial number matrix, number of targets is obtained Word matrix;
It is corresponding audio-frequency information by the target number matrix conversion according to default rule.
15. the device according to claim 13 or 14, which is characterized in that the convolutional code and data queue's order information are used In the start time point and end time point that identify the audio-frequency information.
16. a kind of information processing unit, which is characterized in that including:
Receiving module, for during carrying out voice communication with calling terminal, the Internet protocol for receiving called terminal to be more The audio-frequency information of media system IMS network forwarding;Wherein, the audio-frequency information is the target figure sent by the calling terminal What the convolutional code and data queue's order information that the IMS network of piece and calling terminal is sent were converted to;
Processing module obtains corresponding Target Photo for carrying out analyzing processing to the audio-frequency information.
17. device according to claim 16, which is characterized in that
Receiving module is additionally operable to the audio in the internet protocol multi-media system IMS network forwarding for receiving the called terminal Before information, the convolutional code and data queue's order information of the IMS network forwarding of the called terminal are received.
18. device according to claim 17, which is characterized in that the processing module is specifically used for:
Receive the audio-frequency information decoding indication signals of the IMS network forwarding of the called terminal;
Effective audio-frequency information is digitally converted, target number matrix is obtained;
The convolutional code in the target number matrix is removed according to data queue's order information, obtains initial number matrix;
Inversion process is carried out to the initial number matrix, obtains corresponding Target Photo.
19. according to the device described in any one of claim 16-18, which is characterized in that further include:
Module is monitored, for carrying out analyzing processing to the audio-frequency information, before obtaining corresponding Target Photo, respectively to institute It states audio-frequency information and call voice carries out Signal to Noise Ratio (SNR) monitoring;
If the SNR of the audio-frequency information and/or the call voice is less than threshold value, pass through the IMS network of called terminal Signal enhancing request is sent to the IMS network of calling terminal;So that the IMS network of the calling terminal is by the audio-frequency information And/or after call voice carries out signal enhancing processing, the called end is transmitted to again through the IMS network of called terminal End.
20. a kind of terminal, which is characterized in that including:
Memory, for storing program;
Processor, the described program for executing the memory storage, when described program is performed, the processor is used for Execute the method as described in any one of claim 5-7 and/or 8-11.
CN201810558475.0A 2018-06-01 2018-06-01 Information processing method and device and terminal Active CN108712441B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201810558475.0A CN108712441B (en) 2018-06-01 2018-06-01 Information processing method and device and terminal

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201810558475.0A CN108712441B (en) 2018-06-01 2018-06-01 Information processing method and device and terminal

Publications (2)

Publication Number Publication Date
CN108712441A true CN108712441A (en) 2018-10-26
CN108712441B CN108712441B (en) 2021-11-02

Family

ID=63870251

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201810558475.0A Active CN108712441B (en) 2018-06-01 2018-06-01 Information processing method and device and terminal

Country Status (1)

Country Link
CN (1) CN108712441B (en)

Cited By (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN113596271A (en) * 2021-07-22 2021-11-02 深圳市软讯信息技术有限公司 Method and system for sharing pictures in call
WO2022262729A1 (en) * 2021-06-15 2022-12-22 ***通信有限公司研究院 Method and apparatus for establishing data channel, and device, control system and storage medium

Citations (9)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN1524350A (en) * 2001-03-29 2004-08-25 哈茉尼彩色音技术开发公司 Telephone and method for converting sound to image and displaying on screen thereof
CN101014162A (en) * 2005-12-23 2007-08-08 Lg电子株式会社 Method for displaying menu on mobile communication terminal, and mobile communication terminal thereof
CN101198002A (en) * 2006-12-04 2008-06-11 中兴通讯股份有限公司 Video telephone long-range control establishing method
CN101901470A (en) * 2010-02-10 2010-12-01 桂林电子科技大学 Image-tampering detection and recovery method based on energy-domain semi-fragile watermarking
CN102325224A (en) * 2011-09-16 2012-01-18 成都摩宝网络科技有限公司 Audio data transmission system, audio data transmission method and application thereof
CN102833411A (en) * 2012-08-23 2012-12-19 中兴通讯股份有限公司 Method and system for processing information on basis of dual-tone multifrequency and receiving terminal
US20130247141A1 (en) * 2009-11-19 2013-09-19 At&T Intellectual Property I,L.P. Method and apparatus for providing mobile and social services via virtual individual servers
CN105635427A (en) * 2015-01-21 2016-06-01 宇龙计算机通信科技(深圳)有限公司 Information processing method, information processing device and terminal
CN206775754U (en) * 2017-03-07 2017-12-19 包荷雅 Based on the mobile terminal communication system under offline mode and transfer communication terminal

Patent Citations (9)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN1524350A (en) * 2001-03-29 2004-08-25 哈茉尼彩色音技术开发公司 Telephone and method for converting sound to image and displaying on screen thereof
CN101014162A (en) * 2005-12-23 2007-08-08 Lg电子株式会社 Method for displaying menu on mobile communication terminal, and mobile communication terminal thereof
CN101198002A (en) * 2006-12-04 2008-06-11 中兴通讯股份有限公司 Video telephone long-range control establishing method
US20130247141A1 (en) * 2009-11-19 2013-09-19 At&T Intellectual Property I,L.P. Method and apparatus for providing mobile and social services via virtual individual servers
CN101901470A (en) * 2010-02-10 2010-12-01 桂林电子科技大学 Image-tampering detection and recovery method based on energy-domain semi-fragile watermarking
CN102325224A (en) * 2011-09-16 2012-01-18 成都摩宝网络科技有限公司 Audio data transmission system, audio data transmission method and application thereof
CN102833411A (en) * 2012-08-23 2012-12-19 中兴通讯股份有限公司 Method and system for processing information on basis of dual-tone multifrequency and receiving terminal
CN105635427A (en) * 2015-01-21 2016-06-01 宇龙计算机通信科技(深圳)有限公司 Information processing method, information processing device and terminal
CN206775754U (en) * 2017-03-07 2017-12-19 包荷雅 Based on the mobile terminal communication system under offline mode and transfer communication terminal

Cited By (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2022262729A1 (en) * 2021-06-15 2022-12-22 ***通信有限公司研究院 Method and apparatus for establishing data channel, and device, control system and storage medium
CN113596271A (en) * 2021-07-22 2021-11-02 深圳市软讯信息技术有限公司 Method and system for sharing pictures in call
CN113596271B (en) * 2021-07-22 2023-12-12 深圳市软讯信息技术有限公司 Method and system for sharing pictures in call

Also Published As

Publication number Publication date
CN108712441B (en) 2021-11-02

Similar Documents

Publication Publication Date Title
CN105656915B (en) Immediate communication methods, devices and systems
CN108881783A (en) Realize method and apparatus, computer equipment and the storage medium of multi-conference
CN104272696B (en) Reside in the media file in equipment
CN106161814A (en) The sound mixing method of a kind of Multi-Party Conference and device
CN104363407B (en) A kind of video conferencing system means of communication and related device
CN102185856B (en) Team organizing video method, device and system used in team organizing game
CN104125221B (en) IMS (IP (Internet Protocol) multimedia subsystem) terminal equipment multiple soft-terminal resource sharing and application collaborative device and method
CN103716299A (en) Method carrying out session based on SIP, terminal and call business server
CN104219479A (en) Video communication service processing method and system
CN108712441A (en) Information processing method, device and terminal
CN104253696B (en) Police handheld speech talkback method and system Internet-based
CN105262847B (en) Communication means and system between terminal device
CN103986710B (en) A kind of method, apparatus and system of message transmission
CN107690054A (en) A kind of processing method and processing device of video calling
CN113556783B (en) Media resource transmission method, related device and system
CN105634931B (en) Message service processing method and instant communication server
CN102891831A (en) Implement method of multimedia conferencing service and related equipment
CN105100520B (en) Terminal call forwarding method and its device
CN107087134A (en) Cloud is forwarded and the point-to-point video call system merged and method
KR101085063B1 (en) Group communication method in media server system with distributed structure
CN103905483A (en) Audio and video sharing method, equipment and system
CN109120578B (en) Method and device for realizing link connection processing
CN108811012A (en) Audio communication method, IMS network and terminal
CN106060902B (en) Terminal access method and system based on gateway
CN103701879A (en) Method and device for automatically realizing business processing

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant