CN110047520A - Control method, device, electronic equipment and the computer readable storage medium that audio plays - Google Patents
Control method, device, electronic equipment and the computer readable storage medium that audio plays Download PDFInfo
- Publication number
- CN110047520A CN110047520A CN201910211684.2A CN201910211684A CN110047520A CN 110047520 A CN110047520 A CN 110047520A CN 201910211684 A CN201910211684 A CN 201910211684A CN 110047520 A CN110047520 A CN 110047520A
- Authority
- CN
- China
- Prior art keywords
- parameter
- audio
- sub
- target object
- difference
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V40/00—Recognition of biometric, human-related or animal-related patterns in image or video data
- G06V40/10—Human or animal bodies, e.g. vehicle occupants or pedestrians; Body parts, e.g. hands
-
- G—PHYSICS
- G11—INFORMATION STORAGE
- G11B—INFORMATION STORAGE BASED ON RELATIVE MOVEMENT BETWEEN RECORD CARRIER AND TRANSDUCER
- G11B20/00—Signal processing not specific to the method of recording or reproducing; Circuits therefor
- G11B20/10—Digital recording or reproducing
- G11B20/10527—Audio or video recording; Data buffering arrangements
Landscapes
- Engineering & Computer Science (AREA)
- Multimedia (AREA)
- Human Computer Interaction (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Theoretical Computer Science (AREA)
- Signal Processing (AREA)
- Stereophonic System (AREA)
- Studio Devices (AREA)
Abstract
The present disclosure discloses control method, device, electronic equipment and computer readable storage mediums that a kind of audio plays.The control method that wherein audio plays includes: that the first parameter of target object is determined in first frame image；The second parameter of the target object is determined in the second frame image；According to the broadcasting of first parameter and the second state modulator audio.The embodiment of the present disclosure, can be associated with the broadcasting of audio by the parameter of the target object in image by taking the technical solution, solves the technical issues of broadcasting that cannot neatly control audio in the prior art.
Description
Technical field
This disclosure relates to which audio-visual information process field more particularly to a kind of control method of audio broadcasting, device, electronics are set
Standby and computer readable storage medium.
Background technique
With the development of computer technology, the application range of intelligent terminal has obtained extensive raising, such as can pass through
Intelligent terminal shoots image and video etc..
Intelligent terminal also has powerful data-handling capacity simultaneously, such as is being carried out using intelligent terminal to target object
When shooting, image obtained can be shot to intelligent terminal by image segmentation algorithm and be handled in real time, to identify
Shoot the key point of the target object and the target object in image.It is to handle video by human body image partitioning algorithm
Example, the computer equipments such as intelligent terminal can handle in real time each frame image of video by human body image partitioning algorithm, quasi-
Really each key point of the human body contour outline in identification image and human body, such as the face of human body, the right hand can be identified etc. in image
In position etc., this identification has been able to be accurate to Pixel-level.
In the prior art, acting to control the broadcasting of audio for human body can be identified from the video of shooting, such as works as knowledge
Not Chu the movement nodded of human body then start audio player, when identifying that the movement that human body is shaken the head then closes audio player, but
It is that this interactive mode can only identify that scheduled movement could execute corresponding operation, identification is difficult and interactive mode is single,
The broadcasting of audio cannot neatly be controlled.
Summary of the invention
The embodiment of the present disclosure provides the control method that audio plays, device, electronic equipment and computer-readable storage medium
Matter can make computer equipment neatly control the broadcasting of audio.
In a first aspect, the embodiment of the present disclosure provides the control method that a kind of audio plays characterized by comprising the
The first parameter of target object is determined in one frame image；The second parameter of the target object is determined in the second frame image；Root
According to the broadcasting of first parameter and the second state modulator audio.
Further, according to the broadcasting of first parameter and the second state modulator audio, comprising: determine described
Difference between one parameter and second parameter, ratio or distance；In the difference, ratio or distance belong to first
In the case where section, the audio is played；In the difference, in the case that ratio or distance belong to second interval, stop broadcasting
Put the audio.
Further, the first interval includes the first subinterval and the second subinterval；In the difference, ratio, or
In the case that distance belongs to first interval, the audio is played, comprising: in the difference, ratio or distance belong to the first son
In the case where section, the audio is played with the first play mode；In the difference, ratio or distance belong to the second sub-district
Between in the case where, the audio is played with the second play mode.
Further, corresponding first broadcasting speed of first play mode, second play mode corresponding second are broadcast
Put speed.
Further, first parameter includes multiple first subparameters, and second parameter includes multiple second son ginsengs
Number；According to the broadcasting of first parameter and the second state modulator audio, comprising: determine the multiple first subparameter and
Multiple sub- differences between the multiple second subparameter, multiple sub- ratios or multiple sub- distances；It is poor in the multiple son
Belong to the sub- difference of 3rd interval in value, multiple sub- ratios or multiple son distances, sub- ratio or sub- distance reach first
In the case where ratio, the audio is played；In the multiple sub- difference, belong to institute in multiple sub- ratios or multiple son distances
State the sub- difference of 3rd interval, sub- ratio, or sub in the case where not up to first ratio, the stopping broadcasting sound
Frequently.
Further, first parameter includes multiple first subparameters, and second parameter includes multiple second son ginsengs
Number；According to the broadcasting of first parameter and the second state modulator audio, comprising: determine the multiple first subparameter and
Multiple sub- differences between the multiple second subparameter, multiple sub- ratios or multiple sub- distances；It is poor in the multiple son
Belong to the sub- difference of 3rd interval in value, multiple sub- ratios or multiple son distances, sub- ratio or sub- distance reach first
In the case where quantity, the audio is played；In the multiple sub- difference, belong to institute in multiple sub- ratios or multiple son distances
State the sub- difference of 3rd interval, sub- ratio, or sub in the case where not up to first quantity, the stopping broadcasting sound
Frequently.
Further, the first parameter of the target object includes the first area parameters of the target object, the mesh
Second parameter of mark object includes the second area parameter of the target object；Or the first parameter of the target object includes
The first position parameter of the target object, the second parameter of the target object include the second position ginseng of the target object
Number.
Further, the first image frame is obtained at the first moment, obtains second picture frame at the second moment.
Further, the target object includes human body, the key point of the human body, the pass of object or the object
Key point.
Second aspect, the embodiment of the present disclosure provide a kind of control device that audio plays, which is characterized in that the audio is broadcast
The control device put includes determining module and control module, in which: the determining module, for determining mesh in first frame image
The first parameter for marking object determines the second parameter of the target object in the second frame image；The control module is used for root
According to the broadcasting of first parameter and the second state modulator audio.
Further, the control module is also used to determine the difference between first parameter and second parameter,
Ratio or distance；In the difference, in the case that ratio or distance belong to first interval, the audio is played；Institute
Difference is stated, in the case that ratio or distance belong to second interval, stops playing the audio.
Further, the first interval includes the first subinterval and the second subinterval；The control module is also used to
In the case that the difference, ratio or distance belong to the first subinterval, the audio is played with the first play mode；Institute
Difference is stated, in the case that ratio or distance belong to the second subinterval, the audio is played with the second play mode.
Further, corresponding first broadcasting speed of first play mode, second play mode corresponding second are broadcast
Put speed.
Further, first parameter includes multiple first subparameters, and second parameter includes multiple second son ginsengs
Number；The control module is also used to determine that multiple sons between the multiple first subparameter and the multiple second subparameter are poor
Value, multiple sub- ratios or multiple sub- distances；In the multiple sub- difference, belong in multiple sub- ratios or multiple son distances
In the case that the sub- difference of 3rd interval, sub- ratio or sub- distance reach the first ratio, the audio is played；Described more
Belong in a sub- difference, multiple sub- ratios or multiple son distances the sub- difference of the 3rd interval, sub- ratio, or son away from
In the case where not up to described first ratio, stop playing the audio.
Further, first parameter includes multiple first subparameters, and second parameter includes multiple second son ginsengs
Number；The control module is also used to determine that multiple sons between the multiple first subparameter and the multiple second subparameter are poor
Value, multiple sub- ratios or multiple sub- distances；In the multiple sub- difference, belong in multiple sub- ratios or multiple son distances
In the case that the sub- difference of 3rd interval, sub- ratio or sub- distance reach the first quantity, the audio is played；Described more
Belong in a sub- difference, multiple sub- ratios or multiple son distances the sub- difference of the 3rd interval, sub- ratio, or son away from
In the case where not up to described first quantity, stop playing the audio.
Further, the first parameter of the target object includes the first area parameters of the target object, the mesh
Second parameter of mark object includes the second area parameter of the target object；Or the first parameter of the target object includes
The first position parameter of the target object, the second parameter of the target object include the second position ginseng of the target object
Number.
Further, the control device that the audio plays further includes obtaining module, and the acquisition module is used for first
Moment obtains the first image frame, obtains second picture frame at the second moment.
Further, the target object includes human body, the key point of the human body, the pass of object or the object
Key point.
The third aspect, the embodiment of the present disclosure provide a kind of electronic equipment, comprising: memory, it is computer-readable for storing
Instruction；And one or more processors, for running the computer-readable instruction, so that the processor is realized when running
The control method that any audio in aforementioned first aspect plays.
Fourth aspect, the embodiment of the present disclosure provide a kind of non-transient computer readable storage medium, which is characterized in that described
Non-transient computer readable storage medium stores computer instruction, when the computer instruction is computer-executed, so that institute
It states computer and executes the control method that any audio in aforementioned first aspect plays.
The present disclosure discloses control method, device, electronic equipment and computer readable storage mediums that a kind of audio plays.
The wherein control method that the audio plays characterized by comprising the first ginseng of target object is determined in first frame image
Number；The second parameter of the target object is determined in the second frame image；According to first parameter and the second parameter control
The broadcasting of audio processed.It control method that the audio that the embodiment of the present disclosure provides plays, device, electronic equipment and computer-readable deposits
Storage media, can be associated with the broadcasting of audio by the parameter of the target object in image, and solving in the prior art cannot spirit
The technical issues of controlling the broadcasting of audio livingly.
Above description is only the general introduction of disclosed technique scheme, in order to better understand the technological means of the disclosure, and
It can be implemented in accordance with the contents of the specification, and to allow the above and other objects, features and advantages of the disclosure can be brighter
Show understandable, it is special below to lift preferred embodiment, and cooperate attached drawing, detailed description are as follows.
Detailed description of the invention
In order to illustrate more clearly of the embodiment of the present disclosure or technical solution in the prior art, to embodiment or will show below
There is attached drawing needed in technical description to be briefly described, it should be apparent that, the accompanying drawings in the following description is this public affairs
The some embodiments opened for those of ordinary skill in the art without creative efforts, can be with root
Other attached drawings are obtained according to these attached drawings.
Fig. 1 is the flow chart for the control method embodiment that the audio that the embodiment of the present disclosure provides plays；
Fig. 2 is the structural schematic diagram for the control device embodiment that the audio that the embodiment of the present disclosure provides plays；
Fig. 3 is the structural schematic diagram of the electronic equipment provided according to the embodiment of the present disclosure.
Specific embodiment
Illustrate embodiment of the present disclosure below by way of specific specific example, those skilled in the art can be by this specification
Disclosed content understands other advantages and effect of the disclosure easily.Obviously, described embodiment is only the disclosure
A part of the embodiment, instead of all the embodiments.The disclosure can also be subject to reality by way of a different and different embodiment
It applies or applies, the various details in this specification can also be based on different viewpoints and application, in the spirit without departing from the disclosure
Lower carry out various modifications or alterations.It should be noted that in the absence of conflict, the feature in following embodiment and embodiment can
To be combined with each other.Based on the embodiment in the disclosure, those of ordinary skill in the art are without creative efforts
Every other embodiment obtained belongs to the range of disclosure protection.
It should be noted that the various aspects of embodiment within the scope of the appended claims are described below.Ying Xian
And be clear to, aspect described herein can be embodied in extensive diversified forms, and any specific structure described herein
And/or function is only illustrative.Based on the disclosure, it will be understood by one of ordinary skill in the art that one described herein
Aspect can be independently implemented with any other aspect, and can combine the two or both in these aspects or more in various ways.
For example, carry out facilities and equipments in terms of any number set forth herein can be used and/or practice method.In addition, can make
With other than one or more of aspect set forth herein other structures and/or it is functional implement this equipment and/or
Practice the method.
It should also be noted that, diagram provided in following embodiment only illustrates the basic structure of the disclosure in a schematic way
Think, component count, shape and the size when only display is with component related in the disclosure rather than according to actual implementation in diagram are drawn
System, when actual implementation kenel, quantity and the ratio of each component can arbitrarily change for one kind, and its assembly layout kenel can also
It can be increasingly complex.
In addition, in the following description, specific details are provided for a thorough understanding of the examples.However, fields
The skilled person will understand that the aspect can be practiced without these specific details.
Fig. 1 is the flow chart for the control method embodiment one that the audio that the embodiment of the present disclosure provides plays, and the present embodiment mentions
The control method that the audio supplied plays can be executed by the control device that an audio plays, which can be implemented as soft
Part can be implemented as hardware, be also implemented as the combination of software and hardware, such as the control device that the audio plays includes
Computer equipment (such as intelligent terminal), to execute what the audio provided in this embodiment played by the computer equipment
Control method, the computer equipment may include playing device, so that the computer equipment, which controls the playing device, plays audio,
The computer equipment can also control other playback equipments and play audio, and the embodiment of the present disclosure does not limit this.
The applicable application scenarios of the embodiment of the present disclosure include but is not limited to image of the control device to acquisition of audio broadcasting
It is handled, and controls the broadcasting of audio according to the result of processing.Wherein, the control device that audio plays may include that image obtains
Device is taken, for example including camera, to shoot image by the camera, the control device that audio plays can also be by more
Kind mode obtains image and is handled the broadcasting to realize control audio to the image of acquisition, such as passes through network and obtain figure
Picture obtains image from other equipment, or obtains image from storage equipment.It will be understood by those skilled in the art that video is by one
Image series frame composition, each picture frame of video are properly termed as image or frame image, therefore in the embodiment of the present disclosure, audio plays
Control device obtain video (or video flowing), also just obtain the corresponding a series of images of the video or frame image, thus
The corresponding image of the video can be handled, and control the broadcasting of audio according to the result of processing.For ease of understanding, at it
In description afterwards, by the control device played with audio one or more images corresponding to the video of shooting carry out processing to
It is described for the broadcasting of control audio, still, as previously mentioned, the embodiment of the present disclosure is not limited thereto.
As shown in Figure 1, the control method that the audio of the embodiment of the present disclosure plays includes the following steps:
Step S101 determines the first parameter of target object in first frame image；
In step s101, the control device that audio plays handles the first frame image of acquisition, described first
The first parameter of target object is determined in frame image.Such as the control device that audio plays shoots video by filming apparatus,
The first parameter of target object is determined in the first frame image of the video of shooting.
In an alternative embodiment, the target object includes human body, the key point of human body, object or object
Key point.Wherein, the key point of the human body may include one or more organ, joint or the position of human body,
It may include one or more aforementioned organ, one or more pixels corresponding to joint or position, can also include people
The center of body, mass center or center of gravity etc.；The key point of the object may include one or more positions of object, can also be with
It can also include the center of object including one or more pixels corresponding to one or more aforementioned position, mass center, or
Center of gravity etc..
In an alternative embodiment, the first parameter of the target object includes the first position of the target object
Parameter or the first area parameters.As described in disclosure background technique, computer equipment can be known by image segmentation algorithm
Target object in other image and the parameter that can determine the target object.It include the face of human body with the target object
For: first parameter may include first position parameter, then pass through the face of human body determined by step S101 the
One parameter may include the first position parameter of the face of the human body, and in the embodiment of the present disclosure, location parameter can pass through seat
Mark indicates, it will be understood by those skilled in the art that the coordinate of the face of the human body can be characterized in several ways, as simultaneously
An example of the embodiment of the present disclosure is not limited, can pass through the center of the face of the human body, the coordinate of mass center or center of gravity
The coordinate for characterizing the face of the human body, for coordinate system corresponding to coordinate involved in the embodiment of the present disclosure, such as is clapped
Coordinate system can be established and to each element marking pixel in captured any image when shooting video or image by taking the photograph device
Coordinate, so as to determine coordinate involved in the embodiment of the present disclosure based on the coordinate system that filming apparatus is established, still
It is worth noting that, the embodiment of the present disclosure to coordinate system corresponding to related coordinate without limitation, any type of coordinate
System is used equally for determining coordinate involved in the embodiment of the present disclosure；First parameter can also include the first area parameters, that
The first parameter by the face of human body determined by step S101 may include the first area ginseng of the face of the human body
Number, such as the people is characterized by the face of human body area shared in the first frame image or pixel quantity etc.
First area parameters of the face of body.
Step S102 determines the second parameter of the target object in the second frame image；
In step s 102, the control device that audio plays handles the second frame image of acquisition, described second
The second parameter of the target object is determined in frame image.Such as the control device that audio plays is shot from the filming apparatus
The second parameter of the target object is determined in second frame image of the video.Wherein, the second frame image is different from institute
First frame image is stated, optionally, the control device that the audio plays obtains the first image frame at the first moment, second
Moment obtains second picture frame, such as first moment and second moment can be any two of the video
At the time of different.In an alternative embodiment, the second parameter of the target object includes the second of the target object
Location parameter or second area parameter, wherein the concrete meaning of the second parameter of the target object is referred to step
The identical or corresponding description of first parameter of target object described in S101, details are not described herein again.Optionally, first parameter
Correspond to first parameter corresponding to second parameter or second parameter, such as first parameter includes position
Parameter is set, then second parameter is corresponding with first parameter, i.e., described second parameter also includes location parameter, optional
, the unit of first parameter is identical as the unit of second parameter, in conjunction with the embodiment in step S101, works as step
When first parameter of the face of human body determined by S101 includes the first position parameter of face of the human body, in step S102
In the identified human body face the second parameter include the human body face second position parameter, as step S101
When first parameter of the face of identified human body includes the first area parameters of face of the human body, institute in step s 102
Second parameter of the face of the determining human body includes the second area parameter of the face of the human body.
Step S103, according to the broadcasting of first parameter and the second state modulator audio.
The of target object is determined in first frame image and the second frame image respectively by step S101 and step S102
It, next in step s 103, can be according to the first parameter of the target object and described after one parameter and the second parameter
Second parameter realizes the broadcasting for neatly controlling audio.For example, determining the mesh by first parameter and the second parameter
In the case that movement has occurred in mark object, broadcasting/stopping plays the audio, true by first parameter and the second parameter
In the case that the fixed target object does not move, stop broadcasting/broadcasting audio.By the technical solution of the disclosure,
Can be associated with the broadcasting of audio by the parameter of the target object in image, solving cannot neatly control in the prior art
The technical issues of broadcasting of audio.
In an alternative embodiment, according to the broadcasting of first parameter and the second state modulator audio, packet
It includes: determining the difference between first parameter and second parameter, ratio or distance；In the difference, ratio, or
In the case that person's distance belongs to first interval, the audio is played；In the difference, ratio or distance belong to second interval
In the case where, stop playing the audio.In an alternative embodiment, the first interval and the second interval are without friendship
Collection.
By taking the first parameter and the second parameter include first position parameter and second position parameter as an example, described can be determined
Difference between one location parameter and the second position parameter, ratio or distance, and then according to the difference, ratio, or
The broadcasting of person's distance controlling audio.As an optional embodiment, the first position parameter is included in first frame image
The abscissa of the determining target object, one or more of ordinate and depth coordinate, the second position parameter packet
Include the abscissa of the target object determined in the second frame image, one or more of ordinate and depth coordinate.Make
For an example, when the target object is human body, the coordinate of the human body described in first frame image and the second frame image can
To be expressed as (x1, y1) and (x2, y2), x and y therein represent the abscissa and ordinate of the human body, if certainly
The depth coordinate that the human body can be obtained, the coordinate of the human body described in the first frame image and the second frame image is also
It can be expressed as (x1, y1, z1) and (x2, y2, z2), z therein represents human depth's coordinate, such as audio plays
Control device when shooting video by filming apparatus with depth acquisition capability, captured target object can be obtained
Depth information is to also just can determine the depth coordinate, then the first position parameter includes x1, one in y1, z1
Or it is multiple, the second position parameter includes x2, y2, one or more of z2.
For example, controlling the broadcasting of audio according to the difference of the first position parameter and the second position parameter.It is optional
, the difference in the embodiment of the present disclosure includes the absolute value of the difference of first parameter and second parameter.As one
A example, the first position parameter include the abscissa x1 of the human body determined in first frame image, the second
The abscissa x2 that parameter includes the human body determined in the second frame image is set, the difference can be expressed as | x1-x2 | (when
Can also so be expressed as | x2-x1 |), " | the | " symbol being related to can indicate to take absolute value in the embodiments of the present disclosure, thus
In the case that the difference belongs to first interval, the audio is played, in the case where the difference belongs to second interval, is stopped
Play the audio.First interval is, for example, to be greater than the section of first threshold, and second interval is, for example, to be less than or equal to described the
The section of one threshold value, when the difference of the first position parameter and the second position parameter belongs to the section greater than first threshold
When, it is believed that in the first moment corresponding first frame image and the second moment corresponding second frame image, captured people
The variation of the position of body is greater than the first threshold, that is to say, that the human body is moved, then determining the human body
The audio is then played when movement has occurred；It is less than when the difference of the first position parameter and the second position parameter belongs to
Or equal to the first threshold section when, it is believed that it is corresponding in the first moment corresponding first frame image and the second moment
In second frame image, the variation of the position of captured human body is less than or equal to the first threshold, that is to say, that the human body
Do not occur to move or only have occurred small movements, then when determining that movement does not occur or small movements only occur for the human body
Then stop playing the audio.
For example, controlling the broadcasting of audio according to the ratio of the first position parameter and the second position parameter.It is optional
, the ratio in the embodiment of the present disclosure includes the absolute value of the ratio of first parameter and second parameter.As
One example, the first position parameter include the depth coordinate z1 of the human body determined in first frame image, and described the
Two location parameters include the depth coordinate z2 of the human body determined in the second frame image, and the ratio can be expressed as | z1/
Z2 | and (can certainly be expressed as | z2/z1 |), so that the audio is played in the case where the ratio belongs to first interval,
In the case where the ratio belongs to second interval, stop playing the audio.The first interval is, for example, less than 0.8 or big
In 1.2 section, the second interval is, for example, to be greater than or equal to 0.8 and the section less than or equal to 1.2, when described first
When setting the ratio of parameter and the second position parameter and belonging to first interval, it is believed that in the first moment corresponding first frame figure
In picture and the second moment corresponding second frame image, the position of captured human body is changed greatly, that is to say, that the human body
It is moved, then then playing the audio when determining that movement has occurred in the human body；When the first position parameter and
When the ratio of the second position parameter belongs to second interval, it is believed that in the first moment corresponding first frame image and second
In moment corresponding second frame image, the position of captured human body does not change or changes smaller, that is to say, that the human body
Do not occur to move or only have occurred small movements, then when determining that movement does not occur or small movements only occur for the human body
Then stop playing the audio.
For example, according to the broadcasting of the first position parameter and the distance controlling audio of the second position parameter.It is optional
, the distance in the embodiment of the present disclosure includes but is not limited to Euclidean distance.As an example, the first position parameter
Coordinate (x1, y1) including the human body determined in first frame image, the second position parameter are included in the second frame figure
The coordinate (x2, y2) of the human body determined as in, so as to determine distance according to (x1, y1) and (x2, y2), it is described away from
In the case where belonging to first interval, the audio is played, in the case where the distance belongs to second interval, stops playing institute
State audio.First interval is, for example, to be greater than the section of first threshold, and second interval is, for example, to be less than or equal to the first threshold
Section can when the distance of the first position parameter and the second position parameter belongs to the section greater than first threshold
To think in the first moment corresponding first frame image and the second moment corresponding second frame image, the position of captured human body
The variation set is greater than the first threshold, that is to say, that the human body is moved, then determining that the human body has occurred
The audio is then played when movement；It is less than or equal to when the distance of the first position parameter and the second position parameter belongs to
When the section of the first threshold, it is believed that in the first moment corresponding first frame image and the second moment corresponding second frame
In image, the variation of the position of captured human body is less than or equal to the first threshold, that is to say, that the human body does not occur
Small movements only have occurred in movement, then then stopping when determining that movement or only generation small movements do not occur for the human body
Play the audio.
It include the first area parameters and second area parameter with first parameter and the second parameter in the embodiment of the present disclosure
For, it can determine the difference between first area parameters and the second area parameter, ratio or distance, in turn
According to the difference, the broadcasting of ratio or distance controlling audio.As an optional embodiment, the first area ginseng
Number includes the area or pixel quantity shared in the first frame image of the determining target object in first frame image,
The second area parameter includes that the determining target object in the second frame image is shared in the second frame image
Area or pixel quantity.It will be understood by those skilled in the art that determining first area parameters and second area ginseng
After number, it is referred to the aforementioned difference according between first position parameter and second position parameter, ratio or distance controlling sound
The identical or corresponding manner of the broadcasting of frequency determines the difference between first area parameters and the second area parameter,
Ratio or distance, and then according to the difference, the broadcasting of ratio or distance controlling audio, details are not described herein again.
In an alternative embodiment, the first interval includes the first subinterval and the second subinterval, in the difference
Value in the case that ratio or distance belong to the first subinterval, plays the audio with the first play mode, in the difference,
In the case that ratio or distance belong to the second subinterval, the audio is played with the second play mode.Optionally, described
One play mode corresponds to the first broadcasting speed, and second play mode corresponds to the second broadcasting speed, thus in the difference, than
Example or in the case that distance belongs to the first subinterval, plays the audio with the first broadcasting speed, in the difference, ratio,
Or in the case that distance belongs to the second subinterval, the audio is played with the second broadcasting speed, first broadcasting speed with
Second broadcasting speed is different.
It is worth noting that in the embodiments of the present disclosure, the audio can be preset any audio, optional
, the control device that audio described in the embodiment of the present disclosure plays includes the device for playing audio, so that the audio is broadcast
The control device put can control the device for playing audio and play or stop playing according to step S101-S103
The audio, optionally, the control device that audio described in the embodiment of the present disclosure plays can lead to according to step S101-S103
It crosses network or connecting line sends the mode of control instruction to control other for playing the device broadcasting of audio or stopping broadcasting
Put the audio.
In an alternative embodiment, first parameter includes multiple first subparameters, and second parameter includes
Multiple second subparameters, according to the broadcasting of first parameter and the second state modulator audio, comprising: determine the multiple
Multiple sub- differences between first subparameter and the multiple second subparameter, multiple sub- ratios or multiple sub- distances, in institute
State multiple sub- differences, belong in multiple sub- ratios or multiple son distances the sub- difference of 3rd interval, sub- ratio, or son away from
In the case where reaching the first ratio, play the audio, in the multiple sub- difference, multiple sub- ratios or multiple sons away from
Belong to the sub- difference of the 3rd interval, sub- ratio, or sub in the case where not up to first ratio, stopping from
Play the audio.As an example, the first parameter includes first position parameter, and the first position parameter includes multiple
One position subparameter, the multiple first position subparameter include the abscissa of the target object determined in first frame image
X1, ordinate y1 and depth coordinate z1, the second parameter include second position parameter, and the second position parameter includes multiple
Two position subparameters, the multiple second position subparameter include the horizontal seat of the target object determined in the second frame image
X2, ordinate y2 and depth coordinate z2 are marked, then more between identified multiple first subparameters and multiple second subparameters
A sub- difference includes | x1-x2 |, | y1-y2 |, and | z1-z2 | totally three sub- differences, then belonging in three sub- differences
In the case that the sub- difference of 3rd interval reaches the first ratio (e.g. 60%), the audio is played, it is poor in the multiple son
Belong in value the 3rd interval sub- difference be not up to first ratio in the case where, stop playing the audio, wherein
The 3rd interval is, for example, to be greater than the section of first threshold, when the son for belonging to the 3rd interval in the multiple sub- difference is poor
Value reaches the first ratio, it is believed that the target object maximum probability is moved, and then plays the audio, when described more
The sub- difference for belonging to the 3rd interval in a sub- difference is not up to first ratio, it is believed that the target object is not sent out
Small movements only have occurred in raw movement, and then stop playing the audio.As another example, the target object packet
Human body is included, multiple first position subparameters that first parameter includes may include the people determined in first frame image
Multiple organs of body and/or the position in joint, multiple second position subparameters that second parameter includes may include
Multiple organs of the human body determined in two frame images and/or the position in joint, the embodiment of the present disclosure are without limitation.
In another alternative embodiment, first parameter includes multiple first subparameters, the second parameter packet
Multiple second subparameters are included, according to the broadcasting of first parameter and the second state modulator audio, comprising: determine described more
Multiple sub- differences between a first subparameter and the multiple second subparameter, multiple sub- ratios or multiple sub- distances；?
Belong to the sub- difference of 3rd interval, sub- ratio, Huo Zhezi in the multiple sub- difference, multiple sub- ratios or multiple son distances
In the case that distance reaches the first quantity, the audio is played, in the multiple sub- difference, multiple sub- ratios or multiple sons
Belong to the sub- difference of the 3rd interval, sub- ratio in distance, or in the case that son distance is not up to first quantity, stops
Only play the audio.Wherein it is identical or it is corresponding description be referred to precedent, it is only necessary to by precedent the first ratio replace
For the first quantity, wherein the first quantity in the embodiment of the present disclosure and the first ratio may each be preset, and details are not described herein again.
In another optional embodiment, in step S103: according to first parameter and second state modulator
After the broadcasting of audio, the method also includes: the third parameter of target object is determined in third frame image, in the 4th frame figure
The 4th parameter that the target object is determined as in, according to the broadcasting of the third parameter and the 4th state modulator audio.
Wherein the description as described in third frame image and third parameter is referred to the identical of first frame image and the first parameter or accordingly retouches
It states, the description as described in the 4th frame image and the 4th parameter is referred to the identical of the second frame image and the second parameter or accordingly retouches
It states, details are not described herein again.
The structural schematic diagram for 200 embodiment of control device that the audio that Fig. 2 show embodiment of the present disclosure offer plays, such as
Shown in Fig. 2, described device includes determining module 201 and control module 202.
Wherein, the determining module 201, for determining the first parameter of target object in first frame image, second
The second parameter of the target object is determined in frame image；The control module 202, for according to first parameter and described
The broadcasting of second state modulator audio.
The method that Fig. 2 shown device can execute embodiment illustrated in fig. 1, the part that the present embodiment is not described in detail can join
Examine the related description to embodiment illustrated in fig. 1.In implementation procedure and the technical effect embodiment shown in Figure 1 of the technical solution
Description, details are not described herein.
Below with reference to Fig. 3, it illustrates the structural representations for the electronic equipment 300 for being suitable for being used to realize the embodiment of the present disclosure
Figure.Electronic equipment in the embodiment of the present disclosure can include but is not limited to such as mobile phone, laptop, digital broadcasting and connect
Receive device, PDA (personal digital assistant), PAD (tablet computer), PMP (portable media player), car-mounted terminal (such as vehicle
Carry navigation terminal) etc. mobile terminal and such as number TV, desktop computer etc. fixed terminal.Electricity shown in Fig. 3
Sub- equipment is only an example, should not function to the embodiment of the present disclosure and use scope bring any restrictions.
As shown in figure 3, electronic equipment 300 may include processing unit (such as central processing unit, graphics processor etc.)
301, random access can be loaded into according to the program being stored in read-only memory (ROM) 302 or from storage device 308
Program in memory (RAM) 303 and execute various movements appropriate and processing.In RAM 303, it is also stored with electronic equipment
Various programs and data needed for 300 operations.Processing unit 301, ROM 302 and RAM 303 pass through bus or communication line
304 are connected with each other.Input/output (I/O) interface 305 is also connected to bus or communication line 304.
In general, following device can connect to I/O interface 305: including such as touch screen, touch tablet, keyboard, mouse, figure
As the input unit 306 of sensor, microphone, accelerometer, gyroscope etc.；Including such as liquid crystal display (LCD), loudspeaking
The output device 307 of device, vibrator etc.；Storage device 308 including such as tape, hard disk etc.；And communication device 309.It is logical
T unit 309 can permit electronic equipment 300 and wirelessly or non-wirelessly be communicated with other equipment to exchange data.Although Fig. 3 shows
The electronic equipment 300 with various devices is gone out, it should be understood that being not required for implementing or having all dresses shown
It sets.It can alternatively implement or have more or fewer devices.
Particularly, in accordance with an embodiment of the present disclosure, it may be implemented as computer above with reference to the process of flow chart description
Software program.For example, embodiment of the disclosure includes a kind of computer program product comprising be carried on computer-readable medium
On computer program, which includes the program code for method shown in execution flow chart.In such reality
It applies in example, which can be downloaded and installed from network by communication device 309, or from storage device 308
It is mounted, or is mounted from ROM 302.When the computer program is executed by processing unit 301, the embodiment of the present disclosure is executed
Method in the above-mentioned function that limits.
It should be noted that the above-mentioned computer-readable medium of the disclosure can be computer-readable signal media or meter
Calculation machine readable storage medium storing program for executing either the two any combination.Computer readable storage medium for example can be --- but not
Be limited to --- electricity, magnetic, optical, electromagnetic, infrared ray or semiconductor system, device or device, or any above combination.Meter
The more specific example of calculation machine readable storage medium storing program for executing can include but is not limited to: have the electrical connection, just of one or more conducting wires
Taking formula computer disk, hard disk, random access storage device (RAM), read-only memory (ROM), erasable type may be programmed read-only storage
Device (EPROM or flash memory), optical fiber, portable compact disc read-only memory (CD-ROM), light storage device, magnetic memory device,
Or above-mentioned any appropriate combination.In the disclosure, computer readable storage medium can be it is any include or storage journey
The tangible medium of sequence, the program can be commanded execution system, device or device use or in connection.And at this
In open, computer-readable signal media may include in a base band or as the data-signal that carrier wave a part is propagated,
In carry computer-readable program code.The data-signal of this propagation can take various forms, including but not limited to
Electromagnetic signal, optical signal or above-mentioned any appropriate combination.Computer-readable signal media can also be computer-readable and deposit
Any computer-readable medium other than storage media, the computer-readable signal media can send, propagate or transmit and be used for
By the use of instruction execution system, device or device or program in connection.Include on computer-readable medium
Program code can transmit with any suitable medium, including but not limited to: electric wire, optical cable, RF (radio frequency) etc. are above-mentioned
Any appropriate combination.
Above-mentioned computer-readable medium can be included in above-mentioned electronic equipment；It is also possible to individualism, and not
It is fitted into the electronic equipment.
Above-mentioned computer-readable medium carries one or more program, when said one or multiple programs are by the electricity
When sub- equipment executes, so that the electronic equipment executes the control method of the broadcasting of the audio in above-described embodiment.
The calculating of the operation for executing the disclosure can be write with one or more programming languages or combinations thereof
Machine program code, above procedure design language include object oriented program language one such as Java, Smalltalk, C+
+, it further include conventional procedural programming language one such as " C " language or similar programming language.Program code can
Fully to execute, partly execute on the user computer on the user computer, be executed as an independent software package,
Part executes on the remote computer or executes on a remote computer or server completely on the user computer for part.
In situations involving remote computers, remote computer can pass through the network of any kind --- including local area network (LAN)
Or wide area network (WAN)-is connected to subscriber computer, or, it may be connected to outer computer (such as mentioned using Internet service
It is connected for quotient by internet).
Flow chart and block diagram in attached drawing are illustrated according to the system of the various embodiments of the disclosure, method and computer journey
The architecture, function and operation in the cards of sequence product.In this regard, each box in flowchart or block diagram can generation
A part of one module, program segment or code of table, a part of the module, program segment or code include one or more use
The executable instruction of the logic function as defined in realizing.It should also be noted that in some implementations as replacements, being marked in box
The function of note can also occur in a different order than that indicated in the drawings.For example, two boxes succeedingly indicated are actually
It can be basically executed in parallel, they can also be executed in the opposite order sometimes, and this depends on the function involved.Also it to infuse
Meaning, the combination of each box in block diagram and or flow chart and the box in block diagram and or flow chart can be with holding
The dedicated hardware based system of functions or operations as defined in row is realized, or can use specialized hardware and computer instruction
Combination realize.
Being described in unit involved in the embodiment of the present disclosure can be realized by way of software, can also be by hard
The mode of part is realized.Wherein, the title of unit does not constitute the restriction to the unit itself under certain conditions.
Above description is only the preferred embodiment of the disclosure and the explanation to institute's application technology principle.Those skilled in the art
Member is it should be appreciated that the open scope involved in the disclosure, however it is not limited to technology made of the specific combination of above-mentioned technical characteristic
Scheme, while should also cover in the case where not departing from design disclosed above, it is carried out by above-mentioned technical characteristic or its equivalent feature
Any combination and the other technical solutions formed.Such as features described above has similar function with (but being not limited to) disclosed in the disclosure
Can technical characteristic replaced mutually and the technical solution that is formed.
Claims (12)
1. the control method that a kind of audio plays characterized by comprising
The first parameter of target object is determined in first frame image；
The second parameter of the target object is determined in the second frame image；
According to the broadcasting of first parameter and the second state modulator audio.
2. the control method that audio according to claim 1 plays, which is characterized in that according to first parameter and described
The broadcasting of second state modulator audio, comprising:
Determine the difference between first parameter and second parameter, ratio or distance；
In the difference, in the case that ratio or distance belong to first interval, the audio is played；
In the difference, in the case that ratio or distance belong to second interval, stop playing the audio.
3. the control method that audio according to claim 2 plays, which is characterized in that the first interval includes the first son
Section and the second subinterval；
In the difference, in the case that ratio or distance belong to first interval, the audio is played, comprising:
In the difference, in the case that ratio or distance belong to the first subinterval, the sound is played with the first play mode
Frequently；
In the difference, in the case that ratio or distance belong to the second subinterval, the sound is played with the second play mode
Frequently.
4. the control method that audio according to claim 3 plays, which is characterized in that first play mode corresponding the
One broadcasting speed, corresponding second broadcasting speed of second play mode.
5. the control method that audio according to claim 1 plays, which is characterized in that first parameter includes multiple the
One subparameter, second parameter include multiple second subparameters；
According to the broadcasting of first parameter and the second state modulator audio, comprising:
Determine multiple sub- differences between the multiple first subparameter and the multiple second subparameter, multiple sub- ratios, or
The multiple sub- distances of person；
In the multiple sub- difference, multiple sub- ratios or multiple sub sub- differences for belonging to 3rd interval in, sub- ratio,
Or in the case that sub- distance reaches the first ratio, the audio is played；
In the multiple sub- difference, the sub- difference of the 3rd interval, sub- ratio are belonged in multiple sub- ratios or multiple son distances
In the case where example, or son distance not up to first ratio, stop playing the audio.
6. the control method that audio according to claim 1 plays, which is characterized in that first parameter includes multiple the
One subparameter, second parameter include multiple second subparameters；
According to the broadcasting of first parameter and the second state modulator audio, comprising:
Determine multiple sub- differences between the multiple first subparameter and the multiple second subparameter, multiple sub- ratios, or
The multiple sub- distances of person；
In the multiple sub- difference, multiple sub- ratios or multiple sub sub- differences for belonging to 3rd interval in, sub- ratio,
Or in the case that sub- distance reaches the first quantity, the audio is played；
In the multiple sub- difference, the sub- difference of the 3rd interval, sub- ratio are belonged in multiple sub- ratios or multiple son distances
In the case where example, or son distance not up to first quantity, stop playing the audio.
7. the control method that audio according to claim 1 plays, which is characterized in that the first parameter of the target object
Second parameter of the first area parameters including the target object, the target object includes the second face of the target object
Product parameter；Or the first parameter of the target object includes the first position parameter of the target object, the target object
The second parameter include the target object second position parameter.
8. the control method that audio according to claim 1 plays, which is characterized in that obtain described first at the first moment
Picture frame obtains second picture frame at the second moment.
9. the control method that audio according to claim 1 plays, which is characterized in that the target object includes human body,
The key point of the human body, the key point of object or the object.
10. the control device that a kind of audio plays, which is characterized in that including determining module and control module, in which:
The determining module determines in the second frame image for determining the first parameter of target object in first frame image
Second parameter of the target object；
The control module, for the broadcasting according to first parameter and the second state modulator audio.
11. a kind of electronic equipment, comprising:
Memory, for storing computer-readable instruction；And
Processor, for running the computer-readable instruction, so that realizing according to claim 1-9 when the processor is run
Any one of described in audio play control method.
12. a kind of non-transient computer readable storage medium, for storing computer-readable instruction, when the computer-readable finger
When order is executed by computer, so that the control that the computer perform claim requires audio described in any one of 1-9 to play
Method.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201910211684.2A CN110047520B (en) | 2019-03-19 | 2019-03-19 | Audio playing control method and device, electronic equipment and computer readable storage medium |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201910211684.2A CN110047520B (en) | 2019-03-19 | 2019-03-19 | Audio playing control method and device, electronic equipment and computer readable storage medium |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN110047520A true CN110047520A (en) | 2019-07-23 |
| CN110047520B CN110047520B (en) | 2021-09-17 |
Family
ID=67273880
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201910211684.2A Active CN110047520B (en) | 2019-03-19 | 2019-03-19 | Audio playing control method and device, electronic equipment and computer readable storage medium |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN110047520B (en) |
Citations (14)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| EP2365420A2 (en) * | 2010-03-11 | 2011-09-14 | Deutsche Telekom AG | System and method for hand gesture recognition for remote control of an internet protocol TV |
| CN103634720A (en) * | 2012-08-21 | 2014-03-12 | 联想(北京)有限公司 | Playing control method and electronic equipment |
| TW201432546A (en) * | 2013-02-07 | 2014-08-16 | Univ Nat Yunlin Sci & Tech | Hand gesture controlled music playing system and hand gesture identification method |
| CN105430262A (en) * | 2015-11-17 | 2016-03-23 | 小米科技有限责任公司 | Photographing control method and photographing control device |
| CN106503127A (en) * | 2016-10-19 | 2017-03-15 | 竹间智能科技（上海）有限公司 | The music data processing method recognized based on facial action and system |
| US20170097807A1 (en) * | 2015-10-01 | 2017-04-06 | Samsung Electronics Co., Ltd. | Electronic device and method for controlling the same |
| CN107145326A (en) * | 2017-03-28 | 2017-09-08 | 浙江大学 | A kind of the music automatic playing system and method for collection of being expressed one's feelings based on target face |
| CN107678818A (en) * | 2017-09-22 | 2018-02-09 | 维沃移动通信有限公司 | A kind of user interface control method and mobile terminal |
| CN107708007A (en) * | 2017-09-18 | 2018-02-16 | 歌尔股份有限公司 | A kind of wireless headset control method, device and wireless headset |
| CN107831896A (en) * | 2017-11-07 | 2018-03-23 | 广东欧珀移动通信有限公司 | Audio-frequency information player method, device, storage medium and electronic equipment |
| CN108229355A (en) * | 2017-12-22 | 2018-06-29 | 北京市商汤科技开发有限公司 | Activity recognition method and apparatus, electronic equipment, computer storage media, program |
| CN108322831A (en) * | 2018-02-28 | 2018-07-24 | 广东美晨通讯有限公司 | video playing control method, mobile terminal and computer readable storage medium |
| CN108491792A (en) * | 2018-03-21 | 2018-09-04 | 安徽大学 | Office scene human-computer interaction Activity recognition method based on electro-ocular signal |
| CN108921798A (en) * | 2018-06-14 | 2018-11-30 | 北京微播视界科技有限公司 | The method, apparatus and electronic equipment of image procossing |
-
2019
- 2019-03-19 CN CN201910211684.2A patent/CN110047520B/en active Active
Patent Citations (14)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| EP2365420A2 (en) * | 2010-03-11 | 2011-09-14 | Deutsche Telekom AG | System and method for hand gesture recognition for remote control of an internet protocol TV |
| CN103634720A (en) * | 2012-08-21 | 2014-03-12 | 联想(北京)有限公司 | Playing control method and electronic equipment |
| TW201432546A (en) * | 2013-02-07 | 2014-08-16 | Univ Nat Yunlin Sci & Tech | Hand gesture controlled music playing system and hand gesture identification method |
| US20170097807A1 (en) * | 2015-10-01 | 2017-04-06 | Samsung Electronics Co., Ltd. | Electronic device and method for controlling the same |
| CN105430262A (en) * | 2015-11-17 | 2016-03-23 | 小米科技有限责任公司 | Photographing control method and photographing control device |
| CN106503127A (en) * | 2016-10-19 | 2017-03-15 | 竹间智能科技（上海）有限公司 | The music data processing method recognized based on facial action and system |
| CN107145326A (en) * | 2017-03-28 | 2017-09-08 | 浙江大学 | A kind of the music automatic playing system and method for collection of being expressed one's feelings based on target face |
| CN107708007A (en) * | 2017-09-18 | 2018-02-16 | 歌尔股份有限公司 | A kind of wireless headset control method, device and wireless headset |
| CN107678818A (en) * | 2017-09-22 | 2018-02-09 | 维沃移动通信有限公司 | A kind of user interface control method and mobile terminal |
| CN107831896A (en) * | 2017-11-07 | 2018-03-23 | 广东欧珀移动通信有限公司 | Audio-frequency information player method, device, storage medium and electronic equipment |
| CN108229355A (en) * | 2017-12-22 | 2018-06-29 | 北京市商汤科技开发有限公司 | Activity recognition method and apparatus, electronic equipment, computer storage media, program |
| CN108322831A (en) * | 2018-02-28 | 2018-07-24 | 广东美晨通讯有限公司 | video playing control method, mobile terminal and computer readable storage medium |
| CN108491792A (en) * | 2018-03-21 | 2018-09-04 | 安徽大学 | Office scene human-computer interaction Activity recognition method based on electro-ocular signal |
| CN108921798A (en) * | 2018-06-14 | 2018-11-30 | 北京微播视界科技有限公司 | The method, apparatus and electronic equipment of image procossing |
Also Published As
| Publication number | Publication date |
|---|---|
| CN110047520B (en) | 2021-09-17 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| WO2020186935A1 (en) | Virtual object displaying method and device, electronic apparatus, and computer-readable storage medium | |
| CN112073748B (en) | Panoramic video processing method and device and storage medium | |
| CN110324647A (en) | The determination method, apparatus and electronic equipment of information | |
| CN112672185B (en) | Augmented reality-based display method, device, equipment and storage medium | |
| CN109600559B (en) | Video special effect adding method and device, terminal equipment and storage medium | |
| CN109889893A (en) | Method for processing video frequency, device and equipment | |
| CN110069191B (en) | Terminal-based image dragging deformation implementation method and device | |
| WO2021027596A1 (en) | Image special effect processing method and apparatus, and electronic device and computer readable storage medium | |
| CN110062157A (en) | Render method, apparatus, electronic equipment and the computer readable storage medium of image | |
| CN110070585A (en) | Image generating method, device and computer readable storage medium | |
| WO2023116801A1 (en) | Particle effect rendering method and apparatus, device, and medium | |
| CN110781823A (en) | Screen recording detection method and device, readable medium and electronic equipment | |
| CN109618216A (en) | Show method, apparatus, equipment and the storage medium of video stress state mark | |
| CN109981989A (en) | Render method, apparatus, electronic equipment and the computer readable storage medium of image | |
| CN110062158A (en) | Control method, apparatus, electronic equipment and the computer readable storage medium of filming apparatus | |
| WO2023246302A9 (en) | Subtitle display method and apparatus, device and medium | |
| CN110069195A (en) | Image pulls deformation method and device | |
| CN110047520A (en) | Control method, device, electronic equipment and the computer readable storage medium that audio plays | |
| CN109871465A (en) | A kind of time shaft calculation method, device, electronic equipment and storage medium | |
| CN110197459A (en) | Image stylization generation method, device and electronic equipment | |
| CN108874141A (en) | A kind of body-sensing browsing method and device | |
| CN110209861A (en) | Image processing method, device, electronic equipment and computer readable storage medium | |
| CN109816791A (en) | Method and apparatus for generating information | |
| CN109636917A (en) | Generation method, device, the hardware device of threedimensional model | |
| CN110070479B (en) | Method and device for positioning image deformation dragging point |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant | ||
| CP01 | Change in the name or title of a patent holder |
Address after: 100041 B-0035, 2 floor, 3 building, 30 Shixing street, Shijingshan District, Beijing. Patentee after: Tiktok vision (Beijing) Co.,Ltd. Address before: 100041 B-0035, 2 floor, 3 building, 30 Shixing street, Shijingshan District, Beijing. Patentee before: BEIJING BYTEDANCE NETWORK TECHNOLOGY Co.,Ltd. Address after: 100041 B-0035, 2 floor, 3 building, 30 Shixing street, Shijingshan District, Beijing. Patentee after: Douyin Vision Co.,Ltd. Address before: 100041 B-0035, 2 floor, 3 building, 30 Shixing street, Shijingshan District, Beijing. Patentee before: Tiktok vision (Beijing) Co.,Ltd. |
|
| CP01 | Change in the name or title of a patent holder |