CN112135187A - Multimedia data generation method, interception method, device, equipment and storage medium - Google Patents

Multimedia data generation method, interception method, device, equipment and storage medium Download PDF

Info

Publication number
CN112135187A
CN112135187A CN202010751053.2A CN202010751053A CN112135187A CN 112135187 A CN112135187 A CN 112135187A CN 202010751053 A CN202010751053 A CN 202010751053A CN 112135187 A CN112135187 A CN 112135187A
Authority
CN
China
Prior art keywords
event information
control event
control
instruction
multimedia data
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Granted
Application number
CN202010751053.2A
Other languages
Chinese (zh)
Other versions
CN112135187B (en
Inventor
肖亮亮
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Guangzhou Cubesili Information Technology Co Ltd
Original Assignee
Guangzhou Huaduo Network Technology Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Guangzhou Huaduo Network Technology Co Ltd filed Critical Guangzhou Huaduo Network Technology Co Ltd
Priority to CN202010751053.2A priority Critical patent/CN112135187B/en
Publication of CN112135187A publication Critical patent/CN112135187A/en
Application granted granted Critical
Publication of CN112135187B publication Critical patent/CN112135187B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/44—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream or rendering scenes according to encoded video stream scene graphs
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/433—Content storage operation, e.g. storage operation in response to a pause request, caching operations
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/442—Monitoring of processes or resources, e.g. detecting the failure of a recording device, monitoring the downstream bandwidth, the number of times a movie has been viewed, the storage space available from the internal hard disk
    • H04N21/44213—Monitoring of end-user related data
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/45—Management operations performed by the client for facilitating the reception of or the interaction with the content or administrating data related to the end-user or to the client device itself, e.g. learning user preferences for recommending movies, resolving scheduling conflicts
    • H04N21/4508—Management of client data or end-user data
    • H04N21/4532—Management of client data or end-user data involving end-user characteristics, e.g. viewer profile, preferences
    • Y—GENERAL TAGGING OF NEW TECHNOLOGICAL DEVELOPMENTS; GENERAL TAGGING OF CROSS-SECTIONAL TECHNOLOGIES SPANNING OVER SEVERAL SECTIONS OF THE IPC; TECHNICAL SUBJECTS COVERED BY FORMER USPC CROSS-REFERENCE ART COLLECTIONS [XRACs] AND DIGESTS
    • Y02—TECHNOLOGIES OR APPLICATIONS FOR MITIGATION OR ADAPTATION AGAINST CLIMATE CHANGE
    • Y02P—CLIMATE CHANGE MITIGATION TECHNOLOGIES IN THE PRODUCTION OR PROCESSING OF GOODS
    • Y02P90/00—Enabling technologies with a potential contribution to greenhouse gas [GHG] emissions mitigation
    • Y02P90/02—Total factory control, e.g. smart factories, flexible manufacturing systems [FMS] or integrated manufacturing systems [IMS]

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Databases & Information Systems (AREA)
  • Health & Medical Sciences (AREA)
  • General Health & Medical Sciences (AREA)
  • Social Psychology (AREA)
  • Computer Networks & Wireless Communication (AREA)
  • Two-Way Televisions, Distribution Of Moving Picture Or The Like (AREA)
  • Management Or Editing Of Information On Record Carriers (AREA)
  • Television Signal Processing For Recording (AREA)

Abstract

The invention relates to the field of data processing, and provides a multimedia data generation method, an interception method, a device, equipment and a storage medium, wherein the multimedia data generation method comprises the steps of receiving a control instruction, generating corresponding control event information according to the control instruction, and storing the control event information into a control event information set; acquiring first control event information and second control event information in a control event information set according to a preset matching rule; generating intercepted multimedia data according to the first control event information and the second control event information; and displaying the multimedia video to the user in a preset display mode. The invention can improve the timeliness of the user for recording the live video.

Description

Multimedia data generation method, interception method, device, equipment and storage medium
Technical Field
The present invention relates to the field of data processing, and in particular, to a multimedia data generating method, an intercepting apparatus, a device, and a storage medium.
Background
The recording of the live video is to store the played video data during live broadcasting, record a required video file through the stored video data according to time and video stream information, and provide a physical video file for subsequent editing and review.
With the continuous development of internet technology, the real-time sharing of live videos is increasingly required. When a network television channel or a scene is playing a highlight program, a user needs to distribute a video which is just played to the internet in time so that more users can see the highlight video segment which is just played.
However, the existing live video recording method has a complicated recording process and poor timeliness of live video recording, and cannot meet the requirement of a user on timely publishing live video. Therefore, how to improve the timeliness of live video recording becomes a technical problem which needs to be solved urgently.
Disclosure of Invention
The invention mainly aims to provide a multimedia data generating method, an intercepting method, a device, equipment and a storage medium, and aims to solve the problem of how to improve the timeliness of live video recording.
To achieve the above object, a first aspect provides a multimedia data generation method, including:
receiving a control instruction, generating corresponding control event information according to the control instruction, and storing the control event information to a control event information set;
acquiring first control event information and second control event information in the control event information set according to a preset matching rule;
generating the multimedia data according to the first control event information and the second control event information;
and displaying the multimedia video to a user in a preset display mode.
Preferably, the step of generating corresponding control event information according to the control command includes:
generating control instruction information including identification information for identifying the control instruction according to the control instruction;
and when the control instruction information meets the instruction verification rule, generating corresponding control event information.
Preferably, after the step of "when the control instruction information satisfies the instruction verification rule", the method further includes:
when the control instruction corresponding to the control instruction information is a preset cancel instruction, finding the last piece of control event information of the control instruction information from the control event information set, and if the control instruction corresponding to the last piece of control event information is a preset start instruction, deleting the last piece of control event information.
Preferably, the step of generating the multimedia data according to the first control event information and the second control event information includes:
generating a multimedia data interception instruction according to the first control event information and the second control event information;
and intercepting and generating corresponding multimedia data according to the multimedia intercepting instruction.
Preferably, the step of "acquiring the first control event information and the second control event information in the control event information set according to a preset matching rule" includes:
and acquiring first control event information from the control event information set, and deleting the first control event information when a control instruction corresponding to the first control event information is a preset ending instruction.
Preferably, the step of "acquiring the first control event information and the second control event information in the control event information set according to a preset matching rule" includes:
and acquiring first control event information from the control event information set, acquiring second control event information when a control instruction corresponding to the first control event information is the preset starting instruction, and deleting the first control event information when the control instruction corresponding to the second control event information is the preset starting instruction.
Preferably, the step of "acquiring the first control event information and the second control event information in the control event information set according to a preset matching rule" includes:
and acquiring first control event information from the control event information set, acquiring second control event information when a control instruction corresponding to the first control event information is the preset starting instruction, and generating the multimedia data according to the first control event information and the second control event information when a control instruction corresponding to the second control event information is the preset ending instruction.
The second aspect of the present invention provides a multimedia data intercepting method, for intercepting multimedia data displayed on a user interaction interface, comprising:
receiving a control instruction, and generating control instruction information including identification information for identifying the control instruction according to the control instruction;
when the control instruction information meets an instruction verification rule, generating corresponding control event information, and storing the control event information to a control event information set;
acquiring first control event information and second control event information in the control event information set according to a preset matching rule;
and generating the intercepted multimedia data according to the first control event information and the second control event information.
Preferably, the step of generating the intercepted multimedia data according to the first control event information and the second control event information includes:
generating a multimedia data interception instruction according to the first control event information and the second control event information;
and intercepting and generating corresponding multimedia data according to the multimedia intercepting instruction.
Preferably, after the step of "when the control instruction information satisfies the instruction verification rule", the method further includes:
and when the control instruction corresponding to the control instruction information is a preset cancel instruction, finding the last piece of control event information of the control instruction information from the control event information set, and when the control instruction corresponding to the last piece of control event information is a preset start instruction, deleting the last piece of control event information.
Preferably, the step of "acquiring the first control event information and the second control event information in the control event information set according to a preset matching rule" includes:
and acquiring first control event information from the control event information set, and deleting the first control event information when a control instruction corresponding to the first control event information is a preset ending instruction.
Preferably, the step of "acquiring the first control event information and the second control event information in the control event information set according to a preset matching rule" includes:
and acquiring first control event information from the control event information set, acquiring second control event information when a control instruction corresponding to the first control event information is the preset starting instruction, and deleting the first control event information when the control instruction corresponding to the second control event information is the preset starting instruction.
Preferably, the step of "acquiring the first control event information and the second control event information in the control event information set according to a preset matching rule" includes:
and when the control instruction corresponding to the second control event information is the preset ending instruction, generating a multimedia data interception instruction according to the first control event information and the second control event information.
To achieve the above object, a third aspect of the present invention provides a multimedia data generating apparatus comprising:
the receiving module is used for receiving a control instruction, generating corresponding control event information according to the control instruction, and storing the control event information to a control event information set;
the acquisition module is used for acquiring first control event information and second control event information in the control event information set according to a preset matching rule;
the generating module is used for generating the multimedia data according to the first control event information and the second control event information;
and the display module is used for displaying the multimedia video to a user in a preset display mode.
To achieve the above object, a fourth aspect of the present invention provides an electronic device comprising a memory and a processor, the memory having stored thereon a multimedia data generation program, the multimedia data generation program, when executed by the processor, implementing the steps of the multimedia data generation method as described above.
To achieve the above object, a fifth aspect of the present invention provides a computer-readable storage medium having a multimedia data generation program stored thereon, the multimedia data generation program being executable by one or more processors to implement the steps of the multimedia data generation method as described above.
To achieve the above object, a sixth aspect of the present invention provides a computer-readable storage medium having a multimedia data interception program stored thereon, where the multimedia data interception program is executable by one or more processors to implement the steps of the multimedia data interception method as described above.
The multimedia data generation method, the interception method, the device, the equipment and the storage medium provided by the invention have the advantages that the control instruction is received, the corresponding control event information is generated according to the control instruction, and the control event information is stored in a control event information set; acquiring first control event information and second control event information in a control event information set according to a preset matching rule; generating intercepted multimedia data according to the first control event information and the second control event information; and displaying the multimedia video to the user in a preset display mode. The invention can improve the timeliness of the user for recording the live video.
Drawings
Fig. 1 is a schematic diagram of a network deployment architecture of a multimedia data generation method according to an embodiment of the present invention;
fig. 2 is a flowchart illustrating a multimedia data generating method according to an embodiment of the invention;
fig. 3 is a schematic view of a user interface operation of an electronic device implementing a multimedia data generating method according to an embodiment of the present invention;
fig. 4 is a flowchart illustrating a multimedia data intercepting method according to an embodiment of the present invention;
fig. 5 is a block diagram of a multimedia data generating apparatus according to an embodiment of the invention;
fig. 6 is a schematic internal structural diagram of an electronic device implementing a multimedia data generating method according to an embodiment of the present invention.
The implementation, functional features and advantages of the objects of the present invention will be further explained with reference to the accompanying drawings.
Detailed Description
In order to make the objects, technical embodiments and advantages of the present invention more apparent, the present invention will be described in detail with reference to the accompanying drawings and embodiments. It should be understood that the specific embodiments described herein are merely illustrative of the invention and are not intended to limit the invention. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present invention.
It should be noted that the description relating to "first", "second", etc. in the present invention is for descriptive purposes only and is not to be construed as indicating or implying relative importance or implicitly indicating the number of technical features indicated. Thus, a feature defined as "first" or "second" may explicitly or implicitly include at least one such feature. In addition, the technical embodiments of the present invention may be combined with each other, but it must be based on the realization of those skilled in the art, and when the combination of the technical embodiments contradicts each other or cannot be realized, such combination of the technical embodiments should be considered to be absent and not within the protection scope of the present invention.
Fig. 1 is a schematic diagram of a network deployment architecture according to an embodiment of the multimedia data generation method of the present invention. The client 01 is installed with a multimedia data generating program 10. A plurality of clients 01 are connected to the server 03 via the network 02. Network 02 may be a local area network, wide area network, metropolitan area network, personal area network, or the like; the wireless network can be a wired network or a wireless network. The client 01 may be a desktop computer, a notebook, a tablet computer, a mobile phone, or other terminal devices installed with application software and capable of communicating with the server 03 through the network 02.
Because the existing live video recording method has complicated recording process and poor timeliness of live video recording, the requirement of timely releasing live video by a user cannot be met.
Accordingly, to solve the above-mentioned problems, an aspect of the present invention provides a multimedia data generating method. Fig. 2 is a schematic flow chart of a multimedia data generating method according to an embodiment of the present invention. The method may be performed by an apparatus, which may be implemented by software and/or hardware.
S110, receiving a control instruction, generating corresponding control event information according to the control instruction, and storing the control event information to a control event information set.
In this embodiment, in order to make this embodiment more clear, how to timely intercept a video generated in a live broadcast process on the live broadcast platform APP according to the preference of the user himself is taken as an example to further explain this scheme, and a client is taken as an execution subject, where the client refers to a computer or a mobile phone or other electronic equipment capable of installing the live broadcast platform APP. Specifically, the control instruction may be triggered by detecting an operation of the client by the user, for example, by inputting text information on a keyboard of the client; the control action of the user can be detected to trigger, such as waving or moving fingers, twisting fingers, stretching palms, rotating wrists, watching or transferring sight, moving heads and moving bodies; it may also be triggered by detecting a voice input by the user, e.g. by detecting a voice message of the user by a microphone, etc.
In a specific embodiment, the control command may be a piece of data input by the user in the input area 002 of the operation interface 001 of the client, and then click the control area 003 to trigger, for example, "SSS", and generate a text bullet screen to be displayed on the display area 004 of the client. Referring to fig. 3, a schematic view of a user interface operation of an electronic device implementing a multimedia data generating method according to an embodiment of the present invention is shown.
When the client receives a control instruction sent by a user, the client generates control instruction information including identification information (for example, UID: unique identification of the user) for identifying the control instruction according to the control instruction, namely, the intention of the user is identified through the control instruction information, for example, different control instructions can indicate that the user wants to start video capture operation at a certain time point, or wants to end video capture operation at a certain time point, or wants to cancel video capture operation at a certain time point. The identity information of the user (e.g. UID: unique identification of the user) may also be identified by the control instruction information.
Furthermore, as the live broadcast platform belongs to a public platform facing audiences, any user can log in the live broadcast platform and send a control instruction to the client. If all users can randomly intercept videos generated in the live broadcasting process by sending a control instruction and issue small videos, a plurality of small videos with different qualities are derived from the same live video, and the overall quality of the small videos is affected. Therefore, in the present embodiment, it needs to be specified that when the received control instruction information is judged to satisfy the instruction verification rule, the corresponding control event information is generated and stored to the control event information set.
Wherein, the validation rule comprises:
and judging whether the identification information corresponding to the control instruction information is contained in a pre-established white list or not, and if so, generating control event information corresponding to the control instruction information.
The white list records identification information (such as UID) with appointed authority, namely the client is controlled to carry out operations such as video interception, video interception stop, video interception cancellation and the like by the authority through a control instruction.
In another embodiment, the method further comprises:
when the control instruction corresponding to the control instruction information is a preset cancel instruction, finding the last piece of control event information of the control instruction information from the control event information set, and if the control instruction corresponding to the last piece of control event information is a preset start instruction, deleting the last piece of control event information.
The method aims to meet the requirement that a user can cancel the control instruction sent this time according to the actual situation after sending the control instruction which wants to carry out the video capturing operation. In this embodiment, the control instruction may also be configured to be an instruction capable of controlling the client to cancel the video capture operation. Specifically, when the client receives that the control instruction sent by the user is a preset cancel instruction (for example, "CCC"), the client first finds the last piece of control event information of the control instruction information from the control event information set, and deletes the last piece of control event information if the control instruction corresponding to the last piece of control event information is a preset start instruction (for example, "SSS"), that is, cancels the video capture operation.
And S120, acquiring first control event information and second control event information in the control event information set according to a preset matching rule.
In the embodiment, the invalid control commands are automatically filtered by using the preset matching rule, and only the first control event and the second control event which simultaneously satisfy the matching rule can be intercepted and generated to generate the multimedia data.
Specifically, how to obtain the first control event information and the second control event information according to the preset matching rule may be implemented by the following steps:
and acquiring first control event information from the control event information set, and deleting the first control event information when a control instruction corresponding to the first control event information is a preset ending instruction. For example, when the control command corresponding to the first control event message is the preset end command "EEE", because there is no matched preset start command, the first control event message is directly deleted, or is included in the to-be-deleted event list and waits to be deleted.
The method can also be realized by the following steps:
and acquiring first control event information from the control event information set, acquiring second control event information when a control instruction corresponding to the first control event information is the preset starting instruction, and deleting the first control event information when the control instruction corresponding to the second control event information is the preset starting instruction. For example, when the control instruction corresponding to the first control event information is a preset start instruction "SS", the second control event message is acquired, and when the control instruction corresponding to the second control event information is a preset start instruction "SSs" as the first control event information, the first control event message needs to be deleted, and the first control event message is directly deleted, or is included in an event list to be deleted, and waits for deletion. And reserving a preset starting instruction which is closest to the current event, namely the second control event information.
The method can also be realized by the following steps:
and when the control instruction corresponding to the second control event information is the preset ending instruction, generating a multimedia data interception instruction according to the first control event information and the second control event information. For example, when the control instruction corresponding to the first control event information is a preset start instruction "SSS", the second control event information is acquired, and when the control instruction corresponding to the second control event information is a preset end instruction "EEE", at this time, the first control event information is just successfully paired with the second control event information, and a multimedia data (for example, a video generated in a live broadcast process) interception instruction can be generated according to the first control event information and the second control event information.
In another embodiment, the method further comprises:
acquiring first control event information from the control event information set, and acquiring grouping information corresponding to the first control event information, wherein the grouping information is included in the control event information;
and acquiring second control event information of the same group from the control event information set according to the group information.
In this embodiment, the first control event information and the second control event information corresponding to the same user need to be grouped and classified, so as to avoid confusion of pairing between the first control event information and the second control event information of different users.
S130, generating the multimedia data according to the first control event information and the second control event information.
In this embodiment, when the first control event information and the second control event information in the control event information set obtained by using the preset matching rule just can be successfully paired, a multimedia data interception instruction can be generated according to the first control event information and the second control event information, and corresponding multimedia data (for example, a video generated in a live broadcast process) can be intercepted and generated according to the multimedia interception instruction.
In another embodiment, the method further comprises the steps of:
and screening the plurality of multimedia data interception instructions according to a preset interception instruction screening rule, and reserving one multimedia data interception instruction from the plurality of multimedia data interception instructions with the similarity greater than or equal to a preset threshold value.
In order to make the embodiment more clear, the above description is continued by taking an example of how to timely intercept the video generated in the live broadcast process on the live broadcast platform APP according to the preference of the user. Because a plurality of users in the white list may perform video capture operations on the same live video at the same time, and the video contents obtained after capture are just similar, the overall quality of the video is affected if deduplication processing is not performed.
In order to solve the above problem, in this embodiment, a plurality of multimedia data interception instructions are screened, and only one of the multimedia data interception instructions is reserved, where the specific implementation process includes:
and calculating the similarity values of every two multimedia data interception instructions, and reserving one multimedia data interception instruction from a plurality of multimedia data interception instructions with the similarity greater than or equal to a preset threshold value. The specific similarity value calculation algorithm can adopt a conventional cosine similarity calculation method.
In another embodiment, the method further comprises the steps of:
screening out a multimedia data interception instruction of which the interval duration between the first control event information and the second control event information is greater than or equal to a first preset duration;
and delaying the time point corresponding to the first control event information by the first preset time length to obtain a time point which is used as the time point of the second control event information.
In the embodiment, by limiting the maximum duration of data interception, the situation that the duration of a video recorded by a user exceeds the specified maximum duration of video transmission to cause failure of video distribution is avoided. Specifically, a multimedia data interception instruction that the interval duration between the first control event information and the second control event information is greater than or equal to a first preset duration is screened out, and a time point obtained by delaying a time point corresponding to the first control event information by the first preset duration is used as a time point of the second control event information. For example, the time point corresponding to the first control event information is 15:20:00, the time point corresponding to the second control event information is 15:26:23, the first preset time duration is 5 minutes, and at this time, the time point corresponding to the second control event information already exceeds the first preset time duration, so that the actual time point corresponding to the second control event information is a time point corresponding to the first control event information, which is delayed by the first preset time duration, that is, 15:25: 00.
In another embodiment, the method further comprises the steps of:
and judging whether the multimedia data conforms to the auditing rule.
In order to prevent illegal information, such as sensitive information, existing in the intercepted video, which causes the video to be published unsuccessfully. Therefore, in this embodiment, after the video capture is completed, it is necessary to determine whether the multimedia data conforms to the auditing rule, and the specific auditing rule may refer to the current video publishing legal provision.
In another embodiment, the time point corresponding to the first control event information or the time point corresponding to the second control event information is obtained by converting a preset expression rule;
wherein the preset expression rule comprises:
the time point corresponding to the first control event information is equal to the time when the control instruction corresponding to the first control event information is sent out, and the time is increased or decreased by a second preset time length; or
And the time corresponding to the second control event information is equal to the time point when the control instruction corresponding to the second control event information is sent out, and the time point is increased or decreased by a third preset time length.
In actual operation, the user may think that the video capture operation is to be performed after a period of time elapses after the highlight of the multimedia data, but it is not time to issue the video capture instruction. Therefore, in order to make the present solution better satisfy the actual situation of the user, in this embodiment, the time point corresponding to the first control event information or the time point corresponding to the second control event information may be obtained by converting the preset expression rule.
For example, when the control command issued by the user is "SSS-10 s", the time point corresponding to the generated control event information is the current time-10 s.
For another example, when the control command issued by the user is "SSS +10 s", the time point current time corresponding to the control event information is +10 s.
And S140, displaying the multimedia video to the user in a preset display mode.
In this embodiment, after the multimedia data is generated, the multimedia data (for example, a video generated in a live broadcasting process) may be presented to a user in a preset presentation manner. The display mode may be that the generated multimedia data is directly played on a client (for example, a mobile phone or a computer), or a reminder message of "successful data interception" is sent and displayed on the client to remind the user that the data is generated.
The invention also provides a multimedia data intercepting method which is used for intercepting the multimedia data displayed on the user interaction interface. Fig. 4 is a schematic flow chart of a multimedia data interception method according to an embodiment of the present invention. The method may be performed by an apparatus, which may be implemented by software and/or hardware.
In this embodiment, the multimedia data intercepting method includes:
s210, receiving a control instruction, and generating control instruction information including identification information for identifying the control instruction according to the control instruction.
In this embodiment, in order to make this embodiment more clear, how to timely intercept a video generated in a live broadcast process on the live broadcast platform APP according to the preference of the user himself is taken as an example to further explain this scheme, and a client is taken as an execution subject, where the client refers to a computer or a mobile phone or other electronic equipment capable of installing the live broadcast platform APP. Specifically, the control instruction may be triggered by detecting an operation of the client by the user, for example, by inputting text information on a keyboard of the client; the control action of the user can be detected to trigger, such as waving or moving fingers, twisting fingers, stretching palms, rotating wrists, watching or transferring sight, moving heads and moving bodies; it may also be triggered by detecting a voice input by the user, e.g. by detecting a voice message of the user by a microphone, etc.
In a specific embodiment, the control command may be a piece of data input by the user in the input area 002 of the operation interface 001 of the client, and then click the control area 003 to trigger, for example, "SSS", and generate a text bullet screen to be displayed on the display area 004 of the client. Referring to fig. 3, a schematic view of a user interface operation of an electronic device implementing a multimedia data generating method according to an embodiment of the present invention is shown.
When the client receives a control instruction sent by a user, the client generates control instruction information including identification information (for example, UID: unique identification of the user) for identifying the control instruction according to the control instruction, namely, the intention of the user is identified through the control instruction information, for example, different control instructions can indicate that the user wants to start video capture operation at a certain time point, or wants to end video capture operation at a certain time point, or wants to cancel video capture operation at a certain time point. The identity information of the user (e.g. UID: unique identification of the user) may also be identified by the control instruction information.
S220, when the control instruction information meets the instruction verification rule, generating corresponding control event information, and storing the control event information to a control event information set.
In this embodiment, in order to make this embodiment more clear, the present solution is further explained by taking as an example how to timely intercept, according to the preference of the user, the video generated in the live broadcast process on the live broadcast platform APP, and taking a client as an execution subject, where the client refers to a computer or a mobile phone or other electronic equipment capable of installing the live broadcast platform APP. Specifically, as the live broadcast platform belongs to a public platform facing audiences, any user can log in the live broadcast platform and send a control instruction to the client. If all users can randomly intercept videos generated in the live broadcasting process by sending a control instruction and issue small videos, a plurality of small videos with different qualities are derived from the same live video, and the overall quality of the small videos is affected. Therefore, in the present embodiment, it needs to be specified that when the received control instruction information is judged to satisfy the instruction verification rule, the corresponding control event information is generated and stored to the control event information set.
Wherein, the validation rule comprises:
and judging whether the identification information corresponding to the control instruction information is contained in a pre-established white list or not, and if so, generating control event information corresponding to the control instruction information.
The white list records identification information (such as UID) with appointed authority, namely the client is controlled to carry out operations such as video interception, video interception stop, video interception cancellation and the like by the authority through a control instruction.
In another embodiment, the method further comprises:
when the control instruction corresponding to the control instruction information is a preset cancel instruction, finding the last piece of control event information of the control instruction information from the control event information set, and if the control instruction corresponding to the last piece of control event information is a preset start instruction, deleting the last piece of control event information.
The method aims to meet the requirement that a user can cancel the control instruction sent this time according to the actual situation after sending the control instruction which wants to carry out the video capturing operation. In this embodiment, the control instruction may also be configured to be an instruction capable of controlling the client to cancel the video capture operation. Specifically, when the client receives that the control instruction sent by the user is a preset cancel instruction (for example, "CCC"), the client first finds the last piece of control event information of the control instruction information from the control event information set, and deletes the last piece of control event information if the control instruction corresponding to the last piece of control event information is a preset start instruction (for example, "SSS"), that is, cancels the video capture operation.
And S230, acquiring first control event information and second control event information in the control event information set according to a preset matching rule.
In the embodiment, the invalid control commands are automatically filtered by using the preset matching rule, and only the first control event and the second control event which simultaneously satisfy the matching rule can be intercepted and generated to generate the multimedia data.
Specifically, how to obtain the first control event information and the second control event information according to the preset matching rule may be implemented by the following steps:
and acquiring first control event information from the control event information set, and deleting the first control event information when a control instruction corresponding to the first control event information is a preset ending instruction. For example, when the control command corresponding to the first control event message is the preset end command "EEE", because there is no matched preset start command, the first control event message is directly deleted, or is included in the to-be-deleted event list and waits to be deleted.
The method can also be realized by the following steps:
and acquiring first control event information from the control event information set, acquiring second control event information when a control instruction corresponding to the first control event information is the preset starting instruction, and deleting the first control event information when the control instruction corresponding to the second control event information is the preset starting instruction. For example, when the control instruction corresponding to the first control event information is a preset start instruction "SS", the second control event message is acquired, and when the control instruction corresponding to the second control event information is a preset start instruction "SSs" as the first control event information, the first control event message needs to be deleted, and the first control event message is directly deleted, or is included in an event list to be deleted, and waits for deletion. And reserving a preset starting instruction which is closest to the current event, namely the second control event information.
The method can also be realized by the following steps:
and when the control instruction corresponding to the second control event information is the preset ending instruction, generating a multimedia data interception instruction according to the first control event information and the second control event information. For example, when the control instruction corresponding to the first control event information is a preset start instruction "SSS", the second control event information is acquired, and when the control instruction corresponding to the second control event information is a preset end instruction "EEE", at this time, the first control event information is just successfully paired with the second control event information, and a multimedia data (for example, a video generated in a live broadcast process) interception instruction can be generated according to the first control event information and the second control event information.
In another embodiment, the method further comprises:
acquiring first control event information from the control event information set, and acquiring grouping information corresponding to the first control event information, wherein the grouping information is included in the control event information;
and acquiring second control event information of the same group from the control event information set according to the group information.
In this embodiment, the first control event information and the second control event information corresponding to the same user need to be grouped and classified, so as to avoid confusion of pairing between the first control event information and the second control event information of different users.
S240, generating the intercepted multimedia data according to the first control event information and the second control event information.
In this embodiment, when the first control event information and the second control event information in the control event information set obtained by using the preset matching rule just can be successfully paired, a multimedia data interception instruction can be generated according to the first control event information and the second control event information, and corresponding multimedia data (for example, a video generated in a live broadcast process) can be intercepted and generated according to the multimedia interception instruction.
In another embodiment, the method further comprises the steps of:
and screening the plurality of multimedia data interception instructions according to a preset interception instruction screening rule, and reserving one multimedia data interception instruction from the plurality of multimedia data interception instructions with the similarity greater than or equal to a preset threshold value.
In order to make the embodiment more clear, the above description is continued by taking an example of how to timely intercept the video generated in the live broadcast process on the live broadcast platform APP according to the preference of the user. Because a plurality of users in the white list may perform video capture operations on the same live video at the same time, and the video contents obtained after capture are just similar, the overall quality of the video is affected if deduplication processing is not performed.
In order to solve the above problem, in this embodiment, a plurality of multimedia data interception instructions are screened, and only one of the multimedia data interception instructions is reserved, where the specific implementation process includes:
and calculating the similarity values of every two multimedia data interception instructions, and reserving one multimedia data interception instruction from a plurality of multimedia data interception instructions with the similarity greater than or equal to a preset threshold value. The specific similarity value calculation algorithm can adopt a conventional cosine similarity calculation method.
In another embodiment, the method further comprises the steps of:
screening out a multimedia data interception instruction of which the interval duration between the first control event information and the second control event information is greater than or equal to a first preset duration;
and delaying the time point corresponding to the first control event information by the first preset time length to obtain a time point which is used as the time point of the second control event information.
In the embodiment, by limiting the maximum duration of data interception, the situation that the duration of a video recorded by a user exceeds the specified maximum duration of video transmission to cause failure of video distribution is avoided. Specifically, a multimedia data interception instruction that the interval duration between the first control event information and the second control event information is greater than or equal to a first preset duration is screened out, and a time point obtained by delaying a time point corresponding to the first control event information by the first preset duration is used as a time point of the second control event information. For example, the time point corresponding to the first control event information is 15:20:00, the time point corresponding to the second control event information is 15:26:23, the first preset time duration is 5 minutes, and at this time, the time point corresponding to the second control event information already exceeds the first preset time duration, so that the actual time point corresponding to the second control event information is a time point corresponding to the first control event information, which is delayed by the first preset time duration, that is, 15:25: 00.
In another embodiment, the method further comprises the steps of:
and judging whether the multimedia data conforms to the auditing rule.
In order to prevent illegal information, such as sensitive information, existing in the intercepted video, which causes the video to be published unsuccessfully. Therefore, in this embodiment, after the video capture is completed, it is necessary to determine whether the multimedia data conforms to the auditing rule, and the specific auditing rule may refer to the current video publishing legal provision.
In another embodiment, the time point corresponding to the first control event information or the time point corresponding to the second control event information is obtained by converting a preset expression rule;
wherein the preset expression rule comprises:
the time point corresponding to the first control event information is equal to the time when the control instruction corresponding to the first control event information is sent out, and the time is increased or decreased by a second preset time length; or
And the time corresponding to the second control event information is equal to the time point when the control instruction corresponding to the second control event information is sent out, and the time point is increased or decreased by a third preset time length.
In actual operation, the user may think that the video capture operation is to be performed after a period of time elapses after the highlight of the multimedia data, but it is not time to issue the video capture instruction. Therefore, in order to make the present solution better satisfy the actual situation of the user, in this embodiment, the time point corresponding to the first control event information or the time point corresponding to the second control event information may be obtained by converting the preset expression rule.
For example, when the control command issued by the user is "SSS-10 s", the time point corresponding to the generated control event information is the current time-10 s.
For another example, when the control command issued by the user is "SSS +10 s", the time point current time corresponding to the control event information is +10 s.
In another embodiment, the method further comprises the steps of:
and displaying the multimedia video to a user in a preset display mode.
In this embodiment, after the multimedia data is generated, the multimedia data (for example, a video generated in a live broadcasting process) may be presented to a user in a preset presentation manner. The display mode may be that the generated multimedia data is directly played on a client (for example, a mobile phone or a computer), or a reminder message of "successful data interception" is sent and displayed on the client to remind the user that the data is generated.
For detailed description of the above steps, please refer to the following description of fig. 5 regarding a schematic diagram of program modules of an embodiment of the multimedia data generating program 10 and fig. 2 regarding a schematic diagram of a method flow of an embodiment of a multimedia data generating method.
Fig. 5 is a functional block diagram of the multimedia data generating apparatus 100 according to the present invention.
The multimedia generating apparatus 100 of the present invention may be installed in the electronic device 1. According to the realized functions, the multimedia generating apparatus 100 may include a receiving module 110, an obtaining module 120, a generating module 130 and a presenting module 140. The module of the invention, which may also be referred to as a unit, is a series of computer program segments that can be executed by a processor of the electronic device 1 and that can perform a fixed function, and is stored in a memory of the electronic device 1.
In the present embodiment, the functions regarding the respective modules/units are as follows:
the receiving module 110 is configured to receive a control instruction, generate corresponding control event information according to the control instruction, and store the control event information in a control event information set.
In this embodiment, in order to make this embodiment more clear, how to timely intercept a video generated in a live broadcast process on the live broadcast platform APP according to the preference of the user himself is taken as an example to further explain this scheme, and a client is taken as an execution subject, where the client refers to a computer or a mobile phone or other electronic equipment capable of installing the live broadcast platform APP. Specifically, the control instruction may be triggered by detecting an operation of the client by the user, for example, by inputting text information on a keyboard of the client; the control action of the user can be detected to trigger, such as waving or moving fingers, twisting fingers, stretching palms, rotating wrists, watching or transferring sight, moving heads and moving bodies; it may also be triggered by detecting a voice input by the user, e.g. by detecting a voice message of the user by a microphone, etc.
In a specific embodiment, the control command may be a piece of data input by the user in the input area 002 of the operation interface 001 of the client, and then click the control area 003 to trigger, for example, "SSS", and generate a text bullet screen to be displayed on the display area 004 of the client. Referring to fig. 3, a schematic view of a user interface operation of an electronic device implementing a multimedia data generating method according to an embodiment of the present invention is shown.
When the client receives a control instruction sent by a user, the client generates control instruction information including identification information (for example, UID: unique identification of the user) for identifying the control instruction according to the control instruction, namely, the intention of the user is identified through the control instruction information, for example, different control instructions can indicate that the user wants to start video capture operation at a certain time point, or wants to end video capture operation at a certain time point, or wants to cancel video capture operation at a certain time point. The identity information of the user (e.g. UID: unique identification of the user) may also be identified by the control instruction information.
Furthermore, as the live broadcast platform belongs to a public platform facing audiences, any user can log in the live broadcast platform and send a control instruction to the client. If all users can randomly intercept videos generated in the live broadcasting process by sending a control instruction and issue small videos, a plurality of small videos with different qualities are derived from the same live video, and the overall quality of the small videos is affected. Therefore, in the present embodiment, it needs to be specified that when the received control instruction information is judged to satisfy the instruction verification rule, the corresponding control event information is generated and stored to the control event information set.
Wherein, the validation rule comprises:
and judging whether the identification information corresponding to the control instruction information is contained in a pre-established white list or not, and if so, generating control event information corresponding to the control instruction information.
The white list records identification information (such as UID) with appointed authority, namely the client is controlled to carry out operations such as video interception, video interception stop, video interception cancellation and the like by the authority through a control instruction.
In another embodiment, the apparatus further comprises a deletion module to:
when the control instruction corresponding to the control instruction information is a preset cancel instruction, finding the last piece of control event information of the control instruction information from the control event information set, and if the control instruction corresponding to the last piece of control event information is a preset start instruction, deleting the last piece of control event information.
The method aims to meet the requirement that a user can cancel the control instruction sent this time according to the actual situation after sending the control instruction which wants to carry out the video capturing operation. In this embodiment, the control instruction may also be configured to be an instruction capable of controlling the client to cancel the video capture operation. Specifically, when the client receives that the control instruction sent by the user is a preset cancel instruction (for example, "CCC"), the client first finds the last piece of control event information of the control instruction information from the control event information set, and deletes the last piece of control event information if the control instruction corresponding to the last piece of control event information is a preset start instruction (for example, "SSS"), that is, cancels the video capture operation.
The obtaining module 120 is configured to obtain the first control event information and the second control event information in the control event information set according to a preset matching rule.
In the embodiment, the invalid control commands are automatically filtered by using the preset matching rule, and only the first control event and the second control event which simultaneously satisfy the matching rule can be intercepted and generated to generate the multimedia data.
Specifically, how to obtain the first control event information and the second control event information according to the preset matching rule may be implemented by the following steps:
and acquiring first control event information from the control event information set, and deleting the first control event information when a control instruction corresponding to the first control event information is a preset ending instruction. For example, when the control command corresponding to the first control event message is the preset end command "EEE", because there is no matched preset start command, the first control event message is directly deleted, or is included in the to-be-deleted event list and waits to be deleted.
The method can also be realized by the following steps:
and acquiring first control event information from the control event information set, acquiring second control event information when a control instruction corresponding to the first control event information is the preset starting instruction, and deleting the first control event information when the control instruction corresponding to the second control event information is the preset starting instruction. For example, when the control instruction corresponding to the first control event information is a preset start instruction "SS", the second control event message is acquired, and when the control instruction corresponding to the second control event information is a preset start instruction "SSs" as the first control event information, the first control event message needs to be deleted, and the first control event message is directly deleted, or is included in an event list to be deleted, and waits for deletion. And reserving a preset starting instruction which is closest to the current event, namely the second control event information.
The method can also be realized by the following steps:
and when the control instruction corresponding to the second control event information is the preset ending instruction, generating a multimedia data interception instruction according to the first control event information and the second control event information. For example, when the control instruction corresponding to the first control event information is a preset start instruction "SSS", the second control event information is acquired, and when the control instruction corresponding to the second control event information is a preset end instruction "EEE", at this time, the first control event information is just successfully paired with the second control event information, and a multimedia data (for example, a video generated in a live broadcast process) interception instruction can be generated according to the first control event information and the second control event information.
In another embodiment, the apparatus further comprises a grouping module to:
acquiring first control event information from the control event information set, and acquiring grouping information corresponding to the first control event information, wherein the grouping information is included in the control event information;
and acquiring second control event information of the same group from the control event information set according to the group information.
In this embodiment, the first control event information and the second control event information corresponding to the same user need to be grouped and classified, so as to avoid confusion of pairing between the first control event information and the second control event information of different users.
A generating module 130, configured to generate the multimedia data according to the first control event information and the second control event information.
In this embodiment, when the first control event information and the second control event information in the control event information set obtained by using the preset matching rule just can be successfully paired, a multimedia data interception instruction can be generated according to the first control event information and the second control event information, and corresponding multimedia data (for example, a video generated in a live broadcast process) can be intercepted and generated according to the multimedia interception instruction.
In another embodiment, the apparatus further comprises a first screening module to:
and screening the plurality of multimedia data interception instructions according to a preset interception instruction screening rule, and reserving one multimedia data interception instruction from the plurality of multimedia data interception instructions with the similarity greater than or equal to a preset threshold value.
In order to make the embodiment more clear, the above description is continued by taking an example of how to timely intercept the video generated in the live broadcast process on the live broadcast platform APP according to the preference of the user. Because a plurality of users in the white list may perform video capture operations on the same live video at the same time, and the video contents obtained after capture are just similar, the overall quality of the video is affected if deduplication processing is not performed.
In order to solve the above problem, in this embodiment, a plurality of multimedia data interception instructions are screened, and only one of the multimedia data interception instructions is reserved, where the specific implementation process includes:
and calculating the similarity values of every two multimedia data interception instructions, and reserving one multimedia data interception instruction from a plurality of multimedia data interception instructions with the similarity greater than or equal to a preset threshold value. The specific similarity value calculation algorithm can adopt a conventional cosine similarity calculation method.
In another embodiment, the apparatus further comprises a second screening module for:
screening out a multimedia data interception instruction of which the interval duration between the first control event information and the second control event information is greater than or equal to a first preset duration;
and delaying the time point corresponding to the first control event information by the first preset time length to obtain a time point which is used as the time point of the second control event information.
In the embodiment, by limiting the maximum duration of data interception, the situation that the duration of a video recorded by a user exceeds the specified maximum duration of video transmission to cause failure of video distribution is avoided. Specifically, a multimedia data interception instruction that the interval duration between the first control event information and the second control event information is greater than or equal to a first preset duration is screened out, and a time point obtained by delaying a time point corresponding to the first control event information by the first preset duration is used as a time point of the second control event information. For example, the time point corresponding to the first control event information is 15:20:00, the time point corresponding to the second control event information is 15:26:23, the first preset time duration is 5 minutes, and at this time, the time point corresponding to the second control event information already exceeds the first preset time duration, so that the actual time point corresponding to the second control event information is a time point corresponding to the first control event information, which is delayed by the first preset time duration, that is, 15:25: 00.
In another embodiment, the apparatus further comprises an audit module to:
and judging whether the multimedia data conforms to the auditing rule.
In order to prevent illegal information, such as sensitive information, existing in the intercepted video, which causes the video to be published unsuccessfully. Therefore, in this embodiment, after the video capture is completed, it is necessary to determine whether the multimedia data conforms to the auditing rule, and the specific auditing rule may refer to the current video publishing legal provision.
In another embodiment, the time point corresponding to the first control event information or the time point corresponding to the second control event information is obtained by converting a preset expression rule;
wherein the preset expression rule comprises:
the time point corresponding to the first control event information is equal to the time when the control instruction corresponding to the first control event information is sent out, and the time is increased or decreased by a second preset time length; or
And the time corresponding to the second control event information is equal to the time point when the control instruction corresponding to the second control event information is sent out, and the time point is increased or decreased by a third preset time length.
In actual operation, the user may think that the video capture operation is to be performed after a period of time elapses after the highlight of the multimedia data, but it is not time to issue the video capture instruction. Therefore, in order to make the present solution better satisfy the actual situation of the user, in this embodiment, the time point corresponding to the first control event information or the time point corresponding to the second control event information may be obtained by converting the preset expression rule.
For example, when the control command issued by the user is "SSS-10 s", the time point corresponding to the generated control event information is the current time-10 s.
For another example, when the control command issued by the user is "SSS +10 s", the time point current time corresponding to the control event information is +10 s.
The display module 140 is configured to display the multimedia video to a user in a preset display manner.
In this embodiment, after the multimedia data is generated, the multimedia data (for example, a video generated in a live broadcasting process) may be presented to a user in a preset presentation manner. The display mode may be that the generated multimedia data is directly played on a client (for example, a mobile phone or a computer), or a reminder message of "successful data interception" is sent and displayed on the client to remind the user that the data is generated.
Fig. 6 is a schematic structural diagram of an electronic device implementing the multimedia data generating method according to the present invention.
The electronic device 1 may comprise a processor 12, a memory 11 and a bus, and may further comprise a computer program, such as a multimedia data generating program 10, stored in the memory 11 and executable on the processor 12.
Wherein the memory 11 includes at least one type of readable storage medium having stored thereon a multimedia data generation program executable by one or more processors. The readable storage medium includes flash memory, removable hard disks, multimedia cards, card type memory (e.g., SD or DX memory, etc.), magnetic memory, magnetic disks, optical disks, etc. The memory 11 may in some embodiments be an internal storage unit of the electronic device 1, such as a removable hard disk of the electronic device 1. The memory 11 may also be an external storage device of the electronic device 1 in other embodiments, such as a plug-in mobile hard disk, a Smart Media Card (SMC), a Secure Digital (SD) Card, a Flash memory Card (Flash Card), and the like, which are provided on the electronic device 1. Further, the memory 11 may also include both an internal storage unit and an external storage device of the electronic device 1. The memory 11 may be used not only to store application software installed in the electronic device 1 and various types of data, such as codes of the multimedia data generating program 10, but also to temporarily store data that has been output or is to be output.
The processor 12 may be formed of an integrated circuit in some embodiments, for example, a single packaged integrated circuit, or may be formed of a plurality of integrated circuits packaged with the same or different functions, including one or more Central Processing Units (CPUs), microprocessors, digital Processing chips, graphics processors, and combinations of various control chips. The processor 12 is a Control Unit (Control Unit) of the electronic device 1, connects various components of the electronic device 1 by using various interfaces and lines, and executes various functions and processes data of the electronic device 1 by operating or executing programs or modules (such as a multimedia data generating program) stored in the memory 11 and calling data stored in the memory 11.
The bus may be a Peripheral Component Interconnect (PCI) bus, an Extended Industry Standard Architecture (EISA) bus, or the like. The bus may be divided into an address bus, a data bus, a control bus, etc. The bus is arranged to enable connection communication between the memory 11 and at least one processor 12 or the like.
Fig. 6 only shows the electronic device 1 with components, and it will be understood by those skilled in the art that the structure shown in fig. 6 does not constitute a limitation of the electronic device 1, and may comprise fewer or more components than those shown, or some components may be combined, or a different arrangement of components.
For example, although not shown, the electronic device 1 may further include a power supply (such as a battery) for supplying power to each component, and preferably, the power supply may be logically connected to the at least one processor 12 through a power management system, so as to implement functions of charge management, discharge management, power consumption management, and the like through the power management system. The power supply may also include any component of one or more dc or ac power sources, recharging systems, power failure detection circuitry, power converters or inverters, power status indicators, and the like. The electronic device 1 may further include various sensors, a bluetooth module, a Wi-Fi module, and the like, which are not described herein again.
Further, the electronic device 1 may further include a network interface 13, and optionally, the network interface 13 may include a wired interface and/or a wireless interface (such as a WI-FI interface, a bluetooth interface, etc.), which are generally used for establishing a communication connection between the electronic device 1 and other electronic devices 1.
Optionally, the electronic device 1 may further comprise a user interface, which may be a Display (Display), an input unit (such as a Keyboard), and optionally a standard wired interface, a wireless interface. Alternatively, in some embodiments, the display may be an LED display, a liquid crystal display, a touch-sensitive liquid crystal display, an OLED (Organic Light-Emitting Diode) touch device, or the like. The display, which may also be referred to as a display screen or display unit, is suitable for displaying information processed in the electronic device 1 and for displaying a visualized user interface, among other things.
It is to be understood that the described embodiments are for purposes of illustration only and that the scope of the appended claims is not limited to such structures.
The multimedia data generating program 10 stored in the memory 11 of the electronic device 1 is a combination of instructions that, when executed in the processor 12, enable:
receiving a control instruction, generating corresponding control event information according to the control instruction, and storing the control event information to a control event information set;
acquiring first control event information and second control event information in the control event information set according to a preset matching rule;
generating the multimedia data according to the first control event information and the second control event information;
and displaying the multimedia video to a user in a preset display mode.
In another embodiment, the program further performs the steps comprising:
and screening the plurality of multimedia data interception instructions according to a preset interception instruction screening rule, and reserving one multimedia data interception instruction from the plurality of multimedia data interception instructions with the similarity greater than or equal to a preset threshold value.
In another embodiment, the program further performs the steps comprising:
screening out a multimedia data interception instruction of which the interval duration between the first control event information and the second control event information is greater than or equal to a first preset duration;
and delaying the time point corresponding to the first control event information by the first preset time length to obtain a time point which is used as the time point of the second control event information.
In another embodiment, the program further performs the steps comprising:
and judging whether the multimedia data conforms to the auditing rule.
In another embodiment, the program further performs the steps comprising:
when the control instruction corresponding to the control instruction information is a preset cancel instruction, finding the last piece of control event information of the control instruction information from the control event information set, and if the control instruction corresponding to the last piece of control event information is a preset start instruction, deleting the last piece of control event information.
Specifically, the processor 11 may refer to the description of the relevant steps in the embodiment corresponding to fig. 2, and details thereof are not repeated herein.
Further, the integrated modules/units of the electronic device 1, if implemented in the form of software functional units and sold or used as separate products, may be stored in a computer readable storage medium. The computer-readable medium may include: any entity or system capable of carrying said computer program code, a recording medium, a usb-disk, a removable hard disk, a magnetic disk, an optical disk, a computer Memory, a Read-Only Memory (ROM).
In the embodiments provided by the present invention, it should be understood that the disclosed apparatus, system, and method may be implemented in other ways. For example, the system embodiments described above are merely illustrative, and for example, the division of the modules is only one logical functional division, and other divisions may be realized in practice.
The modules described as separate parts may or may not be physically separate, and parts displayed as modules may or may not be physical units, may be located in one place, or may be distributed on a plurality of network units. Some or all of the modules may be selected according to actual needs to achieve the purpose of the solution of the present embodiment.
In addition, functional modules in the embodiments of the present invention may be integrated into one processing unit, or each unit may exist alone physically, or two or more units are integrated into one unit. The integrated unit can be realized in a form of hardware, or in a form of hardware plus a software functional module.
It will be evident to those skilled in the art that the invention is not limited to the details of the foregoing illustrative embodiments, and that the present invention may be embodied in other specific forms without departing from the spirit or essential attributes thereof.
The present embodiments are therefore to be considered in all respects as illustrative and not restrictive, the scope of the invention being indicated by the appended claims rather than by the foregoing description, and all changes which come within the meaning and range of equivalency of the claims are therefore intended to be embraced therein. Any reference signs in the claims shall not be construed as limiting the claim concerned.
Furthermore, it is obvious that the word "comprising" does not exclude other elements or steps, and the singular does not exclude the plural. A plurality of units or systems recited in the system claims may also be implemented by one unit or system in software or hardware. The terms second, etc. are used to denote names, but not any particular order.
Finally, it should be noted that the above embodiments are only for illustrating the technical solutions of the present invention and not for limiting, and although the present invention is described in detail with reference to the preferred embodiments, it should be understood by those skilled in the art that modifications or equivalent substitutions may be made on the technical solutions of the present invention without departing from the spirit and scope of the technical solutions of the present invention.

Claims (16)

1. A method for generating multimedia data, comprising:
receiving a control instruction, generating corresponding control event information according to the control instruction, and storing the control event information to a control event information set;
acquiring first control event information and second control event information in the control event information set according to a preset matching rule;
generating the multimedia data according to the first control event information and the second control event information;
and displaying the multimedia video to a user in a preset display mode.
2. The multimedia data generating method according to claim 1, wherein the step of generating the corresponding control event information according to the control command comprises:
generating control instruction information including identification information for identifying the control instruction according to the control instruction;
and when the control instruction information meets the instruction verification rule, generating corresponding control event information.
3. The multimedia data generating method as claimed in claim 2, wherein after the step of "when the control instruction information satisfies the instruction verification rule", the method further comprises:
when the control instruction corresponding to the control instruction information is a preset cancel instruction, finding the last piece of control event information of the control instruction information from the control event information set, and if the control instruction corresponding to the last piece of control event information is a preset start instruction, deleting the last piece of control event information.
4. The method for generating multimedia data according to claim 1, wherein the step of obtaining the first control event information and the second control event information in the control event information set according to a preset matching rule comprises:
and acquiring first control event information from the control event information set, and deleting the first control event information when a control instruction corresponding to the first control event information is a preset ending instruction.
5. The method for generating multimedia data according to claim 1, wherein the step of obtaining the first control event information and the second control event information in the control event information set according to a preset matching rule comprises:
and acquiring first control event information from the control event information set, acquiring second control event information when a control instruction corresponding to the first control event information is the preset starting instruction, and deleting the first control event information when the control instruction corresponding to the second control event information is the preset starting instruction.
6. The method for generating multimedia data according to claim 1, wherein the step of obtaining the first control event information and the second control event information in the control event information set according to a preset matching rule comprises:
and acquiring first control event information from the control event information set, acquiring second control event information when a control instruction corresponding to the first control event information is the preset starting instruction, and generating the multimedia data according to the first control event information and the second control event information when a control instruction corresponding to the second control event information is the preset ending instruction.
7. A multimedia data intercepting method is used for intercepting multimedia data displayed on a user interaction interface, and is characterized by comprising the following steps:
receiving a control instruction, and generating control instruction information including identification information for identifying the control instruction according to the control instruction;
when the control instruction information meets an instruction verification rule, generating corresponding control event information, and storing the control event information to a control event information set;
acquiring first control event information and second control event information in the control event information set according to a preset matching rule;
and generating the intercepted multimedia data according to the first control event information and the second control event information.
8. The multimedia data interception method according to claim 7, wherein the step of generating the intercepted multimedia data based on the first control event information and the second control event information comprises:
generating a multimedia data interception instruction according to the first control event information and the second control event information;
and intercepting and generating corresponding multimedia data according to the multimedia intercepting instruction.
9. The multimedia data intercepting method of claim 8, wherein after the step of "when the control directive information satisfies the directive validation rule", the method further comprises:
when the control instruction corresponding to the control instruction information is a preset cancel instruction, finding the last piece of control event information of the control instruction information from the control event information set, and if the control instruction corresponding to the last piece of control event information is a preset start instruction, deleting the last piece of control event information.
10. The multimedia data interception method according to claim 7, wherein the step of acquiring the first control event information and the second control event information in the control event information set according to a preset matching rule comprises:
and acquiring first control event information from the control event information set, and deleting the first control event information when a control instruction corresponding to the first control event information is a preset ending instruction.
11. The multimedia data interception method according to claim 7, wherein the step of acquiring the first control event information and the second control event information in the control event information set according to a preset matching rule comprises:
and acquiring first control event information from the control event information set, acquiring second control event information when a control instruction corresponding to the first control event information is the preset starting instruction, and deleting the first control event information when the control instruction corresponding to the second control event information is the preset starting instruction.
12. The multimedia data interception method according to claim 7, wherein the step of acquiring the first control event information and the second control event information in the control event information set according to a preset matching rule comprises:
and when the control instruction corresponding to the second control event information is the preset ending instruction, generating a multimedia data interception instruction according to the first control event information and the second control event information.
13. A multimedia data generating apparatus, characterized by comprising:
the receiving module is used for receiving a control instruction, generating corresponding control event information according to the control instruction, and storing the control event information to a control event information set;
the acquisition module is used for acquiring first control event information and second control event information in the control event information set according to a preset matching rule;
the generating module is used for generating the multimedia data according to the first control event information and the second control event information;
and the display module is used for displaying the multimedia video to a user in a preset display mode.
14. An electronic device, characterized in that the electronic device comprises a memory and a processor, the memory having stored thereon a multimedia data generation program, which, when executed by the processor, implements the steps of the multimedia data generation method according to any one of claims 1-6.
15. A computer-readable storage medium having stored thereon a multimedia data generation program executable by one or more processors to perform the steps of the multimedia data generation method of any one of claims 1-6.
16. A computer-readable storage medium, having a multimedia data interception program stored thereon, the multimedia data interception program being executable by one or more processors to implement the steps of the multimedia data interception method according to any one of claims 7 to 12.
CN202010751053.2A 2020-07-30 2020-07-30 Multimedia data generation method, intercepting method, device, equipment and storage medium Active CN112135187B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN202010751053.2A CN112135187B (en) 2020-07-30 2020-07-30 Multimedia data generation method, intercepting method, device, equipment and storage medium

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN202010751053.2A CN112135187B (en) 2020-07-30 2020-07-30 Multimedia data generation method, intercepting method, device, equipment and storage medium

Publications (2)

Publication Number Publication Date
CN112135187A true CN112135187A (en) 2020-12-25
CN112135187B CN112135187B (en) 2023-07-28

Family

ID=73851352

Family Applications (1)

Application Number Title Priority Date Filing Date
CN202010751053.2A Active CN112135187B (en) 2020-07-30 2020-07-30 Multimedia data generation method, intercepting method, device, equipment and storage medium

Country Status (1)

Country Link
CN (1) CN112135187B (en)

Citations (14)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20010041050A1 (en) * 1999-12-07 2001-11-15 Yoshiaki Iwata Video editing apparatus, video editing method, and recording medium
CN101123716A (en) * 2006-08-11 2008-02-13 三星电子株式会社 Multimedia playback control apparatus and method
US20090317051A1 (en) * 2008-06-18 2009-12-24 Millington Daniel K Mobile Timestamp Systems and Methods of Use
CN103647991A (en) * 2013-12-23 2014-03-19 乐视致新电子科技（天津）有限公司 Method and system for sharing video in intelligent television
US20150128048A1 (en) * 2013-11-07 2015-05-07 International Business Machines Corporation Automated multimedia content editing
US20160005440A1 (en) * 2013-03-05 2016-01-07 British Telecommunications Public Limited Company Provision of video data
US20160027471A1 (en) * 2014-07-25 2016-01-28 Shindig, Inc. Systems and methods for creating, editing and publishing recorded videos
WO2016095071A1 (en) * 2014-12-14 2016-06-23 深圳市大疆创新科技有限公司 Video processing method, video processing device and playing device
CN106550264A (en) * 2016-12-08 2017-03-29 腾讯科技（深圳）有限公司 A kind of intercept method and device of television video
US20170171630A1 (en) * 2015-12-14 2017-06-15 International Business Machines Corporation Sharing Portions of a Video
CN107276981A (en) * 2017-05-05 2017-10-20 中广热点云科技有限公司 A kind of local video sharing method
CN109710779A (en) * 2018-12-24 2019-05-03 北京金山安全软件有限公司 Multimedia file intercepting method, device, equipment and storage medium
CN110650375A (en) * 2019-10-18 2020-01-03 腾讯科技（深圳）有限公司 Video processing method, device, equipment and storage medium
CN110830847A (en) * 2019-10-24 2020-02-21 杭州威佩网络科技有限公司 Method and device for intercepting game video clip and electronic equipment

Patent Citations (14)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20010041050A1 (en) * 1999-12-07 2001-11-15 Yoshiaki Iwata Video editing apparatus, video editing method, and recording medium
CN101123716A (en) * 2006-08-11 2008-02-13 三星电子株式会社 Multimedia playback control apparatus and method
US20090317051A1 (en) * 2008-06-18 2009-12-24 Millington Daniel K Mobile Timestamp Systems and Methods of Use
US20160005440A1 (en) * 2013-03-05 2016-01-07 British Telecommunications Public Limited Company Provision of video data
US20150128048A1 (en) * 2013-11-07 2015-05-07 International Business Machines Corporation Automated multimedia content editing
CN103647991A (en) * 2013-12-23 2014-03-19 乐视致新电子科技（天津）有限公司 Method and system for sharing video in intelligent television
US20160027471A1 (en) * 2014-07-25 2016-01-28 Shindig, Inc. Systems and methods for creating, editing and publishing recorded videos
WO2016095071A1 (en) * 2014-12-14 2016-06-23 深圳市大疆创新科技有限公司 Video processing method, video processing device and playing device
US20170171630A1 (en) * 2015-12-14 2017-06-15 International Business Machines Corporation Sharing Portions of a Video
CN106550264A (en) * 2016-12-08 2017-03-29 腾讯科技（深圳）有限公司 A kind of intercept method and device of television video
CN107276981A (en) * 2017-05-05 2017-10-20 中广热点云科技有限公司 A kind of local video sharing method
CN109710779A (en) * 2018-12-24 2019-05-03 北京金山安全软件有限公司 Multimedia file intercepting method, device, equipment and storage medium
CN110650375A (en) * 2019-10-18 2020-01-03 腾讯科技（深圳）有限公司 Video processing method, device, equipment and storage medium
CN110830847A (en) * 2019-10-24 2020-02-21 杭州威佩网络科技有限公司 Method and device for intercepting game video clip and electronic equipment

Non-Patent Citations (3)

* Cited by examiner, † Cited by third party
Title
YE-PENG GUAN ET AL.: "Content based sports video sequences analysis and synthesis", 《2011 INTERNATIONAL CONFERENCE ON COMPUTER SCIENCE AND SERVICE SYSTEM (CSSS)》, pages 1 - 3 *
周巨等: "基于多特征分层的视频摘要提取算法", 《五邑大学学报(自然科学版)》, vol. 34, no. 2, pages 34 - 45 *
赵晖: "基于内容的视频镜头边界检测及关键帧提取", 《中国学位论文全文数据库》 *

Also Published As

Publication number Publication date
CN112135187B (en) 2023-07-28

Similar Documents

Publication Publication Date Title
US20120170814A1 (en) Images of cars integration system and method
CN108182211B (en) Video public opinion acquisition method and device, computer equipment and storage medium
CN109275042B (en) Bullet screen message distribution method, bullet screen message distribution device, terminal and storage medium
US9607088B2 (en) Method and apparatus for detecting multimedia content change, and resource propagation system
CN112104626A (en) Block chain-based data access verification method and device, electronic equipment and medium
US10917484B2 (en) Identifying and managing redundant digital content transfers
CN113949697B (en) Data distribution method, device, electronic equipment and storage medium
CN110740088B (en) Method, device, terminal and medium for recommending and adding social resources
CN110610376A (en) Behavior data response method and device, computer equipment and storage medium
CN111246238A (en) Live broadcast method, device, storage medium and live broadcast system
CN106844731A (en) Advertisement shields method and system
CN106575414B (en) Contextual platform feature recommendation
CN114489561A (en) Intelligent audio volume adjusting method and device, electronic equipment and storage medium
CN108520401B (en) User list management method, device, platform and storage medium
EP3528151A1 (en) Method and apparatus for user authentication
CN110569114B (en) Service processing method, device, equipment and storage medium
CN111723163A (en) Information processing method, device and system
CN112135187B (en) Multimedia data generation method, intercepting method, device, equipment and storage medium
CN107480269B (en) Object display method and system, medium and computing equipment
CN111447267B (en) Information synchronization method, device, computer readable storage medium and equipment
CN109729410B (en) Live broadcast room interactive event processing method, device, equipment and storage medium
CN108228250A (en) The display methods and terminal of a kind of application interface
CN111913918A (en) File storage method and device and electronic equipment
US20140164538A1 (en) Electronic device and method of recording and outputting messages
CN114710685B (en) Video stream processing method and device, terminal equipment and storage medium

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
TA01 Transfer of patent application right

Effective date of registration: 20210126

Address after: 511400 3108, 79 Wanbo 2nd Road, Nancun Town, Panyu District, Guangzhou City, Guangdong Province

Applicant after: GUANGZHOU CUBESILI INFORMATION TECHNOLOGY Co.,Ltd.

Address before: 511400 24 / F, building B-1, Wanda Plaza North, Wanbo business district, 79 Wanbo 2nd Road, Nancun Town, Panyu District, Guangzhou City, Guangdong Province (office use only)

Applicant before: GUANGZHOU HUADUO NETWORK TECHNOLOGY Co.,Ltd.

TA01 Transfer of patent application right
EE01 Entry into force of recordation of patent licensing contract

Application publication date: 20201225

Assignee: GUANGZHOU HUADUO NETWORK TECHNOLOGY Co.,Ltd.

Assignor: GUANGZHOU CUBESILI INFORMATION TECHNOLOGY Co.,Ltd.

Contract record no.: X2021440000054

Denomination of invention: Multimedia data generation method, interception method, device, device and storage medium

License type: Common License

Record date: 20210208

EE01 Entry into force of recordation of patent licensing contract
GR01 Patent grant
GR01 Patent grant