CN113141538A - Media resource playing method, device, terminal, server and storage medium - Google Patents
Media resource playing method, device, terminal, server and storage medium Download PDFInfo
- Publication number
- CN113141538A CN113141538A CN202110449978.6A CN202110449978A CN113141538A CN 113141538 A CN113141538 A CN 113141538A CN 202110449978 A CN202110449978 A CN 202110449978A CN 113141538 A CN113141538 A CN 113141538A
- Authority
- CN
- China
- Prior art keywords
- video
- playing
- panoramic
- terminal
- video data
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
Images
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/47—End-user applications
- H04N21/472—End-user interface for requesting content, additional data or services; End-user interface for interacting with content, e.g. for content reservation or setting reminders, for requesting event notification, for manipulating displayed content
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
- H04N21/4302—Content synchronisation processes, e.g. decoder synchronisation
- H04N21/4307—Synchronising the rendering of multiple content streams or additional data on devices, e.g. synchronisation of audio on a mobile phone with the video output on the TV screen
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
- H04N21/431—Generation of visual interfaces for content selection or interaction; Content or additional data rendering
- H04N21/4312—Generation of visual interfaces for content selection or interaction; Content or additional data rendering involving specific graphical features, e.g. screen layout, special fonts or colors, blinking icons, highlights or animations
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/80—Generation or processing of content or additional data by content creator independently of the distribution process; Content per se
- H04N21/81—Monomedia components thereof
- H04N21/816—Monomedia components thereof involving special video data, e.g 3D video
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/80—Generation or processing of content or additional data by content creator independently of the distribution process; Content per se
- H04N21/81—Monomedia components thereof
- H04N21/8166—Monomedia components thereof involving executable data, e.g. software
- H04N21/8173—End-user applications, e.g. Web browser, game
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/80—Generation or processing of content or additional data by content creator independently of the distribution process; Content per se
- H04N21/85—Assembly of content; Generation of multimedia applications
- H04N21/854—Content authoring
- H04N21/8547—Content authoring involving timestamps for synchronizing content
Landscapes
- Engineering & Computer Science (AREA)
- Multimedia (AREA)
- Signal Processing (AREA)
- Databases & Information Systems (AREA)
- Human Computer Interaction (AREA)
- Computer Security & Cryptography (AREA)
- General Engineering & Computer Science (AREA)
- Software Systems (AREA)
- Two-Way Televisions, Distribution Of Moving Picture Or The Like (AREA)
Abstract
The application discloses a media resource playing method, a device, a terminal, a server and a storage medium, and belongs to the technical field of internet. The method comprises the following steps: responding to a video playing operation of the target audio, and sending a video acquisition request to a server, wherein the video acquisition request is used for acquiring video data associated with the target audio; when the terminal meets the panoramic playing condition, receiving first video data returned by the server based on the video acquisition request, wherein the first video data corresponds to a panoramic video associated with a target audio; and when the target audio is played, playing the panoramic video based on the first video data. In the embodiment of the application, the terminal is triggered to acquire the panoramic video associated with the audio through the server by video playing operation of the audio, so that the panoramic video is played while the audio is played, the combination of audio playing and panoramic video playing is realized, the playing form of media resources is enriched, and the playing effect of the media resources is improved.
Description
Technical Field
The present application relates to the field of internet technologies, and in particular, to a method, an apparatus, a terminal, a server, and a storage medium for playing a media resource.
Background
With the continuous development of internet technology, the playing forms of audio, video and other media resources are more and more diversified. For example, during playing audio, a user may operate on a terminal to trigger the terminal to play a Video corresponding to the audio, such as an MV (Music Video), at which time the terminal simultaneously plays the audio and the corresponding Video, so that the user can also watch the Video while listening to the audio. However, the video played in the above technology is usually a flat video, and the playing form is still relatively single.
Disclosure of Invention
The embodiment of the application provides a media resource playing method, a media resource playing device, a terminal, a server and a storage medium, enriches the playing forms of media resources and improves the playing effect of the media resources. The technical scheme is as follows:
in one aspect, a media resource playing method performed by a terminal is provided, and the method includes:
responding to a video playing operation of a target audio, and sending a video acquisition request to a server, wherein the video acquisition request is used for acquiring video data associated with the target audio;
when the terminal meets the panoramic playing condition, receiving first video data returned by the server based on the video acquisition request, wherein the first video data corresponds to the panoramic video associated with the target audio;
and playing the panoramic video based on the first video data when the target audio is played.
In some embodiments, when the terminal satisfies the panorama play condition, receiving the first video data returned by the server based on the video acquisition request includes:
and when the equipment model of the terminal meets the panoramic playing condition, receiving first video data returned by the server based on the video acquisition request.
In some embodiments, after sending the video acquisition request to the server in response to the video play operation on the target audio, the method further comprises:
when the terminal meets the panoramic playing condition, responding to the receiving of a plug-in downloading link sent by the server, downloading a target plug-in based on the plug-in downloading link, wherein the target plug-in is used for creating a panoramic player;
and based on the panoramic player, executing the step of playing the panoramic video based on the first video data when the target audio is played.
In some embodiments, playing the panoramic video based on the first video data while playing the target audio comprises:
and when the target audio is played, based on the playing progress of the target audio at the current moment, playing the panoramic video corresponding to the playing progress.
In some embodiments, after playing the panoramic video based on the first video data while playing the target audio, the method further comprises:
and sending a playing progress message of the target audio to the server, wherein the playing progress message is used for triggering the server to adjust the playing progress of the panoramic video based on the playing progress of the target audio.
In some embodiments, before sending the play progress message of the target audio to the server, the method further includes:
responding to the adjustment operation of the playing progress of the target audio, and executing the step of sending the playing progress message of the target audio to the server.
In some embodiments, after playing the panoramic video based on the first video data while playing the target audio, the method further comprises:
in response to a sliding operation on a video picture of the panoramic video, displaying a panoramic video block corresponding to the sliding direction based on the sliding direction of the sliding operation, wherein the panoramic video block comprises a video picture of an angle corresponding to the sliding direction.
In some embodiments, the video frame of the panoramic video includes a target control and at least one information control, and the method further includes, after playing the panoramic video based on the first video data while playing the target audio:
and stopping displaying the at least one information control in the video picture in response to the triggering operation of the target control in the video picture.
In some embodiments, the video frame of the panoramic video includes at least one information control, and after playing the panoramic video based on the first video data while playing the target audio, the method further comprises:
and stopping displaying the at least one information control in the video picture in response to the playing time of the panoramic video reaching the target time.
In some embodiments, after ceasing to display the at least one information control in the video frame, the method further comprises any of:
responding to the switching operation of the panoramic video, and displaying the at least one information control in the video picture;
and responding to the switching operation of the target audio, and displaying the at least one information control in the video picture.
In some embodiments, displaying the at least one information control in the video screen in response to the switching operation of the panoramic video comprises:
and responding to the switching operation of the panoramic video, wherein the switched video is not the panoramic video, and the at least one information control is displayed in the video picture of the switched video.
In some embodiments, after playing the panoramic video based on the first video data while playing the target audio, the method further comprises any one of:
responding to the panoramic video played to a target playing progress, and playing a special effect corresponding to the target playing progress;
and responding to the video picture of the panoramic video played to the target angle, and playing the special effect corresponding to the target angle.
In some embodiments, after sending the video acquisition request to the server in response to the video play operation on the target audio, the method further comprises:
when the equipment model of the terminal does not meet the panoramic playing condition, receiving second video data returned by the server, wherein the second video data corresponds to a planar video with the same content as the panoramic video;
and playing the plane video based on the second video data when the target audio is played.
In one aspect, a media resource playing method performed by a server is provided, and the method includes:
receiving a video acquisition request sent by a terminal, wherein the video acquisition request is used for acquiring video data associated with a target audio, and the video acquisition request is triggered based on a video playing operation of the target audio;
responding to the terminal meeting the panoramic playing condition, and acquiring first video data based on the video acquisition request, wherein the first video data corresponds to the panoramic video associated with the target audio;
and returning the first video data to the terminal, wherein the first video data is used for triggering the terminal to play the panoramic video based on the first video data when the target audio is played.
In some embodiments, in response to the terminal satisfying the panorama play condition, acquiring the first video data based on the video acquisition request includes:
and responding to the situation that the equipment model of the terminal meets the panoramic playing condition, and acquiring first video data based on the video acquisition request.
In some embodiments, the method further comprises at least one of:
responding to the existence of the equipment model of the terminal in a first model list, determining that the equipment model of the terminal meets the panoramic playing condition, wherein the first model list comprises a plurality of equipment models of which the equipment models meet the panoramic playing condition;
and in response to the fact that the equipment model of the terminal does not exist in a second model list, determining that the equipment model of the terminal meets the panoramic playing condition, wherein the second model list comprises a plurality of equipment models of which the equipment models do not meet the panoramic playing condition.
In some embodiments, after receiving the video acquisition request sent by the terminal, the method further includes:
and responding to the terminal meeting the panoramic playing condition, and sending a plug-in downloading link to the terminal, wherein the plug-in downloading link is used for downloading a target plug-in, and the target plug-in is used for creating a panoramic player.
In some embodiments, obtaining the first video data based on the video obtaining request comprises:
determining a plurality of video data corresponding to the audio identifier based on the audio identifier and the target corresponding relation of the target audio carried by the video acquisition request, wherein the target corresponding relation is the corresponding relation of the audio identifier and the video data;
the first video data is obtained from the plurality of video data.
In some embodiments, obtaining the first video data from the plurality of video data comprises any one of:
sequencing the plurality of video data according to the sequence of the video playing completion rate from high to low, and determining the video data in the front sequence as the first video data, wherein the video playing completion rate is used for representing the probability of the complete playing of the corresponding video;
and selecting video data of a panoramic type from the plurality of video data to obtain the first video data.
In some embodiments, after returning the first video data to the terminal, the method further comprises:
receiving a playing progress message sent by the terminal;
and responding to the playing progress message to indicate that the playing progress of the target audio is different from the playing progress of the panoramic video, and adjusting the playing progress of the panoramic video based on the playing progress of the target audio.
In some embodiments, after receiving the video acquisition request sent by the terminal, the method further includes:
responding to the situation that the terminal does not meet the panoramic playing condition, and acquiring second video data, wherein the second video data corresponds to a plane video with the same content as the panoramic video;
and returning the second video data to the terminal, wherein the second video data is used for triggering the terminal to play the plane video based on the second video data when the target audio is played.
In one aspect, a media resource playing apparatus is provided, the apparatus including:
the sending module is used for responding to video playing operation of the target audio and sending a video obtaining request to the server, wherein the video obtaining request is used for obtaining video data related to the target audio;
a receiving module, configured to receive, when the terminal meets a panorama playing condition, first video data returned by the server based on the video acquisition request, where the first video data corresponds to a panoramic video associated with the target audio;
and the playing module is used for playing the panoramic video based on the first video data when the target audio is played.
In some embodiments, the receiving module is configured to:
and when the equipment model of the terminal meets the panoramic playing condition, receiving first video data returned by the server based on the video acquisition request.
In some embodiments, the receiving module is further configured to, in response to receiving a plug-in download link sent by the server when the terminal meets the panorama playing condition, download a target plug-in based on the plug-in download link, where the target plug-in is used to create a panorama player;
the playing module is further configured to execute the step of playing the panoramic video based on the first video data when the target audio is played based on the panoramic player.
In some embodiments, the playback module is configured to:
and when the target audio is played, based on the playing progress of the target audio at the current moment, playing the panoramic video corresponding to the playing progress.
In some embodiments, the sending module is further configured to:
and sending a playing progress message of the target audio to the server, wherein the playing progress message is used for triggering the server to adjust the playing progress of the panoramic video based on the playing progress of the target audio.
In some embodiments, the sending module is further configured to:
responding to the adjustment operation of the playing progress of the target audio, and executing the step of sending the playing progress message of the target audio to the server.
In some embodiments, the apparatus further comprises:
and the display module is used for responding to the sliding operation of the video pictures of the panoramic video and displaying the panoramic video blocks corresponding to the sliding direction based on the sliding direction of the sliding operation, wherein the panoramic video blocks comprise the video pictures of the angle corresponding to the sliding direction.
In some embodiments, a video frame of a panoramic video includes a target control and at least one information control, the apparatus further comprising:
and the display module is used for responding to the triggering operation of the target control in the video picture and stopping displaying the at least one information control in the video picture.
In some embodiments, the video frame of the panoramic video includes at least one information control, the apparatus further comprising:
and the display module is used for responding to the fact that the playing duration of the panoramic video reaches the target duration and stopping displaying the at least one information control in the video picture.
In some embodiments, the display module is further configured to any one of:
responding to the switching operation of the panoramic video, and displaying the at least one information control in the video picture;
and responding to the switching operation of the target audio, and displaying the at least one information control in the video picture.
In some embodiments, the display module is further configured to:
and responding to the switching operation of the panoramic video, wherein the switched video is not the panoramic video, and the at least one information control is displayed in the video picture of the switched video.
In some embodiments, the playing module is further configured to:
responding to the panoramic video played to a target playing progress, and playing a special effect corresponding to the target playing progress;
and responding to the video picture of the panoramic video played to the target angle, and playing the special effect corresponding to the target angle.
In some embodiments, the receiving module is further configured to receive, when the terminal does not satisfy the panorama playback condition, second video data returned by the server, where the second video data is a flat video that is the same as the panoramic video content;
the playing module is further configured to play the flat video based on the second video data when the target audio is played.
In one aspect, a media resource playing apparatus is provided, the apparatus including:
the receiving module is used for receiving a video acquisition request sent by a terminal, wherein the video acquisition request is used for acquiring video data associated with a target audio, and the video acquisition request is triggered based on a video playing operation of the target audio;
the acquisition module is used for responding to the situation that the terminal meets a panoramic playing condition, and acquiring first video data based on the video acquisition request, wherein the first video data corresponds to the panoramic video associated with the target audio;
and the returning module is used for returning the first video data to the terminal, and the first video data is used for triggering the terminal to play the panoramic video based on the first video data when the target audio is played.
In some embodiments, the obtaining module includes:
and responding to the situation that the equipment model of the terminal meets the panoramic playing condition, and acquiring first video data based on the video acquisition request.
In some embodiments, the apparatus further comprises a determination module to at least one of:
responding to the existence of the equipment model of the terminal in a first model list, determining that the equipment model of the terminal meets the panoramic playing condition, wherein the first model list comprises a plurality of equipment models of which the equipment models meet the panoramic playing condition;
and in response to the fact that the equipment model of the terminal does not exist in a second model list, determining that the equipment model of the terminal meets the panoramic playing condition, wherein the second model list comprises a plurality of equipment models of which the equipment models do not meet the panoramic playing condition.
In some embodiments, the apparatus further comprises a sending module to:
and responding to the terminal meeting the panoramic playing condition, and sending a plug-in downloading link to the terminal, wherein the plug-in downloading link is used for downloading a target plug-in, and the target plug-in is used for creating a panoramic player.
In some embodiments, the obtaining module includes:
the determining submodule is used for determining a plurality of video data corresponding to the audio identification based on the audio identification and the target corresponding relation of the target audio carried by the video acquisition request, wherein the target corresponding relation is the corresponding relation of the audio identification and the video data;
and the obtaining sub-module is used for obtaining the first video data from the plurality of video data.
In some embodiments, the acquisition submodule is configured to any one of:
sequencing the plurality of video data according to the sequence of the video playing completion rate from high to low, and determining the video data in the front sequence as the first video data, wherein the video playing completion rate is used for representing the probability of the complete playing of the corresponding video;
and selecting video data of a panoramic type from the plurality of video data to obtain the first video data.
In some embodiments, the receiving module is further configured to receive a play progress message sent by the terminal;
the device further comprises an adjusting module, configured to adjust the playing progress of the panoramic video based on the playing progress of the target audio in response to the playing progress message indicating that the playing progress of the target audio is different from the playing progress of the panoramic video.
In some embodiments, the obtaining module is further configured to, in response to that the terminal does not satisfy the panorama playing condition, obtain second video data, where the second video data corresponds to a flat video having the same content as the panorama video;
the returning module is further configured to return the second video data to the terminal, where the second video data is used to trigger the terminal to play the flat video based on the second video data when the target audio is played.
In one aspect, a terminal is provided, where the terminal includes a processor and a memory, where the memory stores at least one program code, and the at least one program code is loaded and executed by the processor to implement the content executed by the terminal in the media resource playing method described above.
In one aspect, a server is provided, where the server includes a processor and a memory, where the memory stores at least one program code, and the at least one program code is loaded and executed by the processor to implement the content executed by the server in the media resource playing method described above.
In one aspect, a computer-readable storage medium is provided, in which at least one program code is stored, and the at least one program code is loaded and executed by a processor to implement the media resource playing method.
In one aspect, a computer program product is provided, and the computer program product includes computer program code, the computer program code is stored in a computer readable storage medium, and a processor of a terminal or a server reads the computer program code from the computer readable storage medium, and the processor executes the computer program code, so that the terminal or the server executes corresponding content in the media resource playing method.
According to the technical scheme, the terminal is triggered to acquire the panoramic video associated with the audio through the server through the video playing operation of the audio, and then the panoramic video is played while the audio is played, so that the combination of audio playing and panoramic video playing is realized, the playing form of the media resource is enriched, and the playing effect of the media resource is improved.
Drawings
In order to more clearly illustrate the technical solutions in the embodiments of the present application, the drawings needed to be used in the description of the embodiments are briefly introduced below, and it is obvious that the drawings in the following description are only some embodiments of the present application, and it is obvious for those skilled in the art to obtain other drawings based on these drawings without creative efforts.
Fig. 1 is a schematic diagram of an implementation environment of a media resource playing method provided in an embodiment of the present application;
fig. 2 is a flowchart of a media resource playing method provided in an embodiment of the present application;
fig. 3 is a flowchart of a media resource playing method provided in an embodiment of the present application;
fig. 4 is a flowchart of a media resource playing method provided in an embodiment of the present application;
fig. 5 is a schematic diagram of a video playback page provided in an embodiment of the present application;
fig. 6 is a schematic diagram of a video playback page provided in an embodiment of the present application;
fig. 7 is a schematic structural diagram of a media resource playing apparatus according to an embodiment of the present application;
fig. 8 is a schematic structural diagram of a media resource playing apparatus according to an embodiment of the present application;
fig. 9 is a schematic structural diagram of a terminal according to an embodiment of the present application;
fig. 10 is a schematic structural diagram of a terminal according to an embodiment of the present application.
Detailed Description
To make the objects, technical solutions and advantages of the present application more clear, embodiments of the present application will be described in further detail below with reference to the accompanying drawings.
Fig. 1 is a schematic diagram of an implementation environment of a media resource playing method according to an embodiment of the present application. Referring to fig. 1, the implementation environment includes: a terminal 101 and a server 102.
The terminal 101 may be at least one of a smartphone, a smart watch, a desktop computer, a laptop computer, a virtual reality terminal, an augmented reality terminal, a wireless terminal, a laptop portable computer, and the like. The terminal 101 has a communication function and can access a wired network or a wireless network. The terminal 101 may be generally referred to as one of a plurality of terminals, and the embodiment is only illustrated by the terminal 101. Those skilled in the art will appreciate that the number of terminals described above may be greater or fewer.
The terminal 101 runs a target application having an audio playing function and a video playing function. In some embodiments, a user operates on the terminal 101 to start a target application program, and performs a play operation on any audio displayed in the target application program, so that the terminal 101 plays a corresponding audio. In this embodiment, the terminal 101 is configured to send, in response to a video playing operation on a target audio, a video obtaining request to a server to obtain video data associated with the target audio, and further play a panoramic video based on received first video data when the target audio is played, where the first video data corresponds to the panoramic video associated with the target audio.
The server 102 may be an independent physical server, a server cluster or a distributed file system formed by a plurality of physical servers, or a cloud server providing basic cloud computing services such as a cloud service, a cloud database, cloud computing, a cloud function, cloud storage, a Network service, cloud communication, a middleware service, a domain name service, a security service, a CDN (Content Delivery Network), a big data and artificial intelligence platform, and the like. The server 102 and the terminal 101 may be directly or indirectly connected through wired or wireless communication, which is not limited in this embodiment of the application. Alternatively, the number of the servers 102 may be more or less, and the embodiment of the present application is not limited thereto. Of course, the server 102 may also include other functional servers to provide more comprehensive and diverse services.
Fig. 2 is a flowchart of a media resource playing method provided in an embodiment of the present application, where the embodiment is executed by a terminal, referring to fig. 2, and the embodiment includes:
201. the terminal responds to the video playing operation of the target audio and sends a video acquisition request to the server, wherein the video acquisition request is used for acquiring video data associated with the target audio.
In the embodiment of the application, a target application program runs on the terminal, and the target application program is provided with an audio playing function and a video playing function. The target audio refers to any audio in the target application program, and optionally, the target audio is an audio currently played by the terminal. For example, the target audio may be a song. The server is associated with a video database for storing a plurality of audio associated video data. One audio may have associated therewith one video data, or one audio may have associated therewith a plurality of video data. For example, taking target audio as a song as an example, the video data associated with the target audio may be video data of an MV video that matches the mood of the song.
In an optional embodiment, the target application program is provided with an audio playing control and a video playing control, and the terminal is triggered to play the target audio by performing a triggering operation on the audio playing control of the target audio, and further, the terminal is triggered to send a video acquisition request to the server by performing a triggering operation on the video playing control of the target audio, so as to acquire video data associated with the target audio.
In another optional embodiment, the audio playing control and the video playing control may be integrated, that is, the target application program provides the audio and video playing control, and the trigger terminal sends the video acquisition request to the server by performing a trigger operation on the audio and video playing control of the target audio, so as to acquire the video data associated with the target audio.
202. And when the terminal meets the panoramic playing condition, receiving first video data returned by the server based on the video acquisition request, wherein the first video data corresponds to the panoramic video associated with the target audio.
In the embodiment of the application, the first video data is video data of a panoramic video. A panoramic video is a 360 degree panoramic video. Optionally, the panoramic video is a video obtained by shooting 360 degrees in all directions by using a 3D camera, or the panoramic video is obtained by performing post-synthesis based on the shot video.
203. And when the terminal plays the target audio, playing the panoramic video based on the first video data.
According to the technical scheme, the terminal is triggered to acquire the panoramic video associated with the audio through the server through the video playing operation of the audio, and then the panoramic video is played while the audio is played, so that the combination of audio playing and panoramic video playing is realized, the playing form of the media resource is enriched, and the playing effect of the media resource is improved.
Fig. 3 is a flowchart of a media resource playing method provided in an embodiment of the present application, where the embodiment is executed by a server, referring to fig. 3, and the embodiment includes:
301. the server receives a video acquisition request sent by the terminal, wherein the video acquisition request is used for acquiring video data associated with a target audio, and the video acquisition request is triggered based on a video playing operation of the target audio.
302. And the server responds to the situation that the terminal meets the panoramic playing condition, and acquires first video data based on the video acquisition request, wherein the first video data corresponds to the panoramic video associated with the target audio.
303. And the server returns the first video data to the terminal, wherein the first video data is used for triggering the terminal to play the panoramic video based on the first video data when the target audio is played.
According to the technical scheme, the terminal is triggered to acquire the panoramic video associated with the audio through the server through the video playing operation of the audio, and then the panoramic video is played while the audio is played, so that the combination of audio playing and panoramic video playing is realized, the playing form of the media resource is enriched, and the playing effect of the media resource is improved.
Fig. 2 to fig. 3 are only basic flows of the present application, and the following further explains a scheme provided by the present application based on a specific implementation, and fig. 4 is a flow chart of a media resource playing method provided by an embodiment of the present application, and referring to fig. 4, the embodiment includes:
401. the terminal responds to the video playing operation of the target audio and sends a video acquisition request to the server, wherein the video acquisition request is used for acquiring video data associated with the target audio.
In some embodiments, a user operates on the terminal to launch a target application in which a plurality of audios are exposed. If a user wants to play a target audio and performs a trigger operation on an audio playing control of the target audio, the terminal plays the target audio, and if the user wants to play a video associated with the target audio and performs the trigger operation on the video playing control of the target audio when the target audio is played, the terminal responds to the trigger operation on the video playing control and sends a video acquisition request to the server to acquire video data associated with the target audio.
In other embodiments, if a user wants to play a target audio and a video associated with the target audio and performs a trigger operation on an audio/video playing control of the target audio, the terminal sends a video acquisition request to the server in response to the trigger operation on the audio/video playing control to acquire video data associated with the target audio. Alternatively, the play control mentioned in the above embodiments may be in the form of an Icon control.
In other embodiments, the video playing operation is an operation of triggering entry into a video playing page, and accordingly, if the terminal detects the operation of triggering entry into the video playing page, the video playing page is displayed, and in response to the entry into the video playing page, a video acquisition request is sent to the server.
402. And the server receives a video acquisition request sent by the terminal.
403. The server determines whether the device model of the terminal satisfies the panorama play condition based on the video acquisition request, and executes step 404 in response to that the device model of the terminal satisfies the panorama play condition.
In the embodiment of the application, the video acquisition request carries the equipment model of the terminal. In some embodiments, after receiving a video acquisition request sent by a terminal, a server acquires an equipment model of the terminal carried by the video acquisition request from a terminal field of the video acquisition request, determines whether the equipment model of the terminal meets a panorama play condition, and then executes step 404 in response to that the equipment model of the terminal meets the panorama play condition.
Optionally, whether the device model satisfies the panorama playback condition is determined based on a version of a target application run by the terminal, a memory limit of the terminal, whether the terminal supports 4K decoding, or whether a Central Processing Unit (CPU) model of the terminal supports the panorama mode. The following describes a process of determining whether the device model of the terminal satisfies the panorama playback condition, see (403A) to (403B):
(403A) in some embodiments, taking as an example whether the device model satisfies the panorama playing condition based on any of the above items, if the version of the target application program run by the terminal is a version supporting the panorama mode, the device model of the terminal satisfies the panorama playing condition; if the memory limit of the terminal allows playing the video in the panoramic mode, the equipment model of the terminal meets the panoramic playing condition; if the terminal supports 4K decoding, the equipment model of the terminal meets the panoramic playing condition; and if the CPU of the terminal supports the panoramic mode, the equipment model of the terminal meets the panoramic playing condition.
(403B) In other embodiments, whether the device model satisfies the panorama playback condition is determined based on two or more of the above. Taking two items as examples, if the version of the target application program operated by the terminal is the version supporting the panoramic mode and the memory limitation of the terminal allows playing the video in the panoramic mode, the device model of the terminal meets the panoramic playing condition; or, if the terminal supports 4K decoding and the CPU of the terminal supports the panorama mode, the device model of the terminal satisfies the panorama playback condition. Taking multiple items as an example, if the version of the target application program run by the terminal is a version supporting the panoramic mode, the memory limit of the terminal allows playing of the video in the panoramic mode, the terminal supports 4K decoding, and the CPU of the terminal supports the panoramic mode, the device model of the terminal meets the panoramic playing condition.
Through the process of judging whether the equipment model meets the panoramic playing condition or not, the server executes the subsequent process under the condition that the terminal meets the panoramic playing condition, the subsequent video playing effect is ensured, and the accuracy of video playing is improved.
Optionally, the server is associated with a first model list or a second model list, and further determines whether the device model of the terminal meets the panorama playing condition according to the model list. The first model list comprises a plurality of equipment models of which the equipment models meet the panoramic playing condition. Optionally, the first model list is a model white list. The second type list includes a plurality of device types whose device types do not satisfy the panorama playback condition. Optionally, the second type list is a type blacklist.
In some embodiments, taking the first model list as an example, the process of the server determining whether the device model of the terminal meets the panorama playing condition is as follows: the server judges whether the equipment model of the terminal exists in the first model list or not, and determines that the equipment model of the terminal meets the panoramic playing condition in response to the existence of the equipment model of the terminal in the first model list; and in response to the fact that the equipment model of the terminal does not exist in the first model list, determining that the equipment model of the terminal does not meet the panoramic playing condition.
In some embodiments, taking the second type list as an example, the process of the server determining whether the device type of the terminal meets the panorama playing condition is as follows: the server judges whether the equipment model of the terminal exists in the second model list or not, and determines that the equipment model of the terminal meets the panoramic playing condition in response to the fact that the equipment model of the terminal does not exist in the second model list; and in response to the fact that the equipment model of the terminal exists in the second model list, determining that the equipment model of the terminal does not meet the panoramic playing condition.
404. The server acquires first video data based on the video acquisition request, wherein the first video data corresponds to the panoramic video associated with the target audio.
Optionally, the panoramic video uses a video id (video identity Identification number) as the video identifier, or the panoramic video uses a video link as the video identifier.
In some embodiments, after receiving a video acquisition request sent by a terminal, a server acquires an audio identifier of a target audio carried by the video acquisition request from an audio field of the video acquisition request, and further acquires first video data based on the audio identifier of the target audio.
In some embodiments, the server determines, based on an audio identifier of a target audio carried by the video acquisition request and a target correspondence, a plurality of video data corresponding to the audio identifier, where the target correspondence is a correspondence between the audio identifier and the video data, and acquires the first video data from the plurality of video data. It should be understood that the target correspondence may be provided by a video database.
Optionally, the process of the server obtaining the first video data from the plurality of video data includes any one of the following:
in an alternative embodiment, the server sorts the plurality of video data in order of a video end play rate from high to low, and determines the video data that is sorted in the top as the first video data, where the video end play rate is used to indicate a probability that the corresponding video is completely played. It should be understood that the video data sorted to the top may be video data of a panoramic video, and may also be video data of a flat video, and the embodiment of the present application takes the video data sorted to the top as the example of a panoramic video, and the scheme is described. In the embodiment, the video data with the video playing completion rate before is obtained, so that the obtained video data is the video data which is more interesting to the user, and the video watching experience of the user is improved.
In another alternative embodiment, the server selects a panoramic type video data from the plurality of video data to obtain the first video data. Optionally, if the plurality of video data includes a panoramic type video data, the server selects the panoramic type video data as the first video data; if the plurality of video data comprise a plurality of panoramic type video data, the server randomly selects one panoramic type video data from the plurality of video data to obtain the first video data, or the server sorts the plurality of panoramic type video data according to the sequence of the video playing rate from high to low, and determines the panoramic type video data in the front of the sequence as the first video data. In the embodiment, the panoramic video acquisition efficiency is improved by preferentially selecting the panoramic type video data.
405. And the server returns the first video data to the terminal, wherein the first video data is used for triggering the terminal to play the panoramic video based on the first video data when the target audio is played.
406. And when the equipment model of the terminal meets the panoramic playing condition, receiving first video data returned by the server based on the video acquisition request.
The above steps 405 to 406 are processes of directly sending the first video data to the terminal after the server acquires the first video data. In some embodiments, before sending the first video data to the terminal, the server further sends a plug-in download link to the terminal in response to the terminal satisfying the panorama play condition, the plug-in download link being used for downloading a target plug-in used for creating the panorama player. Accordingly, when the terminal meets the panorama playing condition, in response to receiving the plug-in download link sent by the server, downloading a target plug-in based on the plug-in download link, creating a panorama player based on the target plug-in, and then the terminal performs step 407 based on the panorama player. For example, when the terminal triggers to play the panoramic video for the first time, the process of downloading the plug-in of the panoramic player is executed, so that the playing process of the panoramic video is performed later.
407. And when the terminal plays the target audio, playing the panoramic video based on the first video data.
In some embodiments, when the terminal plays the target audio, the terminal plays the panoramic video based on the first video data in the video playing page. For example, fig. 5 is a schematic diagram of a video playing page provided in an embodiment of the present application, where the video playing page may be a "vertical screen MV page" shown in fig. 5, and a terminal may play a panoramic video in the "vertical screen MV page".
In some embodiments, when the terminal plays the target audio, based on the playing progress of the target audio at the current time, the panoramic video corresponding to the playing progress is played. Therefore, the synchronization of the playing progress of the target audio and the playing progress of the panoramic video can be ensured, and the playing effect of the audio and video is improved.
Optionally, the terminal may further perform interaction based on the panoramic video in the process of playing the panoramic video, and the interaction process is described below:
(407A) in some embodiments, the terminal responds to the sliding operation of the video pictures of the panoramic video, and displays the panoramic video blocks corresponding to the sliding direction based on the sliding direction of the sliding operation, wherein the panoramic video blocks comprise the video pictures of the angle corresponding to the sliding direction.
Optionally, the sliding operation is a left sliding operation or a right sliding operation. For example, the terminal displays a left panoramic video block in response to a left-slide operation on the video screen, or displays a right panoramic video block in response to a right-slide operation on the video screen. For example, fig. 6 is a schematic diagram of a video playing page provided in the embodiment of the present application, and by sliding left and right, a multi-angle picture of a panoramic video can be viewed, so that diversity of video interaction is enriched, and video viewing experience of a user is improved.
(407B) In some embodiments, the video frame of the panoramic video comprises a target control and at least one information control, and the terminal stops displaying the at least one information control in the video frame in response to a triggering operation of the target control in the video frame.
In the embodiment of the application, the target control is used for triggering the switching of the playing mode of the panoramic video to the pure panoramic mode, and the pure panoramic mode refers to that no information control is displayed in the video picture of the panoramic video. For example, referring to fig. 5, the target control may be the control 501 shown in fig. 5, and the at least one information control is at least one of the user avatar 502, the like button 503, the barrage button 504, and the song information 505 shown in fig. 5. In the process, the terminal can be triggered to stop displaying the information control through the triggering operation of the target control, so that the operation flow is simplified, and the man-machine interaction efficiency is improved.
(407C) In some embodiments, the video frame of the panoramic video comprises at least one information control, and the terminal stops displaying the at least one information control in the video frame in response to the playing duration of the panoramic video reaching the target duration. Wherein the target duration is a preset fixed duration, such as 5 s. In the process, the terminal can be automatically triggered to stop displaying the information control.
In the above embodiment, the display of the information control is stopped, so that the playing mode of the panoramic video enters the pure panoramic mode, the user can concentrate on the content immersed in the panoramic video, and the panoramic video watching experience of the user is further improved.
The above (407B) and (407C) are the stop of displaying the at least one information control in the video frame. In other embodiments, the video frame further includes an interactive control, and accordingly, in response to a trigger operation on a target control in the video frame or in response to the playing duration of the panoramic video reaching a target duration, the terminal stops displaying the at least one information control in the video frame but displays the interactive control in the video frame. For example, referring to FIG. 5, the interaction control may be the control 506 shown in FIG. 5.
(407D) In some embodiments, after the terminal stops displaying the at least one information control in the video frame, there may be other implementations as follows:
in some embodiments, the terminal displays the at least one information control in the video screen in response to a switching operation of the panoramic video. Optionally, the terminal displays the at least one information control in a video screen of the switched video in response to a switching operation on the panoramic video, wherein the switched video is not the panoramic video. Wherein, the switching operation may be a sliding operation of the video picture up and down. For example, the terminal plays the last video of the panoramic video in response to a slide-up operation on the video screen, or the terminal plays the next video of the panoramic video in response to a slide-down operation on the video screen.
In still other embodiments, the terminal displays the at least one information control in the video frame in response to a switching operation of the target audio.
In other embodiments, the terminal displays the at least one information control in the video frame in response to the re-triggering operation of the target control.
In the embodiment, the terminal can be triggered to exit the pure panoramic mode by switching the audio or video or triggering the target control again, so that the operation process is simplified, and the human-computer interaction efficiency is improved. It should be appreciated that if the terminal exits the pure panorama mode, the target audio is still playing.
(407E) In some embodiments, the terminal responds to the panoramic video played to a target playing progress, and plays a special effect corresponding to the target playing progress; or the terminal responds to the video picture of the panoramic video played to the target angle and plays the special effect corresponding to the target angle. The target playing progress is a preset fixed playing progress, and the target playing progress is represented by a playing time stamp, such as the playing time stamp 5 s. The target angle is a preset fixed angle. Of course, the terminal can also trigger playing of the special effect based on other manners, for example, in response to the panoramic video being played to a certain scene or picture, playing the corresponding special effect. The special effect can be understood as a colored egg, so that the colored egg falling in any type can be triggered through the triggering operation of a user, and the interest of watching videos is improved.
In the process, the user is supported to interact with the panoramic video in the process of playing the panoramic video, so that the interestingness of watching the video by the user is improved.
In steps 403 to 407, when the device model of the terminal meets the panorama playing condition, the server sends the first video data to the terminal, and further triggers the terminal to play the panorama video. In other embodiments, the server, in response to that the terminal does not satisfy the panorama playback condition, obtains second video data corresponding to a flat video having the same content as the panorama video, and returns the second video data to the terminal, where the second video data is used to trigger the terminal to play the flat video based on the second video data when playing the target audio. Correspondingly, when the terminal does not meet the panoramic playing condition, second video data returned by the server is received, and when the target audio is played, the plane video is played based on the second video data. In this embodiment, when the device model of the terminal does not satisfy the panorama playing condition, the planar video with the same content can be used for alternative display, so as to ensure the viewing experience of the user. It should be understood that panoramic video may be associated with flat video with content to enable data interworking.
408. And the terminal sends a playing progress message of the target audio to the server, wherein the playing progress message is used for triggering the server to adjust the playing progress of the panoramic video based on the playing progress of the target audio.
In some embodiments, the terminal sends a play progress message of the target audio to the server every target time period. Wherein the target time period is a preset time period, such as 5 minutes.
In other embodiments, the terminal sends the playing progress message of the target audio to the server in response to the operation of adjusting the playing progress of the target audio. Optionally, the terminal sends a pause message of the target audio to the server in response to a pause operation on the target audio, or sends a fast forward message of the target audio to the server in response to a fast forward operation on the target audio, or sends a fast backward message of the target audio to the server in response to a fast backward operation on the target audio. In the embodiment, the playing progress of the audio is used for controlling the playing of the panoramic video, when the audio is played and paused, the panoramic video is played and paused synchronously, and when the music is fast-forwarded and fast-backed, the panoramic video is synchronously switched to the corresponding progress, so that the synchronous playing of the audio and the video is ensured.
Optionally, the terminal sends the playing progress message of the target audio to the server through a Communication mode of IPC (Inter Process Communication). IPC refers to a technique for transferring data or signals between at least two processes or threads. Specifically, the communication method of the IPC may be any one of a message, a broadcast, a heartbeat packet, and the like, that is, the sent play progress message may be in a form of a message, a form of a broadcast, or a form of a heartbeat packet. It should be noted that, in the embodiment of the present application, the playing progress is described only by the playing progress message, and the form of the playing progress is not limited. Further, the terminal may send a playing progress message of the target audio to the server based on a message mechanism or a registration callback mechanism. The message mechanism means that the terminal sends the playing progress message of the target audio to the server in a single side. The registration callback mechanism is that the terminal sends a playing progress message of the target audio to the server, and the server returns a response message to the playing progress message to the terminal. In the process, by the communication technology, the problem of asynchronism of sound and pictures between the audio player and the video player in the same process and the cross-process can be solved, and further the synchronization of audio and video playing can be ensured.
409. And the server receives the playing progress message sent by the terminal.
410. And the server responds to the playing progress message to indicate that the playing progress of the target audio is different from the playing progress of the panoramic video, and adjusts the playing progress of the panoramic video based on the playing progress of the target audio.
In the above steps 408 to 410, the terminal sends a playing progress message of the target audio to the server, and then the server is triggered to adjust the playing progress of the panoramic video, so as to ensure that the audio and video playing is synchronous. It should be noted that steps 408 to 410 are optional steps. In other embodiments, when the terminal plays the panoramic video based on the first video data, the terminal does not need to perform a process of sending a play progress message to the server.
According to the technical scheme, the terminal is triggered to acquire the panoramic video associated with the audio through the server through the video playing operation of the audio, and then the panoramic video is played while the audio is played, so that the combination of audio playing and panoramic video playing is realized, the playing form of the media resource is enriched, and the playing effect of the media resource is improved.
Fig. 7 is a schematic structural diagram of a media resource playing apparatus provided in an embodiment of the present application, and referring to fig. 7, the apparatus includes:
a sending module 701, configured to send a video acquisition request to a server in response to a video playing operation on a target audio, where the video acquisition request is used to acquire video data associated with the target audio;
a receiving module 702, configured to receive, when the terminal meets a panorama playing condition, first video data returned by the server based on the video acquisition request, where the first video data corresponds to a panoramic video associated with the target audio;
the playing module 703 is configured to play the panoramic video based on the first video data when the target audio is played.
According to the technical scheme, the terminal is triggered to acquire the panoramic video associated with the audio through the server through the video playing operation of the audio, and then the panoramic video is played while the audio is played, so that the combination of audio playing and panoramic video playing is realized, the playing form of the media resource is enriched, and the playing effect of the media resource is improved.
In some embodiments, the receiving module 702 is configured to:
and when the equipment model of the terminal meets the panoramic playing condition, receiving first video data returned by the server based on the video acquisition request.
In some embodiments, the receiving module 702 is further configured to, when the terminal meets the panorama playing condition, in response to receiving a plug-in download link sent by the server, download a target plug-in based on the plug-in download link, where the target plug-in is used to create a panorama player;
the playing module 703 is further configured to execute the step of playing the panoramic video based on the first video data when the target audio is played based on the panoramic player.
In some embodiments, the playing module 703 is configured to:
and when the target audio is played, based on the playing progress of the target audio at the current moment, playing the panoramic video corresponding to the playing progress.
In some embodiments, the sending module 701 is further configured to:
and sending a playing progress message of the target audio to the server, wherein the playing progress message is used for triggering the server to adjust the playing progress of the panoramic video based on the playing progress of the target audio.
In some embodiments, the sending module 701 is further configured to:
responding to the adjustment operation of the playing progress of the target audio, and executing the step of sending the playing progress message of the target audio to the server.
In some embodiments, the apparatus further comprises:
and the display module is used for responding to the sliding operation of the video pictures of the panoramic video and displaying the panoramic video blocks corresponding to the sliding direction based on the sliding direction of the sliding operation, wherein the panoramic video blocks comprise the video pictures of the angle corresponding to the sliding direction.
In some embodiments, a video frame of a panoramic video includes a target control and at least one information control, the apparatus further comprising:
and the display module is used for responding to the triggering operation of the target control in the video picture and stopping displaying the at least one information control in the video picture.
In some embodiments, the video frame of the panoramic video includes at least one information control, the apparatus further comprising:
and the display module is used for responding to the fact that the playing duration of the panoramic video reaches the target duration and stopping displaying the at least one information control in the video picture.
In some embodiments, the display module is further configured to any one of:
responding to the switching operation of the panoramic video, and displaying the at least one information control in the video picture;
and responding to the switching operation of the target audio, and displaying the at least one information control in the video picture.
In some embodiments, the display module is further configured to:
and responding to the switching operation of the panoramic video, wherein the switched video is not the panoramic video, and the at least one information control is displayed in the video picture of the switched video.
In some embodiments, the playing module 703 is further configured to any one of:
responding to the panoramic video played to a target playing progress, and playing a special effect corresponding to the target playing progress;
and responding to the video picture of the panoramic video played to the target angle, and playing the special effect corresponding to the target angle.
In some embodiments, the receiving module 702 is further configured to receive, when the terminal does not satisfy the panorama playing condition, second video data returned by the server, where the second video data is a same flat video as the panoramic video content;
the playing module 703 is further configured to play the flat video based on the second video data when the target audio is played.
Fig. 8 is a schematic structural diagram of a media resource playing apparatus provided in an embodiment of the present application, and referring to fig. 8, the apparatus includes:
a receiving module 801, configured to receive a video acquisition request sent by a terminal, where the video acquisition request is used to acquire video data associated with a target audio, and the video acquisition request is triggered based on a video playing operation on the target audio;
an obtaining module 802, configured to, in response to that the terminal meets a panorama playing condition, obtain first video data based on the video obtaining request, where the first video data corresponds to a panorama video associated with the target audio;
a returning module 803, configured to return the first video data to the terminal, where the first video data is used to trigger the terminal to play the panoramic video based on the first video data when the terminal plays the target audio.
According to the technical scheme, the terminal is triggered to acquire the panoramic video associated with the audio through the server through the video playing operation of the audio, and then the panoramic video is played while the audio is played, so that the combination of audio playing and panoramic video playing is realized, the playing form of the media resource is enriched, and the playing effect of the media resource is improved.
In some embodiments, the obtaining module 802 includes:
and responding to the situation that the equipment model of the terminal meets the panoramic playing condition, and acquiring first video data based on the video acquisition request.
In some embodiments, the apparatus further comprises a determination module to at least one of:
responding to the existence of the equipment model of the terminal in a first model list, determining that the equipment model of the terminal meets the panoramic playing condition, wherein the first model list comprises a plurality of equipment models of which the equipment models meet the panoramic playing condition;
and in response to the fact that the equipment model of the terminal does not exist in a second model list, determining that the equipment model of the terminal meets the panoramic playing condition, wherein the second model list comprises a plurality of equipment models of which the equipment models do not meet the panoramic playing condition.
In some embodiments, the apparatus further comprises a sending module to:
and responding to the terminal meeting the panoramic playing condition, and sending a plug-in downloading link to the terminal, wherein the plug-in downloading link is used for downloading a target plug-in, and the target plug-in is used for creating a panoramic player.
In some embodiments, the obtaining module 802 includes:
the determining submodule is used for determining a plurality of video data corresponding to the audio identification based on the audio identification and the target corresponding relation of the target audio carried by the video acquisition request, wherein the target corresponding relation is the corresponding relation of the audio identification and the video data;
and the obtaining sub-module is used for obtaining the first video data from the plurality of video data.
In some embodiments, the acquisition submodule is configured to any one of:
sequencing the plurality of video data according to the sequence of the video playing completion rate from high to low, and determining the video data in the front sequence as the first video data, wherein the video playing completion rate is used for representing the probability of the complete playing of the corresponding video;
and selecting video data of a panoramic type from the plurality of video data to obtain the first video data.
In some embodiments, the receiving module 801 is further configured to receive a play progress message sent by the terminal;
the device further comprises an adjusting module, configured to adjust the playing progress of the panoramic video based on the playing progress of the target audio in response to the playing progress message indicating that the playing progress of the target audio is different from the playing progress of the panoramic video.
In some embodiments, the obtaining module 802 is further configured to, in response to that the terminal does not satisfy the panorama playing condition, obtain second video data, where the second video data corresponds to a flat video with the same content as the panorama video;
the returning module 803 is further configured to return the second video data to the terminal, where the second video data is used to trigger the terminal to play the flat video based on the second video data when playing the target audio.
It should be noted that: in the media resource playing apparatus provided in the foregoing embodiment, when playing a media resource, only the division of the functional modules is exemplified, and in practical applications, the function distribution may be completed by different functional modules according to needs, that is, the internal structure of the device is divided into different functional modules, so as to complete all or part of the functions described above. In addition, the media resource playing apparatus and the media resource playing method provided in the foregoing embodiments belong to the same concept, and specific implementation processes thereof are described in the method embodiments and are not described herein again.
Fig. 9 shows a block diagram of a terminal 900 according to an exemplary embodiment of the present application. The terminal 900 may be: a smart phone, a tablet computer, an MP3 player (Moving Picture Experts Group Audio Layer III, motion video Experts compression standard Audio Layer 3), an MP4 player (Moving Picture Experts Group Audio Layer IV, motion video Experts compression standard Audio Layer 4), a notebook computer, or a desktop computer. Terminal 900 may also be referred to by other names such as user equipment, portable terminals, laptop terminals, desktop terminals, and the like.
In general, terminal 900 includes: a processor 901 and a memory 902.
In some embodiments, terminal 900 can also optionally include: a peripheral interface 903 and at least one peripheral. The processor 901, memory 902, and peripheral interface 903 may be connected by buses or signal lines. Various peripheral devices may be connected to the peripheral interface 903 via a bus, signal line, or circuit board. Specifically, the peripheral device includes: at least one of a radio frequency circuit 904, a display screen 905, a camera assembly 906, an audio circuit 907, a positioning assembly 908, and a power supply 909.
The peripheral interface 903 may be used to connect at least one peripheral related to I/O (Input/Output) to the processor 901 and the memory 902. In some embodiments, the processor 901, memory 902, and peripheral interface 903 are integrated on the same chip or circuit board; in some other embodiments, any one or two of the processor 901, the memory 902 and the peripheral interface 903 may be implemented on a separate chip or circuit board, which is not limited by this embodiment.
The Radio Frequency circuit 904 is used for receiving and transmitting RF (Radio Frequency) signals, also called electromagnetic signals. The radio frequency circuitry 904 communicates with communication networks and other communication devices via electromagnetic signals. The radio frequency circuit 904 converts an electrical signal into an electromagnetic signal to transmit, or converts a received electromagnetic signal into an electrical signal. Optionally, the radio frequency circuit 904 comprises: an antenna system, an RF transceiver, one or more amplifiers, a tuner, an oscillator, a digital signal processor, a codec chipset, a subscriber identity module card, and so forth. The radio frequency circuit 904 may communicate with other terminals via at least one wireless communication protocol. The wireless communication protocols include, but are not limited to: metropolitan area networks, various generation mobile communication networks (2G, 3G, 4G, and 5G), Wireless local area networks, and/or WiFi (Wireless Fidelity) networks. In some embodiments, the radio frequency circuit 904 may also include NFC (Near Field Communication) related circuits, which are not limited in this application.
The display screen 905 is used to display a UI (User Interface). The UI may include graphics, text, icons, video, and any combination thereof. When the display screen 905 is a touch display screen, the display screen 905 also has the ability to capture touch signals on or over the surface of the display screen 905. The touch signal may be input to the processor 901 as a control signal for processing. At this point, the display 905 may also be used to provide virtual buttons and/or a virtual keyboard, also referred to as soft buttons and/or a soft keyboard. In some embodiments, the display 905 may be one, disposed on the front panel of the terminal 900; in other embodiments, the number of the display panels 905 may be at least two, and each of the display panels is disposed on a different surface of the terminal 900 or is in a foldable design; in other embodiments, the display 905 may be a flexible display disposed on a curved surface or a folded surface of the terminal 900. Even more, the display screen 905 may be arranged in a non-rectangular irregular figure, i.e. a shaped screen. The Display panel 905 can be made of LCD (Liquid Crystal Display), OLED (Organic Light-Emitting Diode), and other materials.
The camera assembly 906 is used to capture images or video. Optionally, camera assembly 906 includes a front camera and a rear camera. Generally, a front camera is disposed at a front panel of the terminal, and a rear camera is disposed at a rear surface of the terminal. In some embodiments, the number of the rear cameras is at least two, and each rear camera is any one of a main camera, a depth-of-field camera, a wide-angle camera and a telephoto camera, so that the main camera and the depth-of-field camera are fused to realize a background blurring function, and the main camera and the wide-angle camera are fused to realize panoramic shooting and VR (Virtual Reality) shooting functions or other fusion shooting functions. In some embodiments, camera assembly 906 may also include a flash. The flash lamp can be a monochrome temperature flash lamp or a bicolor temperature flash lamp. The double-color-temperature flash lamp is a combination of a warm-light flash lamp and a cold-light flash lamp, and can be used for light compensation at different color temperatures.
The positioning component 908 is used to locate the current geographic Location of the terminal 900 for navigation or LBS (Location Based Service). The Positioning component 908 may be a Positioning component based on the GPS (Global Positioning System) in the united states, the beidou System in china, the graves System in russia, or the galileo System in the european union.
In some embodiments, terminal 900 can also include one or more sensors 910. The one or more sensors 910 include, but are not limited to: acceleration sensor 911, gyro sensor 912, pressure sensor 913, fingerprint sensor 914, optical sensor 915, and proximity sensor 916.
The acceleration sensor 911 can detect the magnitude of acceleration in three coordinate axes of the coordinate system established with the terminal 900. For example, the acceleration sensor 911 may be used to detect the components of the gravitational acceleration in three coordinate axes. The processor 901 can control the display screen 905 to display the user interface in a landscape view or a portrait view according to the gravitational acceleration signal collected by the acceleration sensor 911. The acceleration sensor 911 may also be used for acquisition of motion data of a game or a user.
The gyro sensor 912 may detect a body direction and a rotation angle of the terminal 900, and the gyro sensor 912 may cooperate with the acceleration sensor 911 to acquire a 3D motion of the user on the terminal 900. The processor 901 can implement the following functions according to the data collected by the gyro sensor 912: motion sensing (such as changing the UI according to a user's tilting operation), image stabilization at the time of photographing, game control, and inertial navigation.
The pressure sensor 913 may be disposed on a side bezel of the terminal 900 and/or underneath the display 905. When the pressure sensor 913 is disposed on the side frame of the terminal 900, the user's holding signal of the terminal 900 may be detected, and the processor 901 performs left-right hand recognition or shortcut operation according to the holding signal collected by the pressure sensor 913. When the pressure sensor 913 is disposed at a lower layer of the display screen 905, the processor 901 controls the operability control on the UI interface according to the pressure operation of the user on the display screen 905. The operability control comprises at least one of a button control, a scroll bar control, an icon control and a menu control.
The fingerprint sensor 914 is used for collecting a fingerprint of the user, and the processor 901 identifies the user according to the fingerprint collected by the fingerprint sensor 914, or the fingerprint sensor 914 identifies the user according to the collected fingerprint. Upon recognizing that the user's identity is a trusted identity, processor 901 authorizes the user to perform relevant sensitive operations including unlocking the screen, viewing encrypted information, downloading software, paying, and changing settings, etc. The fingerprint sensor 914 may be disposed on the front, back, or side of the terminal 900. When a physical key or vendor Logo is provided on the terminal 900, the fingerprint sensor 914 may be integrated with the physical key or vendor Logo.
The optical sensor 915 is used to collect ambient light intensity. In one embodiment, the processor 901 may control the display brightness of the display screen 905 based on the ambient light intensity collected by the optical sensor 915. Specifically, when the ambient light intensity is high, the display brightness of the display screen 905 is increased; when the ambient light intensity is low, the display brightness of the display screen 905 is reduced. In another embodiment, the processor 901 can also dynamically adjust the shooting parameters of the camera assembly 906 according to the ambient light intensity collected by the optical sensor 915.
Those skilled in the art will appreciate that the configuration shown in fig. 9 does not constitute a limitation of terminal 900, and may include more or fewer components than those shown, or may combine certain components, or may employ a different arrangement of components.
The computer device provided by the embodiment of the application can be provided as a server. Fig. 10 is a schematic structural diagram of a server according to an embodiment of the present application, where the server 1000 may generate a relatively large difference due to different configurations or performances, and may include one or more processors (CPUs) 1001 and one or more memories 1002, where the memory 1002 stores at least one program code, and the at least one program code is loaded and executed by the processors 1001 to implement content executed by the server in the media resource playing method provided by the foregoing method embodiments. Of course, the server may also have components such as a wired or wireless network interface, a keyboard, and an input/output interface, so as to perform input/output, and the server may also include other components for implementing the functions of the device, which are not described herein again.
In an exemplary embodiment, a computer readable storage medium, such as a memory including a program code, which is executable by a processor in a terminal or a server to perform the media asset playing method in the above embodiments, is also provided. For example, the computer-readable storage medium may be a ROM (read-only memory), a ram (random access memory), a compact-disc (read-only memory), a magnetic tape, a floppy disk, an optical data storage device, and the like.
It will be understood by those skilled in the art that all or part of the steps for implementing the above embodiments may be implemented by hardware, or may be implemented by hardware associated with program code, and the program may be stored in a computer readable storage medium, and the above mentioned storage medium may be a read-only memory, a magnetic disk or an optical disk, etc.
The above description is only exemplary of the present application and should not be taken as limiting, as any modification, equivalent replacement, or improvement made within the spirit and principle of the present application should be included in the protection scope of the present application.
Claims (26)
1. A media resource playing method, performed by a terminal, the method comprising:
responding to a video playing operation of a target audio, and sending a video acquisition request to a server, wherein the video acquisition request is used for acquiring video data associated with the target audio;
when the terminal meets a panoramic playing condition, receiving first video data returned by the server based on the video acquisition request, wherein the first video data corresponds to the panoramic video associated with the target audio;
and when the target audio is played, playing the panoramic video based on the first video data.
2. The method according to claim 1, wherein the receiving the first video data returned by the server based on the video acquisition request when the terminal satisfies the panorama play condition comprises:
and when the equipment model of the terminal meets the panoramic playing condition, receiving first video data returned by the server based on the video acquisition request.
3. The method of claim 1, wherein after sending a video acquisition request to the server in response to the video play operation on the target audio, the method further comprises:
when the terminal meets the panoramic playing condition, responding to the receiving of a plug-in downloading link sent by the server, downloading a target plug-in based on the plug-in downloading link, wherein the target plug-in is used for creating a panoramic player;
and based on the panoramic player, executing the step of playing the panoramic video based on the first video data when the target audio is played.
4. The method of claim 1, wherein playing the panoramic video based on the first video data while playing the target audio comprises:
and when the target audio is played, based on the playing progress of the target audio at the current moment, playing the panoramic video corresponding to the playing progress.
5. The method of claim 1, wherein after playing the panoramic video based on the first video data while playing the target audio, the method further comprises:
and sending a playing progress message of the target audio to the server, wherein the playing progress message is used for triggering the server to adjust the playing progress of the panoramic video based on the playing progress of the target audio.
6. The method of claim 5, wherein before sending the play progress message of the target audio to the server, the method further comprises:
responding to the adjustment operation of the playing progress of the target audio, and executing the step of sending the playing progress message of the target audio to the server.
7. The method of claim 1, wherein after playing the panoramic video based on the first video data while playing the target audio, the method further comprises:
in response to a sliding operation on a video picture of the panoramic video, displaying a panoramic video block corresponding to the sliding direction based on the sliding direction of the sliding operation, wherein the panoramic video block comprises a video picture of an angle corresponding to the sliding direction.
8. The method of claim 1, wherein the video frame of the panoramic video comprises a target control and at least one information control, and wherein after playing the panoramic video based on the first video data while playing the target audio, the method further comprises:
and stopping displaying the at least one information control in the video picture in response to the triggering operation of the target control in the video picture.
9. The method of claim 1, wherein the video frame of the panoramic video comprises at least one information control, and wherein after playing the panoramic video based on the first video data while playing the target audio, the method further comprises:
and stopping displaying the at least one information control in the video picture in response to the playing duration of the panoramic video reaching a target duration.
10. The method of claim 8 or 9, wherein after the ceasing to display the at least one information control in the video frame, the method further comprises any of:
displaying the at least one information control in the video picture in response to a switching operation of the panoramic video;
and responding to the switching operation of the target audio, and displaying the at least one information control in the video picture.
11. The method of claim 10, wherein the displaying the at least one information control in the video screen in response to the switching operation of the panoramic video comprises:
and responding to the switching operation of the panoramic video, wherein the switched video is not the panoramic video, and the at least one information control is displayed in the video picture of the switched video.
12. The method according to claim 1, wherein after playing the panoramic video based on the first video data while playing the target audio, the method further comprises any one of:
responding to the panoramic video played to a target playing progress, and playing a special effect corresponding to the target playing progress;
responding to the video picture of the panoramic video played to the target angle, and playing the special effect corresponding to the target angle.
13. The method of claim 1, wherein after sending a video acquisition request to the server in response to the video play operation on the target audio, the method further comprises:
when the terminal does not meet the panoramic playing condition, receiving second video data returned by the server, wherein the second video data corresponds to a plane video with the same content as the panoramic video;
and when the target audio is played, playing the plane video based on the second video data.
14. A media asset playing method, performed by a server, the method comprising:
receiving a video acquisition request sent by a terminal, wherein the video acquisition request is used for acquiring video data associated with a target audio, and the video acquisition request is triggered based on a video playing operation on the target audio;
responding to the situation that the terminal meets a panoramic playing condition, and acquiring first video data based on the video acquisition request, wherein the first video data corresponds to the panoramic video associated with the target audio;
and returning the first video data to the terminal, wherein the first video data is used for triggering the terminal to play the panoramic video based on the first video data when the target audio is played.
15. The method according to claim 14, wherein the acquiring first video data based on the video acquisition request in response to the terminal satisfying the panorama playback condition comprises:
and responding to the situation that the equipment model of the terminal meets the panoramic playing condition, and acquiring first video data based on the video acquisition request.
16. The method of claim 15, further comprising at least one of:
responding to the fact that the equipment model of the terminal exists in a first model list, determining that the equipment model of the terminal meets the panoramic playing condition, wherein the first model list comprises a plurality of equipment models of which the equipment models meet the panoramic playing condition;
and in response to the fact that the equipment model of the terminal does not exist in a second model list, determining that the equipment model of the terminal meets the panoramic playing condition, wherein the second model list comprises a plurality of equipment models of which the equipment models do not meet the panoramic playing condition.
17. The method according to claim 14, wherein after receiving the video acquisition request sent by the terminal, the method further comprises:
and responding to the situation that the terminal meets the panoramic playing condition, and sending a plug-in downloading link to the terminal, wherein the plug-in downloading link is used for downloading a target plug-in, and the target plug-in is used for creating a panoramic player.
18. The method of claim 14, wherein the obtaining first video data based on the video obtaining request comprises:
determining a plurality of video data corresponding to the audio identification based on the audio identification and the target corresponding relation of the target audio carried by the video acquisition request, wherein the target corresponding relation is the corresponding relation of the audio identification and the video data;
and acquiring the first video data from the plurality of video data.
19. The method according to claim 18, wherein said obtaining the first video data from the plurality of video data comprises any one of:
sequencing the plurality of video data according to the sequence of the video playing completion rate from high to low, and determining the video data which is sequenced at the top as the first video data, wherein the video playing completion rate is used for representing the probability that the corresponding video is completely played;
and selecting one panoramic type video data from the plurality of video data to obtain the first video data.
20. The method of claim 14, wherein after returning the first video data to the terminal, the method further comprises:
receiving a playing progress message sent by the terminal;
and responding to the playing progress message to indicate that the playing progress of the target audio is different from the playing progress of the panoramic video, and adjusting the playing progress of the panoramic video based on the playing progress of the target audio.
21. The method according to claim 14, wherein after receiving the video acquisition request sent by the terminal, the method further comprises:
responding to the situation that the terminal does not meet the panoramic playing condition, and acquiring second video data, wherein the second video data correspond to a plane video with the same content as the panoramic video;
and returning the second video data to the terminal, wherein the second video data is used for triggering the terminal to play the plane video based on the second video data when the terminal plays the target audio.
22. An apparatus for playing media assets, the apparatus comprising:
the sending module is used for responding to video playing operation of a target audio and sending a video obtaining request to a server, wherein the video obtaining request is used for obtaining video data related to the target audio;
a receiving module, configured to receive, when the terminal meets a panorama playing condition, first video data returned by the server based on the video acquisition request, where the first video data corresponds to a panorama video associated with the target audio;
and the playing module is used for playing the panoramic video based on the first video data when the target audio is played.
23. An apparatus for playing media assets, the apparatus comprising:
the system comprises a receiving module, a processing module and a processing module, wherein the receiving module is used for receiving a video acquisition request sent by a terminal, the video acquisition request is used for acquiring video data associated with a target audio, and the video acquisition request is triggered based on a video playing operation of the target audio;
an obtaining module, configured to obtain first video data based on the video obtaining request in response to that the terminal meets a panorama playing condition, where the first video data corresponds to a panorama video associated with the target audio;
and the return module is used for returning the first video data to the terminal, and the first video data is used for triggering the terminal to play the panoramic video based on the first video data when the target audio is played.
24. A terminal, characterized in that the terminal comprises a processor and a memory, the memory having stored therein at least one program code, the at least one program code being loaded and executed by the processor to implement the operations executed by the media asset playback method according to any one of claims 1 to 13.
25. A server, characterized in that the server comprises a processor and a memory, wherein the memory stores at least one program code, and the at least one program code is loaded and executed by the processor to implement the operations executed by the media resource playing method according to any one of claims 14 to 21.
26. A computer-readable storage medium having at least one program code stored therein, the at least one program code being loaded and executed by a processor to implement the operations performed by the media asset playback method as claimed in any one of claims 1 to 21.
Priority Applications (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CN202110449978.6A CN113141538B (en) | 2021-04-25 | 2021-04-25 | Media resource playing method, device, terminal, server and storage medium |
Applications Claiming Priority (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CN202110449978.6A CN113141538B (en) | 2021-04-25 | 2021-04-25 | Media resource playing method, device, terminal, server and storage medium |
Publications (2)
Publication Number | Publication Date |
---|---|
CN113141538A true CN113141538A (en) | 2021-07-20 |
CN113141538B CN113141538B (en) | 2023-08-11 |
Family
ID=76813503
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
CN202110449978.6A Active CN113141538B (en) | 2021-04-25 | 2021-04-25 | Media resource playing method, device, terminal, server and storage medium |
Country Status (1)
Country | Link |
---|---|
CN (1) | CN113141538B (en) |
Cited By (1)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN113535116A (en) * | 2021-08-05 | 2021-10-22 | 广州酷狗计算机科技有限公司 | Audio file playing method and device, terminal and storage medium |
Citations (8)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN102830992A (en) * | 2012-07-31 | 2012-12-19 | 北京奇虎科技有限公司 | Plug-in loading method and system |
CN103645923A (en) * | 2013-12-26 | 2014-03-19 | 浙江宇天科技股份有限公司 | Insert installation method and system |
CN108962244A (en) * | 2018-06-29 | 2018-12-07 | 百度在线网络技术(北京)有限公司 | Method and apparatus for sending information |
CN109302538A (en) * | 2018-12-21 | 2019-02-01 | 广州酷狗计算机科技有限公司 | Method for playing music, device, terminal and storage medium |
CN109429072A (en) * | 2017-08-28 | 2019-03-05 | 触信(厦门)智能科技有限公司 | A kind of sharing method of panoramic pictures or panoramic video |
CN111031393A (en) * | 2019-12-26 | 2020-04-17 | 广州酷狗计算机科技有限公司 | Video playing method, device, terminal and storage medium |
CN111526323A (en) * | 2020-03-24 | 2020-08-11 | 视联动力信息技术股份有限公司 | Panoramic video processing method and device |
CN111741366A (en) * | 2020-07-16 | 2020-10-02 | 广州酷狗计算机科技有限公司 | Audio playing method, device, terminal and storage medium |
Family Cites Families (1)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN107977184A (en) * | 2017-11-21 | 2018-05-01 | 北京小鸟看看科技有限公司 | A kind of method for playing music and device based on virtual reality technology |
-
2021
- 2021-04-25 CN CN202110449978.6A patent/CN113141538B/en active Active
Patent Citations (8)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN102830992A (en) * | 2012-07-31 | 2012-12-19 | 北京奇虎科技有限公司 | Plug-in loading method and system |
CN103645923A (en) * | 2013-12-26 | 2014-03-19 | 浙江宇天科技股份有限公司 | Insert installation method and system |
CN109429072A (en) * | 2017-08-28 | 2019-03-05 | 触信(厦门)智能科技有限公司 | A kind of sharing method of panoramic pictures or panoramic video |
CN108962244A (en) * | 2018-06-29 | 2018-12-07 | 百度在线网络技术(北京)有限公司 | Method and apparatus for sending information |
CN109302538A (en) * | 2018-12-21 | 2019-02-01 | 广州酷狗计算机科技有限公司 | Method for playing music, device, terminal and storage medium |
CN111031393A (en) * | 2019-12-26 | 2020-04-17 | 广州酷狗计算机科技有限公司 | Video playing method, device, terminal and storage medium |
CN111526323A (en) * | 2020-03-24 | 2020-08-11 | 视联动力信息技术股份有限公司 | Panoramic video processing method and device |
CN111741366A (en) * | 2020-07-16 | 2020-10-02 | 广州酷狗计算机科技有限公司 | Audio playing method, device, terminal and storage medium |
Cited By (1)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN113535116A (en) * | 2021-08-05 | 2021-10-22 | 广州酷狗计算机科技有限公司 | Audio file playing method and device, terminal and storage medium |
Also Published As
Publication number | Publication date |
---|---|
CN113141538B (en) | 2023-08-11 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
CN110267067B (en) | Live broadcast room recommendation method, device, equipment and storage medium | |
CN109729411B (en) | Live broadcast interaction method and device | |
CN110213636B (en) | Method and device for generating video frame of online video, storage medium and equipment | |
CN112118477B (en) | Virtual gift display method, device, equipment and storage medium | |
CN109874043B (en) | Video stream sending method, video stream playing method and video stream playing device | |
CN109327608B (en) | Song sharing method, terminal, server and system | |
CN111918090B (en) | Live broadcast picture display method and device, terminal and storage medium | |
US20220191557A1 (en) | Method for displaying interaction data and electronic device | |
CN110248236B (en) | Video playing method, device, terminal and storage medium | |
CN110533585B (en) | Image face changing method, device, system, equipment and storage medium | |
CN109922356B (en) | Video recommendation method and device and computer-readable storage medium | |
CN111083526B (en) | Video transition method and device, computer equipment and storage medium | |
CN110139143B (en) | Virtual article display method, device, computer equipment and storage medium | |
CN113490010B (en) | Interaction method, device and equipment based on live video and storage medium | |
CN112583806B (en) | Resource sharing method, device, terminal, server and storage medium | |
CN111711838B (en) | Video switching method, device, terminal, server and storage medium | |
CN112104648A (en) | Data processing method, device, terminal, server and storage medium | |
WO2022227581A1 (en) | Resource display method and computer device | |
CN114245218B (en) | Audio and video playing method and device, computer equipment and storage medium | |
CN114116053A (en) | Resource display method and device, computer equipment and medium | |
CN111628925A (en) | Song interaction method and device, terminal and storage medium | |
CN113204671A (en) | Resource display method, device, terminal, server, medium and product | |
CN110337042B (en) | Song on-demand method, on-demand order processing method, device, terminal and medium | |
CN113271470B (en) | Live broadcast wheat connecting method, device, terminal, server and storage medium | |
CN111294551B (en) | Method, device and equipment for audio and video transmission and storage medium |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
PB01 | Publication | ||
PB01 | Publication | ||
SE01 | Entry into force of request for substantive examination | ||
SE01 | Entry into force of request for substantive examination | ||
GR01 | Patent grant | ||
GR01 | Patent grant |