WO2024051615A1 - 多媒体组件触发方法、装置、电子设备及存储介质 - Google Patents
多媒体组件触发方法、装置、电子设备及存储介质 Download PDFInfo
- Publication number
- WO2024051615A1 WO2024051615A1 PCT/CN2023/116623 CN2023116623W WO2024051615A1 WO 2024051615 A1 WO2024051615 A1 WO 2024051615A1 CN 2023116623 W CN2023116623 W CN 2023116623W WO 2024051615 A1 WO2024051615 A1 WO 2024051615A1
- Authority
- WO
- WIPO (PCT)
- Prior art keywords
- target
- video
- component
- hidden
- trigger area
- Prior art date
Links
- 238000000034 method Methods 0.000 title claims abstract description 69
- 230000001960 triggered effect Effects 0.000 claims abstract description 47
- 230000004044 response Effects 0.000 claims abstract description 28
- 238000001514 detection method Methods 0.000 claims abstract description 21
- 230000006870 function Effects 0.000 claims description 56
- 238000004590 computer program Methods 0.000 claims description 16
- 241000721701 Lynx Species 0.000 claims description 6
- 238000010586 diagram Methods 0.000 description 28
- 235000013601 eggs Nutrition 0.000 description 12
- 230000008569 process Effects 0.000 description 11
- 238000005516 engineering process Methods 0.000 description 8
- 230000003287 optical effect Effects 0.000 description 6
- 230000003993 interaction Effects 0.000 description 5
- 230000002452 interceptive effect Effects 0.000 description 5
- 238000012545 processing Methods 0.000 description 5
- 230000001737 promoting effect Effects 0.000 description 4
- 230000008859 change Effects 0.000 description 3
- 238000004891 communication Methods 0.000 description 3
- 230000000694 effects Effects 0.000 description 2
- 239000013307 optical fiber Substances 0.000 description 2
- 230000000644 propagated effect Effects 0.000 description 2
- 239000004065 semiconductor Substances 0.000 description 2
- 101000822695 Clostridium perfringens (strain 13 / Type A) Small, acid-soluble spore protein C1 Proteins 0.000 description 1
- 101000655262 Clostridium perfringens (strain 13 / Type A) Small, acid-soluble spore protein C2 Proteins 0.000 description 1
- 101000655256 Paraclostridium bifermentans Small, acid-soluble spore protein alpha Proteins 0.000 description 1
- 101000655264 Paraclostridium bifermentans Small, acid-soluble spore protein beta Proteins 0.000 description 1
- 230000006399 behavior Effects 0.000 description 1
- 230000001788 irregular Effects 0.000 description 1
- 239000004973 liquid crystal related substance Substances 0.000 description 1
- 238000013507 mapping Methods 0.000 description 1
- 230000007246 mechanism Effects 0.000 description 1
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
- G06F3/0481—Interaction techniques based on graphical user interfaces [GUI] based on specific properties of the displayed interaction object or a metaphor-based environment, e.g. interaction with desktop elements like windows or icons, or assisted by a cursor's changing behaviour or appearance
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
- G06F3/0484—Interaction techniques based on graphical user interfaces [GUI] for the control of specific functions or operations, e.g. selecting or manipulating an object, an image or a displayed text element, setting a parameter value or selecting a range
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
- G06F3/0487—Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser
- G06F3/0488—Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser using a touch-screen or digitiser, e.g. input of commands through traced gestures
- G06F3/04883—Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser using a touch-screen or digitiser, e.g. input of commands through traced gestures for inputting data by handwriting, e.g. gesture or text
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
- H04N21/442—Monitoring of processes or resources, e.g. detecting the failure of a recording device, monitoring the downstream bandwidth, the number of times a movie has been viewed, the storage space available from the internal hard disk
Definitions
- the embodiments of the present disclosure relate to the field of Internet technology, and in particular, to a multimedia component triggering method, device, electronic device, and storage medium.
- Embodiments of the present disclosure provide a multimedia component triggering method, device, electronic device, and storage medium.
- embodiments of the present disclosure provide a multimedia component triggering method, including:
- the target trigger area is the contact area of the gesture operation on the video playback interface, and the video playback interface is used to play the currently displayed target video; detect The target trigger area, and according to the detection result, triggers a hidden component or a video component, wherein the hidden component is used to display the corresponding target page in the video playback interface after being triggered, and the video component is used to After being triggered, the first application function is executed for the target video.
- an embodiment of the present disclosure provides a multimedia component triggering device, including:
- a response module that responds to a gesture operation on the video playback interface and determines a target trigger area.
- the target trigger area is the contact area of the gesture operation on the video playback interface.
- the video playback interface is used to play the currently displayed target. video;
- a trigger module detects the target trigger area, and triggers a hidden component or a video component according to the detection result, wherein the hidden component is used to display the corresponding target page in the video playback interface after being triggered, and the The video component is used to execute the first application function for the target video after being triggered.
- an electronic device including:
- a processor and a memory communicatively connected to the processor
- the memory stores computer execution instructions
- the processor executes computer execution instructions stored in the memory to implement the multimedia component triggering method described in the first aspect and various possible designs of the first aspect.
- embodiments of the present disclosure provide a computer-readable storage medium.
- Computer-executable instructions are stored in the computer-readable storage medium.
- the processor executes the computer-executable instructions, the above first aspect and the first aspect are implemented. square
- the described multimedia component triggering method faces various possible designs.
- embodiments of the present disclosure provide a computer program product, including a computer program that, when executed by a processor, implements the multimedia component triggering method described in the first aspect and various possible designs of the first aspect.
- embodiments of the present disclosure provide a computer program that, when executed by a processor, implements the multimedia component triggering method described in the first aspect and various possible designs of the first aspect.
- the multimedia component triggering method, device, electronic device and storage medium determine the target triggering area by responding to the gesture operation on the video playback interface.
- the target trigger area is the gesture operation on the video playback interface.
- the video playback interface is used to play the currently displayed target video; detect the target trigger area, and trigger the hidden component or video component according to the detection result, wherein the hidden component is used to trigger the , display the corresponding target page in the video playback interface, and the video component is used to execute the first application function for the target video after being triggered.
- Figure 1 is an application scenario diagram of the multimedia component triggering method provided by an embodiment of the present disclosure
- FIG. 2 is a schematic flowchart 1 of a multimedia component triggering method provided by an embodiment of the present disclosure
- Figure 3 is a schematic diagram of a video playback interface provided by an embodiment of the present disclosure.
- Figure 4 is a schematic diagram of a target triggering area provided by an embodiment of the present disclosure.
- FIG. 5 is a flow chart of the specific implementation of step S101 in the embodiment shown in Figure 2;
- Figure 6 is a schematic diagram of a process for determining a target trigger area provided by an embodiment of the present disclosure
- FIG. 7 is a flow chart of the specific implementation of step S102 in the embodiment shown in Figure 2;
- Figure 8 is a schematic diagram of a process for determining a trigger hidden component provided by an embodiment of the present disclosure
- Figure 9 is a schematic diagram of a dynamic target object provided by an embodiment of the present disclosure.
- Figure 10 is a schematic flowchart 2 of a multimedia component triggering method provided by an embodiment of the present disclosure
- Figure 11 is a schematic logical structure diagram of a video playback interface provided by an embodiment of the present disclosure.
- Figure 12 is a schematic diagram of a process for triggering a hidden component through a long press gesture operation according to an embodiment of the present disclosure
- Figure 13 is a schematic diagram of triggering a hidden component based on a page container according to an embodiment of the present disclosure
- Figure 14 is a structural block diagram of a multimedia component triggering device provided by an embodiment of the present disclosure.
- Figure 15 is a schematic structural diagram of an electronic device provided by an embodiment of the present disclosure.
- Figure 16 is a schematic diagram of the hardware structure of an electronic device provided by an embodiment of the present disclosure.
- FIG 1 is an application scenario diagram of a multimedia component triggering method provided by an embodiment of the present disclosure.
- the multimedia component triggering method provided by an embodiment of the present disclosure can be applied to the application scenario of short video playback. More specifically, it can be applied to short video playback.
- the method provided by the embodiment of the present disclosure can be applied to terminal devices, such as smart phones, tablet computers, etc. Among them, for example, a short video application is running in the terminal device. During the process of the terminal device playing the target video (short video) through the video playback interface of the application, some hidden information is hidden in the video playback interface. , that is, an "Easter egg".
- short video applications based on feed streaming technology can only implement simple interactive operations such as video switching and video likes for the currently played video, but cannot add more complex interactive operations, such as in short videos.
- the video component used to display videos in short video applications has a native operation mode preset by the application, such as a long press gesture. Operation can realize the "like" function of the currently playing video; sliding up and down gesture operation can realize the "switch" function of the currently playing video.
- the easter egg is a page display mode that improves interactive fun and content display diversity by hiding trigger controls (without displaying the location of the trigger controls). The user is required to trigger hidden components in a specific area through gesture operations.
- Embodiments of the present disclosure provide a multimedia component triggering method to solve the above problems.
- FIG 2 is a schematic flowchart 1 of a multimedia component triggering method provided by an embodiment of the present disclosure.
- the method of this embodiment can be applied in terminal devices.
- the multimedia component triggering method includes:
- Step S101 In response to the gesture operation on the video playback interface, determine the target trigger area.
- the target trigger area is the contact area of the gesture operation on the video playback interface.
- the video playback interface is used to play the currently displayed target video.
- the execution subject of the method provided in this embodiment may be a terminal device, such as a smart phone, a tablet, etc.
- the terminal device runs an application for playing videos, more specifically, for example, a short video application based on feed streaming technology, in which the application plays short videos through a video playback interface.
- Figure 3 is a schematic diagram of a video playback interface provided by an embodiment of the present disclosure.
- the video playback interface can be a functional module implemented in the target application based on the functional class for playing videos provided by the operating system.
- Video playback While playing the target video the interface can respond to the user's gesture operations on the video playback interface and execute corresponding application functions, such as switching videos through sliding gestures, collecting videos through long press gestures, etc.
- the interaction unit can determine the gesture by checking the gesture operation Operate on the contact area on the video playback interface, which is the target trigger area.
- Figure 4 is a schematic diagram of a target trigger area provided by an embodiment of the present disclosure.
- the interaction unit is, for example, a touch screen
- the gesture operation is, for example, a click gesture.
- the click gesture is applied to the touch screen of the terminal device, it will cause The touch screen capacitance changes.
- the touch screen determines the specific contact position of the click gesture by detecting the capacitance change.
- the target triggering area is determined according to the area to which the contact coordinate belongs, where the contact coordinate is located inside the target triggering area.
- the outline shape of the target triggering area can be implemented in various ways, such as non-rectangular, circular or other irregular shapes, which will not be described in detail here.
- step S102 includes:
- Step S1011 Detect the contact coordinates corresponding to the gesture operation.
- the contact coordinates represent the coordinates of the contact point of the gesture operation on the video playback interface.
- Step S1012 According to the contact coordinates, determine the hidden trigger area within the first distance from the contact coordinates as the target trigger area, where the hidden trigger area is an area where hidden components are provided.
- one possible implementation is to determine the target trigger area corresponding to the contact coordinates according to the preset mapping relationship between the contact coordinates and the trigger area. This implementation The method will not be described again.
- the contact coordinate is used to search for a hidden trigger area within a preset range centered on the contact coordinate. If the preset range includes a hidden trigger area, the hidden trigger area is determined as the target trigger area.
- Figure 6 is a schematic diagram of a process for determining a target trigger area provided by an embodiment of the present disclosure. As shown in Figure 6, after determining the contact coordinate A, a circle with the contact coordinate A as the center and the first distance R as the radius is detected. Area Zoom_1, after detection, the preset hidden trigger area Zoom_2 partially overlaps with Zoom_1, then the hidden trigger area is considered to be within the first distance from the contact coordinates, and then the hidden trigger area Zoom_2 is determined as the target trigger area.
- the target trigger area is prioritized to be within the hidden trigger area. Since in the application scenario of triggering Easter eggs (hidden information) in short videos, Easter eggs are usually invisible, which may cause inaccurate user gesture operations. Through the steps of this embodiment, automatic adjustment of the contact coordinates when they are located in the surrounding area of the hidden trigger area can be achieved, thereby increasing the probability of the user triggering the Easter egg. Improve user experience.
- Step S102 Detect the target trigger area, and trigger the hidden component or video component according to the detection result.
- the hidden component is used to display the corresponding target page in the video playback interface after being triggered, and the video component is used to display the corresponding target page after being triggered. , execute the first application function for the target video.
- the target triggering area is further detected, and the obtained detection results are used to determine whether the target triggering area is specifically used to trigger the hidden component or the video component. If the target trigger area is used to trigger a hidden component, the hidden component will be triggered. After calling the corresponding program, the corresponding target page will be displayed in the video playback interface to achieve the purpose of triggering the hidden information; if the target trigger area is used to trigger the video component, the video component is triggered, and after calling the corresponding program, the first application function is executed for the target video, and conventional application functions for the target video are implemented, such as likes, favorites, video switching, etc.
- step S102 the position of the hidden trigger area changes dynamically as the target video is played.
- the specific implementation steps of step S102 include:
- Step S1021 Detect the position of the target trigger area.
- Step S1022 If the target trigger area is located within the recognition outline of the target object in the target video, trigger the hidden component, where the target object is obtained by image recognition of the current frame of the target video.
- Step S1023 If the target trigger area is located outside the recognition outline of the target object in the target video, trigger the video component.
- the target object is an image element determined based on the semantic information of the target video, such as a face, a person, and a characteristic object, such as a car, a house, etc. in the video. It can be obtained through image recognition technology and will not be described again here.
- After detecting the position of the target trigger area it is determined based on the position of the target trigger area whether the target trigger area falls within the recognition contour of the target object in the target video, where the recognition contour refers to the outward extension of the outline of the target object.
- the contour is formed after the preset distance. The preset distance is greater than or equal to 0.
- the area corresponding to the identified contour is the hidden trigger area.
- the target trigger area belongs to the hidden trigger area, and then the hidden component is triggered, and the subsequent corresponding calling program is executed; if it does not fall within the recognition contour of the target object, then The target trigger zone The domain does not belong to the hidden trigger area, and then the video component is triggered and the subsequent corresponding calling program is executed.
- FIG 8 is a schematic diagram of a process for determining a trigger hidden component provided by an embodiment of the present disclosure.
- the target video includes two target objects, which are the "smartphone” and the “promotion display board” in the target video. , among which, “smartphone” and “promotional display board” respectively correspond to a recognition outline.
- “smartphone” and “promotional display board” respectively correspond to a recognition outline.
- Hidden components corresponding to smartphones such as displaying target page A on the video playback interface, which is used to display the parameters of the smartphone; if the target trigger area falls within the recognition outline corresponding to the "promotion display board", the target page A is triggered.
- Hidden components corresponding to the promotional display board such as displaying target page B on the video playback interface, which is used to display videos of promotional activities for the smartphone; in addition, if the target trigger area does not fall into the identification corresponding to "smartphone” within the outline, and does not fall within the recognition outline corresponding to the "Promotion Display Board", that is, the target trigger area is outside the recognition outline of the target object in the target video, then the corresponding video component is triggered according to the specific gesture operation, such as collecting the current The target video to play.
- the position of the target object dynamically changes with the playback of the target video.
- step S1021 it also includes:
- the content of the target video will change as the playback progresses, that is, the content displayed in the current frame of the target video will change.
- the target video corresponds to
- the target objects may be in the same or different locations, and the target objects may or may not exist.
- Figure 9 is a schematic diagram of a dynamic target object provided by an embodiment of the present disclosure.
- the target object is such as the "promotion display board” in Figure 9.
- the "promotion display board” is located on the left side of the target video (current video frame).
- the “promotion display board” is located on the right side of the target video (current video frame).
- the "promotion display board” is located outside the target video (current video frame), that is, there is no target object in the target video.
- step S1020 re-execute the above steps, and re-detect the target object and gesture operation.
- the dynamic hidden trigger area for the target video is realized, so that the hidden trigger area can follow the specific target object in real time, improving multimedia components. Trigger flexibility and fun.
- the target trigger area is determined by responding to the gesture operation on the video playback interface.
- the target trigger area is the contact area of the gesture operation on the video playback interface.
- the video playback interface is used to play the currently displayed target video; detecting the target Trigger the area, and trigger the hidden component or video component according to the detection result.
- the hidden component is used to display the corresponding target page in the video playback interface after being triggered, and the video component is used to execute the target video after being triggered.
- First application function After the terminal device detects the gesture operation on the video playback page, it first determines the corresponding target trigger area based on the gesture operation, and then determines that the hidden component or video component should be triggered based on the detection results of the target trigger area, thus avoiding hidden components. Operational conflicts with video components enable normal triggering of hidden components, thereby improving the interactive fun and content display diversity during video playback in hidden information triggering mode.
- FIG. 10 is a schematic flowchart 2 of a multimedia component triggering method provided by an embodiment of the present disclosure. Based on the embodiment shown in Figure 2, this embodiment further refines step S102, in which the video playback interface includes overlapping settings. Video container and page container, where the page container is above the video container.
- the multimedia component triggering method provided in this embodiment includes:
- Step S201 Set the page container to a visible state, and display the indicator mark corresponding to the hidden component in the page container.
- the indicator mark is used to indicate the trigger area corresponding to the hidden component.
- FIG. 11 is a schematic logical structure diagram of a video playback interface provided by an embodiment of the present disclosure.
- the video playback interface includes overlapping video containers and page containers.
- the video containers and page containers each correspond to a layer (Layer). Therefore, Video containers and page containers can also be called video container layers and page container layers.
- the page container is positioned above the video container, but the page container is not visible.
- the video container is used to display the target video and set the video component
- the page container is used to display the target page and set the hidden component
- the page container is not visible before responding to the gesture operation on the video playback interface.
- both the video container and the page container are software modules, implemented through corresponding classes. For example, the video container is implemented based on canvas; the page container is implemented based on lynx container.
- step S201 is an optional step in this embodiment, and this embodiment can perform subsequent steps without executing step S201.
- Step S202 In response to the gesture operation on the video playback interface, determine the target trigger area.
- the target trigger area is the contact area of the gesture operation on the video playback interface.
- the video playback interface is used to play the currently displayed target video.
- the terminal device will detect the gesture operation and determine the corresponding target trigger area.
- the specific implementation of this step has been performed in step S101 of the embodiment shown in Figure 2 The specific introduction will not be repeated here.
- the terminal device After that, based on the obtained target trigger area, the terminal device first detects the page container to determine whether there are hidden components in the target trigger area of the page container.
- the specific implementation method is implemented by calling the corresponding functional interface of the page container, which will not be described again.
- both the page container and the application container can be used to respond to the user's gesture operation.
- the page container is superimposed on the application container.
- Both the page container and the application container need to respond to gesture operations, thus causing logic conflicts.
- the target trigger area of the page container is first detected.
- the first calling function corresponding to the hidden component is called to implement the corresponding function. , that is, the corresponding target page is displayed in the page container to trigger the hidden information; then, if there is no hidden component in the target trigger area of the page container, the second calling function corresponding to the video component in the video container is called to realize the corresponding
- the function is to perform the first application function, such as liking a video. This solves the problem of logical conflicts between page containers and application containers.
- the page container is a lynx container
- the video container is a canvas container.
- the terminal device the target application running inside
- the default behavior is that the upper element will consume the event regardless of whether it has a bound click call function.
- the event The target detection mechanism continues to execute until it finds to the bottom video element. After the user presses and holds the guidance gesture, the level of the page container rises to the highest level, and the full-screen target page is played.
- step S204 includes:
- the guidance logo is displayed.
- the hidden component corresponding to the target trigger area is triggered, and the target page corresponding to the hidden component is displayed in the video playback interface.
- the user's gesture operation may cause accidental touches.
- the duration of the "long press gesture” operation is too short, it may be confused with the "click gesture” operation, resulting in an accidental touch and affecting the interactive experience.
- Figure 12 is a schematic diagram of a process for triggering hidden components through a long press gesture operation according to an embodiment of the present disclosure.
- the terminal device displays on the video playback interface A guidance logo.
- the guidance logo can be an icon that changes over time.
- the guidance logo is a donut-shaped progress bar.
- the donut-shaped progress bar Keep moving forward.
- the long press gesture operation continues for the first time, the progress bar reaches the end.
- the hidden component corresponding to the target trigger area is triggered, and the target page is displayed on the page container.
- the target page is used to play Easter egg videos, for example.
- the hidden component is triggered, thereby avoiding errors and improving interaction efficiency and user experience.
- Step S205 If there is no hidden component in the target trigger area of the page container, call the second calling function corresponding to the video component in the video container, and execute the first application function based on the calling result of the second calling function.
- the video container for the target application is usually full-screen
- gesture operations performed anywhere in the video playback interface can trigger the video component. Therefore, if the target of the page container If there is no hidden component in the trigger area, it means that this area is not a hidden trigger area. At this time, the video component of the video container is triggered and the second calling function corresponding to the video component is called, thereby achieving control of the target video and executing the first application Function.
- Figure 13 is a schematic diagram of triggering a hidden component based on a page container provided by an embodiment of the present disclosure. As shown in Figure 13, the page container overlaps the upper layer of the video container.
- the page container is first determined. Whether there is a hidden component in the target trigger area. If there is a hidden component, the page container consumes the trigger event and displays the target page in full screen in the page container (triggering the hidden component); if there is no hidden component, the trigger event passes through the page container and reaches Video container, and consume the trigger event through the video container to execute the first application function, such as liking the video.
- the hidden component in the target trigger area of the page container is first detected, and based on the detection result, the hidden component or the video component is triggered, thus avoiding the conflict between the hidden component and the video component. Logical conflict.
- FIG. 14 is a structural block diagram of a multimedia component triggering device provided in an embodiment of the present disclosure. For convenience of explanation, only parts related to the embodiments of the present disclosure are shown.
- the multimedia component triggering device 3 includes:
- the response module 31 is used to respond to the gesture operation on the video playback interface and determine the target trigger area.
- the target trigger area is the contact area of the gesture operation on the video playback interface.
- the video playback interface is used to play the currently displayed target video;
- the trigger module 32 is used to detect the target trigger area, and trigger the hidden component or video component according to the detection result.
- the hidden component is used to display the corresponding target page in the video playback interface after being triggered, and the video component is used to display the corresponding target page in the video playback interface. After being triggered, the first application function is executed for the target video.
- the response module 31 is specifically configured to: obtain the contact coordinates corresponding to the gesture operation, the contact coordinates represent the coordinates of the contact point of the gesture operation on the video playback interface; according to the contact coordinates, calculate the distance from the contact coordinates to The hidden trigger area within a certain distance is determined as the target trigger area, where the hidden trigger area is an area where hidden components are set.
- the trigger module 32 is specifically configured to: detect the target object in the target video in real time; if the target trigger area is located within the recognition outline of the target object in the target video, trigger the hidden component, where the target The object is obtained by performing image recognition on the current frame of the target video; if the target trigger area is located outside the recognition outline of the target object in the target video, the video component is triggered.
- the video playback interface includes a video container and a page container arranged overlappingly, wherein the video container is used to display the target video and set video components, the page container is used to display the target page and set hidden components, and the page container Invisible until responding to a gesture on the video playback interface.
- the trigger module 32 is specifically configured to: detect the target trigger area of the page container; if there is a hidden component in the target trigger area of the page container, call the first calling function corresponding to the hidden component, and based on the first Once the call result of the function is called, the corresponding target page is displayed in the page container.
- the trigger module 32 is also configured to: if there is no hidden component in the target trigger area of the page container, call the second calling function corresponding to the video component in the video container, and based on the second calling function As a result of the call, the first application function is executed.
- the video container is implemented based on canvas; the page container is implemented based on lynx container.
- the trigger module 32 before determining the target trigger area in response to a gesture operation on the video playback interface, is also configured to: set the page container to a visible state, and display the hidden component corresponding to the page container.
- the indicator is used to indicate the trigger area corresponding to the hidden component.
- the gesture operation is a long press gesture operation; before triggering the hidden component, the trigger module 32 is further configured to: display a guidance logo in response to the long press gesture operation;
- the trigger module 32 is specifically configured to: after detecting that the long press gesture operation lasts for a first duration, trigger the hidden component corresponding to the target trigger area, and display the target page corresponding to the hidden component in the video playback interface.
- the multimedia component triggering device 3 provided in this embodiment can execute the technical solution of the above method embodiment. Its implementation principles and technical effects are similar, and will not be described again in this embodiment.
- FIG 15 is a schematic structural diagram of an electronic device provided by an embodiment of the present disclosure. As shown in Figure 15, the electronic device 4 includes:
- Processor 41 and memory 42 communicatively connected to processor 41;
- Memory 42 stores computer execution instructions
- the processor 41 executes the computer execution instructions stored in the memory 42 to implement the multimedia component triggering method in the embodiment shown in FIGS. 2 to 13 .
- processor 41 and the memory 42 are connected through the bus 43 .
- the electronic device 900 may be a terminal device or a server.
- the terminal devices may include, but are not limited to, mobile phones, notebook computers, digital broadcast receivers, personal digital assistants (Personal Digital Assistant, PDA), tablet computers (Portable Android Device, PAD), portable multimedia players (Portable Media Player , PMP), mobile terminals such as vehicle-mounted terminals (such as vehicle-mounted navigation terminals), and fixed terminals such as digital televisions (Television, TV), desktop computers, etc.
- PDA Personal Digital Assistant
- PMP portable multimedia players
- mobile terminals such as vehicle-mounted terminals (such as vehicle-mounted navigation terminals)
- fixed terminals such as digital televisions (Television, TV), desktop computers, etc.
- the electronic device shown in FIG. 16 is only an example and should not impose any limitations on the functions and scope of use of the embodiments of the present disclosure.
- the electronic device 900 may include a processing device (such as a central processing unit, a graphics processor, etc.) 901, which may process data according to a program stored in a read-only memory (Read Only Memory, ROM) 902 or from a storage device 908
- the program loaded into the random access memory (Random Access Memory, RAM) 903 performs various appropriate actions and processes.
- RAM 903 various programs and data required for the operation of the electronic device 900 are also stored.
- the processing device 901, ROM 902 and RAM 903 are connected to each other via a bus 904.
- An input/output (I/O) interface 905 is also connected to bus 904.
- the following devices can be connected to the I/O interface 905: input devices 906 including, for example, a touch screen, touch pad, keyboard, mouse, camera, microphone, accelerometer, gyroscope, etc.; including, for example, a Liquid Crystal Display (LCD) , an output device 907 such as a speaker, a vibrator, etc.; a storage device 908 including a magnetic tape, a hard disk, etc.; and a communication device 909.
- the communication device 909 may allow the electronic device 900 to communicate wirelessly or wiredly with other devices to exchange data.
- FIG. 16 illustrates electronic device 900 with various means, it should be understood that implementation or availability of all illustrated means is not required. More or fewer means may alternatively be implemented or provided.
- embodiments of the present disclosure include a computer program product including a computer program carried on a computer-readable medium, the computer program containing program code for performing the method illustrated in the flowchart.
- the computer program may be downloaded and installed from the network via communication device 909, or from storage device 908, or from ROM 902.
- the processing device 901 the above-mentioned functions defined in the method of the embodiment of the present disclosure are performed.
- the computer-readable medium mentioned above in the present disclosure may be a computer-readable signal medium or a computer-readable storage medium, or any combination of the above two.
- the computer-readable storage medium may be, for example, but is not limited to, an electrical, magnetic, optical, electromagnetic, infrared, or semiconductor system, apparatus or device, or any combination thereof.
- Computer readable storage media may include, but are not limited to: an electrical connection having one or more wires, a portable computer disk, a hard drive, random access memory (RAM), read only memory (ROM), removable Programmable Read Only Memory (Erasable Programmable Read Only Memory, EPROM) or flash memory, optical fiber, portable compact disk read only memory (Compact Disc Read Only Memory, CD-ROM), optical storage device, magnetic storage device, or any of the above suitable combination.
- a computer-readable storage medium may be any tangible medium that contains or stores a program for use by or in connection with an instruction execution system, apparatus, or device.
- a computer-readable signal medium may include a data signal propagated in baseband or as part of a carrier wave, carrying computer-readable program code therein. Such propagated data signals may take many forms, including but not limited to electromagnetic signals, optical signals, or any suitable combination of the above.
- a computer-readable signal medium may also be any computer-readable medium other than a computer-readable storage medium that can send, propagate, or transmit a program for use by or in connection with an instruction execution system, apparatus, or device .
- Program code contained on a computer-readable medium can be transmitted using any appropriate medium, including but not limited to: wires, optical cables, radio frequency (Radio Frequency, RF), etc., or any suitable combination of the above.
- the above-mentioned computer-readable medium may be included in the above-mentioned electronic device; it may also exist independently without being assembled into the electronic device.
- the computer-readable medium carries one or more programs.
- the electronic device When the one or more programs are executed by the electronic device, the electronic device performs the method shown in the above embodiment.
- Computer program code for performing the operations of the present disclosure may be written in one or more programming languages, including object-oriented programming languages such as Java, Smalltalk, C++, and conventional Procedural programming language—such as "C" or a similar programming language.
- the program code may execute entirely on the user's computer, partly on the user's computer, as a stand-alone software package, partly on the user's computer and partly on the user's computer.
- Executed on a remote computer or entirely on a remote computer or server.
- the remote computer can be connected to the user's computer through any kind of network, including a Local Area Network (LAN) or a Wide Area Network (WAN), or it can be connected to an external computer ( For example, using an Internet service provider to connect via the Internet).
- LAN Local Area Network
- WAN Wide Area Network
- each block in the flowchart or block diagram may represent a module, segment, or portion of code that contains one or more logic functions that implement the specified executable instructions.
- the functions noted in the block may occur out of the order noted in the figures. For example, two blocks shown one after another may actually execute substantially in parallel, or they may sometimes execute in the reverse order, depending on the functionality involved.
- each block of the block diagram and/or flowchart illustration, and combinations of blocks in the block diagram and/or flowchart illustration can be implemented by special purpose hardware-based systems that perform the specified functions or operations. , or can be implemented using a combination of specialized hardware and computer instructions.
- the units involved in the embodiments of the present disclosure can be implemented in software or hardware.
- the name of the unit does not constitute a limitation on the unit itself under certain circumstances.
- the first acquisition unit can also be described as "the unit that acquires at least two Internet Protocol addresses.”
- exemplary types of hardware logic components include: Field-Programmable Gate Array (FPGA), Application Specific Integrated Circuit (Application Specific Integrated Circuit, ASIC), Application Specification Standard Product (Application Specification) Specific Standard Parts (ASSP), System On Chip (SOC), Complex Programmable Logic Device (CPLD), etc.
- FPGA Field-Programmable Gate Array
- ASIC Application Specific Integrated Circuit
- ASSP Application Specification Standard Product
- SOC System On Chip
- CPLD Complex Programmable Logic Device
- a machine-readable medium may be a tangible medium that may contain or store a program for use by or in connection with an instruction execution system, apparatus, or device.
- the machine-readable medium may be a machine-readable signal medium or a machine-readable storage medium.
- Machine-readable media may include, but are not limited to, electronic, magnetic, optical, electromagnetic, infrared, or semiconductor systems, devices or devices, or any suitable combination of the foregoing.
- machine-readable storage media may include an electrical connection based on one or more wires, a portable computer disk, a hard disk, random access memory (RAM), read only memory (ROM), erasable programmable read only memory (EPROM or flash memory), optical fiber, portable compact disk read-only memory (CD-ROM), optical storage device, magnetic storage device, or any suitable combination of the above.
- RAM random access memory
- ROM read only memory
- EPROM or flash memory erasable programmable read only memory
- CD-ROM portable compact disk read-only memory
- magnetic storage device or any suitable combination of the above.
- a multimedia component triggering method including:
- the target trigger area is the contact area of the gesture operation on the video playback interface, and the video playback interface is used to play the currently displayed target video; detect The target trigger area, and according to the detection result, triggers a hidden component or a video component, wherein the hidden component is used to display the corresponding target page in the video playback interface after being triggered, and the video component is used to After being triggered, the first application function is executed for the target video.
- determining the target trigger area in response to a gesture operation on a video playback interface includes: obtaining contact coordinates corresponding to the gesture operation, and the contact coordinates represent where the gesture operation is located. The coordinates of the contact point on the video playback interface; according to the contact coordinates, a hidden trigger area within a first distance from the contact coordinates is determined as the target trigger area, wherein the hidden trigger area is provided with A region that hides components.
- detecting the target trigger area and triggering a hidden component or a video component according to the detection result includes: detecting the target object in the target video in real time; if the target trigger area is located in the target video If the target trigger area is located within the recognition outline of the target object in the target video, the hidden component is triggered, wherein the target object is obtained by image recognition for the current frame of the target video; if the target trigger area is located in the target video If the target object is outside the recognized outline, the video component is triggered.
- the video playback interface includes a video container and a page container arranged overlappingly, wherein the video container is used to display the target video and set the video component, and the page container Used to display the target page and set the hidden component, the page container is not visible before the gesture operation in response to the video playback interface.
- detecting the target trigger area, and triggering a hidden component or a video component according to the detection result includes: detecting the target trigger area of the page container; if the target trigger area of the page container If there is a hidden component in the area, the first calling function corresponding to the hidden component is called, and the corresponding target page is displayed in the page container according to the calling result of the first calling function.
- the method further includes: if there is no hidden component in the target trigger area of the page container, calling a second calling function corresponding to the video component in the video container, and based on The calling result of the second calling function executes the first application function.
- the video container is implemented based on canvas; the page container is implemented based on lynx container.
- the method before determining the target trigger area in response to a gesture operation on the video playback interface, the method further includes: setting the page container to a visible state, and displaying the page container in the page container. An indication mark corresponding to the hidden component, the indication mark being used to indicate the trigger area corresponding to the hidden component.
- the gesture operation is a long press gesture operation; before triggering the hidden component, the method further includes: displaying a guide logo in response to the long press gesture operation; triggering the hidden component , including: after detecting that the long press gesture operation continues for a first duration, triggering a hidden component corresponding to the target trigger area, and displaying a target page corresponding to the hidden component in the video playback interface.
- a multimedia component triggering device including:
- a response module configured to respond to a gesture operation on a video playback interface and determine a target trigger area.
- the target trigger area is the contact area of the gesture operation on the video playback interface.
- the video playback interface is used to play the current display. target video;
- a triggering module configured to detect the target triggering area, and trigger a hidden component or a video component according to the detection result, wherein the hidden component is used to display the corresponding target page in the video playback interface after being triggered,
- the video component is configured to execute a first application function for the target video after being triggered.
- the response module is specifically configured to: obtain the contact coordinates corresponding to the gesture operation, where the contact coordinates represent the coordinates of the contact point of the gesture operation on the video playback interface; According to the contact coordinates, a hidden trigger area within a first distance from the contact coordinates is determined as the target trigger area, wherein the hidden trigger area is an area where hidden components are provided.
- the trigger module is specifically configured to: detect the target object in the target video in real time; if the target trigger area is located within the recognition outline of the target object in the target video, trigger all The hidden component, wherein the target object is obtained by image recognition for the current frame of the target video; if the target trigger area is located outside the recognition outline of the target object in the target video, the video is triggered components.
- the video playback interface includes a video container and a page container arranged overlappingly, wherein the video container is used to display the target video and set the video component, and the page container is used to Show said target page and setting the hidden component, the page container is not visible before the gesture operation in response to the video playback interface.
- the trigger module is specifically configured to: detect the target trigger area of the page container; if there is a hidden component in the target trigger area of the page container, call the third component corresponding to the hidden component. A function is called, and according to the calling result of the first calling function, the corresponding target page is displayed in the page container.
- the trigger module is also configured to: if there is no hidden component in the target trigger area of the page container, call the second calling function corresponding to the video component in the video container, and Based on the calling result of the second calling function, the first application function is executed.
- the video container is implemented based on canvas; the page container is implemented based on lynx container.
- the trigger module before determining the target trigger area in response to a gesture operation on the video playback interface, is further configured to: set the page container to a visible state, and set the page container to a visible state.
- An indicator mark corresponding to the hidden component is displayed inside, and the indicator mark is used to indicate the trigger area corresponding to the hidden component.
- the gesture operation is a long press gesture operation; before triggering the hidden component, the trigger module is further configured to: display a guidance logo in response to the long press gesture operation;
- the triggering module is specifically configured to: after detecting that the long press gesture operation lasts for a first duration, trigger the hidden component corresponding to the target trigger area, and display the corresponding hidden component in the video playback interface. Describe the target page corresponding to the hidden component.
- an electronic device including: a processor, and a memory communicatively connected to the processor;
- the memory stores computer execution instructions
- the processor executes computer execution instructions stored in the memory to implement the multimedia component triggering method described in the first aspect and various possible designs of the first aspect.
- a computer-readable storage medium is provided.
- Computer-executable instructions are stored in the computer-readable storage medium.
- a processor executes the computer-executed instructions, Implement the multimedia component triggering method as described in the first aspect and various possible designs of the first aspect.
- embodiments of the present disclosure provide a computer program product, including a computer program that, when executed by a processor, implements the multimedia component triggering method described in the first aspect and various possible designs of the first aspect.
- embodiments of the present disclosure provide a computer program that, when executed by a processor, implements the multimedia component triggering method described in the first aspect and various possible designs of the first aspect.
Landscapes
- Engineering & Computer Science (AREA)
- General Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- Human Computer Interaction (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Computer Networks & Wireless Communication (AREA)
- Databases & Information Systems (AREA)
- Multimedia (AREA)
- Signal Processing (AREA)
- User Interface Of Digital Computer (AREA)
Abstract
本公开实施例提供一种多媒体组件触发方法、装置、电子设备及存储介质,通过响应针对视频播放界面的手势操作,确定目标触发区域,目标触发区域为手势操作在视频播放界面上的接触区域,视频播放界面用于播放当前显示的目标视频;检测目标触发区域,并根据检测结果,触发隐藏组件或者视频组件,其中,隐藏组件用于在被触发后,在视频播放界面内显示对应的目标页面,视频组件用于在被触发后,针对目标视频执行第一应用功能。
Description
相关申请交叉引用
本申请要求于2022年09月08日提交中国专利局、申请号为202211098310.2、发明名称为“多媒体组件触发方法、装置、电子设备及存储介质”的中国专利申请的优先权,其全部内容通过引用并入本文。
本公开实施例涉及互联网技术领域,尤其涉及一种多媒体组件触发方法、装置、电子设备及存储介质。
当前,基于互联网的短视频应用(Application),凭借其自由发布、内容丰富等优点,受到越来越多用户的认可。现有技术中,此类短视频应用通常是基于feed流技术向终端设备推送视频,用户通过上下滑动等手势操作,即可在终端设备一侧方便的进行视频观看。
发明内容
本公开实施例提供一种多媒体组件触发方法、装置、电子设备及存储介质。
第一方面,本公开实施例提供一种多媒体组件触发方法,包括:
响应针对视频播放界面的手势操作,确定目标触发区域,所述目标触发区域为所述手势操作在所述视频播放界面上的接触区域,所述视频播放界面用于播放当前显示的目标视频;检测所述目标触发区域,并根据检测结果,触发隐藏组件或者视频组件,其中,所述隐藏组件用于在被触发后,在所述视频播放界面内显示对应的目标页面,所述视频组件用于在被触发后,针对所述目标视频执行第一应用功能。
第二方面,本公开实施例提供一种多媒体组件触发装置,包括:
响应模块,响应针对视频播放界面的手势操作,确定目标触发区域,所述目标触发区域为所述手势操作在所述视频播放界面上的接触区域,所述视频播放界面用于播放当前显示的目标视频;
触发模块,检测所述目标触发区域,并根据检测结果,触发隐藏组件或者视频组件,其中,所述隐藏组件用于在被触发后,在所述视频播放界面内显示对应的目标页面,所述视频组件用于在被触发后,针对所述目标视频执行第一应用功能。
第三方面,本公开实施例提供一种电子设备,包括:
处理器,以及与所述处理器通信连接的存储器;
所述存储器存储计算机执行指令;
所述处理器执行所述存储器存储的计算机执行指令,以实现如上第一方面以及第一方面各种可能的设计所述的多媒体组件触发方法。
第四方面,本公开实施例提供一种计算机可读存储介质,所述计算机可读存储介质中存储有计算机执行指令,当处理器执行所述计算机执行指令时,实现如上第一方面以及第一方
面各种可能的设计所述的多媒体组件触发方法。
第五方面,本公开实施例提供一种计算机程序产品,包括计算机程序,该计算机程序被处理器执行时实现如上第一方面以及第一方面各种可能的设计所述的多媒体组件触发方法。
第六方面,本公开实施例提供一种计算机程序,该计算机程序被处理器执行时实现如上第一方面以及第一方面各种可能的设计所述的多媒体组件触发方法。
本公开实施例提供的多媒体组件触发方法、装置、电子设备及存储介质,通过响应针对视频播放界面的手势操作,确定目标触发区域,所述目标触发区域为所述手势操作在所述视频播放界面上的接触区域,所述视频播放界面用于播放当前显示的目标视频;检测所述目标触发区域,并根据检测结果,触发隐藏组件或者视频组件,其中,所述隐藏组件用于在被触发后,在所述视频播放界面内显示对应的目标页面,所述视频组件用于在被触发后,针对所述目标视频执行第一应用功能。
为了更清楚地说明本公开实施例或现有技术中的技术方案,下面将对实施例或现有技术描述中所需要使用的附图作一简单地介绍,显而易见地,下面描述中的附图是本公开的一些实施例,对于本领域普通技术人员来讲,在不付出创造性劳动性的前提下,还可以根据这些附图获得其他的附图。
图1为本公开实施例提供的多媒体组件触发方法的一种应用场景图;
图2为本公开实施例提供的多媒体组件触发方法的流程示意图一;
图3为本公开实施例提供的一种视频播放界面的示意图;
图4为本公开实施例提供的一种目标触发区域的示意图;
图5为图2所示实施例中步骤S101的具体实现方式流程图;
图6为本公开实施例提供的一种确定目标触发区域的过程示意图;
图7为图2所示实施例中步骤S102的具体实现方式流程图;
图8为本公开实施例提供的一种确定触发隐藏组件的过程示意图;
图9为本公开实施例提供的一种动态目标对象的示意图;
图10为本公开实施例提供的多媒体组件触发方法的流程示意图二;
图11为本公开实施例提供的一种视频播放界面的逻辑结构示意图;
图12为本公开实施例提供的一种通过长按手势操作触发隐藏组件的过程示意图;
图13为本公开实施例提供的一种基于页面容器触发隐藏组件的示意图;
图14为本公开实施例提供的多媒体组件触发装置的结构框图;
图15为本公开实施例提供的一种电子设备的结构示意图;
图16为本公开实施例提供的电子设备的硬件结构示意图。
为使本公开实施例的目的、技术方案和优点更加清楚,下面将结合本公开实施例中的附图,对本公开实施例中的技术方案进行清楚、完整地描述,显然,所描述的实施例是本公开一部分实施例,而不是全部的实施例。基于本公开中的实施例,本领域普通技术人员在没有作出创造性劳动前提下所获得的所有其他实施例,都属于本公开保护的范围。
下面对本公开实施例的应用场景进行解释:
图1为本公开实施例提供的多媒体组件触发方法的一种应用场景图,本公开实施例提供的多媒体组件触发方法,可以应用于短视频播放的应用场景,更具体地,可以应用于在短视频中触发隐藏信息的应用场景中。如图1所示,本公开实施例提供的方法,可以应用于终端设备,例如智能手机、平板电脑等。其中,示例性地,终端设备内运行有短视频类的应用程序,在终端设备通过该应用程序的视频播放界面播放目标视频(短视频)过程中,视频播放界面中隐藏设置有某些隐藏信息,即“彩蛋”,当用户针对视频播放界面进行手势操作时,若触发彩蛋对应的多媒体组件(图中示为施加长按手势时触发彩蛋),则在视频播放界面的上层显示隐藏信息对应的隐藏页面,即“彩蛋页面”。更具体地,例如为宣传视频、促销活动页面等,从而实现在短视频中触发隐藏信息的目的。
现有技术中,在基于feed流技术的短视频应用中,针对当前播放的视频,仅能实现视频切换、视频点赞等简单的交互操作,而无法增加更复杂的交互操作,例如在短视频中触发彩蛋(彩蛋可参见图1所示应用场景的相关介绍)的操作,这是由于,短视频应用中用于显示视频的视频组件,具有应用程序预设的原生操作模式,例如长按手势操作,可以实现对当前播放视频的“点赞”功能;上下滑动手势操作,可以实现对当前播放视频的“切换”功能。而彩蛋则是一种通过隐藏触发控件(不对触发控件的位置进行显示),来提高交互趣味性和内容展示多样性的页面展示模式,需要用户通过手势操作对特定区域内的隐藏组件进行触发来实现,在该过程中,当隐藏组件的触发区域与视频组件的触发区域出现重叠时,会导致彩蛋的触发逻辑与应用程序原生操作逻辑发生冲突,从而导致隐藏组件无法使用,或者视频组件无法使用的问题。本公开实施例提供一种多媒体组件触发方法以解决上述问题。
参考图2,图2为本公开实施例提供的多媒体组件触发方法的流程示意图一。本实施例的方法可以应用在终端设备中,该多媒体组件触发方法包括:
步骤S101:响应针对视频播放界面的手势操作,确定目标触发区域,目标触发区域为手势操作在视频播放界面上的接触区域,视频播放界面用于播放当前显示的目标视频。
示例性地,本实施例提供的方法的执行主体可以为终端设备,例如智能手机、平板电脑等。终端设备内运行有用于播放视频的应用程序,更具体地,例如基于feed流技术的短视频类应用程序,其中,应用程序通过视频播放界面播放短视频。图3为本公开实施例提供的一种视频播放界面的示意图,如图3所示,视频播放界面可以为目标应用内基于操作***提供的用于播放视频的功能类实现的功能模块,视频播放界面可以在播放目标视频的同时,响应于用户针对该视频播放界面的手势操作,执行对应的应用功能,例如通过滑动手势进行切换视频、通过长按手势进行收藏视频等。
基于上述针对视频播放界面的介绍,示例性地,当用户通过终端设备的交互单元,例如触摸屏,针对目标应用内显示的视频播放界面施加手势操作时,交互单元通过检查手势操作,可以确定该手势操作在视频播放界面上的接触区域,该接触区域即目标触发区域。图4为本公开实施例提供的一种目标触发区域的示意图,如图4所示,交互单元例如为触摸屏,手势操作例如为点击手势,当点击手势施加在终端设备的触摸屏上时,会造成触摸屏电容变化,触摸屏通过检测电容变化情况,确定该点击手势的具体接触位置,更具体地,例如接触位置的坐标,即接触坐标。进而根据该接触坐标所归属的区域,确定目标触发区域,其中,接触坐标位于该目标触发区域内部。进一步地,目标触发区域的轮廓形状可以有多种实现,例如非矩形、圆形或其他不规则形状,此处不再具体赘述。
进一步地,在一种可能的实现方式中,如图5所示,步骤S102的具体实现步骤包括:
步骤S1011:检测手势操作对应的接触坐标,接触坐标表征手势操作在视频播放界面上的接触点的坐标。
步骤S1012:根据接触坐标,将距离接触坐标第一距离内的隐藏触发区域,确定为目标触发区域,其中,隐藏触发区域为设置有隐藏组件的区域。
示例性地,在检测到手势操作对应的接触坐标后,一种可能的实现方式中,是根据预设的接触坐标与触发区域的映射关系,确定该接触坐标对应的目标触发区域,此种实现方式不再赘述。另一种可能的实现方式中,通过接触坐标搜索以接触坐标为中心,预设范围内的隐藏触发区域,如果该预设范围内包括隐藏触发区域,将该隐藏触发区域,确定为目标触发区域。图6为本公开实施例提供的一种确定目标触发区域的过程示意图,如图6所示,在确定接触坐标A后,检测以接触坐标A为中心,以第一距离R为半径的圆形区域Zoom_1,经检测,预设的隐藏触发区域Zoom_2与Zoom_1部分重叠,则认为该隐藏触发区域距离接触坐标第一距离内,进而,将该隐藏触发区域Zoom_2确定为目标触发区域。
本实施例中,通过检测手势操作对应的接触坐标预设范围内隐藏触发区域,来优先将目标触发区域确定在隐藏触发区域内,由于在短视频中触发彩蛋(隐藏信息)的应用场景下,彩蛋通常是不可见的,因此会造成用户的手势操作不准确的问题,通过本实施例步骤的方法,可以实现接触坐标位于隐藏触发区域的周边区域时的自动调整,提高用户触发彩蛋的概率,提高用户使用体验。
步骤S102:检测目标触发区域,并根据检测结果,触发隐藏组件或者视频组件,其中,隐藏组件用于在被触发后,在视频播放界面内显示对应的目标页面,视频组件用于在被触发后,针对目标视频执行第一应用功能。
示例性地,在确定目标触发区域后,进一步对目标触发区域进行检测,得到的检测结果用来确定该目标触发区域具体用于触发隐藏组件还是视频组件。若该目标触发区域用于触发隐藏组件,则对隐藏组件进行触发,调用对应程序后,在视频播放界面内显示对应的目标页面,实现隐藏信息的触发目的;若该目标触发区域用于触发视频组件,则对视频组件进行触发,调用对应程序后,针对目标视频执行第一应用功能,实现针对目标视频的常规应用功能,例如点赞、收藏、视频切换等。
在一种可能的实现方式中,隐藏触发区域的位置是随目标视频的播放,动态变化的。如图7所示,示例性地,步骤S102的具体实现步骤包括:
步骤S1021:检测目标触发区域的位置。
步骤S1022:若目标触发区域位于目标视频中的目标对象的识别轮廓内,则触发隐藏组件,其中,目标对象是针对目标视频的当前帧进行图像识别得到的。
步骤S1023:若目标触发区域位于目标视频中的目标对象的识别轮廓外,则触发视频组件。
示例性地,目标对象是基于目标视频的语义信息确定的图像元素,例如人脸、人物,以及特征的物体,例如视频中的汽车、房屋等。可以通过图像识别技术得到,此处不再赘述。在检测到目标触发区域的位置后,根据该目标触发区域的位置,判断目标触发区域是否落入目标视频中的目标对象的识别轮廓内,其中,识别轮廓是指目标对象的外形轮廓向外延伸预设距离后构成的轮廓,预设距离大于或等于0。示例性地,识别轮廓对应的区域为隐藏触发区域。
进一步地,若落入该目标对象的识别轮廓内,则该目标触发区域属于隐藏触发区域,之后触发隐藏组件,并执行后续对应的调用程序;若未落入该目标对象的识别轮廓内,则该目标触发区
域不属于隐藏触发区域,之后触发视频组件,并执行后续对应的调用程序。
图8为本公开实施例提供的一种确定触发隐藏组件的过程示意图,如图8所示,目标视频中包括两个目标对象,分别为目标视频中的“智能手机”和“促销展示牌”,其中,“智能手机”和“促销展示牌”分别对应一个识别轮廓,当通过检测手势操作,得到目标触发区域后,若目标触发区域落入“智能手机”对应的识别轮廓内时,则触发智能手机对应的隐藏组件,例如在视频播放界面显示目标页面A,该目标页面A用于展示该智能手机的参数;若目标触发区域落入“促销展示牌”对应的识别轮廓内时,则触发促销展示牌对应的隐藏组件,例如在视频播放界面显示目标页面B,该目标页面B用于展示该智能手机的促销活动的视频;此外,若目标触发区域未落入“智能手机”对应的识别轮廓内,也未落入“促销展示牌”对应的识别轮廓内,即目标触发区域位于目标视频中的目标对象的识别轮廓外,则根据具体的手势操作,触发对应的视频组件,例如收藏当前播放的目标视频。
本实施例步骤中,通过检测目标触发区域与目标对象的识别轮廓的关系,实现了针对不同的目标对象的动态彩蛋触发,使不同的目标对象能够触发对应类型的隐藏信息,提高因此信息的多样性和内容丰富性。
在一种可能的实现方式中,目标对象的位置随目标视频的播放动态变化,在步骤S1021之前,还包括:
实时检测目标视频中的目标对象。
示例性地,在目标视频播放过程中,随着播放的进行,目标视频播放的内容会发生变化,即目标视频的当前帧所显示的内容会发生变化,在每一视频帧中,目标视频对应的目标对象可能处于相同或不同的位置,目标对象可能存在或不存在。
图9为本公开实施例提供的一种动态目标对象的示意图,如图9所示,目标对象例如图9中的“促销展示牌”,参考图9所示,在目标视频的第N1帧时,“促销展示牌”位于目标视频(当前视频帧)中的左侧,在目标视频的第N2帧时,“促销展示牌”位于目标视频(当前视频帧)中的右侧,在目标视频的第N3帧时,“促销展示牌”位于目标视频(当前视频帧)外,即目标视频中不存在目标对象。当目标触发区域落入目标对象的识别轮廓内时,触发隐藏组件,基于后续步骤触发隐藏信息;当目标触发区域落入识别轮廓外时,根据具体的手势操作,触发对应的视频组件,或者,返回步骤S1020,重新执行上述步骤,对目标对象和手势操作进行重新检测。
本实施例中,通过检测目标触发区域与目标视频中实时的目标对象的识别轮廓的关系,实现了针对目标视频的动态隐藏触发区域,使隐藏触发区域能够实时跟随特定的目标对象,提高多媒体组件触发的灵活性和趣味性。
在本实施例中,通过响应针对视频播放界面的手势操作,确定目标触发区域,目标触发区域为手势操作在视频播放界面上的接触区域,视频播放界面用于播放当前显示的目标视频;检测目标触发区域,并根据检测结果,触发隐藏组件或者视频组件,其中,隐藏组件用于在被触发后,在视频播放界面内显示对应的目标页面,视频组件用于在被触发后,针对目标视频执行第一应用功能。由于终端设备在检测到针对视频播放页面的手势操作后,首先确定根据手势操作确定对应的目标触发区域,再基于针对目标触发区域的检测结果,确定应该触发隐藏组件或视频组件,避免了隐藏组件与视频组件之间的操作冲突,实现针对隐藏组件的正常触发,从而提高隐藏信息触发模式下,视频播放过程中的交互趣味性和内容展示多样性。
参考图10,图10为本公开实施例提供的多媒体组件触发方法的流程示意图二。本实施例在图2所示实施例的基础上,进一步对步骤S102进行细化,其中,视频播放界面包括重叠设置的
视频容器和页面容器,其中,页面容器在视频容器上层。本实施例提供的多媒体组件触发方法包括:
步骤S201:将页面容器设置为可见状态,并在页面容器内显示隐藏组件对应的指示标识,指示标识用于指示隐藏组件对应的触发区域。
示例性地,图11为本公开实施例提供的一种视频播放界面的逻辑结构示意图,视频播放界面包括重叠设置的视频容器和页面容器,视频容器和页面容器各对应一个层级(Layer)因此,视频容器和页面容器也可以称为视频容器层和页面容器层。默认状态下,页面容器设置与视频容器上层,但页面容器不可见。其中,视频容器用于显示目标视频和设置视频组件,页面容器用于显示目标页面和设置隐藏组件,页面容器在响应针对视频播放界面的手势操作之前不可见。进一步地,视频容器和页面容器,均是软件模块,通过对应的类实现,其中,示例性地,视频容器基于canvas实现;页面容器基于lynx容器实现。
在视频播放界面播放目标视频的过程中,在满足预设条件下,会在页面容器内显示指示标识,来指示隐藏组件的位置,更具体地,例如以高亮的方式显示隐藏触发区域,从而提示用户在哪个区域触发彩蛋视频,提高交互效率。需要说明的是,步骤S201是本实施例的可选步骤,本实施例可以在不执行步骤S201的情况下执行后续步骤。
步骤S202:响应针对视频播放界面的手势操作,确定目标触发区域,目标触发区域为手势操作在视频播放界面上的接触区域,视频播放界面用于播放当前显示的目标视频。
S203:检测页面容器的目标触发区域。
S204:若页面容器的目标触发区域存在隐藏组件,则调用隐藏组件对应的第一调用函数,并根据第一调用函数的调用结果,在页面容器内显示对应的目标页面。
示例性地,用户在针对视频播放界面施加手势操作后,终端设备会检测该手势操作并确定对应的目标触发区域,该步骤的具体实现方式,在图2所示实施例的步骤S101中已进行具体介绍,此处不再赘述。
之后,终端设备基于获得的目标触发区域,首先对页面容器进行检测,确定该页面容器的目标触发区域内,是否存在隐藏组件,具体实现方式通过调用页面容器的相应功能接口实现,不再赘述。基于图11所示实施例,以及上述对现有技术的介绍,页面容器和应用容器均能够用于响应用户的手势操作,同时,页面容器叠加在应用容器之上,当检测到手势操作后,页面容器和应用容器均需要对手势操作进行响应,因此会导致逻辑冲突的问题。本实施例中,响应针对视频播放界面的手势操作,首先检测页面容器的目标触发区域,若页面容器的目标触发区域存在隐藏组件,则调用隐藏组件对应的第一调用函数,来实现对应的功能,即在页面容器内显示对应的目标页面,实现隐藏信息的触发;之后,若页面容器的目标触发区域不存在隐藏组件,则调用视频容器内的视频组件对应的第二调用函数,来实现对应的功能,即执行第一应用功能,例如点赞视频。从而解决页面容器和应用容器之间逻辑冲突的问题。
进一步地,更具体地,例如,页面容器为lynx容器,视频容器为canvas容器。具体实现方式为:为底部全屏canvas添加user-interaction-enabled=false表明不需要响应事件,canvas上层其余的元素不添加user-interaction-enabled=false,正常响应事件。当用户在屏幕检测到操作(例如点击操作)时,终端设备(内运行的目标应用)会根据点击坐标,检测应该响应该事件的元素,对于重叠的元素(这里指底部video和上层全屏canvas),默认行为是上层元素不论有没有绑定点击的调用函数,都会消费掉该事件,但因为canvas设置了user-interaction-enabled=false,所以会在检测阶段始终无法作为事件目标(target),事件目标(target)检测机制继续执行,直到找
到底部video元素。用户长按引导手势后,页面容器的层级上升至最高层级,播放全屏的目标页面。
在一种可能的实现方式中,示例性地,手势操作为长按手势操作。步骤S204的具体实现方式包括:
响应于长按手势操作,显示引导标识。
在检测到长按手势操作持续第一时长后,触发目标触发区域对应的隐藏组件,在视频播放界面内显示与隐藏组件对应的目标页面。
示例性地,在触发隐藏信息的应用场景下,考虑到隐藏组件的不可见性,用户的手势操作可能出现误触的问题。例如当“长按手势”操作的持续时间过短时,可能与“点击手势”操作混淆,从而发生误触,影响交互体验。
图12为本公开实施例提供的一种通过长按手势操作触发隐藏组件的过程示意图,如图12所示,在用户施加针对视频播放界面的长按手势操作后,终端设备在视频播放界面显示一个引导标识,引导标识可以为一个随时间变化的图标,参考图12所示,示例性地,引导标识为一个圆环状的进度条,随着长按手势的持续,圆环状的进度条不断前进,当长按手势操作持续第一时长后,该进度条走到尽头。之后,触发该目标触发区域对应的隐藏组件,在页面容器上显示目标页面,目标页面例如用于播放彩蛋视频。
本实施例步骤中,通过设置引导标识,在持续长按第一时长后,再对隐藏组件进行触发,避免了误差,提高交互效率和使用体验。
步骤S205:若页面容器的目标触发区域不存在隐藏组件,则调用视频容器内的视频组件对应的第二调用函数,并基于第二调用函数的调用结果,执行第一应用功能。
示例性地,另一种情况下,由于针对目标应用的视频容器通常是全屏的,在视频播放界面内的任何地方实施手势操作,均能实现对视频组件的触发,因此,若页面容器的目标触发区域不存在隐藏组件,则说明此区域不是隐藏触发区域,此时,对视频容器的视频组件进行触发,调用视频组件对应的第二调用函数,从而实现针对目标视频的控制,执行第一应用功能。
图13为本公开实施例提供的一种基于页面容器触发隐藏组件的示意图,如图13所示,页面容器重叠于视频容器的上层,当生成手势操作对应的触发事件时,首先确定页面容器的目标触发区域是否存在隐藏组件,若存在隐藏组件,则页面容器消费该触发事件,在页面容器内全屏显示目标页面(触发隐藏组件);若不存在隐藏组件,则触发事件穿过页面容器,到达视频容器,并通过视频容器消费该触发事件,使执行第一应用功能,例如点赞视频。
本实施例中,通过重叠设置的页面容器和视频容器,先检测页面容器的目标触发区域内的隐藏组件,并根据检测结果,触发隐藏组件或视频组件,避免了隐藏组件与视频组件之间的逻辑冲突。
对应于上文实施例提供的多媒体组件触发方法,图14为本公开实施例提供的多媒体组件触发装置的结构框图。为了便于说明,仅示出了与本公开实施例相关的部分。参照图14,多媒体组件触发装置3包括:
响应模块31,用于响应针对视频播放界面的手势操作,确定目标触发区域,目标触发区域为手势操作在视频播放界面上的接触区域,视频播放界面用于播放当前显示的目标视频;
触发模块32,用于检测目标触发区域,并根据检测结果,触发隐藏组件或者视频组件,其中,隐藏组件用于在被触发后,在视频播放界面内显示对应的目标页面,视频组件用于在被触发后,针对目标视频执行第一应用功能。
在本公开的一个实施例中,响应模块31,具体用于:获取手势操作对应的接触坐标,接触坐标表征手势操作在视频播放界面上的接触点的坐标;根据接触坐标,将距离接触坐标第一距离内的隐藏触发区域,确定为目标触发区域,其中,隐藏触发区域为设置有隐藏组件的区域。
在本公开的一个实施例中,触发模块32,具体用于:实时检测目标视频中的目标对象;若目标触发区域位于目标视频中的目标对象的识别轮廓内,则触发隐藏组件,其中,目标对象是针对目标视频的当前帧进行图像识别得到的;若目标触发区域位于目标视频中的目标对象的识别轮廓外,则触发视频组件。
在本公开的一个实施例中,视频播放界面包括重叠设置的视频容器和页面容器,其中,视频容器用于显示目标视频和设置视频组件,页面容器用于显示目标页面和设置隐藏组件,页面容器在响应针对视频播放界面的手势操作之前不可见。
在本公开的一个实施例中,触发模块32,具体用于:检测页面容器的目标触发区域;若页面容器的目标触发区域存在隐藏组件,则调用隐藏组件对应的第一调用函数,并根据第一调用函数的调用结果,在页面容器内显示对应的目标页面。
在本公开的一个实施例中,触发模块32,还用于:若页面容器的目标触发区域不存在隐藏组件,则调用视频容器内的视频组件对应的第二调用函数,并基于第二调用函数的调用结果,执行第一应用功能。
在本公开的一个实施例中,视频容器基于canvas实现;页面容器基于lynx容器实现。
在本公开的一个实施例中,在响应针对视频播放界面的手势操作,确定目标触发区域之前,触发模块32,还用于:将页面容器设置为可见状态,并在页面容器内显示隐藏组件对应的指示标识,指示标识用于指示隐藏组件对应的触发区域。
在本公开的一个实施例中,手势操作为长按手势操作;在触发隐藏组件之前,触发模块32,还用于:响应于长按手势操作,显示引导标识;
触发模块32在触发隐藏组件时,具体用于:在检测到长按手势操作持续第一时长后,触发目标触发区域对应的隐藏组件,在视频播放界面内显示与隐藏组件对应的目标页面。
其中,响应模块31和触发模块32连接。本实施例提供的多媒体组件触发装置3可以执行上述方法实施例的技术方案,其实现原理和技术效果类似,本实施例此处不再赘述。
图15为本公开实施例提供的一种电子设备的结构示意图,如图15所示,该电子设备4包括:
处理器41,以及与处理器41通信连接的存储器42;
存储器42存储计算机执行指令;
处理器41执行存储器42存储的计算机执行指令,以实现如图2-图13所示实施例中的多媒体组件触发方法。
其中,可选地,处理器41和存储器42通过总线43连接。
相关说明可以对应参见图2-图13所对应的实施例中的步骤所对应的相关描述和效果进行理解,此处不做过多赘述。
参考图16,其示出了适于用来实现本公开实施例的电子设备900的结构示意图,该电子设备900可以为终端设备或服务器。其中,终端设备可以包括但不限于诸如移动电话、笔记本电脑、数字广播接收器、个人数字助理(Personal Digital Assistant,PDA)、平板电脑(Portable Android Device,PAD)、便携式多媒体播放器(Portable Media Player,PMP)、车载终端(例如车载导航终端)等等的移动终端以及诸如数字电视(Television,TV)、台式计算机等等的固定终端。图16示出的电子设备仅仅是一个示例,不应对本公开实施例的功能和使用范围带来任何限制。
如图16所示,电子设备900可以包括处理装置(例如中央处理器、图形处理器等)901,其可以根据存储在只读存储器(Read Only Memory,ROM)902中的程序或者从存储装置908加载到随机访问存储器(Random Access Memory,RAM)903中的程序而执行各种适当的动作和处理。在RAM 903中,还存储有电子设备900操作所需的各种程序和数据。处理装置901、ROM 902以及RAM 903通过总线904彼此相连。输入/输出(Input/Output,I/O)接口905也连接至总线904。
通常,以下装置可以连接至I/O接口905:包括例如触摸屏、触摸板、键盘、鼠标、摄像头、麦克风、加速度计、陀螺仪等的输入装置906;包括例如液晶显示器(Liquid Crystal Display,LCD)、扬声器、振动器等的输出装置907;包括例如磁带、硬盘等的存储装置908;以及通信装置909。通信装置909可以允许电子设备900与其他设备进行无线或有线通信以交换数据。虽然图16示出了具有各种装置的电子设备900,但是应理解的是,并不要求实施或具备所有示出的装置。可以替代地实施或具备更多或更少的装置。
特别地,根据本公开的实施例,上文参考流程图描述的过程可以被实现为计算机软件程序。例如,本公开的实施例包括一种计算机程序产品,其包括承载在计算机可读介质上的计算机程序,该计算机程序包含用于执行流程图所示的方法的程序代码。在这样的实施例中,该计算机程序可以通过通信装置909从网络上被下载和安装,或者从存储装置908被安装,或者从ROM 902被安装。在该计算机程序被处理装置901执行时,执行本公开实施例的方法中限定的上述功能。
需要说明的是,本公开上述的计算机可读介质可以是计算机可读信号介质或者计算机可读存储介质或者是上述两者的任意组合。计算机可读存储介质例如可以是——但不限于——电、磁、光、电磁、红外线、或半导体的***、装置或器件,或者任意以上的组合。计算机可读存储介质的更具体的例子可以包括但不限于:具有一个或多个导线的电连接、便携式计算机磁盘、硬盘、随机访问存储器(RAM)、只读存储器(ROM)、可擦式可编程只读存储器(Erasable Programmable Read Only Memory,EPROM)或闪存、光纤、便携式紧凑磁盘只读存储器(Compact Disc Read Only Memory,CD-ROM)、光存储器件、磁存储器件、或者上述的任意合适的组合。在本公开中,计算机可读存储介质可以是任何包含或存储程序的有形介质,该程序可以被指令执行***、装置或者器件使用或者与其结合使用。而在本公开中,计算机可读信号介质可以包括在基带中或者作为载波一部分传播的数据信号,其中承载了计算机可读的程序代码。这种传播的数据信号可以采用多种形式,包括但不限于电磁信号、光信号或上述的任意合适的组合。计算机可读信号介质还可以是计算机可读存储介质以外的任何计算机可读介质,该计算机可读信号介质可以发送、传播或者传输用于由指令执行***、装置或者器件使用或者与其结合使用的程序。计算机可读介质上包含的程序代码可以用任何适当的介质传输,包括但不限于:电线、光缆、射频(Radio Frequency,RF)等等,或者上述的任意合适的组合。
上述计算机可读介质可以是上述电子设备中所包含的;也可以是单独存在,而未装配入该电子设备中。
上述计算机可读介质承载有一个或者多个程序,当上述一个或者多个程序被该电子设备执行时,使得该电子设备执行上述实施例所示的方法。
可以以一种或多种程序设计语言或其组合来编写用于执行本公开的操作的计算机程序代码,上述程序设计语言包括面向对象的程序设计语言—诸如Java、Smalltalk、C++,还包括常规的过程式程序设计语言—诸如“C”语言或类似的程序设计语言。程序代码可以完全地在用户计算机上执行、部分地在用户计算机上执行、作为一个独立的软件包执行、部分在用户计算机上部分在
远程计算机上执行、或者完全在远程计算机或服务器上执行。在涉及远程计算机的情形中,远程计算机可以通过任意种类的网络——包括局域网(Local Area Network,LAN)或广域网(Wide Area Network,WAN)—连接到用户计算机,或者,可以连接到外部计算机(例如利用因特网服务提供商来通过因特网连接)。
附图中的流程图和框图,图示了按照本公开各种实施例的***、方法和计算机程序产品的可能实现的体系架构、功能和操作。在这点上,流程图或框图中的每个方框可以代表一个模块、程序段、或代码的一部分,该模块、程序段、或代码的一部分包含一个或多个用于实现规定的逻辑功能的可执行指令。也应当注意,在有些作为替换的实现中,方框中所标注的功能也可以以不同于附图中所标注的顺序发生。例如,两个接连地表示的方框实际上可以基本并行地执行,它们有时也可以按相反的顺序执行,这依所涉及的功能而定。也要注意的是,框图和/或流程图中的每个方框、以及框图和/或流程图中的方框的组合,可以用执行规定的功能或操作的专用的基于硬件的***来实现,或者可以用专用硬件与计算机指令的组合来实现。
描述于本公开实施例中所涉及到的单元可以通过软件的方式实现,也可以通过硬件的方式来实现。其中,单元的名称在某种情况下并不构成对该单元本身的限定,例如,第一获取单元还可以被描述为“获取至少两个网际协议地址的单元”。
本文中以上描述的功能可以至少部分地由一个或多个硬件逻辑部件来执行。例如,非限制性地,可以使用的示范类型的硬件逻辑部件包括:现场可编程门阵列(Field-Programmable Gate Array,FPGA)、专用集成电路(Application Specific Integrated Circuit,ASIC)、专用标准产品(Application Specific Standard Parts,ASSP)、片上***(System On Chip,SOC)、复杂可编程逻辑设备(Complex Programmable Logic Device,CPLD)等等。
在本公开的上下文中,机器可读介质可以是有形的介质,其可以包含或存储以供指令执行***、装置或设备使用或与指令执行***、装置或设备结合地使用的程序。机器可读介质可以是机器可读信号介质或机器可读储存介质。机器可读介质可以包括但不限于电子的、磁性的、光学的、电磁的、红外的、或半导体***、装置或设备,或者上述内容的任何合适组合。机器可读存储介质的更具体示例可以包括基于一个或多个线的电气连接、便携式计算机盘、硬盘、随机存取存储器(RAM)、只读存储器(ROM)、可擦除可编程只读存储器(EPROM或快闪存储器)、光纤、便捷式紧凑盘只读存储器(CD-ROM)、光学储存设备、磁储存设备、或上述内容的任何合适组合。
第一方面,根据本公开的一个或多个实施例,提供了一种多媒体组件触发方法,包括:
响应针对视频播放界面的手势操作,确定目标触发区域,所述目标触发区域为所述手势操作在所述视频播放界面上的接触区域,所述视频播放界面用于播放当前显示的目标视频;检测所述目标触发区域,并根据检测结果,触发隐藏组件或者视频组件,其中,所述隐藏组件用于在被触发后,在所述视频播放界面内显示对应的目标页面,所述视频组件用于在被触发后,针对所述目标视频执行第一应用功能。
根据本公开的一个或多个实施例,所述响应针对视频播放界面的手势操作,确定目标触发区域,包括:获取所述手势操作对应的接触坐标,所述接触坐标表征所述手势操作在所述视频播放界面上的接触点的坐标;根据所述接触坐标,将距离所述接触坐标第一距离内的隐藏触发区域,确定为所述目标触发区域,其中,所述隐藏触发区域为设置有隐藏组件的区域。
根据本公开的一个或多个实施例,检测所述目标触发区域,并根据检测结果,触发隐藏组件或者视频组件,包括:实时检测目标视频中的目标对象;若所述目标触发区域位于所述目标视频
中的目标对象的识别轮廓内,则触发所述隐藏组件,其中,所述目标对象是针对所述目标视频的当前帧进行图像识别得到的;若所述目标触发区域位于所述目标视频中的目标对象的识别轮廓外,则触发所述视频组件。
根据本公开的一个或多个实施例,所述视频播放界面包括重叠设置的视频容器和页面容器,其中,所述视频容器用于显示所述目标视频和设置所述视频组件,所述页面容器用于显示所述目标页面和设置所述隐藏组件,所述页面容器在所述响应针对视频播放界面的手势操作之前不可见。
根据本公开的一个或多个实施例,检测所述目标触发区域,并根据检测结果,触发隐藏组件或者视频组件,包括:检测所述页面容器的目标触发区域;若所述页面容器的目标触发区域存在隐藏组件,则调用所述隐藏组件对应的第一调用函数,并根据所述第一调用函数的调用结果,在所述页面容器内显示对应的目标页面。
根据本公开的一个或多个实施例,所述方法还包括:若所述页面容器的目标触发区域不存在隐藏组件,则调用所述视频容器内的视频组件对应的第二调用函数,并基于所述第二调用函数的调用结果,执行所述第一应用功能。
根据本公开的一个或多个实施例,所述视频容器基于canvas实现;所述页面容器基于lynx容器实现。
根据本公开的一个或多个实施例,在响应针对视频播放界面的手势操作,确定目标触发区域之前,还包括:将所述页面容器设置为可见状态,并在所述页面容器内显示所述隐藏组件对应的指示标识,所述指示标识用于指示所述隐藏组件对应的触发区域。
根据本公开的一个或多个实施例,所述手势操作为长按手势操作;在所述触发隐藏组件之前,还包括:响应于所述长按手势操作,显示引导标识;所述触发隐藏组件,包括:在检测到所述长按手势操作持续第一时长后,触发所述目标触发区域对应的隐藏组件,在所述视频播放界面内显示与所述隐藏组件对应的目标页面。
第二方面,根据本公开的一个或多个实施例,提供了一种多媒体组件触发装置,包括:
响应模块,用于响应针对视频播放界面的手势操作,确定目标触发区域,所述目标触发区域为所述手势操作在所述视频播放界面上的接触区域,所述视频播放界面用于播放当前显示的目标视频;
触发模块,用于检测所述目标触发区域,并根据检测结果,触发隐藏组件或者视频组件,其中,所述隐藏组件用于在被触发后,在所述视频播放界面内显示对应的目标页面,所述视频组件用于在被触发后,针对所述目标视频执行第一应用功能。
在本公开的一个实施例中,所述响应模块,具体用于:获取所述手势操作对应的接触坐标,所述接触坐标表征所述手势操作在所述视频播放界面上的接触点的坐标;根据所述接触坐标,将距离所述接触坐标第一距离内的隐藏触发区域,确定为所述目标触发区域,其中,所述隐藏触发区域为设置有隐藏组件的区域。
在本公开的一个实施例中,所述触发模块,具体用于:实时检测目标视频中的目标对象;若所述目标触发区域位于所述目标视频中的目标对象的识别轮廓内,则触发所述隐藏组件,其中,所述目标对象是针对所述目标视频的当前帧进行图像识别得到的;若所述目标触发区域位于所述目标视频中的目标对象的识别轮廓外,则触发所述视频组件。
在本公开的一个实施例中,所述视频播放界面包括重叠设置的视频容器和页面容器,其中,所述视频容器用于显示所述目标视频和设置所述视频组件,所述页面容器用于显示所述目标页面
和设置所述隐藏组件,所述页面容器在所述响应针对视频播放界面的手势操作之前不可见。
在本公开的一个实施例中,所述触发模块,具体用于:检测所述页面容器的目标触发区域;若所述页面容器的目标触发区域存在隐藏组件,则调用所述隐藏组件对应的第一调用函数,并根据所述第一调用函数的调用结果,在所述页面容器内显示对应的目标页面。
在本公开的一个实施例中,所述触发模块,还用于:若所述页面容器的目标触发区域不存在隐藏组件,则调用所述视频容器内的视频组件对应的第二调用函数,并基于所述第二调用函数的调用结果,执行所述第一应用功能。
在本公开的一个实施例中,所述视频容器基于canvas实现;所述页面容器基于lynx容器实现。
在本公开的一个实施例中,在响应针对视频播放界面的手势操作,确定目标触发区域之前,所述触发模块,还用于:将所述页面容器设置为可见状态,并在所述页面容器内显示所述隐藏组件对应的指示标识,所述指示标识用于指示所述隐藏组件对应的触发区域。
在本公开的一个实施例中,所述手势操作为长按手势操作;在所述触发隐藏组件之前,所述触发模块,还用于:响应于所述长按手势操作,显示引导标识;
所述触发模块在触发隐藏组件时,具体用于:在检测到所述长按手势操作持续第一时长后,触发所述目标触发区域对应的隐藏组件,在所述视频播放界面内显示与所述隐藏组件对应的目标页面。
第三方面,根据本公开的一个或多个实施例,提供了一种电子设备,包括:处理器,以及与所述处理器通信连接的存储器;
所述存储器存储计算机执行指令;
所述处理器执行所述存储器存储的计算机执行指令,以实现如上第一方面以及第一方面各种可能的设计所述的多媒体组件触发方法。
第四方面,根据本公开的一个或多个实施例,提供了一种计算机可读存储介质,所述计算机可读存储介质中存储有计算机执行指令,当处理器执行所述计算机执行指令时,实现如上第一方面以及第一方面各种可能的设计所述的多媒体组件触发方法。
第五方面,本公开实施例提供一种计算机程序产品,包括计算机程序,该计算机程序被处理器执行时实现如上第一方面以及第一方面各种可能的设计所述的多媒体组件触发方法。
第六方面,本公开实施例提供一种计算机程序,该计算机程序被处理器执行时实现如上第一方面以及第一方面各种可能的设计所述的多媒体组件触发方法。
以上描述仅为本公开的较佳实施例以及对所运用技术原理的说明。本领域技术人员应当理解,本公开中所涉及的公开范围,并不限于上述技术特征的特定组合而成的技术方案,同时也应涵盖在不脱离上述公开构思的情况下,由上述技术特征或其等同特征进行任意组合而形成的其它技术方案。例如上述特征与本公开中公开的(但不限于)具有类似功能的技术特征进行互相替换而形成的技术方案。
此外,虽然采用特定次序描绘了各操作,但是这不应当理解为要求这些操作以所示出的特定次序或以顺序次序执行。在一定环境下,多任务和并行处理可能是有利的。同样地,虽然在上面论述中包含了若干具体实现细节,但是这些不应当被解释为对本公开的范围的限制。在单独的实施例的上下文中描述的某些特征还可以组合地实现在单个实施例中。相反地,在单个实施例的上下文中描述的各种特征也可以单独地或以任何合适的子组合的方式实现在多个实施例中。
尽管已经采用特定于结构特征和/或方法逻辑动作的语言描述了本主题,但是应当理解所附
权利要求书中所限定的主题未必局限于上面描述的特定特征或动作。相反,上面所描述的特定特征和动作仅仅是实现权利要求书的示例形式。
Claims (14)
- 一种多媒体组件触发方法,包括:响应针对视频播放界面的手势操作,确定目标触发区域,所述目标触发区域为所述手势操作在所述视频播放界面上的接触区域,所述视频播放界面用于播放当前显示的目标视频;检测所述目标触发区域,并根据检测结果,触发隐藏组件或者视频组件,其中,所述隐藏组件用于在被触发后,在所述视频播放界面内显示对应的目标页面,所述视频组件用于在被触发后,针对所述目标视频执行第一应用功能。
- 根据权利要求1所述的方法,其中,所述响应针对视频播放界面的手势操作,确定目标触发区域,包括:获取所述手势操作对应的接触坐标,所述接触坐标表征所述手势操作在所述视频播放界面上的接触点的坐标;根据所述接触坐标,将距离所述接触坐标第一距离内的隐藏触发区域,确定为所述目标触发区域,其中,所述隐藏触发区域为设置有隐藏组件的区域。
- 根据权利要求1或2所述的方法,其中,检测所述目标触发区域,并根据检测结果,触发隐藏组件或者视频组件,包括:实时检测目标视频中的目标对象;若所述目标触发区域位于所述目标视频中的目标对象的识别轮廓内,则触发所述隐藏组件,其中,所述目标对象是针对所述目标视频的当前帧进行图像识别得到的;若所述目标触发区域位于所述目标视频中的目标对象的识别轮廓外,则触发所述视频组件。
- 根据权利要求1或2所述的方法,其中,所述视频播放界面包括重叠设置的视频容器和页面容器,其中,所述视频容器用于显示所述目标视频和设置所述视频组件,所述页面容器用于显示所述目标页面和设置所述隐藏组件,所述页面容器在所述响应针对视频播放界面的手势操作之前不可见。
- 根据权利要求4所述的方法,其中,检测所述目标触发区域,并根据检测结果,触发隐藏组件或者视频组件,包括:检测所述页面容器的目标触发区域;若所述页面容器的目标触发区域存在隐藏组件,则调用所述隐藏组件对应的第一调用函数,并根据所述第一调用函数的调用结果,在所述页面容器内显示对应的目标页面。
- 根据权利要求5所述的方法,其中,所述方法还包括:若所述页面容器的目标触发区域不存在隐藏组件,则调用所述视频容器内的视频组件对应的第二调用函数,并基于所述第二调用函数的调用结果,执行所述第一应用功能。
- 根据权利要求5或6所述的方法,其中,所述视频容器基于canvas实现;所述页面容器基于lynx容器实现。
- 根据权利要求4至7中任一项所述的方法,其中,在响应针对视频播放界面的手势操作,确定目标触发区域之前,还包括:将所述页面容器设置为可见状态,并在所述页面容器内显示所述隐藏组件对应的指示标识,所述指示标识用于指示所述隐藏组件对应的触发区域。
- 根据权利要求1至8中任一项所述的方法,其中,所述手势操作为长按手势操作;在 所述触发隐藏组件之前,还包括:响应于所述长按手势操作,显示引导标识;所述触发隐藏组件,包括:在检测到所述长按手势操作持续第一时长后,触发所述目标触发区域对应的隐藏组件,在所述视频播放界面内显示与所述隐藏组件对应的目标页面。
- 一种多媒体组件触发装置,包括:响应模块,用于响应针对视频播放界面的手势操作,确定目标触发区域,所述目标触发区域为所述手势操作在所述视频播放界面上的接触区域,所述视频播放界面用于播放当前显示的目标视频;触发模块,用于检测所述目标触发区域,并根据检测结果,触发隐藏组件或者视频组件,其中,所述隐藏组件用于在被触发后,在所述视频播放界面内显示对应的目标页面,所述视频组件用于在被触发后,针对所述目标视频执行第一应用功能。
- 一种电子设备,包括:处理器,以及与所述处理器通信连接的存储器;所述存储器存储计算机执行指令;所述处理器执行所述存储器存储的计算机执行指令,以实现如权利要求1至9中任一项所述的多媒体组件触发方法。
- 一种计算机可读存储介质,所述计算机可读存储介质中存储有计算机执行指令,当处理器执行所述计算机执行指令时,实现如权利要求1至9中任一项所述的多媒体组件触发方法。
- 一种计算机程序产品,包括计算机程序,所述计算机程序被处理器执行时实现权利要求1至9中任一项所述的多媒体组件触发方法。
- 一种计算机程序,所述计算机程序用于实现如权利要求1至9中任一项所述的多媒体组件触发方法。
Applications Claiming Priority (2)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CN202211098310.2A CN117676247A (zh) | 2022-09-08 | 2022-09-08 | 多媒体组件触发方法、装置、电子设备及存储介质 |
CN202211098310.2 | 2022-09-08 |
Publications (1)
Publication Number | Publication Date |
---|---|
WO2024051615A1 true WO2024051615A1 (zh) | 2024-03-14 |
Family
ID=90073980
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
PCT/CN2023/116623 WO2024051615A1 (zh) | 2022-09-08 | 2023-09-01 | 多媒体组件触发方法、装置、电子设备及存储介质 |
Country Status (2)
Country | Link |
---|---|
CN (1) | CN117676247A (zh) |
WO (1) | WO2024051615A1 (zh) |
Citations (5)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN107679156A (zh) * | 2017-09-27 | 2018-02-09 | 努比亚技术有限公司 | 一种视频图像识别方法及终端、可读存储介质 |
CN109933260A (zh) * | 2019-03-15 | 2019-06-25 | Oppo广东移动通信有限公司 | 识屏方法、装置、终端及存储介质 |
CN110866133A (zh) * | 2018-08-27 | 2020-03-06 | 阿里巴巴集团控股有限公司 | 信息搜索方法、页面显示方法、***及设备 |
CN111726675A (zh) * | 2020-07-03 | 2020-09-29 | 北京字节跳动网络技术有限公司 | 对象的信息显示方法、装置、电子设备及计算机存储介质 |
US20210149535A1 (en) * | 2019-11-20 | 2021-05-20 | Beijing Xiaomi Mobile Software Co., Ltd. | Method and device for displaying interface of multimedia information application, user equipment, and storage medium |
-
2022
- 2022-09-08 CN CN202211098310.2A patent/CN117676247A/zh active Pending
-
2023
- 2023-09-01 WO PCT/CN2023/116623 patent/WO2024051615A1/zh unknown
Patent Citations (5)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN107679156A (zh) * | 2017-09-27 | 2018-02-09 | 努比亚技术有限公司 | 一种视频图像识别方法及终端、可读存储介质 |
CN110866133A (zh) * | 2018-08-27 | 2020-03-06 | 阿里巴巴集团控股有限公司 | 信息搜索方法、页面显示方法、***及设备 |
CN109933260A (zh) * | 2019-03-15 | 2019-06-25 | Oppo广东移动通信有限公司 | 识屏方法、装置、终端及存储介质 |
US20210149535A1 (en) * | 2019-11-20 | 2021-05-20 | Beijing Xiaomi Mobile Software Co., Ltd. | Method and device for displaying interface of multimedia information application, user equipment, and storage medium |
CN111726675A (zh) * | 2020-07-03 | 2020-09-29 | 北京字节跳动网络技术有限公司 | 对象的信息显示方法、装置、电子设备及计算机存储介质 |
Also Published As
Publication number | Publication date |
---|---|
CN117676247A (zh) | 2024-03-08 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
US11687214B2 (en) | Method and apparatus for changing screen in electronic device | |
US11693531B2 (en) | Page display position jump method and apparatus, terminal device, and storage medium | |
US11861161B2 (en) | Display method and apparatus | |
US10534534B2 (en) | Method for controlling display, storage medium, and electronic device | |
US20200396498A1 (en) | Method and device for video previewing, electronic equipment, and computer-readable storage medium | |
US11635873B2 (en) | Information display method, graphical user interface, and terminal for displaying media interface information in a floating window | |
KR102049784B1 (ko) | 데이터 표시 방법 및 장치 | |
KR102032449B1 (ko) | 이미지 표시 방법 및 휴대 단말 | |
US20170017451A1 (en) | Method and system for managing applications running on smart device using a wearable device | |
KR20150007760A (ko) | 수신 데이터를 이용하여 어플리케이션을 운영하는 전자 장치 | |
US20160349851A1 (en) | An apparatus and associated methods for controlling content on a display user interface | |
CN109753332B (zh) | 用于展现信息的方法和装置 | |
CN112423138A (zh) | 一种搜索结果展示方法及终端设备 | |
US20220279064A1 (en) | Interface display method and electronic device | |
WO2022179033A1 (zh) | 音乐播放方法及设备 | |
CN104837020B (zh) | 播放视频的方法和装置 | |
KR102140294B1 (ko) | 전자 장치의 광고 방법 및 그 전자 장치 | |
WO2020233170A1 (zh) | 一种信息展示方法、装置、设备和介质 | |
US20220215482A1 (en) | User information processing method, apparatus, electronic device, and computer storage medium | |
WO2024051615A1 (zh) | 多媒体组件触发方法、装置、电子设备及存储介质 | |
WO2020143556A1 (zh) | 用于展示页面的方法和装置 | |
CN113342227A (zh) | 导航栏处理方法、装置、设备及计算机可读存储介质 | |
WO2024051601A1 (zh) | 多媒体组件触发方法、装置、电子设备及存储介质 | |
KR20150029328A (ko) | 휴대형 전자장치의 콘텐츠 제어 방법 | |
WO2023045917A1 (zh) | 一种多媒体信息的识别方法以及电子设备 |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
121 | Ep: the epo has been informed by wipo that ep was designated in this application |
Ref document number: 23862309 Country of ref document: EP Kind code of ref document: A1 |