WO2023020197A1 - 多媒体内容的接续处理方法和***、及存储介质 - Google Patents

多媒体内容的接续处理方法和***、及存储介质 Download PDF

Info

Publication number
WO2023020197A1
WO2023020197A1 PCT/CN2022/107326 CN2022107326W WO2023020197A1 WO 2023020197 A1 WO2023020197 A1 WO 2023020197A1 CN 2022107326 W CN2022107326 W CN 2022107326W WO 2023020197 A1 WO2023020197 A1 WO 2023020197A1
Authority
WO
WIPO (PCT)
Prior art keywords
terminal
camera
multimedia content
target object
target
Prior art date
Application number
PCT/CN2022/107326
Other languages
English (en)
French (fr)
Inventor
吴俊�
Original Assignee
杭州逗酷软件科技有限公司
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 杭州逗酷软件科技有限公司 filed Critical 杭州逗酷软件科技有限公司
Publication of WO2023020197A1 publication Critical patent/WO2023020197A1/zh

Links

Images

Classifications

    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/442Monitoring of processes or resources, e.g. detecting the failure of a recording device, monitoring the downstream bandwidth, the number of times a movie has been viewed, the storage space available from the internal hard disk
    • H04N21/44213Monitoring of end-user related data
    • H04N21/44218Detecting physical presence or behaviour of the user, e.g. using sensors to detect if the user is leaving the room or changes his face expression during a TV program
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/41Structure of client; Structure of client peripherals
    • H04N21/422Input-only peripherals, i.e. input devices connected to specially adapted client devices, e.g. global positioning system [GPS]
    • H04N21/4223Cameras
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/436Interfacing a local distribution network, e.g. communicating with another STB or one or more peripheral devices inside the home
    • H04N21/4363Adapting the video stream to a specific local network, e.g. a Bluetooth® network
    • H04N21/43637Adapting the video stream to a specific local network, e.g. a Bluetooth® network involving a wireless protocol, e.g. Bluetooth, RF or wireless LAN [IEEE 802.11]

Definitions

  • the present application relates to the technical field of communications, and in particular to a multimedia content connection processing method and system, and a storage medium.
  • common terminals such as mobile phones and TVs can cast the content they are watching to other devices based on Wi-Fi Display, Miracast and other screen projection solutions.
  • some terminals also have multi-device interactive video connection capabilities, which can scan out other peripheral devices that support multimedia content connection, and then perform content projection.
  • connection processing method of the multimedia content of the scene cannot timely and accurately select the device for connection processing, which has low intelligence and poor reliability.
  • the embodiment of the present application provides a multimedia content connection processing method and system, and a storage medium, which can ensure the successful establishment of a voice service and improve the reliability of the voice service.
  • connection processing method for multimedia content is applied to a connection processing system, and the connection processing system includes a first terminal, a second terminal, and a camera.
  • the methods described include:
  • Processing of the multimedia content continues by the target terminal.
  • connection processing system includes: an acquisition unit, a determination unit, a processing unit,
  • the acquisition unit is configured to use a camera to monitor the position of the target object in the first area corresponding to the first terminal when the multimedia content is processed by the first terminal, and obtain the first position information of the target object; if If the first position information satisfies a preset switching condition, the second position information of the target object is obtained through the camera;
  • the determining unit is configured to determine a target terminal among at least one second terminal based on the second location information and pre-stored layout information;
  • the processing unit is configured to continue processing the multimedia content through the target terminal.
  • an embodiment of the present application provides a connection processing system
  • the terminal device includes a processor and a memory storing instructions executable by the processor, and when the instructions are executed by the processor, the following steps are implemented: The multimedia content connection processing method described in the first aspect.
  • the embodiment of the present application provides a computer-readable storage medium, on which a program is stored, and when the program is executed by a processor, the multimedia content continuation processing method as described in the first aspect is implemented.
  • Embodiments of the present application provide a multimedia content connection processing method, system, and storage medium, which are applied to a connection processing system.
  • the connection processing system includes a first terminal, a second terminal, and a camera.
  • When multimedia content is processed through the first terminal use the camera to monitor the position of the target object in the first area corresponding to the first terminal, and obtain the first position information of the target object; if the first position information satisfies the preset switching condition, then obtain the second position of the target object through the camera information; determine a target terminal in at least one second terminal based on the second location information and pre-stored layout information; continue to process multimedia content through the target terminal.
  • the connection processing system can use the camera to track the position of the user, and combine the pre-stored layout information in at least one
  • the second terminal determines the target terminal closest to the user to perform multimedia content connection processing, thereby realizing automatic connection processing of multimedia content in response to user location changes, thereby improving the intelligence and reliability of multimedia content connection processing.
  • FIG. 1 is a schematic diagram 1 of the composition and structure of the splicing processing system proposed in the embodiment of the present application;
  • FIG. 2 is a second schematic diagram of the composition and structure of the splicing processing system proposed in the embodiment of the present application;
  • FIG. 3 is a first implementation flow diagram of a multimedia content connection processing method proposed in an embodiment of the present application
  • Fig. 4 is the schematic diagram of control area
  • Fig. 5 is a schematic diagram of determining location information
  • FIG. 6 is a second schematic diagram of the implementation flow of the multimedia content connection processing method proposed in the embodiment of the present application.
  • FIG. 7 is a schematic diagram of the third implementation flow of the multimedia content connection processing method proposed in the embodiment of the present application.
  • FIG. 8 is a schematic diagram 4 of the realization flow of the multimedia content continuation processing method proposed by the embodiment of the present application.
  • FIG. 9 is a schematic diagram 3 of the composition and structure of the splicing processing system proposed in the embodiment of the present application.
  • FIG. 10 is a schematic diagram of the fifth implementation flow of the multimedia content connection processing method proposed in the embodiment of the present application.
  • FIG. 11 is a schematic diagram 4 of the composition and structure of the splicing processing system proposed in the embodiment of the present application.
  • FIG. 12 is a fifth schematic diagram of the composition and structure of the splicing processing system proposed by the embodiment of the present application.
  • references to “some embodiments” describe a subset of all possible embodiments, but it is understood that “some embodiments” may be the same subset or a different subset of all possible embodiments, and Can be combined with each other without conflict.
  • first ⁇ second ⁇ third involved in the embodiment of the present application is only used to distinguish similar objects, and does not represent a specific ordering of objects. Understandably, “first ⁇ second ⁇ The specific order or sequence of "third” can be interchanged where allowed, so that the embodiments of the application described herein can be implemented in an order other than that illustrated or described herein.
  • Wireless video display allows users to enjoy high-quality image display effects without connecting wires.
  • This technology can compress three-dimensional (3-dimension, 3D) video, so that -Fi) transmission. 3D video consumes a lot of bandwidth, and it will lag if it is not compressed.
  • Wi-Fi Display technology can reduce the delay time to less than one hundredth of a millisecond.
  • Miracast is a wireless display standard based on Wi-Fi Direct developed by the Wi-Fi Alliance.
  • 3C Common Communication, Computer, Consumer
  • mobile phones can directly transfer videos or photos to TVs or Other devices do not need any connection wires, and do not need to go through wireless hotspots (AP, Access Point).
  • AP Access Point
  • Miracast is actually the Wi-Fi Alliance's certification name for devices that support the WiFi Display function. Miracast-certified devices can provide simplified discovery and settings, and high-speed video transmission between devices.
  • common terminals such as mobile phones and TVs can cast the content they are watching to other devices based on Wi-Fi Display, Miracast and other screen projection solutions.
  • some terminals also have multi-device interactive video connection capabilities, which can scan out other peripheral devices that support multimedia content connection, and then perform content projection.
  • the connection processing system can use the camera to track the position of the user, and combine the pre-stored layout information at least A target terminal with the closest distance to the user is determined from a second terminal to perform multimedia content connection processing, so that automatic connection processing of multimedia content in response to user location changes can be realized, and the intelligence and reliability of multimedia content connection processing can be improved.
  • FIG. 1 is the connection processing proposed in the embodiment of the application Schematic Diagram 1 of System Composition and Structure.
  • a connection processing system 10 may include a first terminal 11 , a second terminal 12 and a camera 13 .
  • the first terminal 11 and the second terminal 12 may be terminal devices with multimedia content processing capabilities, such as smart phones, tablet computers, palmtop computers, mobile stations (Mobile Station, MS ), a mobile terminal (Mobile Terminal), a smart TV, etc., wherein the first terminal 11 and the second terminal 12 can communicate with one or more network devices through a wireless network.
  • multimedia content processing capabilities such as smart phones, tablet computers, palmtop computers, mobile stations (Mobile Station, MS ), a mobile terminal (Mobile Terminal), a smart TV, etc.
  • the camera 13 may be composed of a plurality of different shooting devices, wherein the camera 13 may include the sensing camera set in the splicing processing system 10, and may also include the first terminal 10 and/or Or the photographing device configured by the second terminal 20 . That is, the cameras configured on the first terminal 11 and the second terminal 12 and other sensing cameras may jointly constitute the camera 13 .
  • FIG. 2 is a schematic diagram 2 of the composition and structure of the connection processing system proposed in the embodiment of the present application.
  • the connection processing system 10 may also include a control device 14 and a cloud 15 .
  • control device 14 may be a terminal device with a communication function, for example, the control device may be a router, a dedicated device, a smart phone, a tablet, or a computer.
  • control device 14 can control the first terminal 11 , the second terminal 12 and the camera 13 , specifically, the control function of the control device 14 can be realized by installing software.
  • control device 14 may also include the first terminal 11 or the second terminal 12 . That is to say, the first terminal 11 or the second terminal 12 can serve as a multimedia device capable of processing multimedia content, and can also serve as a processing device for performing control processing.
  • the first terminal 11, the second terminal 12, the camera 13, and the control device 14 can be bound to the cloud 15, so as to collect data and issue policies through the cloud 15.
  • the first terminal 11, the second terminal 12, the camera 13, and the control device 14 registered as the same account or a group of related accounts can be bound to the account in the cloud 14 by scanning two-dimensional codes, wireless pairing, and other connection methods. under.
  • the first terminal 11, the second terminal 12, the camera 13, and the control device 14 in the connection processing system 10 can all maintain a high-speed network connection with the cloud 15; correspondingly, the connection processing system
  • the first terminal 11 , the second terminal 12 , and the camera 13 registered as the same account or a group of related accounts in 10 can maintain a local area network connection with the control device 14 .
  • the cloud 15 can communicate with the first terminal 11, the second terminal 12, the camera 13, and the control device 14 registered under any account in the connection processing system 10, and control The device 14 can only communicate with the first terminal 11 , the second terminal 12 , and the camera 13 in the connection processing system 10 registered under the same or related account as the control device 14 .
  • FIG. 3 is a first schematic diagram of the implementation flow of the multimedia content connection processing method proposed in the embodiment of the present application.
  • the method for the terminal device to return the voice service may include the following steps:
  • Step 101 When processing multimedia content through the first terminal, use the camera to monitor the position of the target object in the first area corresponding to the first terminal, and obtain first position information of the target object.
  • the connection processing system when the multimedia content is processed through the first terminal, can use the camera to monitor the position of the target object in the first area corresponding to the first terminal, so that the first location of the target object can be obtained. location information.
  • the first terminal and the second terminal may be terminal devices provided in the connection processing system and having multimedia content processing capabilities and communication functions.
  • the first terminal may be a smart TV 1
  • the second terminal may be a tablet computer, a smart TV 2, a computer, and so on.
  • the camera may be a camera configured in the splicing processing system, wherein the camera configured by the first terminal and/or the second terminal may also constitute a camera. That is, the camera configured by the first terminal, the camera configured by the second terminal, and other camera devices arranged in the corresponding control area of the splicing processing system may jointly form a camera of the splicing processing system.
  • the camera includes at least one of the following camera devices: the camera device configured at the first terminal, the camera device configured at the second terminal, arranged in the connection processing system corresponding to Cameras within the control area.
  • the control area corresponding to the connection processing system is an area determined based on the locations of all terminal devices in the connection processing system.
  • FIG. 4 is a schematic diagram of the control area.
  • the first terminal 1 in the connection processing system is set in the living room
  • the second terminal 1 is set in the living room
  • the second terminal 2 and the second terminal 3 are set in the bedroom
  • the second terminal 4 is set in the study
  • the second terminal 5 is set in the children's room
  • the sensing camera 1 is set in the living room
  • the sensing camera 2 is set in the bedroom
  • the sensing camera 3 is set in the study
  • the sensing camera 4 is set in the children's room. Therefore, the control areas corresponding to the splicing processing system include the living room, bedroom, study room, and children's room.
  • connection processing system can process multimedia content through the first terminal, wherein the multimedia content can be multimedia data or multimedia files in any format and form, for example, the multimedia content includes but Not limited to video, audio, pictures, documents, etc.
  • the target object may be at least one user who is currently in the first area corresponding to the first terminal.
  • the first area may be an area within a certain range with the first terminal as a reference point.
  • connection processing system can use the camera to monitor the position of the target object in the first area corresponding to the first terminal, so as to obtain the first position information of the target object, and then can The first location information of the object determines the location relationship between the target object and the first terminal. It can be seen that the first location information can determine the location relationship between the target object and the first terminal.
  • FIG. 5 is a schematic diagram of determining location information.
  • the shooting device configured on the smart TV can detect users within a radius of 3 meters centered on the smart TV.
  • A performs location monitoring to determine the location information of user A in front of the smart TV, and determines that user A is located 2 meters directly in front of the smart TV based on the location information of user A and the location of the smart TV.
  • the camera photographing device configured on the smart TV
  • the camera can monitor the first area corresponding to the first terminal (in the form of The target object (user A) in the smart TV as the center and a radius of 3 meters) is monitored for position, so that the first position information corresponding to the target object can be determined, and the position between the target object and the first terminal can be determined.
  • the relationship is determined (user A is located 2 meters in front of the smart TV).
  • the camera may perform shooting processing on the target object in the first area at a first preset time interval, so that the monitoring process may be completed according to the captured image of the target object.
  • the first preset time interval may be set in advance by the connection processing system, for example, the first preset time interval is set to 10 seconds.
  • Step 102 if the first position information satisfies the preset switching condition, obtain the second position information of the target object through the camera.
  • the camera when the multimedia content is processed by the first terminal, the camera is used to monitor the position of the target object in the first area corresponding to the first terminal to obtain the location of the target object.
  • the subsequent processing system may obtain the second location information of the target object through the camera.
  • the preset switching condition is used to determine whether to switch the terminal processing the multimedia content. Specifically, if the preset switching condition is satisfied, the first terminal processing the multimedia content needs to be switched to another terminal.
  • the first location information satisfies the preset switching condition; if it is determined based on the first location information that the target object has not left the first area the first area, it may be determined that the first location information does not satisfy the preset switching condition.
  • the first terminal when judging whether the preset switching condition is satisfied, may directly execute the judging process, and then report the judging result to the control device and/or the cloud;
  • the camera can directly execute the judgment process, and then report the judgment result to the control device and/or the cloud; it can also directly execute the judgment process by the control device and/or the cloud after obtaining the first location information collected by the camera.
  • the multimedia content processed by the first terminal after using the camera to monitor the position of the target object in the first area corresponding to the first terminal and obtaining the first position information of the target object, if Based on the first location information, it is determined that the target object has left the first area, then it can be considered that the multimedia content processed by the first terminal cannot be obtained by the target object, so it is necessary to perform switching processing on the terminal processing the multimedia content; correspondingly, if based on the first If the location information determines that the target object has not left the first area, it can be considered that the multimedia content processed by the first terminal can still be acquired by the target object, and therefore the multimedia content can continue to be processed through the first terminal.
  • connection processing system determines that the first position information satisfies the preset switching condition, it may continue to track the position of the target object through the camera array to obtain the first position information of the target object. 2. Location information.
  • the second location information may be a specific location of the target object in an area other than the first area.
  • the second location information may be used to determine the location relationship between the target object and the second terminal. That is, the second position may be used to determine the relative positional relationship between the target object and other second terminals other than the first terminal after leaving the first area.
  • the camera may perform shooting processing according to a second preset time interval, so that the tracking processing may be completed according to the image of the target object obtained through shooting.
  • the second preset time interval may be set in advance by the connection processing system, for example, the second preset time interval is set to 5 seconds.
  • FIG. 6 is a schematic diagram of the second implementation flow of the multimedia content connection processing method proposed in the embodiment of the present application.
  • the connection processing system performs the connection of the multimedia content
  • the processing method may also include the following steps:
  • Step 105 if the first location information satisfies the preset switching condition, determine the content parameters of the multimedia content, the characteristic information of the target object, and the identification information of the first terminal.
  • the camera when the multimedia content is processed by the first terminal, the camera is used to monitor the position of the target object in the first area corresponding to the first terminal to obtain the location of the target object.
  • the connection processing system may further determine the content parameters of the multimedia content, the feature information of the target object, and the identification information of the first terminal.
  • the connection processing system may determine the content parameters of the multimedia content being processed through the first terminal.
  • the content parameters of the multimedia content may include at least one of the following parameters: a function type parameter, an application type parameter, a source parameter of the multimedia content, and a progress parameter of the multimedia content.
  • the content parameters corresponding to the video may include video type (function type parameter), player software application identifier (application type parameter), video link (multimedia source parameter of the content), video playback progress (the progress parameter of the multimedia content), etc.
  • the connection processing system may determine the characteristic information of the target object through the first terminal, or determine the target object’s characteristic information through the camera. characteristic information.
  • the feature information of the target object may represent the specific biological features of the target object.
  • the feature information of the target object may include but not limited to the target object's height features, clothing features, facial features wait.
  • connection processing system may determine the identification information of the first terminal through the first terminal when it is determined that the first location information satisfies the preset handover condition.
  • the connection processing system may further determine the identity information of the target object.
  • This identity information can be used to confirm the identity of the target object, so that after the tracking image is obtained through the real-time shooting process of the camera, the identity information of the target object can be used to confirm the identity of the person in the tracking image to accurately determine Get the second location information of the target object.
  • connection processing system when it obtains the second position information of the target object through the camera, it may first send a tracking request to the cloud through the control device; The cloud sends a tracking instruction to the camera; then the camera can perform real-time shooting processing to obtain a tracking image; finally, the second position information can be determined according to the feature information and the tracking image.
  • connection processing system when the connection processing system obtains the second position information of the target object through the camera, it may also directly send a tracking instruction to the camera through the control device; The camera performs real-time shooting processing to obtain a tracking image; finally, the second position information can be determined according to the characteristic information and the tracking image.
  • connection processing system can control the camera through the control device, so that the camera can perform real-time shooting processing and obtain corresponding tracking images; it can also use the control device to request the cloud to perform tracking The command is issued to obtain the corresponding tracking image based on the response of the camera to the tracking command.
  • each shooting device in the camera can choose to perform real-time shooting processing within its corresponding effective area, so that Tracking images detected by each camera can be obtained.
  • the first feature information when determining the second location information according to the feature information and the tracking image, may be firstly compared with the features in the tracking image.
  • the comparison process is to obtain a target image in the tracking image; wherein, the target image includes the target object; and then the second position information can be determined based on the target image.
  • the continuous processing system can combine the feature information of the target object with the person appearing in the tracking image The features of the target object are compared, so that the target image including the target object in the tracking image can be determined, and the second position information of the target object can be further determined by using the target image including the target object.
  • the pre-stored layout information may be pre-stored in the cloud and/or the control device and/or the camera and/or the first terminal and/or the second terminal; It can be synchronized to the cloud and/or the control device and/or the camera and/or the first terminal and/or the second terminal.
  • the control device in the connection processing system may The determination of the second position information is performed; the cloud in the connection processing system may also perform the determination of the second position information according to the tracking image obtained from the camera; it may also be that the camera in the connection processing system directly according to the acquired The image is tracked to perform the determination of the second location information.
  • Step 103 Determine a target terminal among at least one second terminal based on the second position information and the prestored layout information.
  • the connection processing system may further base on the second position information and the pre-stored layout information
  • a target terminal for performing splicing processing on the multimedia content is determined in at least one second terminal.
  • the pre-stored layout information may be preset by the connection processing system and represent the specific positional relationship and distance relationship between the first terminal, the second terminal, and the camera. That is to say, the layout of each device within the control area corresponding to the splicing processing system and the positional relationship between each device can be determined by pre-storing the layout information.
  • connection processing system can first perform detection processing within the control area corresponding to the connection processing system through the camera, so that any of the first terminal, the second terminal and the camera can be determined.
  • the relative position and distance between the two devices can finally generate the pre-stored layout information corresponding to the connection processing system.
  • connection processing system may also receive a modification instruction from the user, and modify and update specific information in the pre-stored layout information according to the modification instruction.
  • connection processing system when the connection processing system determines the target terminal among at least one second terminal based on the second position information and the pre-stored layout information, it may first base on the second position information and the The pre-stored layout information determines a distance parameter between the target object and at least one second terminal; then the second terminal corresponding to the smallest distance parameter may be determined as the target terminal.
  • the connection processing system determines at least one second location information between the target object and at least one second terminal, it can sequentially determine the target object and each of them according to the at least one second location information.
  • the distance between the second terminals is the distance parameter between the target object and at least one second terminal.
  • a second terminal with the closest distance to the target object may be determined as the target terminal, that is, the second terminal corresponding to the minimum distance parameter is determined as the target terminal for performing connection processing on the multimedia content.
  • connection processing system there are seven second terminals set in the connection processing system, which are respectively the second terminal 1, the second terminal 2, the second terminal 3, the second terminal 4, and the second terminal 5.
  • the connection processing system determines the second position information of the target object through the characteristic information of the target object, the tracking image collected by the camera and the pre-stored layout information
  • the connection processing system can determine the second position information of the target object according to the second The location information determines that the four distance parameters between the target object and the second terminal 2, the second terminal 3, the second terminal 4, and the second terminal 5 are 0.51 meters, 3.3 meters, 3.5 meters, and 4 meters, respectively. Since the target object It is closest to the second terminal 2, so the connection processing system can determine the second terminal 2 as the target terminal.
  • the control device in the connection processing system may perform the determination of the target terminal, or the cloud in the connection processing system may The determination of the target terminal is performed.
  • connection processing system before the connection processing system determines the target terminal among at least one second terminal based on the second location information and pre-stored layout information, it may first determine the capability parameter corresponding to the second terminal ; Wherein, the capability parameter indicates the multimedia application possessed by the second terminal.
  • the connection processing system may first determine the processing capability of the multimedia content supported by the second terminal. Specifically, the connection processing system may first determine the multimedia application representing the multimedia content supported by the second terminal, that is, determine the corresponding capability parameter of the second terminal.
  • connection processing system when the connection processing system determines the target terminal among at least one second terminal based on the second position information and the pre-stored layout information, it may first base on the capability parameter and the Content parameters determine a candidate terminal supporting the multimedia content in at least one of the second terminals; and then determine the distance between the target object and the candidate terminal based on the second position information and the pre-stored layout information parameter; finally, the candidate terminal corresponding to the smallest distance parameter can be determined as the target terminal.
  • connection processing system determines the target terminal, it needs to first perform screening processing according to the capability parameters corresponding to the second terminal, and will not have the ability to continue processing the corresponding multimedia content
  • the second terminal screened out.
  • the second terminal that does not have a corresponding multimedia application is excluded, and the target terminal is determined only among the candidate terminals that have a multimedia application capable of supporting the multimedia content.
  • Step 104 continue to process the multimedia content through the target terminal.
  • the connection processing system may choose to use the target terminal according to the multimedia content
  • the content parameter continues to process the multimedia content.
  • the connection processing system uses the camera to determine the second location information corresponding to the target object, and according to the second location information After the target terminal closest to the target object is determined among the at least one second terminal, the multimedia content can be continued to be processed through the target terminal.
  • the target terminal may first acquire the content parameters of the multimedia content, and then continue to process the multimedia content according to the content parameters.
  • the control device may first send a handover message to the target terminal. Instruction; wherein, the switching instruction carries the content parameter.
  • the target terminal can receive the switch command sent by the control device, and then can obtain the content parameter of the multimedia content through the switch command, so that the connection processing of the multimedia content can be performed according to the content parameter.
  • the connection processing system may first send the A switching instruction, so that the target terminal obtains the content parameter from the first terminal based on the switching instruction; wherein, the switching instruction carries the identification information.
  • the target terminal can receive the switching instruction sent by the control device, and then can obtain the identification information of the first terminal through the switching instruction, and can establish a connection with the first terminal through the identification information , and then the content parameter of the multimedia content can be acquired from the first terminal, and finally the multimedia content can be spliced according to the content parameter.
  • the switching instruction carrying content parameters or identification information can not only be sent by the control device to the target terminal, but also can be sent by the cloud to the target terminal.
  • connection processing system when the connection processing system continues to process the multimedia content through the target terminal according to the content parameters of the multimedia content, if the target terminal has a multimedia application corresponding to the content parameters, Then, the connection processing system may execute the connection processing of the multimedia content through the multimedia application of the target terminal.
  • the target terminal in the connection processing system can first confirm whether it can perform connection processing according to the content parameters of the multimedia content, that is, determine whether the target terminal has the multimedia content corresponding to the connection processing Ability. Specifically, the target terminal may first determine whether it has a multimedia application capable of supporting the multimedia content based on the content parameter. If there is a corresponding multimedia application, then the multimedia application can be used to perform multimedia content connection processing according to the content parameter.
  • connection processing system has a connection processing function for performing connection processing of multimedia content, and the connection processing system needs to start the work corresponding to the connection processing function before executing the connection processing. model.
  • the connection processing system can monitor the position of the target object through the camera.
  • FIG. 7 is a schematic diagram of the third implementation flow of the multimedia content connection processing method proposed in the embodiment of the present application.
  • the method for the connection processing system to perform connection processing of multimedia content may further include the following steps:
  • Step 106 When the multimedia content is processed by the first terminal, use the camera to monitor the second area of the second terminal, and obtain a monitoring result.
  • Step 107 if the monitoring result indicates that the target object in the second area satisfies the preset switching condition, obtain second position information of the target object through the camera.
  • the connection processing system when the multimedia content is processed by the first terminal, the connection processing system can use the camera to monitor the second area corresponding to the first terminal, so as to obtain the monitoring result. If the monitoring result indicates that the target object in the second area satisfies the preset switching condition, then the connection processing system may obtain the second position information of the target object through the camera.
  • the target object may be at least one user who has appeared in the first area corresponding to the first terminal when the first terminal processes the multimedia content.
  • the first area may be an area within a certain range with the first terminal as a reference point.
  • the monitoring result obtained by the connection processing system monitoring the second area of the second terminal through the camera may be that there is a target object in the second area or that there is no target object in the second area.
  • the monitoring result indicates that the target object in the second area has appeared in the first area, it can be determined that the preset switching condition is met; if the monitoring result indicates that the target object in the second area has not appeared in the first area appears in an area, then it can be determined that the preset switching condition is not met.
  • the connection processing system may first process the Confirm the identity of the user appearing in the first area when multimedia content is used to obtain the corresponding identity mark, and then confirm the identity of the target object appearing in the second area according to the monitoring results, and obtain the corresponding identity mark. If both IDs are the same, it may be considered that the monitoring result indicates that the target object in the second area satisfies the preset switching condition.
  • connection processing system when it obtains the second position information of the target object through the camera, it may first send a tracking request to the cloud through the control device; The cloud sends a tracking instruction to the camera; then the camera can perform real-time shooting processing to obtain a tracking image; finally, the second position information can be determined according to the feature information and the tracking image.
  • connection processing system when the connection processing system obtains the second position information of the target object through the camera, it may also directly send a tracking instruction to the camera through the control device; The camera performs real-time shooting processing to obtain a tracking image; finally, the second position information can be determined according to the characteristic information and the tracking image.
  • the connection processing system may determine in at least one second terminal based on the second location information and pre-stored layout information.
  • the target terminal that performs continuous processing on the multimedia content, and then continues to process the multimedia content through the target terminal.
  • the connection processing system can re-determine the target terminal for the connection and processing of the multimedia content in at least one second terminal, and pass the target terminal The terminal completes the connection processing of the multimedia content.
  • FIG. 8 is a schematic diagram of the fourth implementation flow of the multimedia content continuation processing method proposed in the embodiment of the present application.
  • the method for the connection processing system to perform multimedia content connection processing may also include the following steps:
  • Step 108 When processing multimedia content through the first terminal, if a control operation is detected through the second terminal, determine a target object corresponding to the control operation through the camera.
  • Step 109 if the target object satisfies the preset switching condition, determine the second terminal as the target terminal.
  • the connection processing system when processing multimedia content through the first terminal, if a control operation is detected through the second terminal, the connection processing system may first determine the target object corresponding to the control operation through the camera, If the target object satisfies the preset switching condition, the connection processing system may determine the second terminal as the target terminal for performing multimedia content connection processing.
  • the target object may be at least one user who has appeared in the first area corresponding to the first terminal when the first terminal processes the multimedia content.
  • the first area may be an area within a certain range with the first terminal as a reference point.
  • the target object performing operation processing if the target object performing operation processing has appeared in the first area, it can be determined that the preset switching condition is met; if the target object performing operation processing has not appeared in appears in the first area, then it can be determined that the preset switching condition is not met.
  • the connection processing system may first check the The identity of the user is confirmed to obtain the corresponding identity, and then the identity of the target object corresponding to the operation process can be confirmed to obtain the corresponding identity. If the two identities are the same, the target object can be considered to meet the preset switching condition.
  • the processing device may consider that the second terminal that detects the operation process is the terminal closest to the target object, and can be used to execute the multimedia content Therefore, the second terminal can be directly determined as the target terminal, so that the target terminal can continue to process the multimedia content according to the content parameters of the multimedia content.
  • the connection processing system when the first terminal is processing multimedia content, if the second terminal detects the operation processing, then the connection processing system can confirm the identity of the target object corresponding to the operation processing, if If the target object is determined to be a user who is far away from the first terminal when the first terminal is processing multimedia content, then the connection processing system can directly determine the second terminal as the target terminal for continuous processing of multimedia content, and pass the target The terminal completes the connection processing of the multimedia content.
  • the above step 101 to step 108 propose a multimedia content connection processing method, which is a capability connection solution that can be applied to smart home terminal equipment, and the connection processing system perceives the user
  • the control device in the connection processing system can use the camera including multiple shooting devices to track the user's position, and can combine the representation of the room type diagram and the equipment location layout and other pre-stored layout information to determine the target terminal closest to the user, and use the target terminal to perform splicing of multimedia content.
  • the multimedia content connection processing method proposed in the embodiment of the present application can use the camera in the connection processing system in combination with the type of home and the terminal installation position to sense the change of the user's location, so as to match the switching focus terminal device. And through the connection processing method, the connection processing system can use the capability connection service to automatically connect the capability application content of different types of terminals to another device, and the whole process can be seamlessly connected even without any operation or instruction issued by the user.
  • An embodiment of the present application provides a multimedia content connection processing method, which is applied to a connection processing system.
  • the connection processing system includes a first terminal, a second terminal, and a camera.
  • the camera is used to monitor the first
  • the target object in the first area corresponding to the terminal performs position monitoring to obtain the first position information of the target object; if the first position information meets the preset switching condition, the second position information of the target object is obtained through the camera; based on the second position
  • the information and the pre-stored layout information determine a target terminal in at least one second terminal; the multimedia content continues to be processed by the target terminal.
  • the connection processing system can use the camera to track the position of the user, and combine the pre-stored layout information in at least one
  • the second terminal determines the target terminal closest to the user to perform multimedia content connection processing, thereby realizing automatic connection processing of multimedia content in response to user location changes, thereby improving the intelligence and reliability of multimedia content connection processing.
  • another embodiment of the present application proposes a method for connection processing of multimedia content, and the method for connection processing of multimedia content can be applied in a connection processing system.
  • FIG. 9 is a schematic diagram of the third structure of the connection processing system proposed in the embodiment of the present application.
  • the connection processing system can be composed of a control device, a mobile terminal (first terminal) , a plurality of multimedia terminals (second terminal), a camera group (including at least one sensing camera), and a smart home cloud (cloud).
  • the mobile terminal and the multimedia terminal may also be configured with a camera, and may form a camera group together with the sensing camera.
  • mobile terminals, multimedia terminals, smart cameras, and control devices in the connection processing system can be bound to the user account name of the smart home cloud by scanning two-dimensional codes, wireless pairing, and other connection methods.
  • the mobile terminal, multimedia terminal, and camera group can maintain a high-speed network connection with the smart home cloud.
  • the mobile terminal, multimedia terminal, and camera group can maintain a local area network connection with the control device.
  • control device can be a router, a dedicated device or a smart device (mobile phone, tablet or computer) through the installation of software, and it can also be connected with the mobile terminal or
  • the form of combining two multimedia terminals into one, that is, a mobile terminal or a multimedia terminal can not only be used to process multimedia content, but also can be used to perform control functions.
  • the mobile terminal or multimedia terminal may be configured with a capability application (A1 or B1), where the capability application may be an application that presents certain capability content, such as video playback capability, audio playback capability , picture playback capability, document processing capability, etc.
  • A1 or B1 a capability application
  • the capability application may be an application that presents certain capability content, such as video playback capability, audio playback capability , picture playback capability, document processing capability, etc.
  • the mobile terminal or multimedia terminal may be configured to be capable of connecting to a software development kit (Software Development Kit, SDK) (A2 or B2).
  • a software development kit Software Development Kit, SDK
  • A2 or B2 can register the capability identifier of A1 or B1 with the connection service, so that the capability connection service can retrieve the application capability of A1 or B1 even when A1 and B1 are not started, And determine whether the capabilities of the mobile terminal and the multimedia terminal match. For example, check whether the TV has the ability to continue the XX video on the mobile phone.
  • A2 or B2 can parameterize the currently processed multimedia content, obtain corresponding content parameters (such as multimedia identification address, progress), and update the content parameters to the capability connection service (A3 or B3 ), so that the capability connection service can perform capability matching processing, that is, it can be judged whether the multimedia content processed by A1 can be connected to B1 for processing.
  • content parameters such as multimedia identification address, progress
  • capability connection service A3 or B3
  • the mobile terminal or the multimedia terminal may be configured with a capability connection service (A3 or B3), and the capability connection service may be a resident service running on the terminal device.
  • A3 or B3 capability connection service
  • the capability connection service may be a resident service running on the terminal device.
  • the capability continuation service can acquire the capability application currently running in the foreground of the system in real time through the capability continuation SDK.
  • the capability connection service can perform capability matching and connection according to the capability connection request sent by the control device.
  • the application B1 can be pulled up and the content corresponding to A1 The parameters are transmitted to B1, so that the user can watch the multimedia content played on A1 on another device through B1.
  • the capability continuation service can suspend the capability presentation of the current application, parameterize the capability presentation status, and obtain corresponding content parameters (such as video Play, extract the application package name of the video, the address of the video, etc.).
  • the mobile terminal or multimedia terminal may be configured with a focus sensing service (A4 or B4), specifically for sensing the mobile terminal being observed or operated by the user (target object).
  • A4 or B4 focus sensing service
  • the focus sensing service may call A5 or B5 to perform photo analysis in the background at regular intervals (for example, at a time interval of 5 seconds), so as to monitor whether the target object is leaving or approaching. Notifies the control device when an exit or approach event is detected.
  • the capability application A1 can notify A4 through A2 that the current device has gained focus, and A4 further confirms the identity of the operator through camera photo analysis. If the identity matches the corresponding account, the control device is notified.
  • the mobile terminal or the multimedia terminal may be equipped with a camera analysis module (A5 or B5), which can analyze the images acquired by the camera, and use existing technologies to realize face recognition matching family membership.
  • a camera analysis module A5 or B5
  • the capability connection service control notifies the start of the camera analysis module, and activates the camera analysis module to track the position of the target object.
  • the camera analysis module can also identify the approaching and moving away of the target object, and turn it into an event notification to the control device.
  • the mobile terminal or the multimedia terminal may be configured with a camera (A6 or B6), where A6 or B6 may serve as a component of the camera group.
  • the mobile terminal or the multimedia terminal may be configured with an account module (A7 or B7), where the account module may connect the account of the device to the control device.
  • account module A7 or B7
  • the camera group may be configured with at least one camera (C1), wherein, in addition to processing an independently configured sensing camera, it may also include a camera (A6 or B6) in a mobile terminal or a multimedia terminal. ).
  • the camera group can be equipped with a camera analysis module (C2), which can analyze the images acquired by the cameras, and use existing technologies to realize face recognition and match family member identities.
  • C2 camera analysis module
  • the camera group may be configured with a focus sensing service (C3), specifically for sensing the mobile terminal that the user (target object) is observing or operating.
  • C3 focus sensing service
  • the camera group may be configured with an account module (C4), where the account module may connect the account of the device to the control device.
  • C4 account module
  • control device may be configured with an account module (D1), wherein the account module is used to connect all devices logged in with an account under the same family group name to the control device, establish a local area network connection, and Establish a data channel for each terminal's focus sensing service and capability extension module.
  • D1 account module
  • control device may be configured with a focus analysis module (D2).
  • D2 focus analysis module
  • the perception ability of the module calculates and matches the matching device that the user is close to and stays, and then the content of the ability application that is being played on the mobile terminal that lost focus before can be connected to the new device (target terminal) where the user moves and stays.
  • control device may be configured with a device layout database (D3), wherein, the device layout record (prestored layout information) generated by online editing by the user in the cloud, the layout includes the overall and each room The name, number, room type diagram, relative coordinates of the equipment on the room type diagram, orientation, etc.
  • D3 device layout database
  • the smart home cloud may be configured with an account service (E1).
  • E1 account service is used to unify the service accounts of each terminal.
  • Each terminal can be bound through the unified account of the user, and can join the management and control of the cloud and control devices. Discover each other through the cloud. After the terminal device logs in to the bound device, it remains in a login-free state for a certain period of time, such as three months. After the terminal is powered on and connected to the network, it can synchronize its own status to the control device and the cloud.
  • the smart home cloud may be configured with a connection setting (E2).
  • This continuation setting can be used to control the overall application switch of the present application, and can also configure the home room layout diagram and the position of the multimedia terminal (fixed position such as a TV set), and the position of the smart camera (fixed position) on the web page by dragging the graphic elements and tools ) and directions to generate equipment layout records (pre-stored layout information), and simultaneously synchronize the equipment layout records to the equipment layout database (D3) of the control equipment.
  • the smart home cloud can be configured with an event push (E3), which is mainly responsible for pushing the event status of the terminal to the control device or any terminal.
  • E3 event push
  • FIG. 10 is a schematic diagram of the fifth implementation flow of the multimedia content connection processing method proposed in the embodiment of the present application.
  • the connection processing system performs the multimedia content connection processing method. Include the following steps:
  • Step 201 When a first terminal processes multimedia content, determine first location information of a target object.
  • the first terminal perceives through the capability SDK (A2) that a capable application on the current device terminal is running in the foreground, that is, processing multimedia content, such as playing video.
  • the capability continuation service (A3) in the first terminal is running in the background, and the capability continuation service notifies the focus sensing service (A4) to perform focus switch sensing.
  • the focus sensing service (A4) invokes the camera analysis module (A5) to monitor the position of the target object and obtain corresponding first position information.
  • the camera analysis module (A5) can regularly capture the first terminal according to a certain time interval (such as 5 seconds) through the camera (A6).
  • a certain time interval such as 5 seconds
  • Step 202 If it is determined based on the first location information that the target object is far away from the first terminal, send a connection request to the control device.
  • the first terminal may suspend the processing of the multimedia content and send a connection request to the control device to notify the control device to execute Follow-up processing.
  • the connection request received by the control device may carry the user identity of the target object, the leaving event, the identification information of the first terminal, and the content parameters of the multimedia content being processed.
  • the content parameter may include at least one of the following multiple parameters: a function type parameter indicating a large category of capabilities (such as video playback), an application type parameter indicating a small category of capabilities (such as XX video application), and a multimedia parameter indicating a capability ID.
  • the source parameter of the content such as a digital code to identify a specific video
  • the progress parameter of the multimedia content indicating the capability parameter (such as video progress).
  • Step 203 In response to the connection request, the control device sends a tracking instruction to the camera group to obtain second position information of the target object.
  • the control device after receiving the connection request sent by the first terminal, the control device can send a tracking instruction to the camera group, so that the target object can be repositioned through the camera group, and the target object's second location can be determined.
  • Location information After receiving the connection request sent by the first terminal, the control device can send a tracking instruction to the camera group, so that the target object can be repositioned through the camera group, and the target object's second location can be determined.
  • the focus analysis module (D2) of the control device can send a message to the same account or a related account through the push function of the local area network or the cloud.
  • the camera of the target object sends a notification of location tracking, wherein the camera also includes the camera (B6) configured on the second terminal.
  • the focus sensing service (C3) of the camera or the focus sensing service (B4) of the second terminal can analyze the camera ( C1, B6)
  • the identification process of the captured tracking image is to determine whether there is a target object in the currently captured picture, and if so, determine the second position information of the target object, and report the second position information to the control terminal.
  • Step 204 the control device determines the target terminal according to the prestored layout information and the second location information.
  • control information determines the second position information of the target object, it may further combine the pre-generated pre-stored layout information and the second position information to determine from the second terminal the link used to execute the multimedia content.
  • the target terminal to process.
  • the pre-stored layout information in the equipment layout database (D3) of the control equipment can determine the room layout and equipment location.
  • the control device can perform matching processing with the determined second position information of the target object according to the positional relationship and distance relationship between each camera and the second terminal recorded in the pre-stored layout information, and finally can be in at least one second terminal.
  • the terminal device with the closest distance to the target object is determined, that is, the target terminal.
  • Step 205 the control device sends a connection instruction to the target terminal, so that the target terminal continues to process the multimedia content.
  • the control device after the control device determines the target terminal closest to the target object from the second terminal, it can send a connection instruction to the target terminal, wherein the connection instruction can carry the content parameters of the multimedia content, Therefore, after receiving the connection instruction, the target terminal can continue to process the multimedia content according to the content parameters.
  • control device notifies the target terminal closest to the target object through the data connection, and sends the content parameters of the capability application of the first terminal that lost focus to the target terminal.
  • the target terminal after receiving the connection instruction, can use the function type parameter (such as video playback) indicating a large category of capabilities in the content parameters, and the application type parameter (such as XX video application), the source parameter of the multimedia content indicating the capability ID (such as a digital code to identify a specific video), the progress parameter of the multimedia content indicating the capability parameter (such as video progress) to retrieve whether there is a registered matching capability connection in the target terminal Applications. If so, the application is launched, and the content parameters are passed to the application through the capability connection SDK, so as to perform capability connection processing (such as video playback).
  • the function type parameter such as video playback
  • the application type parameter such as XX video application
  • the source parameter of the multimedia content indicating the capability ID such as a digital code to identify a specific video
  • the progress parameter of the multimedia content indicating the capability parameter such as video progress
  • connection processing system can simultaneously identify and track the identities and locations of different family members, such as parents and children.
  • family members such as parents and children.
  • the parents watch movies in the living room and the children watch cartoons in the room. Switching can realize the seamless switching between the two watching programs. Children watch cartoons in the living room, and parents watch movies in the room.
  • connection processing system can also realize buffer connection of multimedia capabilities. For example, parents write documents for a while on the computer in the room, watch movies for a while, and browse web pages, and children watch animations in the living room. The child turns off the TV in the living room, and the two exchange positions. The connection processing system can quickly continue the animation for the child in the room. After 10 minutes, the parents turn on the TV, and the TV can ask the parents which type of animation they want to continue. Multimedia processing and continued processing of documents or movies or web browsing determined by the parent's choice.
  • An embodiment of the present application provides a multimedia content connection processing method, which is applied to a connection processing system.
  • the connection processing system includes a first terminal, a second terminal, and a camera.
  • the camera is used to monitor the first
  • the target object in the first area corresponding to the terminal performs position monitoring to obtain the first position information of the target object; if the first position information meets the preset switching condition, the second position information of the target object is obtained through the camera; based on the second position
  • the information and the pre-stored layout information determine a target terminal in at least one second terminal; the multimedia content continues to be processed by the target terminal.
  • the connection processing system can use the camera to track the position of the user, and combine the pre-stored layout information in at least one
  • the second terminal determines the target terminal closest to the user to perform multimedia content connection processing, thereby realizing automatic connection processing of multimedia content in response to user location changes, thereby improving the intelligence and reliability of multimedia content connection processing.
  • FIG. 11 is a schematic diagram 4 of the composition and structure of the connection processing system proposed in the embodiment of the present application.
  • the terminal device 10 proposed in the embodiment of the present application may include An acquisition unit 16, a determination unit 17, a processing unit 18,
  • the acquiring unit 16 is configured to monitor the position of the target object in the first area corresponding to the first terminal by using the camera to obtain the first position information of the target object when the multimedia content is processed through the first terminal; If the first position information satisfies a preset switching condition, obtaining second position information of the target object through the camera;
  • the determining unit 17 is configured to determine a target terminal among at least one second terminal based on the second location information and pre-stored layout information;
  • the processing unit 18 is configured to continue processing the multimedia content through the target terminal.
  • FIG. 12 is a schematic diagram of the fifth composition structure of the connection processing system proposed in the embodiment of the present application.
  • the terminal device 10 proposed in the embodiment of the present application may also include a processor 19 , a memory 110 storing instructions executable by the processor 19 , further, the terminal device 10 may further include a communication interface 111 , and a bus 112 for connecting the processor 19 , the memory 110 and the communication interface 111 .
  • the above-mentioned processor 19 may be an application specific integrated circuit (Application Specific Integrated Circuit, ASIC), a digital signal processor (Digital Signal Processor, DSP), a digital signal processing device (Digital Signal Processing Device, DSPD ), Programmable Logic Device (ProgRAMmable Logic Device, PLD), Field Programmable Gate Array (Field ProgRAMmable Gate Array, FPGA), Central Processing Unit (Central Processing Unit, CPU), controller, microcontroller, microprocessor at least one of .
  • ASIC Application Specific Integrated Circuit
  • DSP Digital Signal Processor
  • DSPD Digital Signal Processing Device
  • PLD Programmable Logic Device
  • Field Programmable Gate Array Field ProgRAMmable Gate Array
  • FPGA Field ProgRAMmable Gate Array
  • CPU Central Processing Unit
  • controller microcontroller, microprocessor at least one of .
  • the terminal device 10 may also include a memory 110, which may be connected to the processor 19, wherein the memory 110 is used to store executable program codes, the program codes include computer operation instructions, and the memory 110 may include a high-speed RAM memory, and may also include Includes non-volatile memory, eg, at least two disk memories.
  • the bus 112 is used to connect the communication interface 111 , the processor 19 and the memory 110 and communicate with each other among these devices.
  • the memory 110 is used to store instructions and data.
  • the above-mentioned processor 19 is configured to, when the multimedia content is processed by the first terminal, use the camera to monitor the target object in the first area corresponding to the first terminal. Position monitoring, obtaining first position information of the target object; if the first position information satisfies a preset switching condition, obtaining second position information of the target object through the camera; based on the second position information and pre-stored layout information to determine a target terminal in at least one of the second terminals; continue to process the multimedia content through the target terminal.
  • the above-mentioned memory 110 can be a volatile memory (volatile memory), such as a random access memory (Random-Access Memory, RAM); or a non-volatile memory (non-volatile memory), such as a read-only memory (Read-Only Memory, ROM), flash memory (flash memory), hard disk (Hard Disk Drive, HDD) or solid state disk (Solid-State Drive, SSD); Provide instructions and data.
  • volatile memory such as a random access memory (Random-Access Memory, RAM)
  • non-volatile memory such as a read-only memory (Read-Only Memory, ROM), flash memory (flash memory), hard disk (Hard Disk Drive, HDD) or solid state disk (Solid-State Drive, SSD); Provide instructions and data.
  • each functional module in this embodiment may be integrated into one processing unit, each unit may exist separately physically, or two or more units may be integrated into one unit.
  • the above-mentioned integrated units can be implemented in the form of hardware or in the form of software function modules.
  • the integrated unit is implemented in the form of a software function module and is not sold or used as an independent product, it can be stored in a computer-readable storage medium.
  • the technical solution of this embodiment is essentially or The part contributed by the prior art or the whole or part of the technical solution can be embodied in the form of software products, the computer software products are stored in a storage medium, and include several instructions to make a computer device (which can be a personal A computer, a server, or a network device, etc.) or a processor (processor) executes all or part of the steps of the method of this embodiment.
  • the aforementioned storage medium includes: U disk, mobile hard disk, read only memory (Read Only Memory, ROM), random access memory (Random Access Memory, RAM), magnetic disk or optical disk and other various media that can store program codes.
  • An embodiment of the present application provides a connection processing system.
  • the connection processing system includes a first terminal, a second terminal, and a camera.
  • the object performs position monitoring to obtain the first position information of the target object; if the first position information meets the preset switching condition, the second position information of the target object is obtained through the camera; based on the second position information and pre-stored layout information in at least one first position information
  • the target terminal is determined among the two terminals; and the multimedia content is continued to be processed through the target terminal.
  • the connection processing system can use the camera to track the position of the user, and combine the pre-stored layout information in at least one
  • the second terminal determines the target terminal closest to the user to perform multimedia content connection processing, thereby realizing automatic connection processing of multimedia content in response to user location changes, thereby improving the intelligence and reliability of multimedia content connection processing.
  • An embodiment of the present application provides a computer-readable storage medium, on which a program is stored, and when the program is executed by a processor, the above-mentioned multimedia content continuation processing method is implemented.
  • the program instructions corresponding to a multimedia content connection processing method in this embodiment can be stored on a storage medium such as an optical disc, a hard disk, or a USB flash drive.
  • a storage medium such as an optical disc, a hard disk, or a USB flash drive.
  • Processing of the multimedia content continues by the target terminal.
  • the embodiments of the present application may be provided as methods, systems, or computer program products. Accordingly, the present application may take the form of a hardware embodiment, a software embodiment, or an embodiment combining software and hardware aspects. Furthermore, the present application may take the form of a computer program product embodied on one or more computer-usable storage media (including but not limited to disk storage and optical storage, etc.) having computer-usable program code embodied therein.
  • a computer-usable storage media including but not limited to disk storage and optical storage, etc.
  • These computer program instructions may also be stored in a computer-readable memory capable of directing a computer or other programmable data processing apparatus to operate in a specific manner, such that the instructions stored in the computer-readable memory produce an article of manufacture comprising instruction means, the instructions
  • the device realizes the function specified in implementing one or more procedures of the flowchart and/or one or more blocks of the block diagram.
  • Embodiments of the present application provide a multimedia content connection processing method, system, and storage medium, which are applied to a connection processing system.
  • the connection processing system includes a first terminal, a second terminal, and a camera.
  • When multimedia content is processed through the first terminal use the camera to monitor the position of the target object in the first area corresponding to the first terminal, and obtain the first position information of the target object; if the first position information satisfies the preset switching condition, obtain the second position of the target object through the camera information; determine a target terminal in at least one second terminal based on the second location information and pre-stored layout information; continue to process multimedia content through the target terminal.
  • the connection processing system can use the camera to track the position of the user, and combine the pre-stored layout information in at least one
  • the second terminal determines the target terminal closest to the user to perform multimedia content connection processing, thereby realizing automatic connection processing of multimedia content in response to user location changes, thereby improving the intelligence and reliability of multimedia content connection processing.

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Computer Networks & Wireless Communication (AREA)
  • Health & Medical Sciences (AREA)
  • General Health & Medical Sciences (AREA)
  • Social Psychology (AREA)
  • Databases & Information Systems (AREA)
  • Two-Way Televisions, Distribution Of Moving Picture Or The Like (AREA)

Abstract

本申请实施例公开了一种多媒体内容的接续处理方法和***、及存储介质,应用于接续处理***,接续处理***包括第一终端、第二终端、摄像头,当通过第一终端处理多媒体内容时,利用摄像头对第一终端对应的第一区域中的目标对象进行位置监控,获得目标对象的第一位置信息;若第一位置信息满足预设切换条件,则通过摄像头获得目标对象的第二位置信息;基于第二位置信息和预存布局信息在至少一个第二终端中确定目标终端;通过目标终端继续处理多媒体内容。

Description

多媒体内容的接续处理方法和***、及存储介质
相关申请的交叉引用
本申请要求在2021年08月19日提交的申请号为202110953962.9、申请名称为“多媒体内容的接续处理方法和***、及存储介质”的中国专利申请的优先权,该中国专利申请的全部内容通过引用结合在本申请中。
技术领域
本申请涉及通信技术领域,尤其涉及一种多媒体内容的接续处理方法和***、及存储介质。
背景技术
目前,常见的如手机、电视等终端可以基于Wi-Fi Display,Miracast等投屏方案将正在观看的内容投屏到其他设备上。其中,一些终端也具有多设备互动视频接续能力,能扫描出周边支持多媒体内容接续的其他设备,然后进行内容投射。
然而,在用户的位置不断改变的场景中,场景的多媒体内容的接续处理方法并不能及时准确地选择接续处理的设备,智能性低,可靠性差。
发明内容
本申请实施例提供了一种多媒体内容的接续处理方法和***、及存储介质,能够保证语音业务的成功建立,提高了语音业务的可靠性。
本申请实施例的技术方案是这样实现的:
第一方面,本申请实施例提供了一种多媒体内容的接续处理方法,所述多媒体内容的接续处理方法应用于接续处理***,所述接续处理***包括第一终端、第二终端、摄像头,所述方法包括:
当通过所述第一终端处理多媒体内容时,利用所述摄像头对所述第一终端对应的第一区域中的目标对象进行位置监控,获得所述目标对象的第一位置信息;
若所述第一位置信息满足预设切换条件,则通过所述摄像头获得所述目标对象的第二位置信息;
基于所述第二位置信息和预存布局信息在至少一个所述第二终端中确定目标终端;
通过所述目标终端继续处理所述多媒体内容。
第二方面,本申请实施例提供了一种接续处理***,所述接续处理***包括:获取单元,确定单元,处理单元,
所述获取单元,配置为当通过第一终端处理多媒体内容时,利用摄像头对所述第一终端对应的第一区域中的目标对象进行位置监控,获得所述目标对象的第一位置信息;若所述第一位置信息满足预设切换条件,则通过所述摄像头获得所述目标对象的第二位置信息;
所述确定单元,配置为基于所述第二位置信息和预存布局信息在至少一个第二终端中确定目标终端;
所述处理单元,配置为通过所述目标终端继续处理所述多媒体内容。
第三方面,本申请实施例提供了一种接续处理***,所述终端设备包括处理器、存储 有所述处理器可执行指令的存储器,当所述指令被所述处理器执行时,实现如第一方面所述的多媒体内容的接续处理方法。
第四方面,本申请实施例提供了一种计算机可读存储介质,其上存储有程序,所述程序被处理器执行时,实现如第一方面所述的多媒体内容的接续处理方法。
本申请实施例提供了一种多媒体内容的接续处理方法和***、及存储介质,应用于接续处理***,接续处理***包括第一终端、第二终端、摄像头,当通过第一终端处理多媒体内容时,利用摄像头对第一终端对应的第一区域中的目标对象进行位置监控,获得目标对象的第一位置信息;若第一位置信息满足预设切换条件,则通过摄像头获得目标对象的第二位置信息;基于第二位置信息和预存布局信息在至少一个第二终端中确定目标终端;通过目标终端继续处理多媒体内容。由此可见,在本申请的实施例中,如果第一终端处理多媒体内容的过程中用户远离了第一终端,那么接续处理***可以利用摄像头对用户进行位置追踪,并结合预存布局信息在至少一个第二终端中确定出与用户距离最近的目标终端进行多媒体内容接续处理,从而可以实现响应于用户位置改变的多媒体内容的自动接续处理,进而可以提升多媒体内容接续处理的智能性和可靠性。
附图说明
图1为本申请实施例提出的接续处理***的组成结构示意图一;
图2为本申请实施例提出的接续处理***的组成结构示意图二;
图3为本申请实施例提出的多媒体内容的接续处理方法的实现流程示意图一;
图4为控制区域的示意图;
图5为确定位置信息的示意图;
图6为本申请实施例提出的多媒体内容的接续处理方法的实现流程示意图二;
图7为本申请实施例提出的多媒体内容的接续处理方法的实现流程示意图三;
图8为本申请实施例提出的多媒体内容的接续处理方法的实现流程示意图四;
图9为本申请实施例提出的接续处理***的组成结构示意图三;
图10为本申请实施例提出的多媒体内容的接续处理方法的实现流程示意图五;
图11为本申请实施例提出的接续处理***的组成结构示意图四;
图12为本申请实施例提出的接续处理***的组成结构示意图五。
具体实施方式
下面将结合本申请实施例中的附图,对本申请实施例中的技术方案进行清楚、完整地描述。可以理解的是,此处所描述的具体实施例仅用于解释相关申请,而非对该申请的限定。另外还需要说明的是,为了便于描述,附图中仅示出了与有关申请相关的部分。
除非另有定义,本文所使用的所有的技术和科学术语与属于本申请的技术领域的技术人员通常理解的含义相同。本文中所使用的术语只是为了描述本申请实施例的目的,不是旨在限制本申请。
在以下的描述中,涉及到“一些实施例”,其描述了所有可能实施例的子集,但是可以理解,“一些实施例”可以是所有可能实施例的相同子集或不同子集,并且可以在不冲突的情况下相互结合。还需要指出,本申请实施例所涉及的术语“第一\第二\第三”仅是用于区别类似的对象,不代表针对对象的特定排序,可以理解地,“第一\第二\第三”在允许的情况下可以互换特定的顺序或先后次序,以使这里描述的本申请实施例能够以除了在这里图示或描述的以外的顺序实施。
无线视频显示(Wi-Fi Display)可以让使用者在不需要连接线的情况下享受高画质影像显示效果,该技术可以压缩三维(3-dimension,3D)视频,从而通过无线通信技术(Wi-Fi) 传输。3D视频很耗宽带,如果不压缩就会迟滞,Wi-Fi Display技术可以将延迟时间降到百分之一毫秒以下。
Miracast是由Wi-Fi联盟(WiFi Alliance)制定的以Wi-Fi直连(Wi-Fi Direct)为基础的无线显示标准。支持此标准的3C(通讯产品(Communication)、电脑产品(Computer)、消费类电子产品(Consumer))设备可透过无线方式分享视频画面,例如手机可透过Miracast将视频或照片直接在电视或其他设备播放而无需任何连接线,也不需透过无线热点(AP,Access Point)。
Miracast实际上就是WiFi联盟对支持WiFi Display功能的设备的认证名称,而通过Miracast认证的设备,便可提供简化发现和设置,实现设备间高速传输视频。
目前,常见的如手机、电视等终端可以基于Wi-Fi Display,Miracast等投屏方案将正在观看的内容投屏到其他设备上。其中,一些终端也具有多设备互动视频接续能力,能扫描出周边支持多媒体内容接续的其他设备,然后进行内容投射。
然而,在存在多个设备的情况下,比如家里有多个房间均有电视,当切换房间时,并不能感知目标对象位置的改变,因此无法自动切换媒体投射的焦点设备。
可见,目前的多媒体内容的接续处理方法,无法响应于用户位置的改变接续处理多媒体内容,智能性低,可靠性差。
为了解决上述问题,在本申请的实施例中,如果第一终端处理多媒体内容的过程中用户远离了第一终端,那么接续处理***可以利用摄像头对用户进行位置追踪,并结合预存布局信息在至少一个第二终端中确定出与用户距离最近的目标终端进行多媒体内容接续处理,从而可以实现响应于用户位置改变的多媒体内容的自动接续处理,进而可以提升多媒体内容接续处理的智能性和可靠性。
下面将结合本申请实施例中的附图,对本申请实施例中的技术方案进行清楚、完整地描述。
本申请一实施例提供了一种多媒体内容的接续处理方法,该多媒体内容的接续处理方法可以应用于接续处理***中,在本申请的实施例中,图1为本申请实施例提出的接续处理***的组成结构示意图一,如图1所示,接续处理***10可以包括第一终端11,第二终端12以及摄像头13。
需要说明的是,在本申请的实施例中,第一终端11和第二终端12可以为具有多媒体内容处理能力的终端设备,例如智能手机、平板电脑、掌上电脑、移动台(Mobile Station,MS)、移动终端(Mobile Terminal)、智能电视等等,其中,该第一终端11和第二终端12可以通过无线网络与一个或多个网络设备进行通信。
进一步地,在本申请的实施例中,摄像头13可以由多个不同的拍摄装置构成,其中,摄像头13中可以包括该接续处理***10中设置的感应摄像头,也可以包括第一终端10和/或第二终端20所配置的拍摄装置。即第一终端11和第二终端12所配置的摄像头以及其他感应摄像头可以共同构成摄像头13。
进一步地,在本申请的实施例中,图2为本申请实施例提出的接续处理***的组成结构示意图二,如图2所示,接续处理***10还可以包括控制设备14和云端15。
需要说明的是,在本申请的实施例中,控制设备14可以为具有通信功能的终端设备,例如,控制设备可以为路由器、专用设备、智能手机、平板或电脑等设备。其中,控制设备14可以对第一终端11、第二终端12以及摄像头13进行控制,具体地,控制设备14的控制功能可以通过安装软件的形式来实现。
进一步地,在本申请的实施例中,控制设备14也可以包括所述第一终端11或所述第二终端12。也就是说,第一终端11或者第二终端12既可以作为能够处理多媒体内容的多媒体设备,也可以同时作为执行控制处理的处理设备。
需要说明的是,在本申请的实施例中,第一终端11、第二终端12、摄像头13、控制 设备14可以绑定至云端15,以通过云端15进行数据的收集和策略的下发。具体地,注册为同一个账号或一组相关账号的第一终端11、第二终端12、摄像头13、控制设备14可以通过扫描二维码、无线配对等连接方式绑定至云端14中该账号之下。
可选地,在本申请的实施例中,接续处理***10中的第一终端11、第二终端12、摄像头13、控制设备14均可以与云端15保持高速网络连接;相应地,接续处理***10中的、注册为同一个账号或一组相关账号的第一终端11、第二终端12、摄像头13可以与控制设备14保持本地局域网连接。
也就是说,在本申请的实施例中,云端15可以与接续处理***10中的、注册在任意账号下的第一终端11、第二终端12、摄像头13、控制设备14进行通信,而控制设备14仅可以与接续处理***10中的、与该控制设备14注册在相同账号或相关账号下的第一终端11、第二终端12、摄像头13进行通信。
图3为本申请实施例提出的多媒体内容的接续处理方法的实现流程示意图一,如图3所示,在本申请的实施例中,终端设备进行语音业务退回的方法可以包括以下步骤:
步骤101、当通过第一终端处理多媒体内容时,利用摄像头对第一终端对应的第一区域中的目标对象进行位置监控,获得目标对象的第一位置信息。
在本申请的实施例中,当通过第一终端处理多媒体内容时,接续处理***可以利用摄像头对处于第一终端对应的第一区域中的目标对象进行位置监控,从而可以获得目标对象的第一位置信息。
可以理解的是,在本申请的实施例中,第一终端和第二终端可以为接续处理***中设置的、具有多媒体内容处理能力和通信功能的终端设备。例如,第一终端可以为智能电视1,第二终端可以为平板电脑,智能电视2,电脑等。
进一步地,在本申请的实施例中,摄像头可以为接续处理***中配置的拍摄装置,其中,第一终端和\或第二终端所配置的摄像装置也可以构成摄像头。即第一终端配置的拍摄装置、第二终端配置的拍摄装置以及其他布置在所述接续处理***对应的控制区域之内的拍摄装置可以共同组成接续处理***的摄像头。
也就是说,在本申请的实施例中,摄像头包括以下摄像装置中的至少一个:所述第一终端配置的摄像装置,所述第二终端配置的摄像装置,布置在所述接续处理***对应的控制区域之内的摄像装置。
可选地,在本申请的实施例中,接续处理***对应的控制区域即为基于接续处理***中的全部终端设备所处位置确定的区域范围。例如,图4为控制区域的示意图,如图4所示,接续处理***中的第一终端1设置于客厅、第二终端1设置于客厅、第二终端2和第二终端3设置于卧室、第二终端4设置于书房、第二终端5设置于儿童房、感应摄像头1设置于客厅、感应摄像头2设置于卧室、感应摄像头3设置于书房、感应摄像头4设置于儿童房。因此,接续处理***对应的控制区域包括客厅、卧室、书房、儿童房。
需要说明的是,在本申请的实施例中,接续处理***可以通过第一终端进行多媒体内容的处理,其中,多媒体内容可以为任意格式和形式的多媒体数据或多媒体文件,例如,多媒体内容包括但不限于视频、音频、图片、文档等。
进一步地,在本申请的实施例中,目标对象可以为正在处于第一终端对应的第一区域中的至少一个用户。其中,第一区域可以为以第一终端为基准点的一定范围之内的区域。
相应地,在本申请的实施例中,接续处理***可以利用摄像头对处于第一终端对应的第一区域中的目标对象进行位置监控,从而可以获得目标对象的第一位置信息,进而可以根据目标对象的第一位置信息确定目标对象与第一终端之间的位置关系。可见,第一位置信息可以对目标对象与第一终端之间的位置关系进行确定。
示例性的,图5为确定位置信息的示意图,如图5所示,当智能电视播放视频时,智能电视配置的拍摄装置可以对以智能电视为中心、半径为3米的范围之内的用户A进行位 置监控,确定出在智能电视前方的用户A的位置信息,并根据用户A的位置信息和智能电视的位置确定出用户A位于智能电视正前方的2米处。也就是说,在本申请中,当第一终端(智能电视)在进行多媒体内容(视频)的处理时,摄像头(智能电视配置的拍摄装置)便可以对第一终端对应的第一区域(以智能电视为中心、半径为3米的范围)中的目标对象(用户A)进行位置监控,从而可以确定出目标对象对应的第一位置信息,并可以对目标对象与第一终端之间的位置关系进行确定(用户A位于智能电视正前方2米)。
需要说明的是,在进行第一位置信息的确定时,摄像头可以按照第一预设时间间隔对第一区域中的目标对象进行拍摄处理,从而可以根据拍摄获得的目标对象的图像完成监控处理。其中,第一预设时间间隔可以为接续处理***提前设置的,例如将第一预设时间间隔设置为10秒。
步骤102、若第一位置信息满足预设切换条件,则通过摄像头获得目标对象的第二位置信息。
在本申请的实施例中,当通过所述第一终端处理多媒体内容时,在利用所述摄像头对所述第一终端对应的第一区域中的目标对象进行位置监控,获得所述目标对象的第一位置信息之后,如果第一位置信息满足预设切换条件,那么接续处理***可以通过摄像头获得目标对象的第二位置信息。
需要说明的是,在本申请的实施例中,预设切换条件用于对是否切换处理多媒体内容的终端进行切换进行确定。具体地,如果满足预设切换条件,便需要将处理多媒体内容的第一终端切换为其他终端。
可选地,在本申请的实施例中。如果基于第一位置信息确定所述目标对象已离开所述第一区域,那么可以判定所述第一位置信息满足所述预设切换条件;如果基于第一位置信息确定所述目标对象未离开所述第一区域,那么可以判定所述第一位置信息不满足所述预设切换条件。
需要说明的是,在本申请的实施例中,在进行是否满足预设切换条件的判断时,可以由第一终端直接执行判断流程,然后再将判断结果上报至控制设备和/或云端;也可以由摄像头直接执行判断流程,然后再将判断结果上报至控制设备和/或云端;还可以再获取到摄像头采集到的第一位置信息之后,直接由控制设备和/或云端执行判断流程。
可以理解的是,在本申请的实施例中,在利用所述摄像头对所述第一终端对应的第一区域中的目标对象进行位置监控,获得所述目标对象的第一位置信息之后,如果基于第一位置信息确定目标对象已经离开第一区域,那么可以认为第一终端处理的多媒体内容并不能被目标对象获取,因此需要对处理多媒体内容的终端进行切换处理;相应地,如果基于第一位置信息确定目标对象并没有离开第一区域,那么可以认为第一终端处理的多媒体内容依然可以被目标对象获取,因此可以继续通过第一终端处理多媒体内容。
进一步地,在本申请的实施例中,如果接续处理***确定第一位置信息满足预设切换条件,那么可以继续通过所述摄像头阵列对所述目标对象进行位置追踪,获得所述目标对象的第二位置信息。
可以理解的是,在本申请中,第二位置信息可以为目标对象在第一区域以外的其他区域中的具***置。具体地,第二位置信息可以用于对目标对象与第二终端之间的位置关系进行确定。即第二位置可以用于确定目标对象离开第一区域之后与第一终端以外的其他第二终端之间的相对位置关系。
可选地,在进行第二位置信息的确定时,摄像头可以按照第二预设时间间隔进行拍摄处理,从而可以根据拍摄获得的目标对象的图像完成追踪处理。其中,第二预设时间间隔可以为接续处理***提前设置的,例如将第二预设时间间隔设置为5秒。
需要说明的是,在本申请的实施例中,图6为本申请实施例提出的多媒体内容的接续处理方法的实现流程示意图二,如图6所示,当通过所述第一终端处理多媒体内容时,利 用所述摄像头对所述第一终端对应的第一区域中的目标对象进行位置监控,获得所述目标对象的第一位置信息之后,即步骤101之后,接续处理***进行多媒体内容的接续处理的方法还可以包括以下步骤:
步骤105、若第一位置信息满足预设切换条件,则确定多媒体内容的内容参数、目标对象的特征信息、第一终端的标识信息。
在本申请的实施例中,当通过所述第一终端处理多媒体内容时,在利用所述摄像头对所述第一终端对应的第一区域中的目标对象进行位置监控,获得所述目标对象的第一位置信息之后,如果第一位置信息满足预设切换条件,那么接续处理***可以进一步确定出多媒体内容的内容参数、目标对象的特征信息以及第一终端的标识信息。
进一步地,在本申请的实施例中,在确定第一位置信息满足预设切换的条件下,接续处理***可以通过第一终端对正在处理的多媒体内容的内容参数进行确定。其中,多媒体内容的内容参数可以包括以下多个参数中的至少一个参数:功能类型参数、应用类型参数,所述多媒体内容的源参数、所述多媒体内容的进度参数。
示例性的,在本申请的实施例中,如果多媒体内容为视频,那么该视频对应的内容参数可以包括视频类型(功能类型参数)、播放软件应用标识(应用类型参数)、视频的链接(多媒体内容的源参数)、视频播放进度(多媒体内容的进度参数)等。
进一步地,在本申请的实施例中,在确定第一位置信息满足预设切换的条件下,接续处理***可以通过第一终端确定出目标对象的特征信息,也可以通过摄像头确定出目标对象的特征信息。
可以理解的是,在本申请的实施例中,目标对象的特征信息可以表征目标对象的具体生物特征,例如,目标对象的特征信息可以包括但不限于目标对象的身高特征、衣着特征、面部特征等。
进一步地,在本申请的实施例中,在确定第一位置信息满足预设切换的条件下,接续处理***可以通过第一终端确定出第一终端的标识信息。
需要说明的是,在本申请的实施例中,如果第一位置信息满足预设切换条件,那么接续处理***还可以进一步确定出目标对象的身份信息。该身份信息可以用于对目标对象的身份进行确认,从而可以在通过所述摄像头进行实时拍摄处理获得追踪图像之后,通过目标对象的身份信息对追踪图像中的人物进行身份确认,以准确地确定出目标对象的第二位置信息。
可选地,在本申请的实施例中,接续处理***在通过所述摄像头获得所述目标对象的第二位置信息时,可以先通过所述控制设备向所述云端发送追踪请求;然后再通过所述云端向所述摄像头发送追踪指令;接着可以通过所述摄像头进行实时拍摄处理,获得追踪图像;最终便可以根据所述特征信息和所述追踪图像,确定所述第二位置信息。
可选地,在本申请的实施例中,接续处理***在通过所述摄像头获得所述目标对象的第二位置信息时,也可以直接通过所述控制设备向所述摄像头发送追踪指令;然后通过所述摄像头进行实时拍摄处理,获得追踪图像;最终便可以根据所述特征信息和所述追踪图像,确定所述第二位置信息。
也就是说,在本申请的实施例中,接续处理***可以通过控制设备来对实现对摄像头的控制,以使摄像头执行实时拍摄处理,获得对应的追踪图像;也可以利用控制设备请求云端进行追踪指令的下发,从而基于摄像头对追踪指令的响应获得对应的追踪图像。
需要说明的是,在本申请的实施例中,摄像头在接收到控制设备或云端发送的追踪指令之后,摄像头中的每一个拍摄装置可以选择在其对应的有效区域之内进行实时拍摄处理,从而可以获得每一个拍摄装置检测到的追踪图像。
进一步地,在本申请的实施例中,在根据所述特征信息和所述追踪图像,确定所述第二位置信息时,可以先将所述第一特征信息与所述追踪图像中的特征进行对比处理,获得 所述追踪图像中的目标图像;其中,所述目标图像中包括所述目标对象;然后便可以基于所述目标图像确定所述第二位置信息。
也就是说,在本申请中,在通过摄像头进行实时拍摄处理获得追踪图像之后,在进行目标对象的第二位置的确定时,接续处理***可以将目标对象的特征信息与追踪图像中出现的人物的特征进行比对处理,从而可以确定出追踪图像中的包括有目标对象的目标图像,进而可以利用包括目标对象的目标图像进一步确定出目标对象的第二位置信息。
可以理解的是,在本申请的实施例中,预存布局信息可以预先存储在云端和\或控制设备和\或摄像头和\或第一终端和\或第二终端中;目标对象的特征信息也可以同步至云端和\或控制设备和\或摄像头和\或第一终端和\或第二终端。
相应地,在本申请的实施例中,在根据所述特征信息和所述追踪图像进一步确定所述第二位置信息时,可以是接续处理***中的控制装置根据从摄像头获取到的追踪图像来执行第二位置信息的确定的;也可以是接续处理***中的云端根据从摄像头获取到的追踪图像来执行第二位置信息的确定的;还可以是接续处理***中的摄像头直接根据获取到的追踪图像来执行第二位置信息的确定的。
步骤103、基于第二位置信息和预存布局信息在至少一个第二终端中确定目标终端。
在本申请的实施例中,如果第一位置信息满足预设切换条件,接续处理***在通过所述摄像头获得所述目标对象的第二位置信息之后,可以进一步基于第二位置信息和预存布局信息在至少一个第二终端中确定出用于对多媒体内容进行接续处理的目标终端。
进一步地,在本申请的实施例中,预存布局信息可以为接续处理***预先设置的、表征第一终端、第二终端、摄像头之间的具***置关系和距离关系。也就是说,通过预存布局信息可以确定接续处理***对应的控制区域之内各个设备的布局以及各个设备之间的位置关系。
可以理解的是,在本申请的实施例中,接续处理***可以先通过摄像头在接续处理***对应的控制区域之内进行检测处理,从而可以确定出第一终端、第二终端以及摄像头中的任意两个设备之间的相对位置和距离,最终便可以生成该接续处理***对应的预存布局信息。
需要说明的是,在本申请的实施例中,接续处理***还可以接收用户的修改指令,并根据修改指令对预存布局信息中的具体信息进行修改和更新。
进一步地,在本申请的实施例中,接续处理***在基于所述第二位置信息和预存布局信息在至少一个所述第二终端中确定目标终端时,可以先基于所述第二位置信息和所述预存布局信息确定所述目标对象与至少一个所述第二终端之间的距离参数;然后可以将最小的距离参数对应的第二终端确定为所述目标终端。
也就是说,在本申请中,接续处理***在确定出目标对象与至少一个第二终端之间的至少一个第二位置信息之后,可以根据至少一个第二位置信息依次确定目标对象与其中每一个第二终端之间的距离,即目标对象与至少一个第二终端之间的距离参数。接着便可以将与目标对象距离最近的一个第二终端确定为目标终端,即将最小距离参数对应的第二终端确定为用于对多媒体内容进行接续处理的目标终端。
示例性的,在本申请的实施例中,假设接续处理***中设置有7个第二终端,分别为第二终端1、第二终端2、第二终端3、第二终端4、第二终端5、第二终端6、第二终端7,接续处理***通过目标对象的特征信息、摄像头采集的追踪图像以及预存布局信息,确定出目标对象的第二位置信息之后,接续处理***可以根据第二位置信息确定出目标对象与第二终端2、第二终端3、第二终端4、第二终端5之间的4个距离参数分别为0.51米、3.3米、3.5米、4米,由于目标对象距离第二终端2最近,因此接续处理***可以将第二终端2确定为目标终端。
可以理解的是,在本申请的实施例中,在根据第二位置信息进行目标终端的确定时, 可以由接续处理***中的控制设备执行目标终端的确定,也可以由接续处理***中的云端执行目标终端的确定。
进一步地,在本申请的实施例中,接续处理***在基于所述第二位置信息和预存布局信息在至少一个所述第二终端中确定目标终端之前,可以先确定第二终端对应的能力参数;其中,所述能力参数指示所述第二终端具有的多媒体应用。
也就是说,在本申请的实施例中,接续处理***可以先对第二终端所支持的多媒体内容的处理能力进行确定。具体地,接续处理***可以先确定出表征第二终端所支持多媒体内容的多媒体应用,即确定第二终端对应的能力参数。
相应地,在本申请的实施例中,接续处理***在基于所述第二位置信息和预存布局信息在至少一个所述第二终端中确定目标终端时,可以先根据所述能力参数和所述内容参数在至少一个所述第二终端中确定支持所述多媒体内容的候选终端;然后再基于所述第二位置信息和所述预存布局信息确定所述目标对象与所述候选终端之间的距离参数;最终便可以将最小的距离参数对应的候选终端确定为所述目标终端。
可以理解的是,在本申请的实施例中,接续处理***在进行目标终端的确定时,需要先根据第二终端对应的能力参数进行筛选处理,将不具有接续处理对应的多媒体内容的能力的第二终端筛除。具体地,对于需要接续处理的多媒体内容,将不具有对应的多媒体应用的第二终端排除,仅在具有能够支持该多媒体内容的多媒体应用的候选终端中进行目标终端的确定。
步骤104、通过目标终端继续处理多媒体内容。
在本申请的实施例中,在基于所述第二位置信息和预存布局信息在至少一个所述第二终端中确定目标终端之后,接续处理***可以选择通过所述目标终端根据所述多媒体内容的内容参数继续处理所述多媒体内容。
也就是说,在本申请的实施例中,接续处理***在确定目标对象已经离开第一终端对应的第一区域,且利用摄像头确定出目标对象对应的第二位置信息,并根据第二位置信息在至少一个第二终端中确定出距离目标对象最近的目标终端之后,便可以通过该目标终端进行多媒体内容的继续处理。
具体地,在本申请的实施例中,目标终端可以先获取多媒体内容的内容参数,然后根据该内容参数继续处理多媒体内容。
进一步地,在本申请的实施例中,接续处理***在通过所述目标终端根据所述多媒体内容的内容参数继续处理所述多媒体内容之前,可以先通过所述控制设备向所述目标终端发送切换指令;其中,所述切换指令携带所述内容参数。
也就是说,在本申请的实施例中,目标终端可以接收控制设备发送的切换指令,然后便可以通过该切换指令获取多媒体内容的内容参数,从而可以根据该内容参数进行多媒体内容的接续处理。
进一步地,在本申请的实施例中,接续处理***在通过所述目标终端根据所述多媒体内容的内容参数继续处理所述多媒体内容之前,也可以先通过所述控制设备向所述目标终端发送切换指令,以使所述目标终端基于所述切换指令从所述第一终端获取所述内容参数;其中,所述切换指令携带所述标识信息。
也就是说,在本申请的实施例中,目标终端可以接收控制设备发送的切换指令,然后便可以通过该切换指令获取第一终端的标识信息,便可以通过该标识信息与第一终端建立连接,进而可以从第一终端获取多媒体内容的内容参数,最终便可以根据该内容参数进行多媒体内容的接续处理。
可以理解的是,在本申请的实施例中,携带内容参数或标识信息的切换指令不仅可以由控制设备向目标终端发送,也可以由云端向目标终端发送。
进一步地,在本申请的实施例中,接续处理***在通过所述目标终端根据所述多媒体 内容的内容参数继续处理所述多媒体内容时,如果目标终端具有与所述内容参数对应的多媒体应用,那么接续处理***可以通过所述目标终端的所述多媒体应用执行所述多媒体内容的接续处理。
可以理解的是,在本申请的实施例中,接续处理***中的目标终端可以先根据多媒体内容的内容参数对自身是否能够执行接续处理进行确认,即确定目标终端是否具有接续处理对应的多媒体内容的能力。具体地,目标终端可以基于内容参数先确定是否具有能够支持该多媒体内容的多媒体应用,如果具有对应的多媒体应用,那么才可以利用该多媒体应用,根据内容参数进行多媒体内容的接续处理。
需要说明的是,在本申请的实施例中,接续处理***具有用于执行多媒体内容的接续处理的接续处理功能,接续处理***在执行接续处理之前,需要先开启与该接续处理功能对应的工作模式。
可选地,在本申请中,当接续处理功能对应的工作模式开启,且通过所述第一终端处理多媒体内容时,接续处理***才可以通过摄像头对目标对象进行位置监控处理。
进一步地,在本申请的实施例中,图7为本申请实施例提出的多媒体内容的接续处理方法的实现流程示意图三,如图7所示,在基于所述第二位置信息和预存布局信息在至少一个所述第二终端中确定目标终端之前,即步骤103之前,接续处理***进行多媒体内容的接续处理的方法还可以包括以下步骤:
步骤106、当通过第一终端处理多媒体内容时,利用摄像头对第二终端的第二区域进行监控,获得监控结果。
步骤107、若监控结果指示第二区域中的目标对象满足预设切换条件,则通过摄像头获得目标对象的第二位置信息。
在本申请的实施例中,当通过第一终端处理多媒体内容时,接续处理***可以利用摄像头对第一终端对应的第二区域进行监控,从而可以获得监控结果。如果监控结果指示第二区域中的目标对象满足预设切换条件,那么接续处理***可以通过摄像头获得所述目标对象的第二位置信息。
进一步地,在本申请的实施例中,目标对象可以为在第一终端处理所述多媒体内容时,在第一终端对应的第一区域中出现过的至少一个用户。其中,第一区域可以为以第一终端为基准点的一定范围之内的区域。
需要说明的是,在本申请的实施例中,接续处理***通过摄像头对第二终端的第二区域进行监控所获得监控结果可以为第二区域存在目标对象或者第二区域不存在目标对象。
可选地,在本申请的实施例中。如果监控结果指示所述第二区域中的目标对象已经在第一区域中出现过,那么可以判定满足所述预设切换条件;如果监控结果指示所述第二区域中的目标对象并没有在第一区域中出现过,那么可以判定所述不满足所述预设切换条件。
可以理解的是,在本申请的实施例中,在判断监控结果指示所述第二区域中的目标对象是否满足所述预设切换条件时,接续处理***可以先对在第一终端处理所述多媒体内容时出现在第一区域中的用户的身份进行确认,获得对应的身份标识,然后可以根据监控结果对出现在第二区域中的目标对象的身份进行确认,获得对应的身份标识,如果两者身份标识相同,则可以认为监控结果指示所述第二区域中的目标对象满足所述预设切换条件。
可选地,在本申请的实施例中,接续处理***在通过所述摄像头获得所述目标对象的第二位置信息时,可以先通过所述控制设备向所述云端发送追踪请求;然后再通过所述云端向所述摄像头发送追踪指令;接着可以通过所述摄像头进行实时拍摄处理,获得追踪图像;最终便可以根据所述特征信息和所述追踪图像,确定所述第二位置信息。
可选地,在本申请的实施例中,接续处理***在通过所述摄像头获得所述目标对象的第二位置信息时,也可以直接通过所述控制设备向所述摄像头发送追踪指令;然后通过所 述摄像头进行实时拍摄处理,获得追踪图像;最终便可以根据所述特征信息和所述追踪图像,确定所述第二位置信息。
可以理解的是,在本申请的实施例中,在确定出目标对象的第二位置信息之后,接续处理***便可以基于第二位置信息和预存布局信息在至少一个第二终端中确定出用于对多媒体内容进行接续处理的目标终端,然后再通过所述目标终端继续处理所述多媒体内容。
由此可见,在本申请的实施例中,当第一终端在进行多媒体内容的处理时,如果第二终端检测到目标对象的靠近,那么便可以对靠近的目标对象进行身份确认,如果确定目标对象为在第一终端在进行多媒体内容的处理时远离第一终端的用户,那么接续处理***便可以重新在至少一个第二终端中确定出用于接续处理多媒体内容的目标终端,并通过该目标终端完成多媒体内容的接续处理。
进一步地,在本申请的实施例中,图8为本申请实施例提出的多媒体内容的接续处理方法的实现流程示意图四,如图8所示,在通过所述目标终端继续处理所述多媒体内容之前,即步骤104之前,接续处理***进行多媒体内容的接续处理的方法还可以包括以下步骤:
步骤108、当通过第一终端处理多媒体内容时,若通过第二终端检测到控制操作,则通过摄像头确定控制操作对应的目标对象。
步骤109、若目标对象满足预设切换条件,则将第二终端确定为目标终端。
在本申请的实施例中,当通过第一终端处理多媒体内容时,如果通过所述第二终端检测到控制操作,那么接续处理***可以先通过所述摄像头确定所述控制操作对应的目标对象,如果目标对象满足所述预设切换条件,那么接续处理***可以将所述第二终端确定为用于进行多媒体内容的接续处理的目标终端。
进一步地,在本申请的实施例中,目标对象可以为在第一终端处理所述多媒体内容时,在第一终端对应的第一区域中出现过的至少一个用户。其中,第一区域可以为以第一终端为基准点的一定范围之内的区域。
需要说明的是,在本申请的实施例中,如果执行操作处理的目标对象已经在第一区域中出现过,那么可以判定满足所述预设切换条件;如果执行操作处理的目标对象并没有在第一区域中出现过,那么可以判定所述不满足所述预设切换条件。
可以理解的是,在本申请的实施例中,在判断目标对象是否满足所述预设切换条件时,接续处理***可以先对在第一终端处理所述多媒体内容时出现在第一区域中的用户的身份进行确认,获得对应的身份标识,然后可以对操作处理对应的目标对象的身份进行确认,获得对应的身份标识,如果两者身份标识相同,则可以认为目标对象满足所述预设切换条件。
需要说明的是,在本申请的实施例中,如果目标对象满足预设切换条件,那么处理设备可以认为检测到操作处理的第二终端是与目标对象距离最近的终端,可以用于执行多媒体内容的接续处理,因此可以直接将该第二终端确定为目标终端,以通过所述目标终端根据所述多媒体内容的内容参数继续处理所述多媒体内容。
由此可见,在本申请的实施例中,当第一终端在进行多媒体内容的处理时,如果第二终端检测到操作处理,那么接续处理***可以对操作处理对应的目标对象进行身份确认,如果确定目标对象为在第一终端在进行多媒体内容的处理时远离第一终端的用户,那么接续处理***便可以直接将该第二终端确定为用于接续处理多媒体内容的目标终端,并通过该目标终端完成多媒体内容的接续处理。
综上所述,在本申请的实施例中,上述步骤101至步骤108提出一种多媒体内容的接续处理方法,是一种可以应用于智能家居终端设备的能力接续方案,由接续处理***感知用户的位置,当用户离开接续处理***中的某个设备时,接续处理***中的控制设备可以 利用包括有多个拍摄装置的摄像头对用户的位置进行追踪,并可以结合表征房型图、设备位置布局等的预存布局信息来确定距离用户最近的目标终端,并利用该目标终端进行多媒体内容的接续处理。
可见,本申请实施例提出的多媒体内容的接续处理方法,能够利用接续处理***中的摄像头结合家居房型和终端设置位置感应用户位置的变化,从而匹配切换的焦点终端设备。且通过该接续处理方法,接续处理***可以利用能力接续服务,将不同类型终端的能力应用内容自动接续到另一个设备上,整个过程甚至无需用户下发任何操作和指示,就可以无缝接续。
本申请实施例提供了一种多媒体内容的接续处理方法,应用于接续处理***,接续处理***包括第一终端、第二终端、摄像头,当通过第一终端处理多媒体内容时,利用摄像头对第一终端对应的第一区域中的目标对象进行位置监控,获得目标对象的第一位置信息;若第一位置信息满足预设切换条件,则通过摄像头获得目标对象的第二位置信息;基于第二位置信息和预存布局信息在至少一个第二终端中确定目标终端;通过目标终端继续处理多媒体内容。由此可见,在本申请的实施例中,如果第一终端处理多媒体内容的过程中用户远离了第一终端,那么接续处理***可以利用摄像头对用户进行位置追踪,并结合预存布局信息在至少一个第二终端中确定出与用户距离最近的目标终端进行多媒体内容接续处理,从而可以实现响应于用户位置改变的多媒体内容的自动接续处理,进而可以提升多媒体内容接续处理的智能性和可靠性。
基于上述实施例,本申请的再一实施例提出了一种多媒体内容的接续处理方法,该多媒体内容的接续处理方法可以应用于接续处理***中。
进一步地,在本申请的实施例中,图9为本申请实施例提出的接续处理***的组成结构示意图三,如图9所示,接续处理***可以由控制设备、移动终端(第一终端)、多个多媒体终端(第二终端)、摄像头组(包括至少一个感应摄像头)、智能家居云(云端)。
需要说明的是,在本申请的实施例中,移动终端、多媒体终端也可以配置有摄像头,可以与感应摄像头共同组成摄像头组。
进一步地,在本申请的实施例中,接续处理***中的移动终端、多媒体终端、智能摄像头、控制设备可以通过扫描二维码、无线配对等连接方式绑定到智能家居云的用户帐号名下,移动终端、多媒体终端、摄像头组可以与智能家居云保持高速网络连接,可选地,移动终端、多媒体终端、摄像头组可以与控制设备保持本地局域网连接。
需要说明的是,在本申请的实施例中,控制设备可以是路由器、专用设备或是智能设备(手机、平板或电脑)通过安装软件的形式来实现,也可以与本申请中的移动终端或多媒体终端合二为一的形式,即移动终端或多媒体终端既可以用于处理多媒体内容,也可以用于执行控制功能。
可选地,在本申请的实施例中,移动终端或多媒体终端可以配置有能力应用(A1或B1),其中,能力应用可以为呈现某种能力内容的应用,比如视频播放能力、音频播放能力、图片播放能力、文档处理能力等。
可选地,在本申请的实施例中,移动终端或多媒体终端可以配置有能力接续软件开发工具包(Software Development Kit,SDK)(A2或B2)。
具体地,在本申请中,A2或B2可以将A1或B1的能力标识注册给接续服务,这样能力接续服务可以在A1和B1未启动的情况下,也能检索出A1或B1的应用能力,并确定移动终端和多媒体终端的能力是否匹配。比如检索电视上是否有可以接续手机上XX视频的能力。
具体地,在本申请中,A2或B2可以将当前处理的多媒体内容进行参数化,获得对应的内容参数(如多媒体标识地址、进度),并将该内容参数更新给能力接续服务(A3或B3),从而可以使能力接续服务执行能力匹配处理,即判断A1所处理的多媒体内容是否可以接 续到B1上进行处理。
可选地,在本申请的实施例中,移动终端或多媒体终端可以配置有能力接续服务(A3或B3),该能力接续服务可以为运行在终端设备上的常驻服务。
具体地,在本申请中,能力接续服务可以通过能力接续SDK实时获取当前在***前台正在运行的能力应用。
具体地,在本申请中,能力接续服务可以根据控制设备发送的能力接续请求进行能力匹配和接续,例如,在多媒体内容从A1接续至B1的场景,可以拉起应用B1并将A1对应的内容参数传输至B1,从而使用户可以在另一个设备上通过B1观看之前A1上播放的多媒体内容。
具体地,在本申请中,当焦点感应服务检测到用户(目标对象)离开之后,能力接续服务可以暂停当前的应用的能力呈现,将能力呈现状态参数化,获得对应的内容参数(比如视频的播放,提取视频的应用包名、视频的地址等)。
可选地,在本申请的实施例中,移动终端或多媒体终端可以配置有焦点感应服务(A4或B4),具体用于感应用户(目标对象)正在观察或操作的移动终端。
具体地,在本申请中,焦点感应服务可以定时(例如5S的时间间隔)调用A5或B5在后台进行拍照分析,用于监视目标对象是否离开或靠近。当监测到离开或靠近事件时,通知控制设备。
具体地,在本申请中,当移动终端或多媒体***有***作时,能力应用A1可以过A2通知A4,当前设备获得了焦点,A4通过摄像头拍照分析进一步确认操作者的身份。如果身份匹配对应的账号,则通知控制设备。
可选地,在本申请的实施例中,移动终端或多媒体终端可以配置有摄像分析模块(A5或B5),该摄像分析模块能够对摄像头获取图像进行分析,利用现有技术实现人脸识别匹配家庭成员身份。
具体地,在本申请中,能力接续服务控制通知摄像分析模块的开启,,激活摄像分析模块进行目标对象位置跟踪。摄像分析模块除了识别成员身份,还可以识别目标对象的靠近和远离运作,转为事件通知给控制设备。
可选地,在本申请的实施例中,移动终端或多媒体终端可以配置有摄像头(A6或B6),其中,A6或B6可以作为摄像头组的组成部分。
可选地,在本申请的实施例中,移动终端或多媒体终端可以配置有帐号模块(A7或B7),其中,该帐号模块可以将设备的账号接入至控制设备。
可选地,在本申请的实施例中,摄像头组可以配置有至少一个摄像头(C1),其中,处理独立配置的感应摄像头之外,还可以包括移动终端或多媒体终端中的摄像头(A6或B6)。
可选地,在本申请的实施例中,摄像头组可以配置有摄像分析模块(C2),该摄像分析模块能够对摄像头获取图像进行分析,利用现有技术实现人脸识别匹配家庭成员身份。
可选地,在本申请的实施例中,摄像头组可以配置有焦点感应服务(C3),具体用于感应用户(目标对象)正在观察或操作的移动终端。
可选地,在本申请的实施例中,摄像头组可以配置有帐号模块(C4),其中,该帐号模块可以将设备的账号接入至控制设备。
可选地,在本申请的实施例中,控制设备可以配置有帐号模块(D1),其中,该账号模块用于将所有登录同一家庭组名下帐号设备接入控制设备,建立局域网连接,并为每个终端的焦点感应服务和能力接续模块建立数据通道。
可选地,在本申请的实施例中,控制设备可以配置有焦点分析模块(D2),该焦点分析模块的作用是当移动终端的摄像头发现用户离开或出现时,能获取其它设备多个摄像头模块的感知能力,计算并匹配出用户所靠近并停留的匹配设备,然后可以将之前失去焦点 的移动终端的正在播放的能力应用的内容接续到用户移动停留的新的设备上(目标终端)。
可选地,在本申请的实施例中,控制设备可以配置有设备布局数据库(D3),其中,通过用户在云端在线编辑生成的设备布局记录(预存布局信息),布局包括整体和每个房间的名称、编号、房型图、设备在房型图的相对坐标,朝向等。
可选地,在本申请的实施例中,家居智能云可以配置有帐号服务(E1)。该账号服务用于统一各终端服务帐号,各终端通过用户统一帐号绑定,可以加入云和控制设备的管控,登录同一帐号或相关账号(如不同帐号间但属于同一家庭帐号组)的设备可以通过云端互相发现,终端设备登录绑定设备以后,在一定时间内比如三个月内保持免登录状态,终端开机,接入网络,就可以将自己的状态同步给控制设备和云端。
可选地,在本申请的实施例中,家居智能云可以配置有接续设置(E2)。该接续设置可以用于控制本申请的整体应用开关,还可以在线通过图元和工具拖动在网页上配置家居房间布局图以及多媒体终端(位置固定如电视机)、智能摄像头的位置(位置固定)和方向,生成设备布局记录(预存布局信息),同时将设备布局记录同步给控制设备的设备布局数据库(D3)中。
可选地,在本申请的实施例中,家居智能云可以配置有事件推送(E3),主要负责将终端的事件状态推送给控制设备或任意终端。
进一步地,在本申请的实施例中,图10为本申请实施例提出的多媒体内容的接续处理方法的实现流程示意图五,如图10所示,接续处理***进行多媒体内容的接续处理的方法可以包括以下步骤:
步骤201、当第一终端处理多媒体内容时,确定目标对象的第一位置信息。
在本申请的实施例中,第一终端通过能力SDK(A2)感知到当前设备终端上有能力应用正在前台运行,即处理多媒体内容,如播放视频。此时,第一终端中的能力接续服务(A3)正在后台运行,能力接续服务通知焦点感应服务(A4)进行焦点切换感应。接着,焦点感应服务(A4)调用摄像分析模块(A5)进行目标对象的位置监控,获得对应的第一位置信息。
需要说明的是,在本申请的实施例中,假设第一终端配置有摄像头(A6),那么摄像分析模块(A5)可以通过摄像头(A6)按照一定的时间间隔(如5秒)定时捕获第一终端前方画面,确定目标对象的第一位置信息。
步骤202、若基于第一位置信息确定目标对象远离第一终端,则向控制设备发送接续请求。
在本申请的实施例中,如果目标对象的基于第一位置信息确定目标对象已经远离第一终端,那么第一终端可以暂停多媒体内容的处理,并向控制设备发送接续请求,以通知控制设备执行后续的接续处理。
需要说明的是,在本申请的实施例中,控制设备接收到的接续请求中可以携带有目标对象的用户身份,离开事件,第一终端的标识信息以及正在处理的多媒体内容的内容参数。其中,内容参数可以包括以下多个参数中的至少一个参数:指示能力大类的功能类型参数(如视频播放)、指示能力小类的应用类型参数(如XX视频应用)、指示能力ID的多媒体内容的源参数(如数字编码标识具体视频)、指示能力参数的多媒体内容的进度参数(如视频进度)。
步骤203、响应于接续请求,控制设备向摄像头组发送追踪指令,以获得目标对象的第二位置信息。
在本申请的实施例中,控制设备在接收到第一终端发送的接续请求之后,可以向摄像头组发送追踪指令,从而可以通过摄像头组实现对目标对象的重新定位,进而可以确定目标对象的第二位置信息。
需要说明的是,在本申请的实施例中,控制设备配置的焦点分析模块(D2)在接收到 第一终端发送的离开事件之后,可以通过局域网或云端的推送功能向相同账号或者相关账号下的摄像头发送目标对象的位置追踪的通知,其中,摄像头也包括第二终端配置的摄像头(B6)。
相应地,在本申请的实施例中,在接收到追踪指令之后,摄像头的焦点感应服务(C3)或第二终端的焦点感应服务(B4)可以通过摄像头分析模块(C2、B5)对摄像头(C1、B6)拍摄的追踪图像的识别处理来确定当前捕捉的画面是否有目标对象,如果有,则确定目标对象的第二位置信息,并将第二位置信息上报至控制终端。
步骤204、控制设备根据预存布局信息和第二位置信息确定目标终端。
在本申请的实施例中,控制信息在确定目标对象的第二位置信息之后,可以进一步结合预先生成的预存布局信息和第二位置信息,从第二终端中确定出用于执行多媒体内容的接续处理的目标终端。
需要说明的是,在本申请的实施例中,控制设备的设备布局数据库(D3)中的预存布局信息能够对房型布局和设备位置进行确定。控制设备可以根据预存布局信息中记录的中每个摄像头与第二终端之间的位置关系和距离关系,与已经确定的目标对象的第二位置信息进行匹配处理,最终便可以在至少一个第二终端中确定出与目标对象距离最接近的终端设备,即目标终端。
步骤205、控制设备向目标终端发送接续指令,以使目标终端继续处理多媒体内容。
在本申请的实施例中,控制设备在从第二终端中确定出与目标对象距离最近的目标终端之后,便可以向目标终端发送接续指令,其中,接续指令中可以携带多媒体内容的内容参数,从而可以使目标终端在接收到接续指令之后,能够根据内容参数进行多媒体内容的继续处理。
需要说明的是,在本申请的实施例中,控制设备通过数据连接通知与目标对象最接近的目标终端,并将之前失去焦点的第一终端的能力应用的内容参数发送给该目标终端。
相应地,在本申请的实施例中,目标终端在接收到接续指令之后,可以通过内容参数中的指示能力大类的功能类型参数(如视频播放)、指示能力小类的应用类型参数(如XX视频应用)、指示能力ID的多媒体内容的源参数(如数字编码标识具体视频)、指示能力参数的多媒体内容的进度参数(如视频进度)来检索目标终端中是否有注册的可以匹配能力接续的应用。如果有,则拉起该应用,将内容参数通过能力接续SDK传给该应用,从而进行能力接续处理(如视频的播放)。
进一步地,在本申请的实施例中,接续处理***可以同时识别追踪不同家庭成员身份和位置,比如父母和孩子,假设父母在客厅看电影,孩子在房间看动画片,只要父母和孩子位置互换就可以实现两者观看节目无缝切换为孩子在客厅看动画片,父母在房间看电影
需要说明的是,在本申请的实施例中,接续处理***还可以实现多媒体能力缓存接续,比如父母在房间电脑写了一会儿文档,又看了一会儿电影,又浏览了网页,孩子在客厅看动画片,孩子关闭客厅的电视,两人互换位置,接续处理***可以很快为孩子在房间接续了动画片的播放,过10分钟以后父母打开电视,电视能询问父母想继续哪一种类型的多媒体处理,并通过父母的选择确定接续处理文档或者电影或者网页浏览。
本申请实施例提供了一种多媒体内容的接续处理方法,应用于接续处理***,接续处理***包括第一终端、第二终端、摄像头,当通过第一终端处理多媒体内容时,利用摄像头对第一终端对应的第一区域中的目标对象进行位置监控,获得目标对象的第一位置信息;若第一位置信息满足预设切换条件,则通过摄像头获得目标对象的第二位置信息;基于第二位置信息和预存布局信息在至少一个第二终端中确定目标终端;通过目标终端继续处理多媒体内容。由此可见,在本申请的实施例中,如果第一终端处理多媒体内容的过程中用户远离了第一终端,那么接续处理***可以利用摄像头对用户进行位置追踪,并结合预存布局信息在至少一个第二终端中确定出与用户距离最近的目标终端进行多媒体内容 接续处理,从而可以实现响应于用户位置改变的多媒体内容的自动接续处理,进而可以提升多媒体内容接续处理的智能性和可靠性。
基于上述实施例,在本申请的另一实施例中,图11为本申请实施例提出的接续处理***的组成结构示意图四,如图11所示,本申请实施例提出的终端设备10可以包括获取单元16,确定单元17,处理单元18,
所述获取单元16,配置为当通过第一终端处理多媒体内容时,利用摄像头对所述第一终端对应的第一区域中的目标对象进行位置监控,获得所述目标对象的第一位置信息;若所述第一位置信息满足预设切换条件,则通过所述摄像头获得所述目标对象的第二位置信息;
所述确定单元17,配置为基于所述第二位置信息和预存布局信息在至少一个第二终端中确定目标终端;
所述处理单元18,配置为通过所述目标终端继续处理所述多媒体内容。
在本申请的实施例中,进一步地,图12为本申请实施例提出的接续处理***的组成结构示意图五,如图12所示,本申请实施例提出的终端设备10还可以包括处理器19、存储有处理器19可执行指令的存储器110,进一步地,终端设备10还可以包括通信接口111,和用于连接处理器19、存储器110以及通信接口111的总线112。
在本申请的实施例中,上述处理器19可以为特定用途集成电路(Application Specific Integrated Circuit,ASIC)、数字信号处理器(Digital Signal Processor,DSP)、数字信号处理装置(Digital Signal Processing Device,DSPD)、可编程逻辑装置(ProgRAMmable Logic Device,PLD)、现场可编程门阵列(Field ProgRAMmable Gate Array,FPGA)、中央处理器(Central Processing Unit,CPU)、控制器、微控制器、微处理器中的至少一种。可以理解地,对于不同的设备,用于实现上述处理器功能的电子器件还可以为其它,本申请实施例不作具体限定。终端设备10还可以包括存储器110,该存储器110可以与处理器19连接,其中,存储器110用于存储可执行程序代码,该程序代码包括计算机操作指令,存储器110可能包含高速RAM存储器,也可能还包括非易失性存储器,例如,至少两个磁盘存储器。
在本申请的实施例中,总线112用于连接通信接口111、处理器19以及存储器110以及这些器件之间的相互通信。
在本申请的实施例中,存储器110,用于存储指令和数据。
进一步地,在本申请的实施例中,上述处理器19,用于当通过所述第一终端处理多媒体内容时,利用所述摄像头对所述第一终端对应的第一区域中的目标对象进行位置监控,获得所述目标对象的第一位置信息;若所述第一位置信息满足预设切换条件,则通过所述摄像头获得所述目标对象的第二位置信息;基于所述第二位置信息和预存布局信息在至少一个所述第二终端中确定目标终端;通过所述目标终端继续处理所述多媒体内容。
在实际应用中,上述存储器110可以是易失性存储器(volatile memory),例如随机存取存储器(Random-Access Memory,RAM);或者非易失性存储器(non-volatile memory),例如只读存储器(Read-Only Memory,ROM),快闪存储器(flash memory),硬盘(Hard Disk Drive,HDD)或固态硬盘(Solid-State Drive,SSD);或者上述种类的存储器的组合,并向处理器19提供指令和数据。
另外,在本实施例中的各功能模块可以集成在一个处理单元中,也可以是各个单元单独物理存在,也可以两个或两个以上单元集成在一个单元中。上述集成的单元既可以采用硬件的形式实现,也可以采用软件功能模块的形式实现。
集成的单元如果以软件功能模块的形式实现并非作为独立的产品进行销售或使用时,可以存储在一个计算机可读取存储介质中,基于这样的理解,本实施例的技术方案本质上或者说对现有技术做出贡献的部分或者该技术方案的全部或部分可以以软件产品的形式 体现出来,该计算机软件产品存储在一个存储介质中,包括若干指令用以使得一台计算机设备(可以是个人计算机,服务器,或者网络设备等)或processor(处理器)执行本实施例方法的全部或部分步骤。而前述的存储介质包括:U盘、移动硬盘、只读存储器(Read Only Memory,ROM)、随机存取存储器(Random Access Memory,RAM)、磁碟或者光盘等各种可以存储程序代码的介质。
本申请实施例提供了一种接续处理***,接续处理***包括第一终端、第二终端、摄像头,当通过第一终端处理多媒体内容时,利用摄像头对第一终端对应的第一区域中的目标对象进行位置监控,获得目标对象的第一位置信息;若第一位置信息满足预设切换条件,则通过摄像头获得目标对象的第二位置信息;基于第二位置信息和预存布局信息在至少一个第二终端中确定目标终端;通过目标终端继续处理多媒体内容。由此可见,在本申请的实施例中,如果第一终端处理多媒体内容的过程中用户远离了第一终端,那么接续处理***可以利用摄像头对用户进行位置追踪,并结合预存布局信息在至少一个第二终端中确定出与用户距离最近的目标终端进行多媒体内容接续处理,从而可以实现响应于用户位置改变的多媒体内容的自动接续处理,进而可以提升多媒体内容接续处理的智能性和可靠性。
本申请实施例提供一种计算机可读存储介质,其上存储有程序,该程序被处理器执行时实现如上所述的多媒体内容的接续处理方法。
具体来讲,本实施例中的一种多媒体内容的接续处理方法对应的程序指令可以被存储在光盘,硬盘,U盘等存储介质上,当存储介质中的与一种多媒体内容的接续处理方法对应的程序指令被一电子设备读取或被执行时,包括如下步骤:
当通过所述第一终端处理多媒体内容时,利用所述摄像头对所述第一终端对应的第一区域中的目标对象进行位置监控,获得所述目标对象的第一位置信息;
若所述第一位置信息满足预设切换条件,则通过所述摄像头获得所述目标对象的第二位置信息;
基于所述第二位置信息和预存布局信息在至少一个所述第二终端中确定目标终端;
通过所述目标终端继续处理所述多媒体内容。
本领域内的技术人员应明白,本申请的实施例可提供为方法、***、或计算机程序产品。因此,本申请可采用硬件实施例、软件实施例、或结合软件和硬件方面的实施例的形式。而且,本申请可采用在一个或多个其中包含有计算机可用程序代码的计算机可用存储介质(包括但不限于磁盘存储器和光学存储器等)上实施的计算机程序产品的形式。
本申请是参照根据本申请实施例的方法、设备(***)、和计算机程序产品的实现流程示意图和/或方框图来描述的。应理解可由计算机程序指令实现流程示意图和/或方框图中的每一流程和/或方框、以及实现流程示意图和/或方框图中的流程和/或方框的结合。可提供这些计算机程序指令到通用计算机、专用计算机、嵌入式处理机或其他可编程数据处理设备的处理器以产生一个机器,使得通过计算机或其他可编程数据处理设备的处理器执行的指令产生用于实现在实现流程示意图一个流程或多个流程和/或方框图一个方框或多个方框中指定的功能的装置。
这些计算机程序指令也可存储在能引导计算机或其他可编程数据处理设备以特定方式工作的计算机可读存储器中,使得存储在该计算机可读存储器中的指令产生包括指令装置的制造品,该指令装置实现在实现流程示意图一个流程或多个流程和/或方框图一个方框或多个方框中指定的功能。
这些计算机程序指令也可装载到计算机或其他可编程数据处理设备上,使得在计算机或其他可编程设备上执行一系列操作步骤以产生计算机实现的处理,从而在计算机或其他可编程设备上执行的指令提供用于实现在实现流程示意图一个流程或多个流程和/或方框图一个方框或多个方框中指定的功能的步骤。
以上所述,仅为本申请的较佳实施例而已,并非用于限定本申请的保护范围。
工业实用性
本申请实施例提供了一种多媒体内容的接续处理方法和***、及存储介质,应用于接续处理***,接续处理***包括第一终端、第二终端、摄像头,当通过第一终端处理多媒体内容时,利用摄像头对第一终端对应的第一区域中的目标对象进行位置监控,获得目标对象的第一位置信息;若第一位置信息满足预设切换条件,则通过摄像头获得目标对象的第二位置信息;基于第二位置信息和预存布局信息在至少一个第二终端中确定目标终端;通过目标终端继续处理多媒体内容。由此可见,在本申请的实施例中,如果第一终端处理多媒体内容的过程中用户远离了第一终端,那么接续处理***可以利用摄像头对用户进行位置追踪,并结合预存布局信息在至少一个第二终端中确定出与用户距离最近的目标终端进行多媒体内容接续处理,从而可以实现响应于用户位置改变的多媒体内容的自动接续处理,进而可以提升多媒体内容接续处理的智能性和可靠性。

Claims (19)

  1. 一种多媒体内容的接续处理方法,所述多媒体内容的接续处理方法应用于接续处理***,所述接续处理***包括第一终端、第二终端、摄像头,所述方法包括:
    当通过所述第一终端处理多媒体内容时,利用所述摄像头对所述第一终端对应的第一区域中的目标对象进行位置监控,获得所述目标对象的第一位置信息;
    若所述第一位置信息满足预设切换条件,则通过所述摄像头获得所述目标对象的第二位置信息;
    基于所述第二位置信息和预存布局信息在至少一个所述第二终端中确定目标终端;
    通过所述目标终端继续处理所述多媒体内容。
  2. 根据权利要求1所述的方法,其中,所述接续处理***还包括:控制设备和云端;其中,所述控制设备包括所述第一终端或所述第二终端。
  3. 根据权利要求2所述的方法,其中,所述方法还包括:
    若所述第一位置信息满足预设切换条件,则确定所述多媒体内容的内容参数、所述目标对象的特征信息、所述第一终端的标识信息。
  4. 根据权利要求3所述的方法,其中,所述通过所述摄像头获得所述目标对象的第二位置信息,包括:
    通过所述控制设备向所述云端发送追踪请求;
    通过所述云端向所述摄像头发送追踪指令;
    通过所述摄像头进行实时拍摄处理,获得追踪图像;
    根据所述特征信息和所述追踪图像,确定所述第二位置信息。
  5. 根据权利要求3所述的方法,其中,所述通过所述摄像头获得所述目标对象的第二位置信息,包括:
    通过所述控制设备向所述摄像头发送追踪指令;
    通过所述摄像头进行实时拍摄处理,获得追踪图像;
    根据所述特征信息和所述追踪图像,确定所述第二位置信息。
  6. 根据权利要求4或5所述的方法,其中,所述根据所述特征信息和所述追踪图像,确定所述第二位置信息,包括:
    将所述第一特征信息与所述追踪图像中的特征进行对比处理,获得所述追踪图像中的目标图像;其中,所述目标图像中包括所述目标对象;
    基于所述目标图像确定所述第二位置信息。
  7. 根据权利要求4或5所述的方法,其中,
    所述摄像头包括以下摄像装置中的至少一个:所述第一终端配置的摄像装置,所述第二终端配置的摄像装置,布置在所述接续处理***对应的控制区域之内的摄像装置。
  8. 根据权利要求7所述的方法,其中,所述方法还包括:
    通过所述摄像头在所述控制区域之内进行检测处理,生成所述预存布局信息。
  9. 根据权利要求1所述的方法,其中,所述基于所述第二位置信息和预存布局信息在至少一个所述第二终端中确定目标终端,包括:
    基于所述第二位置信息和所述预存布局信息确定所述目标对象与至少一个所述第二终端之间的距离参数;
    将最小的距离参数对应的第二终端确定为所述目标终端。
  10. 根据权利要求1所述的方法,其中,所述基于所述第二位置信息和预存布局信息在至少一个所述第二终端中确定目标终端之前,所述方法还包括:
    确定所述第二终端对应的能力参数;其中,所述能力参数指示所述第二终端具有的多媒体应用;
    相应地,所述基于所述第二位置信息和预存布局信息在至少一个所述第二终端中确定目标终端,包括:
    根据所述能力参数和所述内容参数在至少一个所述第二终端中确定支持所述多媒体内容的候选终端;
    基于所述第二位置信息和所述预存布局信息确定所述目标对象与所述候选终端之间的距离参数;
    将最小的距离参数对应的候选终端确定为所述目标终端。
  11. 根据权利要求2所述的方法,其中,所述通过所述目标终端继续处理所述多媒体内容,包括:
    通过所述控制设备向所述目标终端发送切换指令;其中,所述切换指令携带所述内容参数;或者,
    通过所述控制设备向所述目标终端发送切换指令,以使所述目标终端基于所述切换指令从所述第一终端获取所述内容参数;其中,所述切换指令携带所述标识信息。
  12. 根据权利要求1所述的方法,其中,所述通过所述目标终端继续处理所述多媒体内容,包括:
    若所述目标终端具有与所述内容参数对应的多媒体应用,则通过所述目标终端的所述多媒体应用执行所述多媒体内容的接续处理。
  13. 根据权利要求10所述的方法,其中,所述内容参数包括以下多个参数中的至少一个参数:功能类型参数、应用类型参数,所述多媒体内容的源参数、所述多媒体内容的进度参数。
  14. 根据权利要求1所述的方法,其中,所述方法还包括:
    若基于所述第一位置信息确定所述目标对象已离开所述第一区域,则判定所述第一位置信息满足所述预设切换条件;
    若基于所述第一位置信息确定所述目标对象未离开所述第一区域,则判定所述第一位置信息不满足所述预设切换条件。
  15. 根据权利要求2所述的方法,其中,所述基于所述第二位置信息和预存布局信息在至少一个所述第二终端中确定目标终端之前,所述方法还包括:
    当通过所述第一终端处理所述多媒体内容时,利用所述摄像头对所述第二终端的第二区域进行监控,获得监控结果;
    若所述监控结果指示所述第二区域中的目标对象满足所述预设切换条件,则通过所述摄像头获得所述目标对象的所述第二位置信息。
  16. 根据权利要求2所述的方法,其中,所述通过所述目标终端继续处理所述多媒体内容之前,所述方法还包括:
    当通过所述第一终端处理所述多媒体内容时,若通过所述第二终端检测到控制操作,则通过所述摄像头确定所述控制操作对应的目标对象;
    若所述目标对象满足所述预设切换条件,则将所述第二终端确定为所述目标终端。
  17. 一种接续处理***,所述接续处理***包括:获取单元,确定单元,处理单元,
    所述获取单元,配置为当通过第一终端处理多媒体内容时,利用摄像头对所述第一终端对应的第一区域中的目标对象进行位置监控,获得所述目标对象的第一位置信息;若所述第一位置信息满足预设切换条件,则通过所述摄像头获得所述目标对象的第二位置信息;
    所述确定单元,配置为基于所述第二位置信息和预存布局信息在至少一个第二终端中确定目标终端;
    所述处理单元,配置为通过所述目标终端继续处理所述多媒体内容。
  18. 一种接续处理***,所述接续处理***包括处理器、存储有所述处理器可执行指 令的存储器,当所述指令被所述处理器执行时,实现如权利要求1-16任一项所述的方法。
  19. 一种计算机可读存储介质,其上存储有程序,所述程序被处理器执行时,实现如权利要求1-16任一项所述的方法。
PCT/CN2022/107326 2021-08-19 2022-07-22 多媒体内容的接续处理方法和***、及存储介质 WO2023020197A1 (zh)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
CN202110953962.9 2021-08-19
CN202110953962.9A CN113727193A (zh) 2021-08-19 2021-08-19 多媒体内容的接续处理方法和***、及存储介质

Publications (1)

Publication Number Publication Date
WO2023020197A1 true WO2023020197A1 (zh) 2023-02-23

Family

ID=78676777

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2022/107326 WO2023020197A1 (zh) 2021-08-19 2022-07-22 多媒体内容的接续处理方法和***、及存储介质

Country Status (2)

Country Link
CN (1) CN113727193A (zh)
WO (1) WO2023020197A1 (zh)

Families Citing this family (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN113727193A (zh) * 2021-08-19 2021-11-30 杭州逗酷软件科技有限公司 多媒体内容的接续处理方法和***、及存储介质
CN114615542A (zh) * 2022-03-25 2022-06-10 联想(北京)有限公司 一种控制方法、装置及内容共享***

Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20110129196A1 (en) * 2009-11-27 2011-06-02 Sony Corporation Display control apparatus, display control system, and remote control apparatus
CN102984592A (zh) * 2012-12-05 2013-03-20 中兴通讯股份有限公司 一种数字媒体内容播放转移的方法、装置和***
CN103780970A (zh) * 2013-08-20 2014-05-07 华为终端有限公司 一种媒体播放的方法、装置和***
CN111818303A (zh) * 2020-07-06 2020-10-23 深圳博为教育科技有限公司 一种智能导播方法、装置、***及控制主机
CN112770166A (zh) * 2020-12-21 2021-05-07 深圳市欧瑞博科技股份有限公司 多媒体智能播放方法、装置、播放设备以及存储介质
CN113727193A (zh) * 2021-08-19 2021-11-30 杭州逗酷软件科技有限公司 多媒体内容的接续处理方法和***、及存储介质

Family Cites Families (10)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US9426772B2 (en) * 2012-08-09 2016-08-23 Actv8, Inc. Method and apparatus for interactive mobile offer system based on proximity of mobile device to media source
CN105578229A (zh) * 2015-12-15 2016-05-11 小米科技有限责任公司 电子设备控制方法和装置
CN107423020A (zh) * 2017-08-22 2017-12-01 京东方科技集团股份有限公司 播放方法及播放***
CN107645675A (zh) * 2017-09-05 2018-01-30 深圳市盛路物联通讯技术有限公司 节点控制方法及相关产品
CN108513174A (zh) * 2018-03-30 2018-09-07 合肥联宝信息技术有限公司 一种信息处理方法及电子设备
CN110191372A (zh) * 2019-07-03 2019-08-30 百度在线网络技术(北京)有限公司 多媒体交互方法、***和装置
CN110460905A (zh) * 2019-09-03 2019-11-15 腾讯科技(深圳)有限公司 基于多设备的视频自动续播方法、装置及存储介质
CN112702633A (zh) * 2020-12-21 2021-04-23 深圳市欧瑞博科技股份有限公司 多媒体智能播放方法、装置、播放设备以及存储介质
CN113111199B (zh) * 2021-03-31 2023-02-03 青岛海尔科技有限公司 多媒体资源的续播方法及装置、存储介质、电子装置
CN112995731B (zh) * 2021-05-08 2021-08-13 荣耀终端有限公司 切换多媒体设备的方法和***

Patent Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20110129196A1 (en) * 2009-11-27 2011-06-02 Sony Corporation Display control apparatus, display control system, and remote control apparatus
CN102984592A (zh) * 2012-12-05 2013-03-20 中兴通讯股份有限公司 一种数字媒体内容播放转移的方法、装置和***
CN103780970A (zh) * 2013-08-20 2014-05-07 华为终端有限公司 一种媒体播放的方法、装置和***
CN111818303A (zh) * 2020-07-06 2020-10-23 深圳博为教育科技有限公司 一种智能导播方法、装置、***及控制主机
CN112770166A (zh) * 2020-12-21 2021-05-07 深圳市欧瑞博科技股份有限公司 多媒体智能播放方法、装置、播放设备以及存储介质
CN113727193A (zh) * 2021-08-19 2021-11-30 杭州逗酷软件科技有限公司 多媒体内容的接续处理方法和***、及存储介质

Also Published As

Publication number Publication date
CN113727193A (zh) 2021-11-30

Similar Documents

Publication Publication Date Title
WO2023020197A1 (zh) 多媒体内容的接续处理方法和***、及存储介质
US10123066B2 (en) Media playback method, apparatus, and system
US20150128194A1 (en) Method and mobile terminal for switching playback device
JP2021052403A (ja) スマートメディア環境においてスマート制御される媒体再生
WO2017096220A1 (en) Video stream encoding system with live crop editing and recording
KR20170091913A (ko) 영상 서비스 제공 방법 및 장치
KR20220031894A (ko) 데이터 스트림을 동기화하기 위한 시스템 및 방법
CN110677682B (zh) 直播检测与数据处理方法、设备、***及存储介质
JP2012518948A (ja) ビデオシェアリング
JP2009060512A (ja) 携帯端末、再生装置、コンテンツ再生システム、コンテンツ再生プログラム、コンピュータ読み取り可能な記録媒体、及び携帯端末の制御方法
WO2011023032A1 (zh) 一种视频监控场景切换方法及视频监控***
US20150319485A1 (en) Method and system for streaming multimedia contents in a wi-fi network
JP2011044148A (ja) 連繋使用情報を生成または利用する方法及びその装置
KR101708578B1 (ko) 이전되어 재생되는 디지털 미디어 콘텐츠를 복귀시키는 방법, 장치 및 시스템
WO2014183533A1 (zh) 一种图像处理方法、用户终端、图像处理终端及***
JP2015222575A (ja) 連繋使用情報を生成または利用する方法及びその装置
US20240232300A1 (en) Management system, communication system, and information processing method
WO2023011058A1 (zh) 显示设备、通信终端及投屏画面动态显示方法
KR101865459B1 (ko) 시각적 식별의 구현 방법, 장치 및 시스템
US11546556B2 (en) Redundant array of inexpensive cameras
CA3102425C (en) Video processing method, device, terminal and storage medium
US20240205486A1 (en) Collaborative video capture and sharing
CN105763930B (zh) 一种推送电视节目二维码的方法、智能电视机及机顶盒
WO2019100631A1 (zh) 视频播放方法、装置、***及存储介质
US11966658B2 (en) System and method for displaying image, image-capturing device, and recording medium

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 22857510

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE