WO2019007402A1 - Video interaction processing method, apparatus and system - Google Patents

Video interaction processing method, apparatus and system Download PDF

Info

Publication number
WO2019007402A1
WO2019007402A1 PCT/CN2018/094685 CN2018094685W WO2019007402A1 WO 2019007402 A1 WO2019007402 A1 WO 2019007402A1 CN 2018094685 W CN2018094685 W CN 2018094685W WO 2019007402 A1 WO2019007402 A1 WO 2019007402A1
Authority
WO
WIPO (PCT)
Prior art keywords
video
data
display device
information
item
Prior art date
Application number
PCT/CN2018/094685
Other languages
French (fr)
Chinese (zh)
Inventor
赵亚来
Original Assignee
中兴通讯股份有限公司
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 中兴通讯股份有限公司 filed Critical 中兴通讯股份有限公司
Publication of WO2019007402A1 publication Critical patent/WO2019007402A1/en

Links

Images

Classifications

    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N7/00—Television systems
    • H04N7/18—Closed-circuit television [CCTV] systems, i.e. systems in which the video signal is not broadcast
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
    • G06F3/0484—Interaction techniques based on graphical user interfaces [GUI] for the control of specific functions or operations, e.g. selecting or manipulating an object, an image or a displayed text element, setting a parameter value or selecting a range
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
    • G06F3/0487—Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser
    • G06F3/0488—Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser using a touch-screen or digitiser, e.g. input of commands through traced gestures
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06Q—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
    • G06Q30/00—Commerce
    • G06Q30/06—Buying, selling or leasing transactions
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06Q—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
    • G06Q30/00—Commerce
    • G06Q30/06—Buying, selling or leasing transactions
    • G06Q30/0601—Electronic shopping [e-shopping]
    • G06Q30/0641—Shopping interfaces
    • G06Q30/0643—Graphical representation of items or shoppers
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06Q—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
    • G06Q50/00—Information and communication technology [ICT] specially adapted for implementation of business processes of specific business sectors, e.g. utilities or tourism
    • G06Q50/10—Services
    • G06Q50/12—Hotels or restaurants
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V20/00—Scenes; Scene-specific elements
    • G06V20/40—Scenes; Scene-specific elements in video content
    • G06V20/41—Higher-level, semantic clustering, classification or understanding of video scenes, e.g. detection, labelling or Markovian modelling of sport events or news items

Definitions

  • the present disclosure relates to, but is not limited to, the field of communications, and in particular, to a video interaction processing method, apparatus and system.
  • Video surveillance is based on the wide coverage and high bandwidth of the network. It provides audio and video surveillance, Global Positioning System (GPS) positioning, Internet Protocol (IP) data transmission, intelligent image analysis and alarms, etc.
  • GPS Global Positioning System
  • IP Internet Protocol
  • Video surveillance is based on the wide coverage and high bandwidth of the network. It provides audio and video surveillance, Global Positioning System (GPS) positioning, Internet Protocol (IP) data transmission, intelligent image analysis and alarms, etc.
  • GPS Global Positioning System
  • IP Internet Protocol
  • the video interaction processing application based on video surveillance has relatively few or no, and the video interaction experience is insufficient, thus affecting the user's experience satisfaction.
  • video surveillance terminals With the continuous maturity of touch display technology, live broadcast technology and Internet of Things applications, video surveillance terminals will be widely used in different fields such as mobile communication. The above influence on user satisfaction can not be ignored.
  • the present disclosure provides a video interaction processing method, apparatus, and system, which can perform video interaction processing on a monitored video.
  • An embodiment of the present disclosure provides a video interaction processing method, including:
  • a trigger operation for displaying a video on the display device side is detected
  • Identifying the target item in the selected target data by comparing the selected target data with the sample data of the pre-stored item;
  • the attribute information of the target item, or the interactive control information, or the attribute information and the interactive control information are transmitted to the display device.
  • the detecting, by the display device side, a triggering operation for displaying a video includes: detecting video triggering time information sent by the display device side.
  • the selecting target data in the displayed video data based on the triggering operation includes:
  • the video image data corresponding to the time of the trigger time information is taken as the selected target data.
  • the detecting, by the display device side, a triggering operation for displaying a video comprising: detecting video triggering time information and video triggering location information sent by the display device side.
  • the selecting target data in the displayed video data based on the triggering operation includes:
  • the target data is selected in the determined video image data using the trigger position information.
  • the embodiment of the present disclosure further provides a video interaction processing apparatus, including:
  • the detecting module is configured to: when detecting a triggering operation on the display device side for displaying the video, turning on the data selection module;
  • a data selection module configured to: select target data in the video data displayed by the display device based on the triggering operation
  • the identification module is configured to: identify the target item in the selected target data by comparing the target data selected by the data selection module with the sample data of the pre-stored item;
  • the information feedback module is configured to: send attribute information of the target item, or interactive control information, or attribute information and interaction control information to the display device.
  • the detecting module is configured to: when detecting the video triggering time information sent by the display device side, determine that the triggering operation of the display device side for displaying the video is detected.
  • the data selection module is configured to: set a time length forward by using the time point corresponding to the trigger time information, and select video data in the duration as the selected target data; Alternatively, the video image data corresponding to the time of the trigger time information is taken as the selected target data.
  • the detecting module is configured to: when detecting the video triggering time information and the video triggering position information sent by the display device side, determining that the triggering of the display device side for the display video is detected operating.
  • the data selection module is configured to: determine video image data corresponding to the time of the trigger time information, and select the selected video image data by using the trigger position information. Target data.
  • the embodiment of the present disclosure further provides a video interaction processing system, including:
  • the front-end monitoring device is configured to: send the captured video to the display device in real time;
  • the display device is configured to: display the received video, and notify the background device when receiving the triggering operation on the displayed video, and the display device is further configured to:
  • the background device is configured to: detect a triggering operation on the display device side for displaying a video, and select target data in the video data displayed by the display device based on the triggering operation, by using the selected target data and pre-stored The sample data of the item is compared, the target item in the selected target data is identified, and attribute information of the target item, or interactive control information, or attribute information and interactive control information is transmitted to the display device.
  • Embodiments of the present disclosure also provide a computer readable storage medium storing computer executable instructions that, when executed, implement the video interaction processing method described above.
  • the method, the device and the system according to the embodiments of the present disclosure can enable the user to know the information of the item of interest in the video through the real-time video anytime and anywhere, and visually display the related information of the item through the display device, thereby realizing the use of “Internet+”
  • the thinking provides users with a more comfortable video interaction experience, which greatly enhances the user experience.
  • FIG. 1 is a flowchart of a video interaction processing method according to a first embodiment of the present disclosure
  • FIG. 2 is a structural block diagram of a video interaction processing system according to a second embodiment of the present disclosure
  • FIG. 3 is a flow chart of a work plan for booking a meal in an embodiment of the present disclosure
  • FIG. 4 is a flow chart of assigning a staff member to perform a table cleaning operation in the embodiment of the present disclosure
  • FIG. 5 is a flow chart of a smart shopping operation according to an embodiment of the present disclosure.
  • FIG. 6 is a flowchart of a work process of a home smart device control system according to an embodiment of the present disclosure
  • FIG. 7 is a structural block diagram of a video interaction processing apparatus according to a third embodiment of the present disclosure.
  • a video interaction processing method is provided, and the method is applicable to a background device. As described in FIG. 1, the method may include the following steps:
  • Step S101 detecting a trigger operation of the display device side for displaying a video
  • the front-end monitoring device can acquire the monitored video in real time, and send the video to the display device for video display.
  • the background device may determine that the triggering operation of the display device side for displaying the video is detected when detecting the video triggering time information sent by the display device side. That is, when the user is interested in the item in the video displayed by the display device, the displayed video may be triggered in an agreed manner, and the display device sends the time information of the triggering operation time to the background device to enable the background. The device performs subsequent operations such as target item identification.
  • the background device may determine that the triggering operation of the display device side for displaying the video is detected when detecting the video triggering time information and the video triggering location information sent by the display device side.
  • the video when the user is interested in the item in the displayed video, the video may be triggered in an agreed manner for the location of the item of interest, for example, double-clicking on the screen in the area where the item of interest is located, and the like.
  • Step S102 selecting target data in the video data displayed by the display device based on the triggering operation
  • the front-end monitoring device can synchronously send the monitoring video to the background device when the monitoring video acquired in real time is sent to the display device, so that the background device can obtain the video displayed by the display device. data.
  • the background device may start the pre-recording function, that is, only the monitoring video received within the set time period is saved, wherein the set time period, that is, the pre-recording duration, may be, but is not limited to, 5 seconds; Thereby, the storage resources of the background device can be saved.
  • the display device may activate a pre-recording function, and when the user issues a triggering operation for displaying the video, send the pre-recorded video before the triggering operation to the background processing device, so that the background device can enable the background device to Get the video data displayed to the display device.
  • the manner of selecting the target data in the video data displayed by the display device may include, but is not limited to:
  • Manner 1 The time point corresponding to the trigger time information is forwarded to set the duration, and the video data in the duration is selected as the selected target data; wherein the set duration is less than or equal to the pre-recorded duration.
  • Manner 2 The video image data corresponding to the time information of the trigger time information is used as the selected target data.
  • Manner 3 determining video image data corresponding to the time of the trigger time information, and using the video trigger position information, selecting the target data in the determined video image data.
  • Step S103 by comparing the selected target data with the sample data of the pre-stored item, identifying the target item in the selected target data;
  • the sample data of the item may include a picture or video data of the item.
  • Step S104 Send attribute information of the target item, or interactive control information, or attribute information and interaction control information to the display device.
  • the display device may display the attribute information of the target item after receiving the attribute information of the target item; or the display device may display the interaction control for the target item after receiving the interactive control information of the target item. Or, the display device may display the attribute information of the target item and the interactive control for the target item after receiving the attribute information of the target item and the interactive control information.
  • the display device may send the touch command to the background device when the user touches the touch command of the interaction control, and the background device responds to the touch command.
  • the user can know the item information of interest in the video through the real-time video anytime and anywhere, and visually display the item related information through the display device, thereby providing the user with a comfortable video.
  • the interactive experience greatly enhances the user experience.
  • a video interaction processing system is provided, as shown in FIG. 2, which may include: a front end monitoring device 210, a display device 220, and a background device 230;
  • the front-end monitoring device 210 is configured to: send the captured video to the display device 220 in real time;
  • the display device 220 is configured to: display the received video, and notify the background device 230 when receiving the triggering operation on the displayed video, and the display device is further configured to:
  • the attribute information of the target item sent by the background device 230 When the attribute information of the target item sent by the background device 230 is received, the attribute of the target item is displayed; or, when the interaction control information of the target item sent by the background device 230 is received, the interaction with the target item The control performs display; or, when receiving the attribute information and the interactive control information of the target item sent by the background device 230, displaying the attribute and the interactive control of the target item;
  • the background device 230 is configured to: detect a triggering operation on the display device 220 side for displaying a video, and select target data in the video data displayed by the display device 220 based on the triggering operation, by selecting the selected target data and the pre-stored item The sample data is compared, the target item in the selected target data is identified, and the attribute information of the target item, or the interactive control information, or the attribute information and the interactive control information are sent to the display device 220.
  • the process of the target device 230 to implement the target item identification and the like can be referred to the first embodiment, and details are not described herein again.
  • the front-end monitoring device is generally configured to: obtain a video source in the monitoring area, and transmit the front-end video source to the touch screen device (ie, the display device) through the media transmission technology.
  • the touch screen device is generally configured to: connect with the front-end monitoring device and the background processing module through a mobile network or Wireless Fidelity (WIFI), perform video preview, item comparison material acquisition, item-related attribute display, and issue the command through a touch command. To complete the interaction.
  • WIFI Wireless Fidelity
  • the background processing module is roughly configured to perform item identification processing and complete related interaction operations in accordance with instructions of the touch screen device.
  • the front-end video source is transmitted to the touch screen device through the media transmission technology; wherein the touch screen device may include, but is not limited to, a mobile phone, a PAD, a personal computer (PC, Personal Computer) touch display screen, and the like.
  • the touch screen device may include, but is not limited to, a mobile phone, a PAD, a personal computer (PC, Personal Computer) touch display screen, and the like.
  • the object compares the material and compares the comparison material with the comparison sample; wherein the comparison material may include, but is not limited to, a picture, a video, and the like.
  • the background device confirms the item by comparison, the related information such as the item name and some interactive operation buttons are displayed through the touch screen device.
  • the display manner of the item attribute may include, but is not limited to, a text, a voice prompt, and the like.
  • the video interaction processing system proposed by the embodiment of the present invention enables the user to understand the item information of interest in the video through real-time video anytime and anywhere, and more intuitively display the item related information, thereby providing the user with a more comfortable video interaction experience habit, greatly improving the user. Experience.
  • Scenario 1 Intelligent ordering system for video interaction based on touch screen device
  • a commercially available order management system can generally be a system that provides a choice to a customer by displaying a menu or a package picture through an application (APP, Application).
  • APP Application
  • the user decides whether to make a reservation through a menu or a package picture.
  • the user cannot predict in advance whether there is a vacancy, and may waste customer time due to waiting; on the other hand, the user cannot know the dining environment in advance, and may influence the dining mood or re-select due to the dining environment problem after the dining place is reached. Dining places, and wasting customers to re-select time.
  • the video interaction system and method according to the embodiments of the present disclosure can well avoid the above-mentioned situation.
  • Embodiments of the present disclosure may generally include two processes in which a user subscribes to a table workflow, and a merchant administrator assigns a staff member to perform a table hygiene cleaning workflow.
  • the booking place workflow of the embodiment of the present disclosure may include:
  • Step 301 The merchant stores samples of each table in one or more dining tables in the background processing device, and sets attribute information corresponding to each table;
  • Step 302 The user browses the dining environment in real time through the monitoring terminal of the lobby or the booth by using the touch screen device;
  • Step 303 The user selects a table of interest by a touch operation in the video browsing
  • Step 304 The background processing device compares the pre-recorded video 5 seconds before the touch time with the pre-stored table sample.
  • Step 305 The background processing device determines whether the table matching the table sample is found, if not found, proceeds to step 302 to continue the video browsing, if it finds a matching table, then proceeds to step 306;
  • Step 306 Feeding the table information to the touch screen device
  • Step 307 The video browsing interface of the touch screen device displays the table related attributes (for example, the number of people that can be accommodated, whether there is air conditioning, whether it is booked, the time period of being booked), and interactive related buttons (for example, reservation, exit) in the form of a popup box. ;
  • Step 308 After the user understands the related attributes of the table, if the time period for which the reservation is to be booked has been reserved, the user may click the exit button to cancel the reservation, exit the table attribute display box and proceed to step 302 to continue the video browsing; if the time period for the reservation is not available Once booked, you can click the booking button to make a reservation, go to step 309;
  • Step 309 After receiving the reservation request sent by the touch screen device, the background processing device immediately generates an order and feeds back the information to the touch screen device.
  • Step 310 The user confirms the order, and during the reserved time period, the user takes the time to go to the meal.
  • the assigned staff member of the embodiment of the present disclosure may perform:
  • Step 401 The merchant stores samples of each table in one or more dining tables in a background processing device, and sets a health cleaning related person corresponding to each table;
  • Step 402 After monitoring, the management person finds that the guest on a certain dining table in the lobby or the private room has finished eating out, and selects the table to be cleaned by touch operation in the video browsing;
  • Step 403 The background processing device compares the pre-recorded video 5 seconds before the touch time with the table sample in the background;
  • Step 404 The background processing device determines whether the table matching the sample is found. If the table matching the sample is not found, the process proceeds to step 405 to perform an exception processing flow. If a table matching the sample is found, the process proceeds to step 406.
  • Step 405 A comparison failure prompt is given in the background, and then the administrator temporarily arranges the cleaning personnel to clean the cleaning;
  • Step 406 The background processing device feeds the table information to the touch screen device.
  • Step 407 The video browsing interface of the touch screen device displays a list of the health cleaning personnel corresponding to the dining table and interactive related buttons (whether cleaning, exiting, etc.) in a pop-up box for the user to view and operate;
  • Step 408 If the management personnel decides to clean the sanitation, select one of the plurality of cleaning personnel in the pop-up box, and click the clean up health button to proceed to step 409; if it is decided not to clean the sanitation, return to step 402;
  • Step 409 The background processing device automatically reminds the cleaning personnel to clean the table through broadcast or SMS;
  • Step 410 After receiving the reminder, the sanitation cleaning personnel go to the corresponding table to clean the sanitation.
  • Scenario 2 Smart shopping system for video interaction based on IE browser
  • This application scenario is described by expanding the video browsing touch screen device in the scene 1 into a web browser (IE, Internet Explorer) browser of the PC, and expanding the smart ordering system into a smart shopping system.
  • IE Internet Explorer
  • the smart shopping workflow of the embodiment of the present disclosure may include:
  • Step 501 The merchant stores samples of each of the one or more commodities in the background processing device, and sets detailed information corresponding to each commodity;
  • Step 502 The user browses various commodities in the store in real time through the monitoring terminal of the store by using the IE browser of the PC;
  • Step 503 The user selects an item of interest by using a mouse to intercept the video range operation in the video browsing;
  • Step 504 The background processing device compares the pre-recorded video 5 seconds before the mouse interception time with the pre-stored product sample.
  • Step 505 The background processing device determines whether the product matching the sample is found. If the product matching the sample is not found, the process proceeds to step 502 to continue the video browsing. If the product matching the sample is found, the process proceeds to step 506.
  • Step 506 The background processing device feeds back the commodity information to the IE browser.
  • Step 507 The video browsing interface of the IE browser displays the product-related attributes (for example: brand, code number, price, whether it is popular, etc.) and interactive related buttons (such as ordering and exiting) in the form of a pop-up box for the user to view and operate. ;
  • product-related attributes for example: brand, code number, price, whether it is popular, etc.
  • interactive related buttons such as ordering and exiting
  • Step 508 After the user understands the product-related attribute, if the product is not interested, click the exit button to not order, exit the product attribute display box and proceed to step 502 to continue the video browsing; if interested in the product, click the order button to enter the step 509;
  • Step 509 The background processing device generates an order and feeds back to the IE browser.
  • Step 510 The user confirms the order. During the reservation period, the user takes the time to go to the store to try on the purchase, or the online payment is delivered to the door by mail.
  • the home interactive device control system based on video interaction is a typical application of the present disclosure to a Peer-to-Peer (P2P) monitoring system.
  • P2P Peer-to-Peer
  • the P2P monitoring system can directly connect the monitoring front end to the touch screen client device to complete the basic functions of video monitoring.
  • the function of the background processing device provided in the embodiment of the present disclosure for providing sample storage and performing item identification can be implemented in the touch screen client device, and the function of the monitoring front end side can be kept unchanged.
  • the embodiment of the present disclosure can be extended to the P2P monitoring system. To achieve video interaction.
  • the comparative material in the embodiment of the present disclosure may include, but is not limited to, a picture, a video, and the like; after the item is identified, the display of the item attribute may include, but is not limited to, a text, a voice prompt, and the like. Therefore, this application scenario is described by expanding the contrast material into a picture; expanding the item attribute display mode to "text + voice prompt".
  • the workflow of the home smart device control system of the embodiment of the present disclosure may include:
  • Step 601 Whether the user uses the APP for the first time, if the APP is used for the first time, the process proceeds to step 602; if the application is not used for the first time, the process proceeds to step 604;
  • Step 602 prompt the user to take a picture of the home device and input the device name to complete the sample configuration.
  • Step 603 The user completes the sample configuration according to the prompt
  • Step 604 The user uses the touch screen APP application to browse each smart device of one or more smart devices in real time through the monitoring terminal at home;
  • Step 605 The user finds that there is no person in the home in the video browsing, and the home device (such as air conditioner, TV, etc.) is not turned off;
  • the home device such as air conditioner, TV, etc.
  • Step 606 Touch the home device in the video browsing
  • Step 607 The touch screen APP compares the snapshot in the touch area with the locally configured home device sample.
  • Step 608 Determine whether the device matching the sample is found, if the device matching the sample is found, proceed to step 609; if no device matching the sample is found, proceed to step 602;
  • Step 609 Feeding the home device information to the touch screen APP, and giving an interface display;
  • Step 610 The video browsing interface of the touch screen APP displays device related attributes (eg, name, status, etc.) and interactive related buttons (for example, turning on/off the device, exiting the popup box) for the user to view in a popup box; Hear a voice prompt (for example, the status of the air conditioner is turned on);
  • device related attributes eg, name, status, etc.
  • interactive related buttons for example, turning on/off the device, exiting the popup box
  • Hear a voice prompt for example, the status of the air conditioner is turned on
  • Step 611 The touch screen APP determines whether to close the device, if the device is turned off, then proceeds to step 612; if the device is not closed, clicks the exit display box button, proceeds to step 605;
  • Step 612 The touch screen APP sends a shutdown command to the home smart device through the wireless network, and returns a shutdown result to the touch screen APP;
  • Step 613 The user receives the closed successful text and voice reminder in the touch screen APP; at the same time, the user can confirm whether the user is successfully closed by video browsing.
  • a video interaction processing apparatus may include:
  • the detecting module 710 is configured to: when detecting a triggering operation on the display device side for the display video, turning on the data selection module;
  • the data selection module 720 is configured to select target data in the video data displayed by the display device based on the triggering operation
  • the identification module 730 is configured to: identify the target item in the selected target data by comparing the target data selected by the data selection module with the sample data of the pre-stored item;
  • the information feedback module 740 is configured to: send attribute information of the target item, or interactive control information, or attribute information and interaction control information to the display device.
  • the detecting module 710 may be configured to: when detecting the video triggering time information sent by the display device side, determine that the triggering operation of the display device side for displaying the video is detected.
  • the data selection module 720 may be configured to: set a duration of the forward time according to the time point corresponding to the trigger time information, select video data in the duration as the selected target data; or: match the trigger time information The video image data of the moment is taken as the selected target data.
  • the detecting module 710 may be configured to: when detecting the video triggering time information and the video triggering location information sent by the display device side, determining that the display device side is configured to display the video Trigger action.
  • the data selection module 720 may be configured to: determine video image data corresponding to the time of the trigger time information, and select the target data in the determined video image data by using the trigger position information.
  • the user can know the item information of interest in the video through the real-time video anytime and anywhere, and visually display the item related information through the display device, thereby providing the user with a comfortable video interaction experience. Improve the user experience.
  • Embodiments of the present disclosure also provide a computer readable storage medium storing computer executable instructions that, when executed, implement the video interaction processing method described above.
  • the term computer storage medium includes volatile and nonvolatile, implemented in any method or technology for storing information, such as computer readable instructions, data structures, program modules or other data. Sex, removable and non-removable media.
  • the computer storage medium includes, but is not limited to, Random Access Memory (RAM), Read-Only Memory (ROM), and Electrically Erasable Programmable Read-only Memory (EEPROM). Flash memory or other memory technology, compact disc read-only memory (CD-ROM), digital versatile disc (DVD) or other optical disc storage, magnetic cassette, magnetic tape, disk storage or other magnetic storage device, or Any other medium used to store the desired information and that can be accessed by the computer.
  • communication media typically includes computer readable instructions, data structures, program modules or other data in a modulated data signal, such as a carrier wave or other transport mechanism, and can include any information delivery media. .

Landscapes

  • Engineering & Computer Science (AREA)
  • Business, Economics & Management (AREA)
  • Theoretical Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Tourism & Hospitality (AREA)
  • Marketing (AREA)
  • General Engineering & Computer Science (AREA)
  • Accounting & Taxation (AREA)
  • Finance (AREA)
  • General Business, Economics & Management (AREA)
  • Economics (AREA)
  • Strategic Management (AREA)
  • Multimedia (AREA)
  • Development Economics (AREA)
  • Human Computer Interaction (AREA)
  • Health & Medical Sciences (AREA)
  • General Health & Medical Sciences (AREA)
  • Human Resources & Organizations (AREA)
  • Primary Health Care (AREA)
  • Signal Processing (AREA)
  • Software Systems (AREA)
  • Computational Linguistics (AREA)
  • User Interface Of Digital Computer (AREA)
  • Two-Way Televisions, Distribution Of Moving Picture Or The Like (AREA)

Abstract

A video interaction processing method comprises: detecting a trigger operation of a display device side on a displayed video; selecting, on the basis of the trigger operation, target data in the video data displayed by the display device; comparing the selected target data with prestored sample data of an object to identity a target object in the selected target data; and sending attribute information, or interaction control information, or the attribute information and the interaction control information of the target object to the display device.

Description

一种视频交互处理方法、装置及***Video interaction processing method, device and system 技术领域Technical field
本公开涉及但不限于通信领域，尤其是一种视频交互处理方法、装置及***。The present disclosure relates to, but is not limited to, the field of communications, and in particular, to a video interaction processing method, apparatus and system.
背景技术Background technique
视频监控是充分依托网络的广覆盖、高带宽的特点，提供音视频监控、全球定位***(GPS，Global Position System)定位、网际协议(IP，Internet Protocol)数据传输、智能图像分析报警等多功能为一体的综合应用***。只要有能上网的地方都可以实时监控前端传来的图像、实时智能分析图像并进行联动报警，完美地弥补了传统监控的先天性不足，是现代安防移动性、突发性、紧迫性的有机体现。已经有了较多的应用。Video surveillance is based on the wide coverage and high bandwidth of the network. It provides audio and video surveillance, Global Positioning System (GPS) positioning, Internet Protocol (IP) data transmission, intelligent image analysis and alarms, etc. As one integrated application system. As long as there is a place where you can access the Internet, you can monitor the images transmitted from the front end in real time, analyze the images in real time and perform linkage alarms. This perfectly compensates for the congenital insufficiency of traditional monitoring. It is the organic security, suddenness and urgency of modern security. reflect. There are already more applications.
发明内容Summary of the invention
以下是对本文详细描述的主题的概述。本概述并非是为了限制权利要求的保护范围。The following is an overview of the topics detailed in this document. This Summary is not intended to limit the scope of the claims.
基于视频监控的视频交互处理应用相对较少，甚至没有，视频交互体验不足，从而影响了用户的体验满意度。随着触摸显示技术、直播技术及物联网应用的不断成熟，视频监控终端在不同领域如移动通信领域的应用将非常广泛，上述对于用户满意度的影响也越来越不容忽视。The video interaction processing application based on video surveillance has relatively few or no, and the video interaction experience is insufficient, thus affecting the user's experience satisfaction. With the continuous maturity of touch display technology, live broadcast technology and Internet of Things applications, video surveillance terminals will be widely used in different fields such as mobile communication. The above influence on user satisfaction can not be ignored.
本公开提供一种视频交互处理方法、装置及***，能够对监控的视频进行视频交互处理。The present disclosure provides a video interaction processing method, apparatus, and system, which can perform video interaction processing on a monitored video.
本公开实施例提供一种视频交互处理方法，包括：An embodiment of the present disclosure provides a video interaction processing method, including:
检测到显示设备侧针对显示视频的触发操作；A trigger operation for displaying a video on the display device side is detected;
基于所述触发操作，在所述显示设备显示的视频数据中选取目标数据；Selecting target data in the video data displayed by the display device based on the triggering operation;
通过将选取的目标数据与预先存储的物品的样本数据进行比较，识别出选取的目标数据中的目标物品；Identifying the target item in the selected target data by comparing the selected target data with the sample data of the pre-stored item;
将所述目标物品的属性信息、或交互控件信息、或属性信息和交互控件信息发送到所述显示设备。The attribute information of the target item, or the interactive control information, or the attribute information and the interactive control information are transmitted to the display device.
在一种示例性实施方式中，所述检测到显示设备侧针对显示视频的触发操作，包括：检测到所述显示设备侧发送的视频触发时间信息。In an exemplary embodiment, the detecting, by the display device side, a triggering operation for displaying a video includes: detecting video triggering time information sent by the display device side.
在一种示例性实施方式中，所述基于所述触发操作，在显示的视频数据中选取目标数据，包括：In an exemplary embodiment, the selecting target data in the displayed video data based on the triggering operation includes:
以所述触发时间信息对应的时间点，向前推移设定时长，选取该时长内的视频数据作为选取的目标数据；Setting the duration of the forward time according to the time point corresponding to the trigger time information, and selecting video data within the duration as the selected target data;
或者，将所述触发时间信息对应时刻的视频图像数据作为选取的目标数据。Alternatively, the video image data corresponding to the time of the trigger time information is taken as the selected target data.
在一种示例性实施方式中，所述检测到显示设备侧针对显示视频的触发操作，包括：检测到所述显示设备侧发送的视频触发时间信息和视频触发位置信息。In an exemplary embodiment, the detecting, by the display device side, a triggering operation for displaying a video, comprising: detecting video triggering time information and video triggering location information sent by the display device side.
在一种示例性实施方式中，所述基于所述触发操作，在显示的视频数据中选取目标数据，包括：In an exemplary embodiment, the selecting target data in the displayed video data based on the triggering operation includes:
确定所述触发时间信息对应时刻的视频图像数据；Determining video image data corresponding to the time of the trigger time information;
利用所述触发位置信息，在确定的视频图像数据中选定所述目标数据。The target data is selected in the determined video image data using the trigger position information.
本公开实施例还提供一种视频交互处理装置，包括：The embodiment of the present disclosure further provides a video interaction processing apparatus, including:
检测模块，设置为：在检测到显示设备侧针对显示视频的触发操作时，开启数据选取模块；The detecting module is configured to: when detecting a triggering operation on the display device side for displaying the video, turning on the data selection module;
数据选取模块，设置为：基于所述触发操作，在所述显示设备显示的视频数据中选取目标数据；a data selection module, configured to: select target data in the video data displayed by the display device based on the triggering operation;
识别模块，设置为：通过将所述数据选取模块选取的目标数据与预先存储的物品的样本数据进行比较，识别出选取的目标数据中的目标物品；The identification module is configured to: identify the target item in the selected target data by comparing the target data selected by the data selection module with the sample data of the pre-stored item;
信息反馈模块，设置为：将所述目标物品的属性信息、或交互控件信息、或属性信息和交互控件信息发送到所述显示设备。The information feedback module is configured to: send attribute information of the target item, or interactive control information, or attribute information and interaction control information to the display device.
在一种示例性实施方式中，所述检测模块，是设置为：当检测到所述显示设备侧发送的视频触发时间信息时，判定检测到显示设备侧针对显示视频的触发操作。In an exemplary embodiment, the detecting module is configured to: when detecting the video triggering time information sent by the display device side, determine that the triggering operation of the display device side for displaying the video is detected.
在一种示例性实施方式中，所述数据选取模块，是设置为：以所述触发时间信息对应的时间点，向前推移设定时长，选取该时长内的视频数据作为选取的目标数据；或者，将所述触发时间信息对应时刻的视频图像数据作为选取的目标数据。In an exemplary embodiment, the data selection module is configured to: set a time length forward by using the time point corresponding to the trigger time information, and select video data in the duration as the selected target data; Alternatively, the video image data corresponding to the time of the trigger time information is taken as the selected target data.
在一种示例性实施方式中，所述检测模块，是设置为：当检测到所述显示设备侧发送的视频触发时间信息和视频触发位置信息时，判定检测到显示设备侧针对显示视频的触发操作。In an exemplary embodiment, the detecting module is configured to: when detecting the video triggering time information and the video triggering position information sent by the display device side, determining that the triggering of the display device side for the display video is detected operating.
在一种示例性实施方式中，所述数据选取模块，是设置为：确定所述触发时间信息对应时刻的视频图像数据，并利用所述触发位置信息，在确定的视频图像数据中选定所述目标数据。In an exemplary embodiment, the data selection module is configured to: determine video image data corresponding to the time of the trigger time information, and select the selected video image data by using the trigger position information. Target data.
本公开实施例还提供一种视频交互处理***，包括：The embodiment of the present disclosure further provides a video interaction processing system, including:
前端监控设备，设置为：将拍摄的视频实时的发送到显示设备；The front-end monitoring device is configured to: send the captured video to the display device in real time;
所述显示设备，设置为：对接收到的视频进行显示，并在接收到对显示视频的触发操作时，通知后台设备，以及所述显示设备还设置为：The display device is configured to: display the received video, and notify the background device when receiving the triggering operation on the displayed video, and the display device is further configured to:
在接收到所述后台设备发送的目标物品的属性信息时，对所述目标物品的属性进行显示；或者，在接收到所述后台设备发送的目标物品的交互控件信息时，对所述目标物品的交互控件进行显示；或者，在接收到所述后台设备发送的目标物品的属性信息和交互控件信息时，对所述目标物品的属性和交互控件进行显示；And displaying an attribute of the target item when the attribute information of the target item sent by the background device is received; or, when receiving the interaction control information of the target item sent by the background device, the target item The interactive control is displayed; or, when the attribute information and the interactive control information of the target item sent by the background device are received, the attribute and the interactive control of the target item are displayed;
所述后台设备，设置为：检测到显示设备侧针对显示视频的触发操作，基于所述触发操作，在所述显示设备显示的视频数据中选取目标数据，通过将选取的目标数据与预先存储的物品的样本数据进行比较，识别出选取的目标数据中的目标物品，将所述目标物品的属性信息、或交互控件信息、或属性信息和交互控件信息发送到所述显示设备。The background device is configured to: detect a triggering operation on the display device side for displaying a video, and select target data in the video data displayed by the display device based on the triggering operation, by using the selected target data and pre-stored The sample data of the item is compared, the target item in the selected target data is identified, and attribute information of the target item, or interactive control information, or attribute information and interactive control information is transmitted to the display device.
本公开实施例还提供了一种计算机可读存储介质，存储有计算机可执行指令，所述计算机可执行指令被执行时实现上述视频交互处理方法。Embodiments of the present disclosure also provide a computer readable storage medium storing computer executable instructions that, when executed, implement the video interaction processing method described above.
本公开实施例有益效果如下：The beneficial effects of the embodiments of the present disclosure are as follows:
利用本公开实施例所述方法、装置和***，可以使用户随时随地通过实 时视频了解视频中感兴趣的物品信息，并通过显示设备对物品相关信息进行直观地显示，从而实现了利用“互联网+”的思维给用户提供更舒适的视频交互体验习惯，大大提升了用户的使用体验。The method, the device and the system according to the embodiments of the present disclosure can enable the user to know the information of the item of interest in the video through the real-time video anytime and anywhere, and visually display the related information of the item through the display device, thereby realizing the use of “Internet+” The thinking provides users with a more comfortable video interaction experience, which greatly enhances the user experience.
在阅读并理解了附图和详细描述后，可以明白其他方面。Other aspects will be apparent upon reading and understanding the drawings and detailed description.
附图概述BRIEF abstract
图1为本公开第一实施例提供的一种视频交互处理方法的流程图；FIG. 1 is a flowchart of a video interaction processing method according to a first embodiment of the present disclosure;
图2为本公开第二实施例提供的一种视频交互处理***的结构框图；2 is a structural block diagram of a video interaction processing system according to a second embodiment of the present disclosure;
图3为本公开实施例中预订餐位工作流程图；3 is a flow chart of a work plan for booking a meal in an embodiment of the present disclosure;
图4为本公开实施例中指派工作人员进行餐桌卫生清理工作流程图；4 is a flow chart of assigning a staff member to perform a table cleaning operation in the embodiment of the present disclosure;
图5为本公开实施例中智能购物工作流程图；FIG. 5 is a flow chart of a smart shopping operation according to an embodiment of the present disclosure;
图6为本公开实施例中家庭智能设备控制***工作流程图；6 is a flowchart of a work process of a home smart device control system according to an embodiment of the present disclosure;
图7为本公开第三实施例提供的一种视频交互处理装置的结构框图。FIG. 7 is a structural block diagram of a video interaction processing apparatus according to a third embodiment of the present disclosure.
本公开的较佳实施方式Preferred embodiment of the present disclosure
下面结合附图对本公开的实施方式进行描述。Embodiments of the present disclosure will be described below with reference to the accompanying drawings.
在本公开第一实施例中，提供一种视频交互处理方法，所述方法可应用于后台设备，如图1所述，所述方法可包括如下步骤：In the first embodiment of the present disclosure, a video interaction processing method is provided, and the method is applicable to a background device. As described in FIG. 1, the method may include the following steps:
步骤S101，检测到显示设备侧针对显示视频的触发操作；Step S101, detecting a trigger operation of the display device side for displaying a video;
本公开实施例中，前端监控设备可实时获取监控的视频，并将该视频发送到所述显示设备进行视频显示。In the embodiment of the present disclosure, the front-end monitoring device can acquire the monitored video in real time, and send the video to the display device for video display.
在本公开的一个可选实施例中，后台设备可在检测到所述显示设备侧发送的视频触发时间信息时，判定检测到显示设备侧针对显示视频的触发操作。也就是说，当用户对显示设备显示的视频中的物品感兴趣时，可以按约定方式对显示的视频进行触发操作，显示设备将接收到触发操作时刻的时间信息发送到后台设备，以使后台设备进行后续的目标物品识别等操作。In an optional embodiment of the present disclosure, the background device may determine that the triggering operation of the display device side for displaying the video is detected when detecting the video triggering time information sent by the display device side. That is, when the user is interested in the item in the video displayed by the display device, the displayed video may be triggered in an agreed manner, and the display device sends the time information of the triggering operation time to the background device to enable the background. The device performs subsequent operations such as target item identification.
在本公开的又一可选实施例中，后台设备可在检测到所述显示设备侧发送的视频触发时间信息和视频触发位置信息时，判定检测到显示设备侧针对显示视频的触发操作。本实施例中，用户在对显示的视频中的物品感兴趣时， 可以针对感兴趣物品所在位置，按约定的方式触发视频，例如，在感兴趣物品所在区域双击屏幕等等。显示设备将触发操作时刻的时间信息和用户触发的位置信息发送到后台设备后，可以提高后台设备对目标物品的识别效率。In a further optional embodiment of the present disclosure, the background device may determine that the triggering operation of the display device side for displaying the video is detected when detecting the video triggering time information and the video triggering location information sent by the display device side. In this embodiment, when the user is interested in the item in the displayed video, the video may be triggered in an agreed manner for the location of the item of interest, for example, double-clicking on the screen in the area where the item of interest is located, and the like. After the display device sends the time information of the triggering operation time and the location information triggered by the user to the background device, the recognition efficiency of the target device by the background device can be improved.
当然，上述只是列举了本步骤的两个可选实现方式，当然，也可以采用触发视频中物品识别的任何其他触发方式，在此不再赘述。Of course, the foregoing only enumerates two optional implementation manners of this step. Of course, any other triggering manner for triggering the item identification in the video may also be used, and details are not described herein again.
步骤S102，基于所述触发操作，在显示设备显示的视频数据中选取目标数据；Step S102, selecting target data in the video data displayed by the display device based on the triggering operation;
在本公开的一个可选实施例中，前端监控设备可在将实时获取的监控视频发送到显示设备时，同步地将监控视频发送到后台设备，以使后台设备能够获取到显示设备显示的视频数据。可选地，本实施例中，后台设备可启动预录功能，即只保存接收到设定时间段内的监控视频，其中，设定时间段即预录时长，可以但不限于为5秒；由此，可节省后台设备的存储资源。In an optional embodiment of the present disclosure, the front-end monitoring device can synchronously send the monitoring video to the background device when the monitoring video acquired in real time is sent to the display device, so that the background device can obtain the video displayed by the display device. data. Optionally, in this embodiment, the background device may start the pre-recording function, that is, only the monitoring video received within the set time period is saved, wherein the set time period, that is, the pre-recording duration, may be, but is not limited to, 5 seconds; Thereby, the storage resources of the background device can be saved.
在本公开的又一可选实施例中，显示设备可启动预录功能，当用户发出针对显示视频的触发操作时，将触发操作前预录的视频发送到后台处理设备，以使后台设备能够获取到显示设备显示的视频数据。In still another optional embodiment of the present disclosure, the display device may activate a pre-recording function, and when the user issues a triggering operation for displaying the video, send the pre-recorded video before the triggering operation to the background processing device, so that the background device can enable the background device to Get the video data displayed to the display device.
本公开实施例中，在显示设备显示的视频数据中选取目标数据的方式可包括但不限于为：In the embodiment of the present disclosure, the manner of selecting the target data in the video data displayed by the display device may include, but is not limited to:
方式一：以触发时间信息对应的时间点，向前推移设定时长，选取该时长内的视频数据作为选取的目标数据；其中，设定时长小于等于预录时长。Manner 1: The time point corresponding to the trigger time information is forwarded to set the duration, and the video data in the duration is selected as the selected target data; wherein the set duration is less than or equal to the pre-recorded duration.
方式二：将触发时间信息对应时刻的视频图像数据作为选取的目标数据。Manner 2: The video image data corresponding to the time information of the trigger time information is used as the selected target data.
方式三：确定触发时间信息对应时刻的视频图像数据，利用视频触发位置信息，在确定的视频图像数据中选定所述目标数据。Manner 3: determining video image data corresponding to the time of the trigger time information, and using the video trigger position information, selecting the target data in the determined video image data.
当然，上述只是列举了本步骤的几个可选实现方式，当然也可以采用在显示设备显示的视频数据中选取目标数据的处理方式，在此不再赘述。Of course, the foregoing only enumerates several optional implementation manners of this step. Of course, the processing method of selecting target data in the video data displayed by the display device may also be used, and details are not described herein again.
步骤S103，通过将选取的目标数据与预先存储的物品的样本数据进行比较，识别出选取的目标数据中的目标物品；Step S103, by comparing the selected target data with the sample data of the pre-stored item, identifying the target item in the selected target data;
本公开实施例中，所述物品的样本数据可包括物品的图片或视频数据。In an embodiment of the present disclosure, the sample data of the item may include a picture or video data of the item.
步骤S104，将所述目标物品的属性信息、或交互控件信息、或属性信息和交互控件信息发送到所述显示设备。Step S104: Send attribute information of the target item, or interactive control information, or attribute information and interaction control information to the display device.
本公开实施例中，显示设备可在接收到目标物品的属性信息后，显示目 标物品的属性信息；或者，显示设备可在接收到目标物品的交互控件信息后，显示针对该目标物品的交互控件；或者，显示设备可在接收到目标物品的属性信息和交互控件信息后，显示目标物品的属性信息及针对该目标物品的交互控件。In the embodiment of the present disclosure, the display device may display the attribute information of the target item after receiving the attribute information of the target item; or the display device may display the interaction control for the target item after receiving the interactive control information of the target item. Or, the display device may display the attribute information of the target item and the interactive control for the target item after receiving the attribute information of the target item and the interactive control information.
显示设备可在获取到用户侧对某交互控件的触控指令时，将该触控指令发送到后台设备，后台设备对该触控指令进行响应。The display device may send the touch command to the background device when the user touches the touch command of the interaction control, and the background device responds to the touch command.
综上可知，利用本公开实施例所述方法，用户可以随时随地通过实时视频了解视频中感兴趣的物品信息，并通过显示设备对物品相关信息进行直观地显示，从而为用户提供了舒适的视频交互体验，大大提升了用户的使用体验。In summary, by using the method in the embodiment of the present disclosure, the user can know the item information of interest in the video through the real-time video anytime and anywhere, and visually display the item related information through the display device, thereby providing the user with a comfortable video. The interactive experience greatly enhances the user experience.
在本公开的第二实施例中，提供一种视频交互处理***，如图2所示，可包括：前端监控设备210、显示设备220和后台设备230；In the second embodiment of the present disclosure, a video interaction processing system is provided, as shown in FIG. 2, which may include: a front end monitoring device 210, a display device 220, and a background device 230;
前端监控设备210，设置为：将拍摄的视频实时的发送到显示设备220；The front-end monitoring device 210 is configured to: send the captured video to the display device 220 in real time;
显示设备220，设置为：对接收到的视频进行显示，并在接收到对显示视频的触发操作时，通知后台设备230，以及所述显示设备还设置为：The display device 220 is configured to: display the received video, and notify the background device 230 when receiving the triggering operation on the displayed video, and the display device is further configured to:
在接收到后台设备230发送的目标物品的属性信息时，对所述目标物品的属性进行显示；或者，在接收到后台设备230发送的目标物品的交互控件信息时，对所述目标物品的交互控件进行显示；或者，在接收到后台设备230发送的目标物品的属性信息和交互控件信息时，对所述目标物品的属性和交互控件进行显示；When the attribute information of the target item sent by the background device 230 is received, the attribute of the target item is displayed; or, when the interaction control information of the target item sent by the background device 230 is received, the interaction with the target item The control performs display; or, when receiving the attribute information and the interactive control information of the target item sent by the background device 230, displaying the attribute and the interactive control of the target item;
后台设备230，设置为：检测到显示设备220侧针对显示视频的触发操作，基于所述触发操作，在显示设备220显示的视频数据中选取目标数据，通过将选取的目标数据与预先存储的物品的样本数据进行比较，识别出选取的目标数据中的目标物品，将所述目标物品的属性信息、或交互控件信息、或属性信息和交互控件信息发送到显示设备220。The background device 230 is configured to: detect a triggering operation on the display device 220 side for displaying a video, and select target data in the video data displayed by the display device 220 based on the triggering operation, by selecting the selected target data and the pre-stored item The sample data is compared, the target item in the selected target data is identified, and the attribute information of the target item, or the interactive control information, or the attribute information and the interactive control information are sent to the display device 220.
后台设备230实现目标物品识别等过程可参见第一实施例，本实施例在此不再赘述。The process of the target device 230 to implement the target item identification and the like can be referred to the first embodiment, and details are not described herein again.
为了更清楚地阐述本公开实施例所述***的实施过程，下面通过一个可选实施例，对所述***的实施过程进行更详尽的说明。In order to more clearly illustrate the implementation process of the system described in the embodiments of the present disclosure, the implementation process of the system will be described in more detail below through an optional embodiment.
本可选实施例提供的视频交互处理***，可包括：The video interaction processing system provided in this optional embodiment may include:
前端监控设备，大致设置为：进行监控区域内视频源的获取，并通过媒体传输技术将前端视频源传输到触摸屏设备(即显示设备)。The front-end monitoring device is generally configured to: obtain a video source in the monitoring area, and transmit the front-end video source to the touch screen device (ie, the display device) through the media transmission technology.
触摸屏设备，大致设置为：与前端监控设备和后台处理模块通过移动网络或无线保真(WIFI，Wireless Fidelity)连接，进行视频预览、物品对比素材获取、物品相关属性显示、并通过触摸指令下发来完成交互操作。The touch screen device is generally configured to: connect with the front-end monitoring device and the background processing module through a mobile network or Wireless Fidelity (WIFI), perform video preview, item comparison material acquisition, item-related attribute display, and issue the command through a touch command. To complete the interaction.
后台处理模块，大致设置为：进行物品识别处理，并配合触摸屏设备的指令完成相关交互操作。The background processing module is roughly configured to perform item identification processing and complete related interaction operations in accordance with instructions of the touch screen device.
利用本可选实施例所述***，实现视频交互处理的过程可包括：The process of implementing video interaction processing by using the system in this optional embodiment may include:
(1)将物品的样本数据存储在后台设备，并设置好样本对应物品的属性及交互控件信息，以便后续对比查询使用；(1) storing the sample data of the item in the background device, and setting the attribute of the sample corresponding item and the interactive control information for subsequent comparison and query use;
(2)通过前端监控设备实时获取到视频源；(2) real-time access to the video source through the front-end monitoring device;
(3)通过媒体传输技术将前端视频源传输到触摸屏设备；其中，触摸屏设备可包括但不限于：手机、PAD、个人计算机(PC，Personal Computer)触摸显示屏等。(3) The front-end video source is transmitted to the touch screen device through the media transmission technology; wherein the touch screen device may include, but is not limited to, a mobile phone, a PAD, a personal computer (PC, Personal Computer) touch display screen, and the like.
(4)后台设备在检测到触摸屏设备针对视频画面的触发操作时，获取物品对比素材，并将对比素材与对比样本进行比对；其中，对比素材可包括但不限于：图片、录像等。(4) When the background device detects the trigger operation of the touch screen device for the video screen, the object compares the material and compares the comparison material with the comparison sample; wherein the comparison material may include, but is not limited to, a picture, a video, and the like.
(5)后台设备通过比对确认物品后，通过触摸屏设备显示物品名称等相关属性及一些交互操作按钮。其中，物品属性的显示方式可包括但不限于：文字、语音提示等。(5) After the background device confirms the item by comparison, the related information such as the item name and some interactive operation buttons are displayed through the touch screen device. The display manner of the item attribute may include, but is not limited to, a text, a voice prompt, and the like.
(6)用户通过交互操作按钮完成相关操作。(6) The user completes the related operation through the interactive operation button.
本公开实施例提出的视频交互处理***，使用户随时随地通过实时视频了解视频中感兴趣的物品信息，更直观地显示物品相关信息，给用户提供了更舒适的视频交互体验习惯，大大提升用户体验。The video interaction processing system proposed by the embodiment of the present invention enables the user to understand the item information of interest in the video through real-time video anytime and anywhere, and more intuitively display the item related information, thereby providing the user with a more comfortable video interaction experience habit, greatly improving the user. Experience.
以下根据应用场景给出实施例并参照附图，对本公开实施例进行详细说明：Hereinafter, embodiments of the present disclosure will be described in detail based on the application scenarios and with reference to the accompanying drawings:
场景1：基于触摸屏设备进行视频交互的智能订餐***Scenario 1: Intelligent ordering system for video interaction based on touch screen device
市售的订餐管理***，大致可以是通过应用(APP，Application)显示菜单或套餐图片来给客户提供选择的一种***。用户通过菜单或套餐图片来 决定是否预定。然而，一方面，用户不能提前预知是否有空位，有可能由于等待而浪费客户时间；另一方面，用户不能提前了解用餐环境，可能到了用餐地点后，由于用餐环境问题而影响用餐心情或重新选择用餐地点，而浪费客户重新选择时间。A commercially available order management system can generally be a system that provides a choice to a customer by displaying a menu or a package picture through an application (APP, Application). The user decides whether to make a reservation through a menu or a package picture. However, on the one hand, the user cannot predict in advance whether there is a vacancy, and may waste customer time due to waiting; on the other hand, the user cannot know the dining environment in advance, and may influence the dining mood or re-select due to the dining environment problem after the dining place is reached. Dining places, and wasting customers to re-select time.
针对上述情况，利用本公开实施例所述视频交互***及方法，能够很好地避免上面提出的情形。In view of the above situation, the video interaction system and method according to the embodiments of the present disclosure can well avoid the above-mentioned situation.
本公开实施例大致可包括用户预订餐桌工作流程、商家管理员指派工作人员进行餐桌卫生清理工作流程两个流程。Embodiments of the present disclosure may generally include two processes in which a user subscribes to a table workflow, and a merchant administrator assigns a staff member to perform a table hygiene cleaning workflow.
如图3所示，本公开实施例的预订餐位工作流程可以包括：As shown in FIG. 3, the booking place workflow of the embodiment of the present disclosure may include:
步骤301：商家将一个或多个餐桌中每个餐桌的样本存储在后台处理设备，并设置好每个餐桌对应的属性信息；Step 301: The merchant stores samples of each table in one or more dining tables in the background processing device, and sets attribute information corresponding to each table;
步骤302：用户利用触摸屏设备通过大厅或包间的监控终端来实时浏览用餐环境；Step 302: The user browses the dining environment in real time through the monitoring terminal of the lobby or the booth by using the touch screen device;
步骤303：用户在视频浏览中通过触摸操作选择感兴趣的餐桌；Step 303: The user selects a table of interest by a touch operation in the video browsing;
步骤304：后台处理设备将触摸时刻前5秒的预录视频与预先存储的餐桌样本进行对比；Step 304: The background processing device compares the pre-recorded video 5 seconds before the touch time with the pre-stored table sample.
步骤305：后台处理设备判断是否找到与餐桌样本匹配的餐桌，如果没有找到，进入步骤302继续进行视频浏览，如果找到匹配餐桌，则进入步骤306；Step 305: The background processing device determines whether the table matching the table sample is found, if not found, proceeds to step 302 to continue the video browsing, if it finds a matching table, then proceeds to step 306;
步骤306：将餐桌信息反馈给触摸屏设备；Step 306: Feeding the table information to the touch screen device;
步骤307：触摸屏设备的视频浏览界面以弹出框的形式显示餐桌相关属性(例如，可容纳人数、是否有空调、是否被预订、被预订的时间段)及交互式相关按钮(例如预订、退出)；Step 307: The video browsing interface of the touch screen device displays the table related attributes (for example, the number of people that can be accommodated, whether there is air conditioning, whether it is booked, the time period of being booked), and interactive related buttons (for example, reservation, exit) in the form of a popup box. ;
步骤308：用户了解餐桌相关属性后，若想预订的时间段已被预订，则可点击退出按钮不进行预订，退出餐桌属性展示框并进入步骤302继续进行视频浏览；若想预订的时间段没有被预订，则可点击预订按钮进行预订，进入步骤309；Step 308: After the user understands the related attributes of the table, if the time period for which the reservation is to be booked has been reserved, the user may click the exit button to cancel the reservation, exit the table attribute display box and proceed to step 302 to continue the video browsing; if the time period for the reservation is not available Once booked, you can click the booking button to make a reservation, go to step 309;
步骤309：后台处理设备收到触摸屏设备发送过来的预订请求后，马上生成订单，并反馈给触摸屏设备；Step 309: After receiving the reservation request sent by the touch screen device, the background processing device immediately generates an order and feeds back the information to the touch screen device.
步骤310：用户确认订单，在预订时间段内，用户抽空去就餐。Step 310: The user confirms the order, and during the reserved time period, the user takes the time to go to the meal.
如图4所示，本公开实施例的指派工作人员进行餐桌卫生清理工作流程可包括：As shown in FIG. 4, the assigned staff member of the embodiment of the present disclosure may perform:
步骤401：商家将一个或多个餐桌中每个餐桌的样本存储在后台处理设备，并设置好每个餐桌对应的卫生清理相关人员；Step 401: The merchant stores samples of each table in one or more dining tables in a background processing device, and sets a health cleaning related person corresponding to each table;
步骤402：管理人员通过监控发现大厅或包间的某个餐桌上的客人用餐完毕出门后，在视频浏览中通过触摸操作选择待清理卫生的餐桌；Step 402: After monitoring, the management person finds that the guest on a certain dining table in the lobby or the private room has finished eating out, and selects the table to be cleaned by touch operation in the video browsing;
步骤403：后台处理设备将触摸时刻前5秒的预录视频与后台中的餐桌样本进行对比；Step 403: The background processing device compares the pre-recorded video 5 seconds before the touch time with the table sample in the background;
步骤404：后台处理设备判断是否找到与样本匹配的餐桌，如果没有找到与样本匹配的餐桌，进入步骤405进行异常处理流程，如果找到与样本匹配的餐桌，则进入步骤406；Step 404: The background processing device determines whether the table matching the sample is found. If the table matching the sample is not found, the process proceeds to step 405 to perform an exception processing flow. If a table matching the sample is found, the process proceeds to step 406.
步骤405：后台给出对比失败提示，然后，管理员临时去安排清理人员去打扫卫生；Step 405: A comparison failure prompt is given in the background, and then the administrator temporarily arranges the cleaning personnel to clean the cleaning;
步骤406：后台处理设备将餐桌信息反馈给触摸屏设备；Step 406: The background processing device feeds the table information to the touch screen device.
步骤407：触摸屏设备的视频浏览界面以弹出框的形式显示餐桌对应的卫生清理人员名单及交互式相关按钮(是否清理卫生、退出等)，供用户查看及操作；Step 407: The video browsing interface of the touch screen device displays a list of the health cleaning personnel corresponding to the dining table and interactive related buttons (whether cleaning, exiting, etc.) in a pop-up box for the user to view and operate;
步骤408：管理人员若决定清理卫生，则在弹出框中的多名清理人员中选择一个，并点击立即清理卫生按钮进入步骤409；若决定不清理卫生，则返回步骤402；Step 408: If the management personnel decides to clean the sanitation, select one of the plurality of cleaning personnel in the pop-up box, and click the clean up health button to proceed to step 409; if it is decided not to clean the sanitation, return to step 402;
步骤409：后台处理设备自动通过广播或短信提醒清理人员进行餐桌清理；Step 409: The background processing device automatically reminds the cleaning personnel to clean the table through broadcast or SMS;
步骤410：卫生清理人员收到提醒后前去对应餐桌清理卫生。Step 410: After receiving the reminder, the sanitation cleaning personnel go to the corresponding table to clean the sanitation.
场景2：基于IE浏览器进行视频交互的智能购物***Scenario 2: Smart shopping system for video interaction based on IE browser
本应用场景通过将场景1中的视频浏览触摸屏设备扩展为PC机的网页浏览器(IE，Internet Explorer)浏览器，并将智能订餐***扩展为智能购物***为例进行说明。This application scenario is described by expanding the video browsing touch screen device in the scene 1 into a web browser (IE, Internet Explorer) browser of the PC, and expanding the smart ordering system into a smart shopping system.
如图5所示，本公开实施例的智能购物工作流程可包括：As shown in FIG. 5, the smart shopping workflow of the embodiment of the present disclosure may include:
步骤501：商家将一个或多个商品中每个商品的样本存储在后台处理设 备，并设置好每个商品对应的详细信息；Step 501: The merchant stores samples of each of the one or more commodities in the background processing device, and sets detailed information corresponding to each commodity;
步骤502：用户利用PC机的IE浏览器通过商店的监控终端来实时浏览商店中的各种商品；Step 502: The user browses various commodities in the store in real time through the monitoring terminal of the store by using the IE browser of the PC;
步骤503：用户在视频浏览中通过鼠标截取视频范围操作选择感兴趣的商品；Step 503: The user selects an item of interest by using a mouse to intercept the video range operation in the video browsing;
步骤504：后台处理设备将鼠标截取时刻前5秒的预录视频与预先存储的商品样本进行对比；Step 504: The background processing device compares the pre-recorded video 5 seconds before the mouse interception time with the pre-stored product sample.
步骤505：后台处理设备判断是否找到与样本匹配的商品，如果没有找到与样本匹配的商品，进入步骤502继续进行视频浏览，如果找到与样本匹配的商品，则进入步骤506；Step 505: The background processing device determines whether the product matching the sample is found. If the product matching the sample is not found, the process proceeds to step 502 to continue the video browsing. If the product matching the sample is found, the process proceeds to step 506.
步骤506：后台处理设备将商品信息反馈给IE浏览器；Step 506: The background processing device feeds back the commodity information to the IE browser.
步骤507：IE浏览器的视频浏览界面以弹出框的形式显示商品相关属性(例如：品牌，码数，价格，是否热门等)及交互式相关按钮(如订购、退出)，供用户查看及操作；Step 507: The video browsing interface of the IE browser displays the product-related attributes (for example: brand, code number, price, whether it is popular, etc.) and interactive related buttons (such as ordering and exiting) in the form of a pop-up box for the user to view and operate. ;
步骤508：用户了解商品相关属性后，若对商品不感兴趣，则点击退出按钮不进行订购，退出商品属性展示框并进入步骤502继续进行视频浏览；若对商品感兴趣，则点击订购按钮进入步骤509；Step 508: After the user understands the product-related attribute, if the product is not interested, click the exit button to not order, exit the product attribute display box and proceed to step 502 to continue the video browsing; if interested in the product, click the order button to enter the step 509;
步骤509：后台处理设备生成订单，并反馈给IE浏览器；Step 509: The background processing device generates an order and feeds back to the IE browser.
步骤510：用户确认订单，预订期限内，用户抽空去商店试穿购买，或在线支付通过邮寄方式送货上门等。Step 510: The user confirms the order. During the reservation period, the user takes the time to go to the store to try on the purchase, or the online payment is delivered to the door by mail.
场景3：基于视频交互的家庭智能设备控制***Scenario 3: Home Intelligence Device Control System Based on Video Interaction
基于视频交互的家庭智能设备控制***是本公开扩展到对等联网(P2P，Peer-to-Peer)监控***的典型应用。The home interactive device control system based on video interaction is a typical application of the present disclosure to a Peer-to-Peer (P2P) monitoring system.
P2P监控***可以是将监控前端与触摸屏客户端设备进行直连来完成视频监控基本功能。本公开实施例中提出的后台处理设备提供样本存储并进行物品识别的功能可在触摸屏客户端设备实现，监控前端侧的功能可保持不变，这样，本公开实施例可扩展到P2P监控***中来实现视频交互。The P2P monitoring system can directly connect the monitoring front end to the touch screen client device to complete the basic functions of video monitoring. The function of the background processing device provided in the embodiment of the present disclosure for providing sample storage and performing item identification can be implemented in the touch screen client device, and the function of the monitoring front end side can be kept unchanged. Thus, the embodiment of the present disclosure can be extended to the P2P monitoring system. To achieve video interaction.
另外，本公开实施例所述对比素材可包括但不限于：图片、录像等；识别物品后，物品属性的显示可包括但不限于：文字、语音提示等。因此，本 应用场景通过将对比素材扩展为图片；将物品属性显示方式扩展为“文字+语音提示”的方式进行描述。In addition, the comparative material in the embodiment of the present disclosure may include, but is not limited to, a picture, a video, and the like; after the item is identified, the display of the item attribute may include, but is not limited to, a text, a voice prompt, and the like. Therefore, this application scenario is described by expanding the contrast material into a picture; expanding the item attribute display mode to "text + voice prompt".
如图6所示，本公开实施例的家庭智能设备控制***工作流程可包括：As shown in FIG. 6, the workflow of the home smart device control system of the embodiment of the present disclosure may include:
步骤601：用户是否首次使用APP，如果首次使用APP则进入步骤602；如果不是首次使用APP，则进入步骤604；Step 601: Whether the user uses the APP for the first time, if the APP is used for the first time, the process proceeds to step 602; if the application is not used for the first time, the process proceeds to step 604;
步骤602：提示用户对家庭设备拍照并输入设备名称来完成样本配置；Step 602: prompt the user to take a picture of the home device and input the device name to complete the sample configuration.
步骤603：用户根据提示完成样本配置；Step 603: The user completes the sample configuration according to the prompt;
步骤604：用户利用触摸屏APP应用通过家里的监控终端来实时浏览一个或多个智能设备中每个智能设备；Step 604: The user uses the touch screen APP application to browse each smart device of one or more smart devices in real time through the monitoring terminal at home;
步骤605：用户在视频浏览中发现家里没有人，且家庭设备(如空调、电视等)没有关闭；Step 605: The user finds that there is no person in the home in the video browsing, and the home device (such as air conditioner, TV, etc.) is not turned off;
步骤606：通过触摸视频浏览中的家庭设备；Step 606: Touch the home device in the video browsing;
步骤607：触摸屏APP将触摸区域内的快照与本地配置的家庭设备样本进行对比；Step 607: The touch screen APP compares the snapshot in the touch area with the locally configured home device sample.
步骤608：判断是否找到与样本匹配的设备，如果找到与样本匹配的设备，则进入步骤609；如果没有找到与样本匹配的设备，则进入步骤602；Step 608: Determine whether the device matching the sample is found, if the device matching the sample is found, proceed to step 609; if no device matching the sample is found, proceed to step 602;
步骤609：将家庭设备信息反馈给触摸屏APP，并给出界面展示；Step 609: Feeding the home device information to the touch screen APP, and giving an interface display;
步骤610：触摸屏APP的视频浏览界面以弹出框的形式显示设备相关属性(例如，名称、状态等)及交互式相关按钮(例如，开启/关闭设备、退出弹出框)，供用户查看；同时可以听到语音提示(例如，空调设备的状态为开机状态)；Step 610: The video browsing interface of the touch screen APP displays device related attributes (eg, name, status, etc.) and interactive related buttons (for example, turning on/off the device, exiting the popup box) for the user to view in a popup box; Hear a voice prompt (for example, the status of the air conditioner is turned on);
步骤611：触摸屏APP判断是否关闭设备，如果关闭设备，则进入步骤612；如果不关闭设备，则点击退出显示框按钮，进入步骤605；Step 611: The touch screen APP determines whether to close the device, if the device is turned off, then proceeds to step 612; if the device is not closed, clicks the exit display box button, proceeds to step 605;
步骤612：触摸屏APP通过无线网络发送关闭指令给家庭智能设备，并返回关闭结果给触摸屏APP；Step 612: The touch screen APP sends a shutdown command to the home smart device through the wireless network, and returns a shutdown result to the touch screen APP;
步骤613：用户在触摸屏APP中收到关闭成功文字和语音提醒；同时用户可以通过视频浏览来确认是否真的关闭成功。Step 613: The user receives the closed successful text and voice reminder in the touch screen APP; at the same time, the user can confirm whether the user is successfully closed by video browsing.
在本公开第三实施例中，提供一种视频交互处理装置，如图7所示，可包括：In a third embodiment of the present disclosure, a video interaction processing apparatus, as shown in FIG. 7, may include:
检测模块710，设置为：在检测到显示设备侧针对显示视频的触发操作时，开启数据选取模块；The detecting module 710 is configured to: when detecting a triggering operation on the display device side for the display video, turning on the data selection module;
数据选取模块720，设置为：基于所述触发操作，在所述显示设备显示的视频数据中选取目标数据；The data selection module 720 is configured to select target data in the video data displayed by the display device based on the triggering operation;
识别模块730，设置为：通过将所述数据选取模块选取的目标数据与预先存储的物品的样本数据进行比较，识别出选取的目标数据中的目标物品；The identification module 730 is configured to: identify the target item in the selected target data by comparing the target data selected by the data selection module with the sample data of the pre-stored item;
信息反馈模块740，设置为：将所述目标物品的属性信息、或交互控件信息、或属性信息和交互控件信息发送到所述显示设备。The information feedback module 740 is configured to: send attribute information of the target item, or interactive control information, or attribute information and interaction control information to the display device.
基于上述结构框架及实施原理，下面给出在上述结构下的几个可选实施方式，用以细化和优化本公开所述装置的功能，以使本公开方案的实施更方便，准确。可涉及如下内容：Based on the above structural framework and implementation principle, several alternative embodiments under the above structure are given below to refine and optimize the functions of the device of the present disclosure, so that the implementation of the disclosed solution is more convenient and accurate. May involve the following:
本公开实施例中，检测模块710，可以是设置为：当检测到所述显示设备侧发送的视频触发时间信息时，判定检测到显示设备侧针对显示视频的触发操作。In the embodiment of the present disclosure, the detecting module 710 may be configured to: when detecting the video triggering time information sent by the display device side, determine that the triggering operation of the display device side for displaying the video is detected.
数据选取模块720，可以是设置为：以所述触发时间信息对应的时间点，向前推移设定时长，选取该时长内的视频数据作为选取的目标数据；或者，将所述触发时间信息对应时刻的视频图像数据作为选取的目标数据。The data selection module 720 may be configured to: set a duration of the forward time according to the time point corresponding to the trigger time information, select video data in the duration as the selected target data; or: match the trigger time information The video image data of the moment is taken as the selected target data.
可选地，本公开实施例中，检测模块710，可以是设置为：当检测到所述显示设备侧发送的视频触发时间信息和视频触发位置信息时，判定检测到显示设备侧针对显示视频的触发操作。Optionally, in the embodiment of the present disclosure, the detecting module 710 may be configured to: when detecting the video triggering time information and the video triggering location information sent by the display device side, determining that the display device side is configured to display the video Trigger action.
数据选取模块720，可以是设置为：确定所述触发时间信息对应时刻的视频图像数据，并利用所述触发位置信息，在确定的视频图像数据中选定所述目标数据。The data selection module 720 may be configured to: determine video image data corresponding to the time of the trigger time information, and select the target data in the determined video image data by using the trigger position information.
利用本公开实施例所述装置，用户可以随时随地通过实时视频了解视频中感兴趣的物品信息，并通过显示设备对物品相关信息进行直观地显示，从而为用户提供了舒适的视频交互体验，大大提升了用户的使用体验。By using the device in the embodiment of the present disclosure, the user can know the item information of interest in the video through the real-time video anytime and anywhere, and visually display the item related information through the display device, thereby providing the user with a comfortable video interaction experience. Improve the user experience.
本说明书中的实施例均采用递进的方式描述，不同实施例之间相同相似的部分互相参见即可，每个实施例重点说明的都是其与其他实施例的不同之处。尤其对于装置实施例而言，由于其基本相似于方法实施例，所以，描述得比较简单，相关之处参见方法实施例的部分说明即可。The embodiments in the present specification are described in a progressive manner, and the same or similar parts between the different embodiments may be referred to each other, and each embodiment focuses on the differences from the other embodiments. Especially for the device embodiment, since it is basically similar to the method embodiment, the description is relatively simple, and the relevant parts can be referred to the description of the method embodiment.
本公开实施例还提供了一种计算机可读存储介质，存储有计算机可执行指令，所述计算机可执行指令被执行时实现上述视频交互处理方法。Embodiments of the present disclosure also provide a computer readable storage medium storing computer executable instructions that, when executed, implement the video interaction processing method described above.
本领域普通技术人员可以理解，上述实施例的各种方法中的全部或部分步骤是可以通过程序来指令相关的硬件来完成，该程序可以存储于一计算机可读存储介质中，存储介质可以包括：ROM、RAM、磁盘或光盘等。A person skilled in the art can understand that all or part of the steps of the foregoing embodiments may be completed by a program to instruct related hardware, and the program may be stored in a computer readable storage medium, and the storage medium may include : ROM, RAM, disk or CD.
本领域普通技术人员可以理解，上文中所公开方法中的全部或某些步骤、***、装置中的功能模块/单元可以被实施为软件、固件、硬件及其适当的组合。在硬件实施方式中，在以上描述中提及的功能模块/单元之间的划分不一定对应于物理组件的划分；例如，一个物理组件可以具有多个功能，或者一个功能或步骤可以由若干物理组件合作执行。某些组件或所有组件可以被实施为由处理器，如数字信号处理器或微处理器执行的软件，或者被实施为硬件，或者被实施为集成电路，如专用集成电路。这样的软件可以分布在计算机可读介质上，计算机可读介质可以包括计算机存储介质(或非暂时性介质)和通信介质(或暂时性介质)。如本领域普通技术人员公知的，术语计算机存储介质包括在用于存储信息(诸如计算机可读指令、数据结构、程序模块或其他数据)的任何方法或技术中实施的易失性和非易失性、可移除和不可移除介质。计算机存储介质包括但不限于随机存取存储器(RAM，Random Access Memory)、只读存储器(ROM，Read-Only Memory)、电可擦除只读存储器(EEPROM，Electrically Erasable Programmable Read-only Memory)、闪存或其他存储器技术、光盘只读存储器(CD-ROM，Compact Disc Read-Only Memory)、数字多功能盘(DVD)或其他光盘存储、磁盒、磁带、磁盘存储或其他磁存储装置、或者可以用于存储期望的信息并且可以被计算机访问的任何其他的介质。此外，本领域普通技术人员公知的是，通信介质通常包含计算机可读指令、数据结构、程序模块或者诸如载波或其他传输机制之类的调制数据信号中的其他数据，并且可包括任何信息递送介质。Those of ordinary skill in the art will appreciate that all or some of the steps, systems, and functional blocks/units of the methods disclosed above may be implemented as software, firmware, hardware, and suitable combinations thereof. In a hardware implementation, the division between functional modules/units mentioned in the above description does not necessarily correspond to the division of physical components; for example, one physical component may have multiple functions, or one function or step may be composed of several physical The components work together. Some or all of the components may be implemented as software executed by a processor, such as a digital signal processor or microprocessor, or as hardware, or as an integrated circuit, such as an application specific integrated circuit. Such software may be distributed on a computer readable medium, which may include computer storage media (or non-transitory media) and communication media (or transitory media). As is well known to those of ordinary skill in the art, the term computer storage medium includes volatile and nonvolatile, implemented in any method or technology for storing information, such as computer readable instructions, data structures, program modules or other data. Sex, removable and non-removable media. The computer storage medium includes, but is not limited to, Random Access Memory (RAM), Read-Only Memory (ROM), and Electrically Erasable Programmable Read-only Memory (EEPROM). Flash memory or other memory technology, compact disc read-only memory (CD-ROM), digital versatile disc (DVD) or other optical disc storage, magnetic cassette, magnetic tape, disk storage or other magnetic storage device, or Any other medium used to store the desired information and that can be accessed by the computer. Moreover, it is well known to those skilled in the art that communication media typically includes computer readable instructions, data structures, program modules or other data in a modulated data signal, such as a carrier wave or other transport mechanism, and can include any information delivery media. .
本领域的普通技术人员可以理解，可以对本公开的技术方案进行修改或者等同替换，而不脱离本公开技术方案的精神和范围，均应涵盖在本公开的权利要求范围当中。A person skilled in the art can understand that the technical solutions of the present disclosure may be modified or equivalent, without departing from the spirit and scope of the present disclosure, and should be included in the scope of the claims of the present disclosure.
工业实用性Industrial applicability
通过检测到显示设备侧针对显示视频的触发操作；基于所述触发操作，在所述显示设备显示的视频数据中选取目标数据；通过将选取的目标数据与预先存储的物品的样本数据进行比较，识别出选取的目标数据中的目标物品；将所述目标物品的属性信息、或交互控件信息、或属性信息和交互控件信息发送到所述显示设备，可以使用户随时随地通过实时视频了解视频中感兴趣的物品信息，并通过显示设备对物品相关信息进行直观地显示。By detecting a triggering operation of the display device side for the display video; selecting, based on the triggering operation, target data in the video data displayed by the display device; by comparing the selected target data with the sample data of the pre-stored item, Identifying the target item in the selected target data; sending attribute information of the target item, or interactive control information, or attribute information and interactive control information to the display device, so that the user can understand the video through real-time video anytime and anywhere The item information of interest, and visually displaying the item related information through the display device.

Claims (11)

  1. 一种视频交互处理方法，包括：A video interaction processing method includes:
    检测到显示设备侧针对显示视频的触发操作；A trigger operation for displaying a video on the display device side is detected;
    基于所述触发操作，在所述显示设备显示的视频数据中选取目标数据；Selecting target data in the video data displayed by the display device based on the triggering operation;
    通过将选取的目标数据与预先存储的物品的样本数据进行比较，识别出选取的目标数据中的目标物品；Identifying the target item in the selected target data by comparing the selected target data with the sample data of the pre-stored item;
    将所述目标物品的属性信息、或交互控件信息、或属性信息和交互控件信息发送到所述显示设备。The attribute information of the target item, or the interactive control information, or the attribute information and the interactive control information are transmitted to the display device.
  2. 如权利要求1所述的方法，其中，所述检测到显示设备侧针对显示视频的触发操作，包括：检测到所述显示设备侧发送的视频触发时间信息。The method of claim 1, wherein the detecting the triggering operation of the display device side for displaying the video comprises: detecting the video triggering time information sent by the display device side.
  3. 如权利要求2所述的方法，其中，所述基于所述触发操作，在显示的视频数据中选取目标数据，包括：The method of claim 2, wherein the selecting target data in the displayed video data based on the triggering operation comprises:
    以所述触发时间信息对应的时间点，向前推移设定时长，选取该时长内的视频数据作为选取的目标数据；Setting the duration of the forward time according to the time point corresponding to the trigger time information, and selecting video data within the duration as the selected target data;
    或者，将所述触发时间信息对应时刻的视频图像数据作为选取的目标数据。Alternatively, the video image data corresponding to the time of the trigger time information is taken as the selected target data.
  4. 如权利要求1所述的方法，其中，所述检测到显示设备侧针对显示视频的触发操作，包括：检测到所述显示设备侧发送的视频触发时间信息和视频触发位置信息。The method of claim 1, wherein the detecting the triggering operation of the display device side for displaying the video comprises: detecting the video triggering time information and the video triggering location information sent by the display device side.
  5. 如权利要求4所述的方法，其中，所述基于所述触发操作，在显示的视频数据中选取目标数据，包括：The method of claim 4, wherein the selecting target data in the displayed video data based on the triggering operation comprises:
    确定所述触发时间信息对应时刻的视频图像数据；Determining video image data corresponding to the time of the trigger time information;
    利用所述触发位置信息，在确定的视频图像数据中选定所述目标数据。The target data is selected in the determined video image data using the trigger position information.
  6. 一种视频交互处理装置，包括：A video interaction processing device includes:
    检测模块，设置为：在检测到显示设备侧针对显示视频的触发操作时，开启数据选取模块；The detecting module is configured to: when detecting a triggering operation on the display device side for displaying the video, turning on the data selection module;
    数据选取模块，设置为：基于所述触发操作，在所述显示设备显示的视 频数据中选取目标数据；a data selection module, configured to: select target data in the video data displayed by the display device based on the triggering operation;
    识别模块，设置为：通过将所述数据选取模块选取的目标数据与预先存储的物品的样本数据进行比较，识别出选取的目标数据中的目标物品；The identification module is configured to: identify the target item in the selected target data by comparing the target data selected by the data selection module with the sample data of the pre-stored item;
    信息反馈模块，设置为：将所述目标物品的属性信息、或交互控件信息、或属性信息和交互控件信息发送到所述显示设备。The information feedback module is configured to: send attribute information of the target item, or interactive control information, or attribute information and interaction control information to the display device.
  7. 如权利要求6所述的装置，其中，所述检测模块，是设置为：当检测到所述显示设备侧发送的视频触发时间信息时，判定检测到显示设备侧针对显示视频的触发操作。The device of claim 6, wherein the detecting module is configured to: when detecting the video triggering time information sent by the display device side, determine that the triggering operation of the display device side for displaying the video is detected.
  8. 如权利要求7所述的装置，其中，所述数据选取模块，是设置为：以所述触发时间信息对应的时间点，向前推移设定时长，选取该时长内的视频数据作为选取的目标数据；或者，将所述触发时间信息对应时刻的视频图像数据作为选取的目标数据。The device of claim 7, wherein the data selection module is configured to: set a time length forward according to a time point corresponding to the trigger time information, and select video data in the duration as a selected target. Data; or, the video image data corresponding to the time of the trigger time information is taken as the selected target data.
  9. 如权利要求6所述的装置，其中，所述检测模块，是设置为：当检测到所述显示设备侧发送的视频触发时间信息和视频触发位置信息时，判定检测到显示设备侧针对显示视频的触发操作。The device of claim 6, wherein the detecting module is configured to: when detecting the video triggering time information and the video triggering position information sent by the display device side, determining that the display device side is detected for the display video Trigger action.
  10. 如权利要求9所述的装置，其中，所述数据选取模块，是设置为：确定所述触发时间信息对应时刻的视频图像数据，并利用所述触发位置信息，在确定的视频图像数据中选定所述目标数据。The device according to claim 9, wherein the data selection module is configured to: determine video image data corresponding to the time of the trigger time information, and select the selected video image data by using the trigger position information. The target data is determined.
  11. 一种视频交互处理***，包括：A video interactive processing system includes:
    前端监控设备，设置为：将拍摄的视频发送到显示设备；The front-end monitoring device is configured to: send the captured video to the display device;
    所述显示设备，设置为：对接收到的视频进行显示，并在接收到对显示视频的触发操作时，通知后台设备，以及所述显示设备还设置为：The display device is configured to: display the received video, and notify the background device when receiving the triggering operation on the displayed video, and the display device is further configured to:
    在接收到所述后台设备发送的目标物品的属性信息时，对所述目标物品的属性进行显示；或者，在接收到所述后台设备发送的目标物品的交互控件信息时，对所述目标物品的交互控件进行显示；或者，在接收到所述后台设备发送的目标物品的属性信息和交互控件信息时，对所述目标物品的属性和交互控件进行显示；And displaying an attribute of the target item when the attribute information of the target item sent by the background device is received; or, when receiving the interaction control information of the target item sent by the background device, the target item The interactive control is displayed; or, when the attribute information and the interactive control information of the target item sent by the background device are received, the attribute and the interactive control of the target item are displayed;
    所述后台设备，设置为：检测到显示设备侧针对显示视频的触发操作， 基于所述触发操作，在所述显示设备显示的视频数据中选取目标数据，通过将选取的目标数据与预先存储的物品的样本数据进行比较，识别出选取的目标数据中的目标物品，将所述目标物品的属性信息、或交互控件信息、或属性信息和交互控件信息发送到所述显示设备。The background device is configured to: detect a triggering operation on the display device side for displaying a video, and select target data in the video data displayed by the display device based on the triggering operation, by using the selected target data and pre-stored The sample data of the item is compared, the target item in the selected target data is identified, and attribute information of the target item, or interactive control information, or attribute information and interactive control information is transmitted to the display device.
PCT/CN2018/094685 2017-07-06 2018-07-05 Video interaction processing method, apparatus and system WO2019007402A1 (en)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
CN201710546528.2 2017-07-06
CN201710546528.2A CN109218659A (en) 2017-07-06 2017-07-06 A kind of video interactive processing method, apparatus and system

Publications (1)

Publication Number Publication Date
WO2019007402A1 true WO2019007402A1 (en) 2019-01-10

Family

ID=64950590

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2018/094685 WO2019007402A1 (en) 2017-07-06 2018-07-05 Video interaction processing method, apparatus and system

Country Status (2)

Country Link
CN (1) CN109218659A (en)
WO (1) WO2019007402A1 (en)

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN111221491A (en) * 2020-01-09 2020-06-02 Oppo（重庆）智能科技有限公司 Interaction control method and device, electronic equipment and storage medium

Families Citing this family (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN111596242B (en) * 2020-06-04 2022-07-01 京东方科技集团股份有限公司 Sample simulation scanning device and use method

Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN1921620A (en) * 2005-08-22 2007-02-28 佳能株式会社 Video processing apparatus and object identifying method
CN101233540A (en) * 2005-08-04 2008-07-30 皇家飞利浦电子股份有限公司 Apparatus for monitoring a person having an interest to an object, and method thereof
CN103581618A (en) * 2012-08-01 2014-02-12 鸿富锦精密工业（深圳）有限公司 Display device and monitoring method for monitoring targets with transparent display screen
CN103716667A (en) * 2012-10-09 2014-04-09 鸿富锦精密工业（深圳）有限公司 Using a display device to capture information concerning objectives in a screen of another display device

Family Cites Families (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN104597759B (en) * 2014-12-26 2018-05-08 深圳市海蕴新能源有限公司 Appliance control method and system and intelligent household management system based on Internet video
CN106162355A (en) * 2015-04-10 2016-11-23 北京云创视界科技有限公司 video interactive method and terminal
CN105679017B (en) * 2016-01-27 2018-09-18 福建工程学院 A kind of method and system of fender-bender auxiliary evidence obtaining
CN105791437A (en) * 2016-04-29 2016-07-20 板牙信息科技（上海）有限公司 Method for storing video information and equipment thereof

Patent Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101233540A (en) * 2005-08-04 2008-07-30 皇家飞利浦电子股份有限公司 Apparatus for monitoring a person having an interest to an object, and method thereof
CN1921620A (en) * 2005-08-22 2007-02-28 佳能株式会社 Video processing apparatus and object identifying method
CN103581618A (en) * 2012-08-01 2014-02-12 鸿富锦精密工业（深圳）有限公司 Display device and monitoring method for monitoring targets with transparent display screen
CN103716667A (en) * 2012-10-09 2014-04-09 鸿富锦精密工业（深圳）有限公司 Using a display device to capture information concerning objectives in a screen of another display device

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN111221491A (en) * 2020-01-09 2020-06-02 Oppo（重庆）智能科技有限公司 Interaction control method and device, electronic equipment and storage medium

Also Published As

Publication number Publication date
CN109218659A (en) 2019-01-15

Similar Documents

Publication Publication Date Title
US9820104B2 (en) Method and system for evaluating a user response to a presence based action
US10373170B2 (en) Utilizing user devices in venues
WO2022252514A1 (en) Information display method and apparatus
US10712936B2 (en) First electronic device and information processing method applicable to first or second electronic device comprising a first application
US10824869B2 (en) Clickless identification and online posting
CN111667328B (en) Page content display method and device and electronic equipment
CN108108990B (en) Online shopping method and system and live broadcast platform
CN110827073A (en) Data processing method and device
US20180041586A1 (en) Linkage system and device control server
WO2023207770A1 (en) Information processing method, live streaming system and electronic device
US20100262517A1 (en) Systems and Methods for Displaying Goods
CN112005281A (en) System and method for power management on smart devices
CN103106609A (en) Online shopping system
CN113905247A (en) Information interaction method and device, electronic equipment and storage medium
WO2019007402A1 (en) Video interaction processing method, apparatus and system
CN111340405A (en) Order distribution method, equipment and computer readable storage medium
CN111222899A (en) Commodity information and replenishment processing method, equipment and storage medium
KR20150104768A (en) Food delivery agent service system and Method thereof
CN108139736A (en) The remote access method and system of electrical equipment
CN112995778B (en) Interaction method and device for live broadcast room
CN113343075B (en) Virtual resource pushing method and device, electronic equipment and storage medium
US20160125516A1 (en) Method and device for displaying information
TWI479443B (en) Travel service information display system, travel service information display method, computer program product, and information recording medium
CN108573435B (en) Method and device for purchasing commodities
JP6655955B2 (en) Purchase support program and purchase support system

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 18828483

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 18828483

Country of ref document: EP

Kind code of ref document: A1

32PN Ep: public notification in the ep bulletin as address of the adressee cannot be established

Free format text: NOTING OF LOSS OF RIGHTS PURSUANT TO RULE 112(1) EPC (EPO FORM 1205A DATED 28/05/2020)

122 Ep: pct application non-entry in european phase

Ref document number: 18828483

Country of ref document: EP

Kind code of ref document: A1