CN114928724A - Image output control method, system, electronic equipment and storage medium - Google Patents

Image output control method, system, electronic equipment and storage medium Download PDF

Info

Publication number
CN114928724A
CN114928724A CN202210603386.XA CN202210603386A CN114928724A CN 114928724 A CN114928724 A CN 114928724A CN 202210603386 A CN202210603386 A CN 202210603386A CN 114928724 A CN114928724 A CN 114928724A
Authority
CN
China
Prior art keywords
image data
personnel
display
image
multicast
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Granted
Application number
CN202210603386.XA
Other languages
Chinese (zh)
Other versions
CN114928724B (en
Inventor
周迪
邓松杰
王殿盟
袁佳怡
卓越
徐爱华
王威杰
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Zhejiang Uniview Technologies Co Ltd
Original Assignee
Zhejiang Uniview Technologies Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Zhejiang Uniview Technologies Co Ltd filed Critical Zhejiang Uniview Technologies Co Ltd
Priority to CN202210603386.XA priority Critical patent/CN114928724B/en
Publication of CN114928724A publication Critical patent/CN114928724A/en
Application granted granted Critical
Publication of CN114928724B publication Critical patent/CN114928724B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N7/00—Television systems
    • H04N7/18—Closed-circuit television [CCTV] systems, i.e. systems in which the video signal is not broadcast
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V10/00—Arrangements for image or video recognition or understanding
    • G06V10/70—Arrangements for image or video recognition or understanding using pattern recognition or machine learning
    • G06V10/82—Arrangements for image or video recognition or understanding using pattern recognition or machine learning using neural networks
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V40/00—Recognition of biometric, human-related or animal-related patterns in image or video data
    • G06V40/10—Human or animal bodies, e.g. vehicle occupants or pedestrians; Body parts, e.g. hands
    • G06V40/16—Human faces, e.g. facial parts, sketches or expressions
    • G06V40/168—Feature extraction; Face representation
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/41—Structure of client; Structure of client peripherals
    • H04N21/4104—Peripherals receiving signals from specially adapted client devices
    • H04N21/4122—Peripherals receiving signals from specially adapted client devices additional display device, e.g. video projector
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/431—Generation of visual interfaces for content selection or interaction; Content or additional data rendering
    • H04N21/4312—Generation of visual interfaces for content selection or interaction; Content or additional data rendering involving specific graphical features, e.g. screen layout, special fonts or colors, blinking icons, highlights or animations
    • H04N21/4316—Generation of visual interfaces for content selection or interaction; Content or additional data rendering involving specific graphical features, e.g. screen layout, special fonts or colors, blinking icons, highlights or animations for displaying supplemental content in a region of the screen, e.g. an advertisement in a separate window
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/60—Network structure or processes for video distribution between server and client or between remote clients; Control signalling between clients, server and network components; Transmission of management data between server and client, e.g. sending from server to client commands for recording incoming content stream; Communication details between server and client 
    • H04N21/63—Control signaling related to video distribution between client, server and network components; Network processes for video distribution between server and clients or between remote clients, e.g. transmitting basic layer and enhancement layers over different transmission paths, setting up a peer-to-peer communication via Internet between remote STB's; Communication protocols; Addressing
    • H04N21/64—Addressing
    • H04N21/6405—Multicasting

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Health & Medical Sciences (AREA)
  • Theoretical Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Oral & Maxillofacial Surgery (AREA)
  • General Health & Medical Sciences (AREA)
  • Evolutionary Computation (AREA)
  • Computer Vision & Pattern Recognition (AREA)
  • Business, Economics & Management (AREA)
  • Marketing (AREA)
  • Human Computer Interaction (AREA)
  • Artificial Intelligence (AREA)
  • Computing Systems (AREA)
  • Databases & Information Systems (AREA)
  • Medical Informatics (AREA)
  • Software Systems (AREA)
  • Closed-Circuit Television Systems (AREA)
  • Two-Way Televisions, Distribution Of Moving Picture Or The Like (AREA)

Abstract

The embodiment of the invention discloses an image output control method, an image output control system, electronic equipment and a storage medium. The method comprises the following steps: receiving multicast image data of a multicast group where an image data source is located; adding a video port of the display device into an output port list of the multicast routing table entry; and decoding the image data according to the output port list of the multicast routing table entry, and then sending the decoded image data to a video port of the display equipment for display. According to the image output control scheme provided by the embodiment of the disclosure, the image video is acquired in a multicast mode, decoded and output to the video port of the display device, so that the existing more preferable display device in a local area network environment can be fully utilized, a more convenient viewing mode is provided for a user, and the user experience of related image or video application is greatly improved.

Description

Image output control method, system, electronic equipment and storage medium
Technical Field
The present disclosure relates to, but not limited to, the field of smart home, and in particular, to an image output control method, system, electronic device, and storage medium.
Background
Household monitoring systems are increasingly popularized, and users can check video monitoring pictures or historical monitoring videos through a display screen attached to household monitoring equipment or a display screen of a personal intelligent terminal. It can be seen that these existing video display screens all belong to the display screens of portable devices, and are relatively small, and there are many inconveniences for the elderly and children. How to improve the use convenience of the home monitoring system is a direction of continuous improvement in the field.
Disclosure of Invention
The embodiment of the disclosure provides an image output control method, an image output control system, an electronic device and a storage medium, wherein an image video is acquired in a multicast mode, decoded and output to a video port of a display device, so that the existing more preferable display device in a local area network environment can be fully utilized, a more convenient viewing mode is provided for a user, and the user experience of related image or video application is greatly improved.
An embodiment of the present disclosure provides an image output control method, including:
receiving multicast image data of a multicast group where an image data source is located;
adding a video port of the display device into an output port list of the multicast routing table entry;
and decoding the image data according to the output port list of the multicast routing table entry, and then sending the decoded image data to a video port of the display equipment for display.
An embodiment of the present disclosure further provides an image output control system, including:
a display device, an image data source device, and an output control device;
the output control device is set to receive the multicast image data of the multicast group where the image data source device is located;
the output control device is also configured to add the video port of the display device to an output port list of a multicast routing table entry; and decoding the image data according to the output port list of the multicast routing table entry, and then sending the decoded image data to a video port of the display equipment for display.
An embodiment of the present disclosure further provides an electronic device, including:
one or more processors;
a storage device for storing one or more programs,
when the one or more programs are executed by the one or more processors, the one or more processors are caused to implement the image output control method according to any one of the embodiments of the present disclosure.
The embodiments of the present disclosure also provide a computer-readable storage medium on which a computer program is stored, which when executed by a processor, implements the image output control method according to any one of the embodiments of the present disclosure.
Other aspects will be apparent upon reading and understanding the attached drawings and detailed description.
Drawings
In order to more clearly illustrate the embodiments or technical solutions of the present invention, the drawings used in the embodiments or technical solutions of the prior art will be briefly described below, it is obvious that the drawings in the following description are only some embodiments of the present invention, and for those skilled in the art, other drawings can be obtained according to the structures shown in the drawings without creative efforts.
Fig. 1 is a flowchart of an image output control method according to an embodiment of the present invention;
FIG. 2 is a flow chart of another image output control method according to an embodiment of the present invention
FIG. 3 is a flow chart of another image output control method provided by an embodiment of the invention;
fig. 4 is a schematic view of an application scenario of an image output control method according to an embodiment of the present invention;
FIG. 5 is a flow chart of another image output control method provided by an embodiment of the invention;
FIG. 6 is a schematic diagram of an application scenario of another image output control method according to an embodiment of the present invention;
FIG. 7 is a flow chart of another image output control method provided by an embodiment of the invention;
FIG. 8 is a flow chart of another image output control method provided by an embodiment of the present invention;
fig. 9 is a schematic structural diagram of an image output control system according to an embodiment of the present invention;
fig. 10 is a schematic structural diagram of another image output control system according to an embodiment of the present invention.
The implementation, functional features and advantages of the present invention will be further described with reference to the accompanying drawings.
Detailed Description
The technical solutions in the embodiments of the present invention will be described clearly and completely with reference to the drawings in the embodiments of the present invention, and it is obvious that the described embodiments are only a part of the embodiments of the present invention, and not all of the embodiments. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present invention.
It should be noted that all the directional indicators (such as up, down, left, right, front, and rear … …) in the embodiment of the present invention are only used to explain the relative position relationship between the components, the movement situation, etc. in a specific posture (as shown in the drawing), and if the specific posture is changed, the directional indicator is changed accordingly.
In addition, the descriptions related to "first", "second", etc. in the present invention are only for descriptive purposes and are not to be construed as indicating or implying relative importance or implicitly indicating the number of technical features indicated. Thus, a feature defined as "first" or "second" may explicitly or implicitly include at least one such feature. In the description of the present invention, "a plurality" means at least two, e.g., two, three, etc., unless specifically limited otherwise.
In the present invention, unless otherwise expressly stated or limited, the terms "connected," "secured," and the like are to be construed broadly, and for example, "secured" may be a fixed connection, a removable connection, or an integral part; can be mechanically or electrically connected; they may be directly connected or indirectly connected through intervening media, or they may be connected internally or in any other suitable relationship, unless expressly stated otherwise. The specific meanings of the above terms in the present invention can be understood by those skilled in the art according to specific situations.
In addition, the technical solutions in the embodiments of the present invention may be combined with each other, but it must be based on the realization of the technical solutions by those skilled in the art, and when the technical solutions are contradictory to each other or cannot be realized, such a combination of the technical solutions should not be considered to exist, and is not within the protection scope of the present invention.
In some implementations, the home monitoring system views video monitoring pictures or historical monitoring videos through a display screen attached to the home monitoring device or a display screen of the personal intelligent terminal, but the display screen of the portable device is relatively small, so that for the old or the children, there may be a use obstacle due to presbyopia or other factors.
Technicians find that a television is arranged in a common family, and compared with a display screen of a monitoring terminal or a smart phone, the television has a larger screen and a better display effect. Therefore, the embodiment of the disclosure provides an image output control scheme, which can display image data from a visible doorbell or a monitoring camera in a home monitoring system through a television according to the identification result of whether an old person or a child watches a television, thereby greatly improving the convenience of the old person or the child in using the home monitoring system.
It should be noted that the image output control scheme provided by the embodiment of the present disclosure is not only applicable to a home monitoring system, but also can be popularized and used in many application systems related to image data display, and output image data to display devices associated with people according to people collection information, or output image data from display devices corresponding to the default original image data to display devices associated with people in a transfer manner or in an addition manner.
An embodiment of the present disclosure provides an image output control method, as shown in fig. 1, including:
step 110, receiving multicast image data of a multicast group where an image data source is located;
step 120, adding a video port of the display device into an output port list of the multicast routing table entry;
step 130, according to the output port list of the multicast routing table item, decoding the image data, and then sending the decoded image data to the video port of the display device for display.
In some exemplary embodiments, the decoding the image data in step 130 and then sending the decoded image data to a video port of the display device for displaying includes:
and after decoding the image data, superposing the decoded image data in the original video stream of the video port of the display equipment, and sending the decoded image data to the video port of the display equipment for display.
In some exemplary embodiments, the display device is a television. It can be understood that the original video stream of the television is a television video stream, the image data is decoded and then superimposed on the decoded image of the television video stream, and the decoded image is sent to the video port of the television for display, so that the picture-in-picture display effect can be presented on the television.
In some exemplary embodiments, the image data may be picture data or video data.
In some exemplary embodiments, step 120 comprises:
acquiring personnel acquisition information, and determining corresponding display equipment according to the personnel acquisition information;
and adding a video port connected with the display equipment into an output port list of a multicast routing table item under the condition that the personnel acquisition information meets the set image output condition.
In some exemplary embodiments, the method is applied to a set-top box, and the display device is a television; the video port is a port of the set top box connected with the television; and the set-top box decodes the image of the television program and then sends the image to the television from the video port.
In some exemplary embodiments, the set-top box and the image data source that generates the image data belong to the same local area network.
In some exemplary embodiments, the aging time of the video port of the television added in the output port list of the multicast routing entry of the set-top box is infinite, that is, the video port of the television does not age.
It can be known that in some available multicast schemes, the egress port list of the general multicast routing entry (, G) entry only contains network ports. In some exemplary embodiments of the present disclosure, when the television is used as the display device, a video port (non-network port) of the television is added to the exit port list of the multicast routing entry (#, G) entry. After the set-top box joins the multicast group, the set-top box receives the video stream (image data) coded by H.264 or H.265 with the destination address of the image data source as the multicast group G, and the set-top box sends the video stream out from the output port list of the (x, G) table item; if the output port in the list is a network port, the output port is directly forwarded, if the output port is a video port, the output port is decoded first, then the decoded image is superposed to the decoded television program image and then is sent out, and therefore the picture-in-picture effect is presented on the television picture.
In some exemplary embodiments, determining a corresponding display device according to the person collecting information includes:
and searching a preset corresponding relation between the acquisition equipment and the display equipment according to the source acquisition equipment for acquiring the information by the personnel, and determining the corresponding display equipment.
In some exemplary embodiments, the person collection information is a face image, the source collection device is a camera, and the display device is a television. For example, the preset corresponding relationship between the acquisition device and the display device is as follows:
serial number Collection equipment Display device
1 Camera 1 TV set for living room
2 Camera 2 Main lying television
3 Camera 3 Sub-lying television
It can be understood that when the person collecting information (face image) comes from the camera 1, the corresponding display device is determined to be the living room television according to the corresponding relationship; when the person acquisition information (face image) comes from the camera 3, the corresponding display device is determined to be a secondary lying television according to the corresponding relationship.
In some exemplary embodiments, the method further comprises: step 100, configuring a corresponding relation between the acquisition equipment and the display equipment.
Namely, step 100 is executed to perform pre-configuration of the corresponding relationship between the acquisition device and the display device, so as to perform searching in step 120 and determine the display device.
In some exemplary embodiments, before the receiving the multicast image data of the multicast group where the image data source is located in step 110, the method further includes:
and adding the multicast group where the image data source is located.
In some exemplary embodiments, the joining the multicast group in which the image data source is located includes:
acquiring personnel acquisition information;
and sending a multicast group joining message to join the multicast group where the image data source is located under the condition that the personnel acquisition information conforms to the set image output condition.
In some exemplary embodiments, sending the multicast group join message comprises:
periodically sending PIM Join information (Join information) of multicast routing table entries ([ G ]) to other network ports in the local area network;
and the switch in the local area network generates a multicast routing table item (, G) and adds the port receiving the PIM adding message into the multicast routing table item (, G) of the switch.
In some exemplary embodiments, the multicast group where the image data source is located may also be directly added through manual configuration.
In some exemplary embodiments, the PIM join message that is periodically sent to other ports in the local area network includes:
and under the condition that the multicast routing table entry (, G) comprises the personnel characteristic value, periodically sending a PIM adding message (, G) to other network ports in the local area network.
In some exemplary embodiments, the periodically sending (×, G) PIM join messages to other ports in the local area network includes:
and periodically sending the PIM adding message of (G) to other network ports in the local area network according to the first duration.
It can be understood that, according to the above steps, in some exemplary embodiments, after a device joins a multicast group in a local area network; and after receiving the image data from the image data source, the switch forwards the received image data to the equipment according to the multicast routing table entry (x, G) of the switch.
In some exemplary embodiments, the initial multicast routing table entry (, G) does not contain a human characteristic value.
In some exemplary embodiments, the egress port list for multicast routing entries (x, G) that do not contain a person feature value is empty.
In some exemplary embodiments, the joining the multicast group where the image data source is located further includes:
and under the condition that the personnel acquisition information conforms to the set image output condition, saving the personnel characteristic value corresponding to the personnel acquisition information, and initially marking the departure state of the personnel characteristic value as 'not departing'.
In some exemplary embodiments, the joining the multicast group where the image data source is located further includes:
and under the condition that the personnel acquisition information conforms to the set image output condition, adding the personnel characteristic value corresponding to the personnel acquisition information into the multicast routing list item.
In some exemplary embodiments, when the result of identifying the person corresponding to the person collecting information includes at least one person of a set type, adding the person characteristic value corresponding to the person collecting information to the multicast routing entry.
In some exemplary embodiments, when the person identification result corresponding to the person acquisition information includes at least one set person, adding the person characteristic value corresponding to the person acquisition information to the multicast routing entry.
In some exemplary embodiments, the collecting information by the person includes: a human face image or a photographed image containing a person.
In some exemplary embodiments, the acquiring the person collection information includes: and acquiring personnel acquisition information through a camera.
In some exemplary embodiments, the person collecting information is face information, and the corresponding person feature value is a face feature vector; namely, the face feature vector is added into the multicast routing table entry. For example, the face feature vector is added to the multicast routing table entry (, G).
In some exemplary embodiments, the acquired information of the person is a face image, and the corresponding face feature vector is generated through a neural network.
For example, the table entry (x, G) added to the face feature vector is as follows:
Figure DEST_PATH_IMAGE002AAAA
in some exemplary embodiments, the leaving status of the newly added person feature value in the multicast routing table entry is initially marked as "not left".
In some exemplary embodiments, when a person identification result corresponding to the person acquisition information includes at least one person of a set type, and a display switch state of the at least one person of the set type is null or on, determining that a set image output condition is met; this is recorded as case (1).
In some exemplary embodiments, when a person identification result corresponding to the person acquisition information includes at least one set person and a display switch state of the at least one set person is empty or on, it is determined that a set image output condition is met; this is denoted as case (2).
In some exemplary embodiments, the set personnel information corresponds to a personnel characteristic value in the multicast routing entry. That is, the setting personnel information is stored in the multicast routing entry. In some exemplary embodiments, when a facial feature vector corresponding to a person recognition result can be matched with at least one facial feature vector in a multicast routing table entry, it indicates that the person recognition result corresponding to the person collecting information includes at least one set person.
In some exemplary embodiments, the method further comprises:
and 150, acquiring and storing the display switch state setting information of the identified personnel.
When the identified person fails to set the display switch state in step 150, the corresponding display switch state is null.
In some exemplary embodiments, the display switch status corresponding to the person feature value of the identified person in the multicast routing table entry is marked according to the display switch status of the identified person. And the personnel characteristic values stored in the multicast routing table entry respectively mark the display switch states corresponding to the personnel.
In some exemplary embodiments, the method further comprises:
step 160, acquiring personnel tracking information;
and step 180, deleting the video port connected with the display device from the output port list of the multicast routing table item under the condition that the set image output stopping condition is met is determined according to the personnel tracking information.
In some exemplary embodiments, the person tracking information comprises: personnel gather information and departure indication information.
In some exemplary embodiments, the camera has a person tracking function, and when the tracking detects that the person leaves the screen, person tracking information is generated. And the personnel acquisition information is an image cached by the camera.
In some exemplary embodiments, the camera has only a shooting function, and the set-top box or other device performs a person tracking function to generate person tracking information when the tracking detects that a person leaves the screen.
In some exemplary embodiments, the obtaining the person tracking information includes:
and acquiring personnel tracking information through the camera.
In some exemplary embodiments, the camera supports face detection in a screen and determination of a set person type. Correspondingly, the camera generates a preset type of face image and caches the face image.
In some exemplary embodiments, when it is determined that, of the at least one person of the set type, all the persons whose display switches are off or in the on state are away from each other according to the person tracking information, the set stop image output condition is met, which is denoted as a case (a).
Or, in some exemplary embodiments, when it is determined that all the persons with the display switch in the empty state or the display switch in the on state in the at least one set person leave according to the person tracking information, the set stop image output condition is met, and the case (b) is recorded.
In some exemplary embodiments, the display switch status of the mark corresponding to each person feature value is obtained from the multicast routing table entry.
In some exemplary embodiments, the departure status of the flag corresponding to each human characteristic value is obtained from the multicast routing table entry.
In some exemplary embodiments, after step 160, the method further comprises:
step 170, according to the staff tracking information, marking the leaving state of the staff characteristic value corresponding to the staff collecting information in the staff tracking information as "leaving"; or deleting the personnel characteristic value corresponding to the personnel acquisition information in the stored personnel tracking information according to the personnel tracking information.
In some exemplary embodiments, the leaving state corresponding to the human characteristic value is stored in the multicast routing table entry, and accordingly, in step 170, the leaving state of the corresponding human characteristic value in the multicast routing table entry is marked as "leaving"; or deleting the corresponding personnel characteristic value in the multicast routing table entry.
In some exemplary embodiments, the method further comprises:
step 190, forwarding the image data to a portal included in the egress port list of the multicast routing table entry.
It can be understood that, in the case that the exit port list of the multicast routing entry further includes a network port, the image data is directly forwarded through the network port without decoding the image data.
In some exemplary embodiments, the method is applied to a set-top box, and the display device is a television.
In some exemplary embodiments, the image data source is a smart visual doorbell. The intelligent visual doorbell, the network camera and the set-top box belong to the same local area network and are interconnected through a network switch, the television is associated with the network camera, and the set-top box is connected with the television through a video port.
An embodiment of the present disclosure provides an image output control method, as shown in fig. 2, including:
step 210, acquiring personnel acquisition information;
step 220, determining corresponding display equipment according to the personnel acquisition information;
and 230, acquiring image data and outputting the image data to the display equipment for displaying under the condition that the personnel acquisition information meets the set image output condition.
In some exemplary embodiments, the step 220 comprises:
and searching a preset corresponding relation between the acquisition equipment and the display equipment according to the source acquisition equipment for acquiring the information by the personnel, and determining the corresponding display equipment.
In some exemplary embodiments, when a person identification result corresponding to the person acquisition information includes at least one person of a set type, and a display switch state of the at least one person of the set type is null or on, determining that a set image output condition is met; this is described as case (1).
In some exemplary embodiments, the set types of people include one or more of the following types: old people and children.
For example, if the set type is the elderly, the person acquisition information is a face image, the face image is acquired in step 210, the face image is identified in step 230, the identification result includes the elderly, and the display switch state of at least one elderly is empty or on, it is determined that the condition (1) is met, and the set image output condition is met.
Optionally, in some exemplary embodiments, when a person identification result corresponding to the person acquisition information includes at least one set person, and a display switch state of the at least one set person is null or on, it is determined that a set image output condition is met; this is denoted as case (2).
In some exemplary embodiments, the set types of people include one or more of the following types: doctors, security guards, etc. According to different application scenarios, the type of the person to be identified is set as required, and is not limited to the aspect exemplified by the embodiment of the present disclosure.
In some exemplary embodiments, the setting personnel includes one or more.
For example, if a person is Zhang III and the person acquisition information is a face image, acquiring the face image in step 210, identifying the face image in step 230, wherein the identification result includes Zhang III, and if the display switch state of Zhang III is null, determining that the situation belongs to the situation (2), and the situation meets the set image output condition; if Zhang III is not included, then it does not belong to case (2).
For example, if the number of people is Zhang III and Li IV and the person acquisition information is a face image, the face image is acquired in step 210, the face image is recognized in step 230, the recognition result includes Zhang III and/or Li IV, and if the switch state of at least one recognized person is empty or on, the situation (2) is determined to be the case, and the set image output condition is met; if Zhang three is not included and LieIV is not included, then the case (2) is not included.
It should be noted that, the identification of the person collected information to determine whether the person of the set type is included may be performed according to a related person identification scheme, and is not limited to a specific scheme, and specific aspects are not discussed in the embodiments of the present application. Identifying the personnel acquisition information to determine whether set personnel are included, and executing according to a related personnel identification scheme without being limited to a specific scheme; judging whether a certain set person is included or not, wherein the characteristic value of the set person needs to be stored in advance; specific aspects are not discussed in the examples of this application.
For example, if the set type is the elderly, the face image is recognized according to the related face recognition scheme to determine whether the elderly is included. And if the set personnel is the user A, identifying the face image according to the related face identification scheme to judge whether the user A is included, and pre-storing the face characteristic value or the face picture of the user A.
In some exemplary embodiments, before step 210, the method further comprises:
and 200, configuring a corresponding relation between the acquisition equipment and the display equipment.
Namely, step 200 is executed to perform pre-configuration of the corresponding relationship between the acquisition device and the display device, so as to perform the search in step 220.
In some exemplary embodiments, the method is applied to a set-top box, and the display device is a television;
accordingly, the step 230 of acquiring image data and outputting the image data to the display device for displaying includes:
and the set top box acquires the image data, superposes the image data in an original decoding image connected with a video port of the television, and outputs the image data to the television for display.
In some exemplary embodiments, the set-top box and the image data source that generates the image data belong to the same local area network.
In some exemplary embodiments, the method is applied to a set-top box, and the display device is a television;
accordingly, the step 230 of acquiring image data and outputting the image data to the display device for displaying includes:
the set top box is added into a multicast group where an image data source is located to acquire the image data;
and adding a video port connected with the television into an output port list of a multicast routing table entry of the set-top box, and outputting the image data to the display equipment according to the output port list.
In some exemplary embodiments, the adding, by the set top box, the multicast group where the image data source is located includes:
the set-top box periodically sends PIM Join messages (Join messages) of multicast routing table entries (, G) to other network ports in the local area network;
and the switch in the local area network generates a multicast routing table item (, G) and adds the port receiving the PIM adding message into the multicast routing table item (, G) of the switch.
In some exemplary embodiments, the initial multicast routing table entry (, G) of the set-top box does not contain the person characteristic value.
In some exemplary embodiments, step 230 further comprises:
and adding the personnel characteristic value corresponding to the personnel acquisition information into a multicast routing table item ([ X ], G) of the set-top box under the condition that the personnel acquisition information conforms to the set image output condition.
In some exemplary embodiments, the set top box periodically sends (, G) PIM join messages to other ports in the local area network, including:
and under the condition that the multicast routing table entry (, G) comprises the personnel characteristic value, the set top box periodically sends a PIM adding message (, G) to other network ports in the local area network.
In some exemplary embodiments, the set-top box periodically sends an (, G) PIM join message to other ports in the local area network, including:
and the set top box periodically sends the (G) PIM adding message to other network ports in the local area network for a first time length.
It is understood that according to the above steps, in some exemplary embodiments, the set top box joins a multicast group in the local area network; and after receiving the image data from the image data source, the switch forwards the received image data to the set top box according to the multicast routing table item (star, G) of the switch.
It should be noted that, the multicast routing table entry (, G) on the switch may age, and after the aging time (also referred to as aging duration) arrives, the port corresponding to the set-top box is deleted from the egress port list of the multicast routing table entry (, G), so that the multicast data is not forwarded from the port. In some exemplary embodiments, the aging time is 3 times the first time period, or other set time period.
In some exemplary embodiments, the multicast routing entry is (S, G).
It should be noted that in the embodiment of the present disclosure, an embodiment of a PIM (Protocol Independent Multicast) Multicast routing Protocol is taken as an example to exemplify related aspects. Besides the PIM protocol, other multicast routing protocols may be used to implement forwarding or acquiring of related image data in a multicast group, such as: MBGP (Multicast Border Gateway Protocol) Protocol, IGMP (Internet Group Management Protocol) Protocol, and the like, are not limited to specific aspects, and the related steps may be adjusted correspondingly.
In some exemplary embodiments, step 210 comprises: and acquiring personnel acquisition information through a camera.
In some exemplary embodiments, the camera supports face detection in a screen and determination of a set person type. Correspondingly, the camera generates a preset type of face image and caches the face image.
In some exemplary embodiments, the camera only supports the acquisition of the captured images, performed by other devices based on face detection and/or further face recognition of the captured images; correspondingly, the other equipment generates a preset type of face image and caches the face image. In some exemplary embodiments, further face detection and/or face detection is performed by the set-top box. The function of the related device in the scheme is flexibly determined and is not limited in a specific mode. In some exemplary embodiments, the camera is a web camera.
In some exemplary embodiments, when the person identification result corresponding to the person acquisition information includes at least one person of a set type and the display switches of not all identified persons are in an off state, it is determined that a set image output condition is met; this is described as case (1).
In some exemplary embodiments, when the person identification result corresponding to the person acquisition information includes at least one set person, and the display switches of not all identified persons are in the off state, it is determined that the set image output condition is met; this is denoted as case (2).
It is understood that in some exemplary embodiments, the identified person may be provided with a display switch, and the on state represents: the person corresponds to allowing the display device to display the image data, and the closed state represents: the person corresponds to not allowing the display device to display the image data.
In some exemplary embodiments, the identification result corresponding to the person collecting information includes a plurality of persons of a set type, and if the display switches of the plurality of persons are all in an off state, the plurality of persons do not conform to a set image output condition; and if the display switches corresponding to the currently identified personnel are all in the closed state, newly adding or transferring the image data to the display equipment for display. If the display switches of all the persons are not in the off state, the set image output condition is met. That is, if the display switch of at least one person is in an on state or the display switch of at least one person is in an off state, the set image output condition is met; and indicating that the display switches corresponding to the currently identified personnel are not all closed, and at least one person needs to newly add or transfer and display the image data to the display equipment.
For example, the corresponding display switch states of the user a, the user B, the user C, and the user D are: and turning on, turning off and NULL, namely, allowing the display by the user A, not allowing the display by the user B, not allowing the display by the user C and not setting by the user D. If the identification result comprises: the corresponding display switch states of the user A and the user B are as follows: opening and closing, and determining to meet the set image output condition according to the condition (1); if the recognition result comprises the user B and the user C, the corresponding display switch states are as follows: closing, if the image is closed, determining that the image does not accord with the set image output condition under the condition (1); if the identification result comprises: and the user D, the corresponding display switch state is as follows: if NULL is not in the off state, it is determined that the image output condition is satisfied in case (1).
In some exemplary embodiments, the method further comprises:
and step 221, acquiring and storing the display switch setting information of the personnel.
In some exemplary embodiments, in a case where the person collection information meets the set image output condition, the display switch setting information of the identified person is acquired and saved.
In some exemplary embodiments, the display switch setting information of the setting personnel is acquired and saved. It can be understood that, in this embodiment, the display switch setting information of the setting person may be acquired in advance without considering whether the set image output condition is satisfied. For example, a face image of zhang san is collected through the APP, and a display switch corresponding to zhang san is set to be in an off state.
It can be understood that the display switch states of the respective recognized persons can be flexibly set as required. In some exemplary embodiments, the setting may be performed through APP software or through a television remote controller, and a specific setting scheme is not discussed in detail herein.
For example, the person collects a face image of which the information is the royal milk, step 221 is executed, the royal milk passes through the remote controller, and the display switch corresponding to the royal milk is set to be in the off state, namely, the royal milk considers that the image data does not need to be displayed by the television when the royal milk is watched, and after the image data is stored, the display switch corresponding to the royal milk is in the off state. Accordingly, step 230 is executed, and when the recognition result only includes the king milk, it is determined that the set image output condition is not met because the display switch corresponding to the king milk is in the off state.
In some exemplary embodiments, the method further comprises:
and under the condition that the personnel acquisition information accords with the set image output condition, storing the personnel characteristic value of the identified personnel.
In some exemplary embodiments, in a case where the person collection information meets the set image output condition, the departure state of the saved person feature value is marked as "not-departed".
In some exemplary embodiments, the method further comprises:
and under the condition that the personnel acquisition information meets the set image output condition, adding a personnel characteristic value of the identified personnel into the multicast routing list item.
In some exemplary embodiments, in a case where the staff member information meets the set image output condition, the leaving status of the staff characteristic value added to the multicast routing table entry is marked as "not left".
In some exemplary embodiments, the person feature value is a face feature vector, and accordingly, the identified face feature vector is added to the multicast routing entry (, G).
In some exemplary embodiments, the set-top box's initial multicast routing table entry (, G) does not contain a facial feature vector.
In some exemplary embodiments, in the case that the multicast routing table entry (, G) does not contain the facial feature vector, the set-top box does not send the PIM join message (, G) to other portals.
In some exemplary embodiments, the image data source is a video capture system, such as a smart visual doorbell; or, an indoor and outdoor monitoring system. In some exemplary embodiments, the image data source is a video data receiving, transmitting and/or playing system, such as a videophone system; or, small videos, etc. In some exemplary embodiments, the image data source is various application systems with user operation display interfaces. And is not limited in any particular respect.
In some exemplary embodiments, as shown in fig. 3, the method further comprises:
step 240, acquiring personnel tracking information;
and step 260, stopping outputting the image data to the display device under the condition that the set image output stopping condition is met is determined according to the personnel tracking information.
In some exemplary embodiments, the person tracking information comprises: personnel gather information and departure indication information.
In some exemplary embodiments, the camera has a person tracking function, and when the tracking detects that the person leaves the screen, person tracking information is generated. Wherein the person image is the person image cached in step 210.
In some exemplary embodiments, the camera has only a shooting function, and the set-top box or other device performs a person tracking function to generate person tracking information when the tracking detects that a person leaves the screen. Wherein the personnel image is the personnel image correspondingly cached in the step 210.
In some exemplary embodiments, the method further comprises:
step 250, according to the personnel tracking information, marking the leaving state of the personnel characteristic value corresponding to the personnel acquisition information in the personnel tracking information as leaving; or deleting the personnel characteristic value corresponding to the personnel acquisition information in the stored personnel tracking information according to the personnel tracking information.
In some exemplary embodiments, when it is determined that all of the at least one person of the set type is absent or the person whose display switch is in the on state is absent, the set stop image output condition is met, which is denoted as a condition (a).
Alternatively, in some exemplary embodiments, when it is determined that all the persons with the display switch in the at least one set person being in the empty state or the display switch in the on state leave, the set stop image output condition is met, and the case is marked as a case (b).
In some exemplary embodiments, in step 230, when it is determined that the person identification result includes at least one person of a set type and the display switch of at least one person of the set type is in an empty state or is turned on, the image data is output to the display device, and in step 260, when it is determined that all the persons leave, the output of the image data to the display device is stopped.
For example, when the set type is old people, when at least one old person appears in front of the television and the display switch is turned on or is empty, the image data of the intelligent visual doorbell is output to the television for display, and when all the old persons leave, the output of the image data of the intelligent visual doorbell to the television is stopped.
In some exemplary embodiments, in step 230, when it is determined that the person identification result includes at least one set person and the display switch state of at least one set person is empty or on, the image data is output to the display device, and in step 260, when it is determined that all the persons leave, the output of the image data to the display device is stopped.
For example, the person is set as a user a, when the user a is present in front of a television and the display switch is turned on, the image data of the intelligent visual doorbell is output to the television for display, and when the user a leaves, the output of the image data of the intelligent visual doorbell to the television is stopped. For another example, the setting person is user A, B, C, when users a and B are present in front of the television and the display switch is empty, the image data of the smart visual doorbell is output to the television for display, when user a leaves, because user B does not leave, the output of the image data of the smart visual doorbell to the television is not stopped, and when user B leaves, the output of the image data of the smart visual doorbell to the television is stopped. For another example, the user B is not a setting person, and when the user B is present in front of the television, the image data of the smart video doorbell is not output to the television for display, and further, when the user B leaves, the user B does not need to stop.
In some exemplary embodiments, determining that all the persons with the switch being empty or the persons with the switch being in the on state leave from the at least one person with the set type according to the person tracking information includes:
and determining whether all the personnel with the display switches in the at least one set type of personnel in the personnel with the display switches in the empty state or the on state leave according to the leaving state of the personnel characteristic values corresponding to the personnel acquisition information in the tracking information.
In some exemplary embodiments, determining that all the persons with the display switch being empty or the display switch being in the on state of the at least one set person leave according to the person tracking information includes:
and determining whether all the personnel with the display switch being empty or the display switch being in the on state in the at least one set personnel leave or not according to the leaving state of the personnel characteristic value corresponding to the personnel acquisition information in the tracking information.
In some exemplary embodiments, the stopping of the outputting of the image data to the display device includes:
and deleting the video port connected with the television from an output interface list of the item ([ star ], G) of the set top box.
It will be appreciated that the set-top box will not decode the image data to superimpose it on the television program of the television set after deletion.
The embodiment of the disclosure further provides an image output control method, which is applied to a set top box, and an application scene is shown in fig. 4, wherein a display device is a television, an image data source is an intelligent visual doorbell, image data is a video stream of the intelligent visual doorbell, a collecting device for collecting information by a person includes a network camera 1, and the set top box, the intelligent visual doorbell and the network camera 1 are located in the same local area network; presetting a corresponding relation (binding) between the network camera 1 and the television 1; the set-top box is connected with a television 1 through a video port 1. The personnel acquisition information is face information, and the personnel of the set type are the old; the personnel identification result corresponding to the personnel acquisition information comprises at least one old man, and the condition that the switch display state of the old man is empty accords with the set image output condition; and when all the old people leave, the set image output stopping condition is met.
As shown in fig. 5, the method includes:
step 510, the set top box receives a face image sent by the network camera 1;
step 520, determining that the display device corresponding to the network camera 1 is the television 1 according to a preset corresponding relation;
and step 530, acquiring a video stream from the intelligent visual doorbell and outputting the video stream to the television 1 for displaying under the condition that the face image meets the set image output condition.
It can be appreciated that none of the identified elderly people have been set to display the on-off state.
In some exemplary embodiments, when the person recognition result corresponding to the face image includes at least one person of a set type and the display switch state is empty, it is determined in step 530 that the set image output condition is met. Wherein the set type is old people.
The network camera 1 has the functions of face detection and face age identification, the network camera 1 detects and identifies faces appearing in a picture, and when the old people (the display switch state is empty) appearing in the picture is determined, face images are sent to the set top box.
In some exemplary embodiments, the network camera 1 only sends the face image to the set-top box once for the same face, so as to reduce the processing burden of the set-top box.
In some exemplary embodiments, the webcam saves the facial image.
In some exemplary embodiments, step 530 further comprises:
under the condition that the face image meets the set image output condition, the set top box periodically sends a (star, G) PIM adding message to other network ports in the local area network;
and adding the video port connected with the television 1 into an output port list of a multicast routing table item (, G) of the set top box.
In some exemplary embodiments, step 530 further comprises:
adding the face feature vector corresponding to the face image into a multicast routing table item ([ X ], G) of the set-top box under the condition that the face image meets the set image output condition;
and marking the departure state of the face feature vector as 'not departing'.
In some exemplary embodiments, the acquiring and outputting the video stream from the intelligent visual doorbell to the television set 1 for displaying in step 530 includes:
the set top box receives a video stream which is from an intelligent visual doorbell and has a destination address of H.264 or H.265 coding of a multicast group G;
and the set-top box sends the video stream out from the output port list of the (, G) table entry.
When the output port in the output port list of the (#, G) entry includes a video port connected to the television 1, the video stream is decoded, then the decoded image is superimposed on the decoded image of the television program, and then the decoded image is sent out, so that the picture-in-picture effect is presented on the picture of the television 1.
In some exemplary embodiments, the network camera is a clip-on network camera, and is mounted on the television 1.
In some exemplary embodiments, the television set 1 is placed in a living room.
It can be seen that, in some exemplary embodiments, when the royal milk is sitting in front of the television in the living room and watching television, the webcam determines that a person (old man) of a set type is detected according to the face detection and recognition function of the webcam, and sends a face image of the royal milk to the set-top box; the set-top box acquires the face image, determines that the face image meets the set image output condition, periodically sends a (G) PIM adding message to other network ports in the local area network, and adds the video port 1 connected with the television 1 into an output port list of a multicast routing table item (G) of the set-top box. When someone presses the doorbell outside the door, the camera carried by the doorbell sends the video stream to the home network, and the destination address is the multicast group address G. Correspondingly, the set top box receives the video stream, the video stream is matched with the multicast routing table item (, G) of the set top box, the video stream is directly forwarded out for the internet access in the output interface list in the multicast routing table item (, G), the video stream is decoded for the video access 1 in the output interface list, the decoded image is superposed to the decoded image of the television in the living room at the same output port in a picture-in-picture mode, and the grandma can see the outdoor scene on the television.
In some exemplary embodiments, the method further comprises:
step 540, acquiring personnel tracking information;
and step 550, under the condition that all the identified old people leave the picture according to the person tracking information, stopping continuously outputting the video stream from the intelligent visual doorbell to the television 1 for displaying.
It can be seen that in some exemplary embodiments, when the royal milk leaves the television set 1 and is not watching the television in front of the television set 1, the video stream is no longer displayed by the television set 1.
In some exemplary embodiments, step 540 comprises:
when the network camera detects that the old people leave the picture, the network camera sends personnel tracking information to the set top box; the person tracking information includes: face images and departure indication information;
the set top box updates the departure state of the face feature vector in the (, G) table entry to be departure according to the personnel tracking information; or the set top box deletes the corresponding face feature vector in the ([ x, G ]) table item according to the personnel tracking information.
In some exemplary embodiments, step 550 comprises: and deleting the video port 1 connected with the television 1 from the output port list of the multicast routing table item (x, G) of the set-top box under the condition that all the identified old people leave the picture. It will be appreciated that after video port 1 is removed from the output port list, the set top box will not be sending the received multicast video stream to video port 1.
In some exemplary embodiments, step 550 comprises: and when all the identified old people are determined to leave the picture, stopping periodically sending (star, G) PIM joining messages (Join messages) to other network ports in the local area network. It can be understood that after the PIM join message is stopped being sent, the set-top box will not receive the multicast video stream with the destination address G any more after the multicast routing forwarding table entry (, G) on the switch is aged.
It will be appreciated that when the royal milk leaves the television set 1, it is no longer necessary to display the video stream from the doorbell on the television set 1. If the royal milk continues to watch the tv in front of the tv set 1, it is still displayed on the tv set 1 when the multicast video stream from the doorbell is received.
The embodiment of the disclosure further provides an image output control method, which is applied to a set top box, and an application scene is shown in fig. 6, wherein a display device is a television, an image data source is an intelligent visual doorbell, image data is a video stream of the intelligent visual doorbell, a collecting device for collecting information by a person includes a network camera 1 and a network camera 2, and the set top box, the intelligent visual doorbell, the network camera 1 and the network camera 2 are located in the same local area network; presetting a corresponding (binding) relationship: the network camera 1 corresponds to the television 1 (living room), and the network camera 2 corresponds to the television 2 (main lying); the set top box is connected with a television 1 through a video port 1; the set top box is connected with the television 2 through the video port 2; the multicast routing table item (, G) of the set top box does not initially contain the face feature vector, and the output interface list of the set top box is empty. The personnel acquisition information is face information, and the set type of personnel is the old; the personnel identification result corresponding to the personnel acquisition information comprises at least one old man, and the display switches of not all the identified old men are in the off state condition, so that the display switches meet the set image output condition; and if the display switch is empty or all the old people with the display switch in the on state leave, the condition is met according to the set image output stopping condition.
As shown in fig. 7, the method includes:
step 710, the set top box receives the face image sent by the network camera 2;
step 720, according to a preset corresponding relationship, determining that the display device corresponding to the network camera 2 is the television 2;
step 730, in the case that the person identification result corresponding to the face information is of a set type, adding the identified face feature vector of the person of the set type into the multicast routing table item (, G) of the set top box, and marking the departure state of the face feature vector as "not departing";
and step 740, acquiring a video stream from the intelligent visual doorbell and outputting the video stream to the television 2 for displaying.
For example, if grandma and Zhangye are watching television in master-sleeping, the face image received by the set-top box comes from the network camera 2, and the display device is determined to be the television 2. Correspondingly adding the human face feature vectors of the Wang milk and the Zhangye into a multicast routing table entry (star, G), wherein the leaving states of the human face feature vectors of the Wang milk and the Zhangye are 'not leaving'.
In some exemplary embodiments, the method further comprises:
and step 750, acquiring and storing the display switch state setting information of the identified personnel.
For example, the display switch of the copy is set to off state.
In some exemplary embodiments, as shown in fig. 8, the method further comprises:
step 760, determining that the image output condition is met under the condition that the person identification result corresponding to the face information is an old person and the display switches of all the identified old persons are not in the off state;
and step 770, acquiring a video stream from the intelligent visual doorbell and outputting the video stream to the television 2 for displaying.
For example, the display switch is not set in the royal milk, and the display switch is set in the Zhangye to be in an off state.
Then step 740 or 770 includes:
when a person sits in front of the television 2 and accords with the set image output condition, when the intelligent visual doorbell outputs video streams and performs multicast, the set-top box acquires the video streams and outputs the video streams to the television 2 for display;
when the Wang Ning Dai and Zhangye are both in front of the television 2 and meet the set image output condition, and when the intelligent visual doorbell has video stream output and multicast, the set-top box acquires the video stream and outputs the video stream to the television 2 for display;
when a grandpa sits in front of the television 2, the grandpa does not accord with the set image output condition, and when the intelligent visual doorbell is output by a video stream and multicast, the set top box does not need to acquire the video stream or output the video stream to the television 2 for display.
In some exemplary embodiments, the method further comprises:
step 780, acquiring personnel tracking information;
and step 790, under the condition that the set image output stopping condition is determined to be met according to the personnel tracking information, stopping continuously outputting the video stream from the intelligent visual doorbell to the television 2 for displaying.
For example, the display switch is not set in the royal milk, and the display switch is set in the Zhangye to be in an off state.
Step 790 then includes:
when a person sits in front of the television 2 and leaves, the Wang Ning Dai meets the set condition for stopping image output, and the video stream from the intelligent visual doorbell is stopped to be continuously output to the television 2 for display;
when the king milk and the Zhangye are both sitting in front of the television 2, if the king milk leaves, the set image output stopping condition is met, and the video stream from the intelligent visual doorbell is stopped to be continuously output to the television 2 for displaying;
when grandpa and piece grandpa two people all sit before TV set 2, if piece grandpa leaves, then not conform to the stop image output condition of settlement, continue to export the video stream that comes from intelligent visual doorbell to go on showing on the TV set 2.
An embodiment of the present disclosure provides an image output control system, as shown in fig. 9, including:
a display device 910, an image data source device 930, and an output control device 940;
the output control device 940 is configured to join the multicast group in which the image data source device 930 is located, and receive multicast image data;
the output control device 940 is further configured to add a video port connected to the display device 910 into an output port list of a multicast routing entry; and decoding the image data according to the output port list of the multicast routing table entry, and then sending the decoded image data to a video port of the display device 910 for display.
In some exemplary embodiments, the output control device 940 is further configured to, after decoding the image data, superimpose the decoded image data on an original video stream of a video port of the display device 910, and send the decoded image data to the video port of the display device 910 for display.
In some exemplary embodiments, the display device 910 is a television.
In some exemplary embodiments, the output control device 940 is a set-top box.
In some exemplary embodiments, the image data source device 930 is a smart visual doorbell.
In some exemplary embodiments, the system further includes a personnel information collection device 920.
In some exemplary embodiments, the personal information collecting device 920 is a camera.
An embodiment of the present disclosure provides an image output control system, as shown in fig. 10, including:
a display device 1010, a person information collecting device 1020, an image data source device 1030, and an output control device 1040;
the personnel information collection equipment 1020 is configured to obtain personnel collection information;
the output control device 1040 is configured to determine the corresponding display device 1010 according to the person collection information; and under the condition that the personnel acquisition information meets the set image output condition, acquiring image data from the image data source device and outputting the image data to the display device 1010 for display.
In some exemplary embodiments, the display device 1010, the person information collecting device 1020, the image data source device 1030, and the output control device 1040 belong to the same local area network.
In some exemplary embodiments, the display device 1010 is a television;
the personnel information acquisition device 1020 is a camera;
the output control device 1040 is a set-top box.
In some exemplary embodiments, the image data source device 1030 is a smart visual doorbell.
In some exemplary embodiments, the set-top box includes at least one video port for connecting to a television.
In some exemplary embodiments, the set top box comprises at least two network ports.
In some exemplary embodiments, the system comprises one or more display devices.
In some exemplary embodiments, the system includes one or more people information gathering devices.
In some exemplary embodiments, the display devices and the personnel information collection devices in the system correspond one-to-one.
In some exemplary embodiments, one of said set-top boxes is connected to one or more television sets.
An embodiment of the present disclosure further provides an electronic device, including:
one or more processors;
a storage device for storing one or more programs,
when the one or more programs are executed by the one or more processors, the one or more processors are caused to implement the image output control method according to any one of the embodiments of the present disclosure.
The embodiments of the present disclosure also provide a computer-readable storage medium on which a computer program is stored, the program being implemented by a processor to implement the image output control method according to any one of the embodiments of the present disclosure.
It can be seen that based on the image output control scheme provided by the embodiment of the present disclosure, an image video is obtained in a multicast mode and decoded and output to a video port of a display device, so that existing and more preferable display devices in a local area network environment can be fully utilized, a more convenient viewing mode is provided for a user, and user experience of related image or video applications is greatly improved. In some embodiments, the corresponding display device is determined according to the collected information of the viewer, and the image data is added or transferred to the display device, so that the intelligent degree of the image data output scheme is improved. In some embodiments, the existing set-top box and television in the home network system are utilized, and other image data sources which may have inconvenience in watching are newly added or transferred to be output to the television which is more convenient to watch according to the condition that the user watches the television, so that the intelligent degree of the home network system is further improved.
It will be understood by those of ordinary skill in the art that all or some of the steps of the methods, systems, functional modules/units in the devices disclosed above may be implemented as software, firmware, hardware, and suitable combinations thereof. In a hardware implementation, the division between functional modules/units mentioned in the above description does not necessarily correspond to the division of physical components; for example, one physical component may have multiple functions, or one function or step may be performed by several physical components in cooperation. Some or all of the components may be implemented as software executed by a processor, such as a digital signal processor or microprocessor, or as hardware, or as an integrated circuit, such as an application specific integrated circuit. Such software may be distributed on computer readable media, which may include computer storage media (or non-transitory media) and communication media (or transitory media). The term computer storage media includes volatile and nonvolatile, removable and non-removable media implemented in any method or technology for storage of information such as computer readable instructions, data structures, program modules or other data, as is well known to those skilled in the art. Computer storage media includes, but is not limited to, RAM, ROM, EEPROM, flash memory or other memory technology, CD-ROM, Digital Versatile Disks (DVD) or other optical disk storage, magnetic cassettes, magnetic tape, magnetic disk storage or other magnetic storage devices, or any other medium which can be used to store the desired information and which can accessed by a computer. In addition, communication media typically embodies computer readable instructions, data structures, program modules or other data in a modulated data signal such as a carrier wave or other transport mechanism and includes any information delivery media as is well known to those skilled in the art.
The above description is only a preferred embodiment of the present invention, and is not intended to limit the scope of the present invention, and all modifications and equivalents of the present invention, which are made by the contents of the present specification and the accompanying drawings, or directly/indirectly applied to other related technical fields, are included in the scope of the present invention.

Claims (10)

1. An image output control method, characterized by comprising:
receiving multicast image data of a multicast group where an image data source is located;
adding a video port of the display device into an output port list of the multicast routing table entry;
and decoding the image data according to the output port list of the multicast routing table entry, and then sending the decoded image data to a video port of the display equipment for display.
2. The method of claim 1,
after decoding the image data, sending the decoded image data to a video port of the display device for display, including:
and after decoding the image data, superposing the decoded image data in the original video stream of the video port of the display equipment, and sending the decoded image data to the video port of the display equipment for display.
3. The method of claim 1,
the adding the video port of the display device into the output port list of the multicast routing table entry includes:
acquiring personnel acquisition information, and determining corresponding display equipment according to the personnel acquisition information;
and adding a video port connected with the display equipment into an output port list of a multicast routing table item under the condition that the personnel acquisition information meets the set image output condition.
4. The method of claim 1,
before the receiving multicast image data of the multicast group where the image data source is located, the method further includes: adding the multicast group where the image data source is located;
wherein the joining of the multicast group in which the image data source is located includes:
acquiring personnel acquisition information;
and sending a multicast group joining message to join the multicast group where the image data source is located under the condition that the personnel acquisition information meets the set image output condition.
5. The method of claim 4,
the joining the multicast group where the image data source is located further includes:
and under the condition that the personnel acquisition information conforms to the set image output condition, adding the personnel characteristic value corresponding to the personnel acquisition information into the multicast routing list item.
6. The method of claim 3 or 4,
determining that the image output conditions are met under the condition that the personnel identification results corresponding to the personnel acquisition information comprise at least one set type of personnel and the display switch state of the at least one set type of personnel is empty or on;
alternatively, the first and second electrodes may be,
and determining that the image output condition is met under the condition that the personnel identification result corresponding to the personnel acquisition information comprises at least one set personnel and the display switch state of the at least one set personnel is empty or on.
7. The method of any one of claims 1 to 5,
the method further comprises the following steps: acquiring personnel tracking information;
and under the condition that the set image output stopping condition is met is determined according to the personnel tracking information, deleting the video port of the display equipment from the output port list of the multicast routing table item.
8. An image output control system, characterized by comprising:
a display device, an image data source device, and an output control device;
the output control device is set to receive the multicast image data of the multicast group where the image data source device is located;
the output control device is also configured to add the video port of the display device to an output port list of a multicast routing table entry; and decoding the image data according to the output port list of the multicast routing table entry, and then sending the decoded image data to a video port of the display equipment for display.
9. An electronic device, comprising:
one or more processors;
a storage device for storing one or more programs,
when executed by the one or more processors, cause the one or more processors to implement the image output control method of any one of claims 1-7.
10. A computer-readable storage medium on which a computer program is stored, the program, when executed by a processor, implementing the image output control method according to any one of claims 1 to 7.
CN202210603386.XA 2022-05-31 2022-05-31 Image output control method, system, electronic equipment and storage medium Active CN114928724B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN202210603386.XA CN114928724B (en) 2022-05-31 2022-05-31 Image output control method, system, electronic equipment and storage medium

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN202210603386.XA CN114928724B (en) 2022-05-31 2022-05-31 Image output control method, system, electronic equipment and storage medium

Publications (2)

Publication Number Publication Date
CN114928724A true CN114928724A (en) 2022-08-19
CN114928724B CN114928724B (en) 2023-11-24

Family

ID=82811728

Family Applications (1)

Application Number Title Priority Date Filing Date
CN202210603386.XA Active CN114928724B (en) 2022-05-31 2022-05-31 Image output control method, system, electronic equipment and storage medium

Country Status (1)

Country Link
CN (1) CN114928724B (en)

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN117745514A (en) * 2024-02-20 2024-03-22 浙江宇视科技有限公司 Image distribution method, device, equipment and medium of intelligent server cluster

Citations (10)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN1874501A (en) * 2006-06-06 2006-12-06 北京翼域精彩科技有限公司 Video digital monitor and control system and method in use for 3G mobile communication
CN1905530A (en) * 2006-08-08 2007-01-31 杭州华为三康技术有限公司 Method and system of multicast and video-on-demand
JP2013006407A (en) * 2011-05-20 2013-01-10 Sharp Corp Image output device, method for controlling the same, control program, and recording medium
CN103491391A (en) * 2013-09-17 2014-01-01 深圳创维数字技术股份有限公司 Method and device for managing and controlling video playing and terminal equipment
CN105872626A (en) * 2015-12-15 2016-08-17 乐视网信息技术（北京）股份有限公司 Video playing method and device
CN106663115A (en) * 2014-09-16 2017-05-10 谷歌公司 Continuation of playback of media content by different output devices
CN107396151A (en) * 2017-08-24 2017-11-24 维沃移动通信有限公司 A kind of video playing control method and electronic equipment
CN107484005A (en) * 2017-08-08 2017-12-15 深圳创维数字技术有限公司 Monitoring method, set top box, monitoring system and storage medium
US20210385418A1 (en) * 2020-06-03 2021-12-09 Honeywell International Inc. Video monitoring systems and methods
CN114189729A (en) * 2021-12-14 2022-03-15 海信视像科技股份有限公司 Data relay playing method and intelligent device

Family Cites Families (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN110113639A (en) * 2019-05-14 2019-08-09 北京儒博科技有限公司 Video playing control method, device, terminal, server and storage medium
CN114466227B (en) * 2021-12-22 2023-08-04 天翼云科技有限公司 Video analysis method and device, electronic equipment and storage medium

Patent Citations (10)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN1874501A (en) * 2006-06-06 2006-12-06 北京翼域精彩科技有限公司 Video digital monitor and control system and method in use for 3G mobile communication
CN1905530A (en) * 2006-08-08 2007-01-31 杭州华为三康技术有限公司 Method and system of multicast and video-on-demand
JP2013006407A (en) * 2011-05-20 2013-01-10 Sharp Corp Image output device, method for controlling the same, control program, and recording medium
CN103491391A (en) * 2013-09-17 2014-01-01 深圳创维数字技术股份有限公司 Method and device for managing and controlling video playing and terminal equipment
CN106663115A (en) * 2014-09-16 2017-05-10 谷歌公司 Continuation of playback of media content by different output devices
CN105872626A (en) * 2015-12-15 2016-08-17 乐视网信息技术（北京）股份有限公司 Video playing method and device
CN107484005A (en) * 2017-08-08 2017-12-15 深圳创维数字技术有限公司 Monitoring method, set top box, monitoring system and storage medium
CN107396151A (en) * 2017-08-24 2017-11-24 维沃移动通信有限公司 A kind of video playing control method and electronic equipment
US20210385418A1 (en) * 2020-06-03 2021-12-09 Honeywell International Inc. Video monitoring systems and methods
CN114189729A (en) * 2021-12-14 2022-03-15 海信视像科技股份有限公司 Data relay playing method and intelligent device

Cited By (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN117745514A (en) * 2024-02-20 2024-03-22 浙江宇视科技有限公司 Image distribution method, device, equipment and medium of intelligent server cluster
CN117745514B (en) * 2024-02-20 2024-05-10 浙江宇视科技有限公司 Image distribution method, device, equipment and medium of intelligent server cluster

Also Published As

Publication number Publication date
CN114928724B (en) 2023-11-24

Similar Documents

Publication Publication Date Title
US10123066B2 (en) Media playback method, apparatus, and system
US8218080B2 (en) Personal settings, parental control, and energy saving control of television with digital video camera
US8949870B2 (en) Transfer of information from an information node to a broadcast programming receiver
CN107948737A (en) The recommendation method and device of TV programme
CN114928724B (en) Image output control method, system, electronic equipment and storage medium
CN107800964A (en) It is a kind of that method of the face automatic detection with capturing is realized based on dual camera
CN101621654A (en) Household intelligent video gateway
JP2016532386A (en) Method for displaying video and apparatus for displaying video
WO2013069565A1 (en) Imaging/recording device
JP2005033570A (en) Method and system for providing mobile body image
US20240107093A1 (en) Media session management
US8379092B2 (en) System and method for providing application service using image data
CN108063963B (en) extended digital video conversion box
CN114697728B (en) Image output control method, system, electronic equipment and storage medium
JP5989505B2 (en) Message management apparatus, message presentation apparatus, message presentation system, message management apparatus, message presentation apparatus control method, control program, and recording medium
CN111950374A (en) Image transmission method and system
KR20050017436A (en) PVR Apparatus with message recording function during user's absence and method for the same
JP4978125B2 (en) COMMUNICATION CONTROL DEVICE AND COMMUNICATION CONTROL METHOD
JP2016103670A (en) Image management system and monitoring camera
JP2004241817A (en) Image distribution system
CN111246170B (en) Control method and device of monitoring system, storage medium and equipment
JP3908212B2 (en) Interphone device, voice conversion method for interphone device, and voice conversion program for interphone device
CN110365941A (en) A kind of monitoring system and video monitoring method of compatible multiple user's synchronous manipulations
KR101499972B1 (en) IPTV and Audience Rating Survey System using the same
CN117499726A (en) Television control method and device and television

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant