CN113382167B - Information superposition display method, device and system and image processing equipment - Google Patents

Information superposition display method, device and system and image processing equipment Download PDF

Info

Publication number
CN113382167B
CN113382167B CN202110644459.5A CN202110644459A CN113382167B CN 113382167 B CN113382167 B CN 113382167B CN 202110644459 A CN202110644459 A CN 202110644459A CN 113382167 B CN113382167 B CN 113382167B
Authority
CN
China
Prior art keywords
information
character
video frame
display position
sub
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
CN202110644459.5A
Other languages
Chinese (zh)
Other versions
CN113382167A (en
Inventor
袁爽力
孙忠洋
宋长祝
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Hangzhou Hikvision Digital Technology Co Ltd
Original Assignee
Hangzhou Hikvision Digital Technology Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Hangzhou Hikvision Digital Technology Co Ltd filed Critical Hangzhou Hikvision Digital Technology Co Ltd
Priority to CN202110644459.5A priority Critical patent/CN113382167B/en
Publication of CN113382167A publication Critical patent/CN113382167A/en
Application granted granted Critical
Publication of CN113382167B publication Critical patent/CN113382167B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N23/00Cameras or camera modules comprising electronic image sensors; Control thereof
    • H04N23/80Camera processing pipelines; Components thereof
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N5/00Details of television systems
    • H04N5/222Studio circuitry; Studio devices; Studio equipment
    • H04N5/262Studio circuits, e.g. for mixing, switching-over, change of character of image, other special effects ; Cameras specially adapted for the electronic generation of special effects
    • H04N5/265Mixing

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Controls And Circuits For Display Device (AREA)

Abstract

The embodiment of the invention provides an information superposition display method, device and system and image processing equipment. Wherein the method comprises the following steps: acquiring character information acquired by information acquisition equipment; according to the determined display position for displaying the character information, sending the character information and position information for representing the display position to image acquisition equipment, so that the image acquisition equipment superposes the character information on the display position of the acquired video frame in a layer form to obtain a superposed video frame; acquiring a superposed video frame sent by the image acquisition equipment; and displaying the superposed video frame. The system resource occupied by the character information displayed in an overlapping way can be effectively reduced.

Description

Information superposition display method, device and system and image processing equipment
Technical Field
The invention relates to the technical field of video acquisition, in particular to an information superposition display method, device and system and image processing equipment.
Background
The image acquisition equipment can acquire video data of a monitored scene and transmit the video data to the image processing equipment for storage. The user can browse the video data stored in the image processing equipment according to the requirement to acquire the relevant information of the monitored scene. But the image information in the video data may not reflect information of interest to all users in the monitored scene.
In order to enrich information in video data, other information acquisition devices except the image acquisition device can be used for acquiring monitoring scenes, obtaining other information expressed in a character form and sending the other information to the image processing device, and when a user browses the video data in the image processing device, the image processing device can display a video picture and the other information expressed in the character form in a superposition mode, so that the user can obtain more information from the video picture. For example, commodity information represented in the form Of characters may be collected by a POS (Point Of Sale) and sent to an image processing apparatus so that the image processing apparatus displays the commodity information superimposed in a video screen. Hereinafter, for convenience of description, other information expressed in the form of characters will be referred to as character information, and information collecting apparatuses other than these image collecting apparatuses will be simply referred to as information collecting apparatuses.
However, the video frames and the character information displayed in a superimposed manner occupy certain system resources of the image processing device, and when a large amount of character information needs to be displayed in a superimposed manner in the video frames, the image processing device occupies more system resources, which affects the normal operation of the image processing device.
Disclosure of Invention
The embodiment of the invention aims to provide an information superposition display method, device and system and image processing equipment, so as to reduce system resources occupied by superposition display of character information. The specific technical scheme is as follows:
in a first aspect of the embodiments of the present invention, there is provided an information superimposition display method, which is applied to an image processing apparatus, the method including:
acquiring character information acquired by information acquisition equipment;
according to the determined display position for displaying the character information, sending the character information and position information for representing the display position to image acquisition equipment, so that the image acquisition equipment superposes the character information on the display position of the acquired video frame in a layer form to obtain a superposed video frame;
acquiring a superposed video frame sent by the image acquisition equipment;
and displaying the superposed video frame.
In a second aspect of the embodiments of the present invention, there is provided an information superposition display method, which is applied to an image acquisition device, and includes:
acquiring character information sent by image processing equipment and position information used for representing a display position, wherein the display position is a position which is obtained by determination and used for displaying the character information, and the character information is acquired by information acquisition equipment;
superposing the character information on the display position of the collected video frame to obtain a superposed video frame;
and sending the overlay video frame to the image processing equipment so that the image processing equipment displays the overlay video frame.
In a possible embodiment, the character information collected by the information collecting device includes: first character sub information and second character sub information;
the acquiring of the character information and the position information for representing the display position sent by the image processing device comprises:
acquiring the first character sub-information and position information used for representing a first display position, which are sent by image processing equipment;
the overlaying the character information at the display position of the collected video frame to obtain an overlaid video frame comprises:
superposing the first character sub-information on the first display position of the acquired video frame in a layer form to obtain a superposed video frame;
the sending the overlay video frame to the image processing device to enable the image processing device to display the overlay video frame includes:
and sending the superposed video frame to the image processing equipment, so that the image processing equipment superposes and displays the superposed video frame and the second character sub-information according to the determined second display position for displaying the second character sub-information, wherein the second character sub-information is displayed at the second display position.
In a possible embodiment, the method further comprises:
receiving a screen clearing instruction sent by the image processing equipment, wherein the screen clearing instruction is sent when the image processing equipment reaches a preset screen clearing condition;
stopping overlaying the character information on the display position of the acquired video frame in a layer form;
wherein the screen clearing condition comprises:
the information acquisition equipment does not acquire new character information within a preset time length, or receives a preset control instruction.
In a possible embodiment, after the terminating superimposing the character information in an image layer form on the display position of the captured video frame, the method further includes:
locally storing the location information at the image capture device;
and when new character information sent by the image processing equipment is received, the new character information is superposed at the display position of the acquired video frame according to the display position represented by the stored position information.
In a third aspect of the embodiments of the present invention, there is provided an information superimposition display system, including: the system comprises an image processing device, an image acquisition device and an information acquisition device;
the information acquisition equipment is used for acquiring character information;
the image processing device is used for sending the character information and the position information used for representing the display position to the image acquisition device according to the determined display position used for displaying the character information;
the image acquisition equipment is used for superposing the character information on the display position of the acquired video frame in a layer form to obtain a superposed video frame; sending the superposed video frame to the image processing equipment;
the image processing device is further configured to display the overlay video frame.
In a fourth aspect of the embodiments of the present invention, there is provided an information superimposition display device that is applied to an image processing apparatus, the device including:
the character information acquisition module is used for acquiring character information acquired by the information acquisition equipment;
the information issuing module is used for sending the character information and the position information used for representing the display position to image acquisition equipment according to the determined display position used for displaying the character information, so that the image acquisition equipment superposes the character information on the display position of the acquired video frame in a layer form to obtain a superposed video frame;
the video frame acquisition module is used for acquiring a superposed video frame sent by the image acquisition equipment;
and the preview module is used for displaying the superposed video frames.
In a fifth aspect of the embodiments of the present invention, there is provided an information superimposition display device, which is applied to an image capturing apparatus, the device including:
the system comprises an issued information acquisition module, a display module and an information acquisition module, wherein the issued information acquisition module is used for acquiring character information sent by image processing equipment and position information used for representing a display position, the display position is a position which is obtained by determination and used for displaying the character information, and the character information is acquired by information acquisition equipment;
the layer overlapping module is used for overlapping the character information at the display position of the acquired video frame to obtain an overlapped video frame;
and the information uploading module is used for sending the superposed video frame to the image processing equipment so that the image processing equipment displays the superposed video frame.
In a sixth aspect of the embodiments of the present invention, there is provided an image processing apparatus comprising:
a first memory for storing a computer program;
a first processor adapted to perform the method steps of any of the above first aspects when executing a program stored in a memory.
In a seventh aspect of embodiments of the present invention, there is provided an image capturing apparatus, including:
a second memory for storing a computer program;
a second processor, configured to implement the method steps of any of the above second aspects when executing the program stored in the memory.
In an eighth aspect of embodiments of the present invention, there is provided a computer-readable storage medium having stored therein a computer program which, when executed by a processor, performs the method steps of any one of the first or second aspects.
The embodiment of the invention has the following beneficial effects:
according to the information superposition display method, the information superposition display device and the image processing equipment, the superposed character information can be processed by the image acquisition equipment, the video frame received by the image processing equipment is the superposed video frame on which the character information is superposed, the display can be carried out based on the superposed video frame, and the character information is forwarded by only occupying less system resources of the image processing equipment, so that the system resources occupied by the superposed character information can be effectively reduced.
Of course, not all of the advantages described above need to be achieved at the same time in the practice of any one product or method of the invention.
Drawings
In order to more clearly illustrate the embodiments of the present invention or the technical solutions in the prior art, the drawings used in the description of the embodiments or the prior art will be briefly described below, and it is obvious that the drawings in the following description are only some embodiments of the present invention, and it is obvious for those skilled in the art that other embodiments can be obtained by using the drawings without creative efforts.
Fig. 1 is a schematic flowchart of a possible information superposition display method applied to an image processing apparatus according to an embodiment of the present invention;
fig. 2 is another schematic flowchart of an information superposition display method applied to an image processing apparatus according to an embodiment of the present invention;
fig. 3 is a schematic flowchart of another information superposition display method applied to an image processing apparatus according to an embodiment of the present invention;
fig. 4 is a schematic flow chart of an information superposition display method according to an embodiment of the present invention;
fig. 5 is a schematic structural diagram of an information superposition display system according to an embodiment of the present invention;
fig. 6 is a schematic flowchart of a possible information superposition display method applied to an image acquisition device according to an embodiment of the present invention;
fig. 7 is a schematic structural diagram of an information superposition display device applied to an image processing apparatus according to an embodiment of the present invention;
fig. 8 is a schematic structural diagram of an information superposition display device applied to an image acquisition apparatus according to an embodiment of the present invention;
fig. 9 is a schematic structural diagram of an image processing apparatus according to an embodiment of the present invention;
fig. 10 is a schematic structural diagram of an image capturing device according to an embodiment of the present invention.
Detailed Description
The technical solutions in the embodiments of the present invention will be clearly and completely described below with reference to the drawings in the embodiments of the present invention, and it is obvious that the described embodiments are only a part of the embodiments of the present invention, and not all of the embodiments. All other embodiments, which can be derived from the embodiments given herein by one of ordinary skill in the art, are within the scope of the invention.
In order to more clearly describe the information superposition display method provided by the embodiment of the present invention, an exemplary application scenario of the information superposition display method provided by the embodiment of the present invention will be described below, it is to be understood that in other possible embodiments, the information superposition display method provided by the embodiment of the present invention may also be applied to other possible application scenarios, and the following example does not limit this.
In order to keep evidence of whether checkout is wrong or not, image acquisition equipment and image processing equipment can be arranged, wherein the image acquisition equipment is used for shooting video pictures of a checkout counter and transmitting the video pictures to the image processing equipment. The image processing device can acquire character information which is collected by the POS and used for representing commodity information from the POS of the cashier desk, and correspondingly stores the character information and the video pictures sent by image collection.
When the image processing device displays the video picture, the video picture and the corresponding character information can be displayed in a superposed mode, so that a user can browse the character information while watching the video picture, and since the commodity when the customer checks out can be determined through the video picture and the commodity information scanned by the cashier when checking out can be determined through the character information, the user can determine whether the check-out is wrong by comparing the video picture and the character information.
However, the video frames and the corresponding character information displayed in an overlapping manner occupy more system resources of the image processing device, and the more character information displayed in an overlapping manner occupies more system resources, while the total amount of the system resources of the image processing device is limited, so that the system resources are limited, and the image processing device can only overlap a certain amount of character information in a certain amount of video frames within a unit time. Therefore, when the video pictures in which the character information needs to be superimposed in the unit time are more than a certain number, or the total amount of the character information that needs to be superimposed in the video pictures is more than a certain number, the image processing apparatus cannot superimpose the character information in each video picture.
For example, it is assumed that the image processing apparatus superimposes 5120 lines of character information on a video screen at most per unit time, and superimposes character information within 320 video frames at most. And it is assumed that each image capturing device accessing the image processing device transmits 20 video frames to the image processing device within a unit time. The image processing apparatus superimposes character information on video frames captured by 16 image capturing apparatuses at the maximum and superimposes 16 lines of character information in each video frame at the maximum. When the number of the image capturing devices connected to the image processing device is more than 16, the image processing device cannot superimpose character information on the video frames captured by each image capturing device. For example, when 128 image capturing devices are connected to the image capturing device, the image processing device can superimpose character information on video frames captured by 16 of the image capturing devices.
Based on this, an embodiment of the present invention provides an information overlay display method, which is applied to an image processing device, where the image processing device in the present invention may refer to any electronic device with an image processing function, including but not limited to NVR (Network Video Recorder), DVR (Digital Video Recorder), XVR (hybrid Video Recorder), and the like.
Referring to fig. 1, fig. 1 is a schematic flow chart of an information superimposition display method according to an embodiment of the present invention, including:
and S101, acquiring character information acquired by the information acquisition equipment.
S102, according to the determined display position for displaying the character information, the character information and the position information for representing the display position are sent to image acquisition equipment, so that the image acquisition equipment can overlay the character information at the display position of the acquired video frame in a layer form, and an overlaid video frame is obtained.
And S103, acquiring the superposed video frame sent by the image acquisition equipment.
And S104, displaying the superposed video frame.
By adopting the embodiment, the superposed character information can be processed by the image acquisition equipment, the video frame received by the image processing equipment is the superposed video frame on which the character information is superposed, the display can be carried out based on the superposed video frame, and the character information is forwarded by only occupying less system resources of the image processing equipment, so that the system resources occupied by superposed display of the character information can be effectively reduced.
Taking the foregoing example as an example, since the system resources occupied by superimposing character information on video frames acquired by the image acquisition device are reduced, under the condition that the total amount of system resources of the image processing device is not changed, character information can be superimposed on more video frames within a unit time of the image acquisition device, and assuming that the number of video frames sent to the image acquisition device within a unit time of the image acquisition device is not changed, the image processing device can superimpose character information on video frames acquired by more image acquisition devices.
In S101, the information collecting device may refer to any electronic device that has an information collecting capability and can represent collected information in a character form, including but not limited to a POS, a USB scan gun, an RFID (Radio Frequency Identification) reader, a card reader, a velocimeter, and the like.
And the information acquisition device can acquire information in different modes according to different information acquisition devices. For example, if the information acquisition device is a POS, the POS may acquire a barcode on a commodity to obtain barcode information, determine commodity information corresponding to the barcode information obtained by scanning according to a correspondence between the barcode information and the commodity information, and express the commodity information obtained by the determination in the form of a character, thereby obtaining character information. For another example, if the information collecting device is a speedometer, the speedometer may collect positions of the same vehicle at a plurality of different times, determine the speed of the vehicle based on the positions of the vehicle at the plurality of different times, and express the determined speed in the form of characters, thereby obtaining character information.
The information represented by the different character information according to the type of the information acquisition equipment can be different, for example, when the information acquisition equipment is a POS, the character information can be commodity information scanned by a cashier, when the information acquisition equipment is a USB scanning gun, the character information can be express information obtained by scanning a bar code on an express parcel, when the information acquisition equipment is an RFID reader, the character information can be identity information of a vehicle on a road, when the information acquisition equipment is a card reader, the character information can be identity information of a person passing through a preset bayonet, and when the information acquisition equipment is a tachometer, the character information can be speed information of the vehicle on the road.
The acquired character information may be character information acquired by the information acquisition device in real time or character information acquired by the information acquisition device in a historical time period. And the type of the character used for representing the character information in the present application may be different according to the application scenario, and exemplary characters may include, but are not limited to, the following types of characters: characters, numbers, patterns and symbols.
In S102, the presentation position may be determined by the image processing apparatus or may be determined by an apparatus other than the image processing apparatus. For example, in one possible embodiment, the image processing device may determine to obtain the display position according to a preset character superimposition strategy, where the preset character superimposition strategy may be preset by a user according to actual needs, and for example, may superimpose character information in a video frame from top to bottom, from left to right.
The position information may be in the form of pixel coordinates showing the position in the video frame. The image capturing device may be any electronic device having an image capturing function, such as an IPC (Internet Protocol Camera).
The image processing apparatus may superimpose the character information in a layer form at a display position of the captured video frame in an OSD (on screen display).
In some possible application scenarios, in addition to character information, there may also be other text information in the superimposed video frame, for example text information indicating the time at which the video frame was captured. In order to distinguish between character information and other text information in the superimposed video frame, in one possible embodiment, the character information may be superimposed in the video frame in a form different from other text information, for example, the character information may be superimposed in the video frame in a form different from other text information in color and/or font, and for example, the character information may be superimposed in a different position of the video frame than other text information, and for example, the character information may be superimposed at the bottom of the video frame and the other text information may be superimposed at the top of the video frame, and the character information may be superimposed on the left side of the video frame and the other text information may be superimposed on the right side of the video frame.
According to different application scenes, the video frames acquired by the image acquisition equipment can be video frames acquired by the image acquisition equipment in real time or video frames acquired by the image acquisition equipment in a historical time period. The time when the image capturing device captures the video frame should match the time when the information capturing device captures the character information, for example, if the character information is captured by the information capturing device in real time, the video frame should be captured by the image capturing device in real time. And if the character information is acquired by the information acquisition device in a historical time period, the video frame should be acquired by the image acquisition device in the historical time period.
In S103, it can be understood that the superimposed video frame acquired by the image processing device is already superimposed with character information, so that the user can acquire the image information of the monitored scene and the information acquired by the information acquisition device by viewing the superimposed video frame, and therefore the character information does not need to be superimposed in the video frame by the image processing device.
Since the superimposed video frame contains the character information, in order to avoid leakage of the character information, in a possible embodiment, the image processing device may encapsulate the superimposed video frame according to a preset private protocol, so that only the electronic device provided with the private protocol can normally display the superimposed video frame, and the electronic device not provided with the private protocol cannot normally play the superimposed video frame even if acquiring the superimposed video frame.
It can be understood that the character information superimposed into the video frame by the image capturing device will also consume certain system resources, and if too many system resources are consumed due to the superimposed character information, the normal operation of the image capturing device may be affected.
Based on this, referring to fig. 2, fig. 2 is a schematic flow chart of an information superposition display method according to an embodiment of the present invention, in which character information acquired by an information acquisition device includes first character sub information and second character sub information. The information superposition display method can comprise the following steps:
s201, character information acquired by the information acquisition equipment is acquired.
S202, according to the determined first display position for displaying the first character sub-information, the first character sub-information and position information for representing the first display position are sent to image acquisition equipment, so that the image acquisition equipment can overlay the first character sub-information at the first display position of the acquired video frame in a layer form, and the overlaid video frame is obtained.
And S203, acquiring the superposed video frame sent by the image acquisition equipment.
And S204, displaying the superposed video frame and the second character sub-information in a superposed manner according to the determined second display position for displaying the second character sub-information, wherein the second character sub-information is displayed at the second display position.
By adopting the embodiment, the image acquisition equipment and the image processing equipment can respectively superimpose a part of character information in the video frame, thereby effectively reducing the system resources occupied by superimposing and displaying the character information and avoiding the phenomenon that the image acquisition equipment cannot normally operate because the character information is superimposed and the system resources are excessively consumed.
S201 is the same as S101, and reference may be made to the related description in S101, which is not repeated herein.
In S202 and S204, there may be an intersection between the first character sub information and the second character sub information, or there may be no intersection, and a union of the first character sub information and the second character sub information is character information. In one possible embodiment, to avoid repeated display, there is no intersection between the first character sub-information and the second character sub-information.
The first character sub-information and the second character sub-information may be obtained by dividing character information acquired by an information acquisition device, may be obtained by dividing character information by an image processing device, or may be obtained by dividing character information by other electronic devices having a character information dividing capability. The division manner may be different according to different application scenarios, for example, assuming that the character information includes 16 lines of characters, the method may be to divide N lines (for example, the first N lines) of characters into first character sub information, and divide the remaining 16-N lines of characters into second character sub information, where N may be any positive integer, such as 6, 7, 8, 9, and the like.
The determination manner of the first display position and the second display position may refer to the related description in the foregoing S102, and is not described herein again.
In S202, the manner in which the image capturing device superimposes the first character sub-information on the video frame may refer to the foregoing related description of S102, which is not described herein again.
In S204, it can be understood that only part of the character information is contained in the overlay video frame at this time, and therefore the image processing apparatus needs to overlay the remaining character information into the overlay video frame. Therefore, the image processing apparatus can display the superimposed video frame and the second character sub-information in a superimposed manner, and in order to enable the second character sub-information to constitute complete character information with the first character sub-information, the second character sub-information needs to be displayed at a second display position so as to correspond to the first character sub-information.
Referring to fig. 3, fig. 3 is a schematic flow chart of an information overlay display method according to an embodiment of the present invention, which may include:
s301, character information acquired by the information acquisition equipment is acquired.
The step is the same as S101, and reference may be made to the foregoing description about S101, which is not repeated herein.
S302, under the condition that the information amount of the character information is larger than a preset information amount threshold, according to the determined first display position for displaying the first character sub-information, the first character sub-information and position information for representing the first display position are sent to the image acquisition equipment, so that the image acquisition equipment superposes the first character sub-information on the first display position of the acquired video frame in a layer form, and the superposed video frame is obtained.
It can be understood that the larger the information amount of the character information is, the more system resources are consumed for superimposing the character information onto the video frame, and therefore when the information amount of the character information is larger than the preset threshold, it may be considered that the system resources of the image processing device are insufficient to support superimposing all the character information onto the video frame, and at this time, a part of the character information needs to be superimposed onto the video frame by the image capturing device.
And S303, acquiring the superposed video frame sent by the image acquisition equipment.
S304, displaying the superposed video frame and the second character sub-information in a superposed manner according to the determined second display position for displaying the second character sub-information, wherein the second character sub-information is displayed at the second display position.
S305, under the condition that the information quantity of the character information is not larger than a preset information quantity threshold value, the video frame, the first character sub-information and the second character sub-information collected by the image collecting device are displayed in an overlapping mode.
The first character information is displayed at the first display position, and the second character information is displayed at the second display position. It can be understood that, when the information amount of the character information is greater than the preset information amount threshold, it may be considered that the system resources of the image processing device are sufficient to support the superimposition of all the character information in the video frame, and at this time, it is not necessary to superimpose part of the character information in the video frame through the image capturing device. All character information can be superimposed in the video frame directly by the image processing device.
In a possible embodiment, after displaying the character information, a clear screen instruction may be further sent to the image capturing device whenever a preset clear screen condition is reached, so that the image capturing device terminates superimposing the character information on the display position of the captured video frame in a layer form, where the clear screen condition includes: the information acquisition equipment does not acquire new character information within a preset time length, or receives a preset control instruction.
After the image acquisition equipment terminates the superposition of the character information on the display position of the acquired video frame in the form of the layer, the character information will not be superposed in the video frame acquired subsequently by the image acquisition equipment. For example, it is assumed that, from time t1, the image capture device superimposes the first commodity information in a layer form on the display position of the captured video frame to obtain a superimposed video frame, and from time t2, the image capture device terminates superimposing the first commodity information in a layer form on the captured video frame. The time t2 is any time later than the time ti.
The image capture device sends the video frame of the image processing device with the first commodity information superimposed at the display position from the time t1 to the time t2, and after the time t2, the image capture device sends the video frame of the image processing device with the first commodity information no longer superimposed at the display position. That is, when the user views the video frame captured by the image capturing device within the time period from t1 to t2 through the image processing device, the first commodity information will be viewed at the display position, and when the user views the video frame captured by the image capturing device after the time period t2 through the image processing device, the first commodity information will not be viewed at the display position.
It is understood that, limited to the size of the display position, the performance of the image processing device, and other factors, the number of character information that can be displayed by the display position is limited, for example, in some possible scenarios, the display position can display 32 lines of commodity information at most, and if the first commodity information is 28 lines, if the image capture device continues to superimpose the first commodity information on the captured video frame in the form of a layer after time t2, when the image capture device captures more than 4 lines of second commodity information after time t2, the second commodity information cannot be completely superimposed on the display position because the display position is already superimposed with 28 lines of commodity information, so that the user cannot see the complete second commodity information.
And if the image capture device terminates overlaying the first commodity information in the form of a layer on the captured video frame after the time t2, even if the image capture device captures more than 4 lines of second commodity information after the time t2, the second commodity information can be completely overlaid to the display position without exceeding 32 lines of second commodity information, so that the user can view the complete second commodity information.
It can be seen that with this embodiment, the completeness of the displayed character information can be increased in a screen-clearing manner.
The preset time duration can be set according to actual requirements, and it can be understood that if the information acquisition device does not acquire new character information within the preset time duration, the character information acquired by the information acquisition device is theoretically already superposed in a plurality of continuous video frames acquired by the image acquisition device, and at this time, it can be considered that when a user watches videos acquired by the image acquisition device, there is sufficient time to browse the character information, so that the character information does not need to be continuously displayed in subsequent video frames, and therefore, the character information can be stopped being continuously superposed in the acquired video frames in a layer form at this time.
After the image acquisition device terminates the superposition of the character information on the display position of the acquired video frame in the form of the layer, the image acquisition device may remove the locally stored character information while retaining the locally stored position information, and when new character information sent by the image processing device is received again, the image acquisition device superposes the new character information on the display position represented by the locally stored position information in the form of the layer. The image acquisition equipment can also clear the locally stored character information and the position information at the same time. And the image processing device needs to send new position information when sending new character information to the image acquisition device again, and the image acquisition device superposes the new character information on the display position represented by the new position information in a layer form.
The preset control instruction may be input by a user, for example, the user may input a field to the image processing device through an input device local to the image processing device or through a remote access mode, and when the field input by the user is a preset end field, the image processing device determines that a preset operation instruction is received, so as to send a screen clearing instruction to the image capturing device.
In another possible embodiment, after acquiring a superimposed video frame sent by an image acquisition device, the character information and the superimposed video frame may also be correspondingly stored; when a retrieval instruction aiming at a target character is received, searching a target superposed video frame from the stored superposed video frames, wherein the character information corresponding to the target superposed video frame is matched with the target character; and displaying the video clip to which the target overlay video frame belongs, or displaying the target overlay video frame.
When the target superposed video frame is displayed, a playing control can be provided for the user, and when the user confirms that the target superposed video frame is the video frame which is interested by the user, the user can control the image processing equipment to continue playing from the target superposed video frame by interacting with the playing control.
By adopting the embodiment, the user can position the corresponding segment according to the target character, and the user can conveniently and quickly position the interested video segment from a large amount of video data.
For example, assuming that the user wishes to view the video clip when the commodity a is settled, a retrieval instruction including the commodity information of the commodity a may be input, and since the commodity information of the commodity a matches the character information acquired by the POS when the commodity a is settled, the superimposed video frame on which the commodity information of the commodity a is superimposed and displayed may be found according to the retrieval instruction, so as to locate the video clip when the commodity a is settled for the user.
It is understood that in some application scenarios, in addition to displaying character information in a video frame in an overlaid manner, a user needs to record information collected by an information collecting device in a designated information recording device, and the information recording device herein may refer to any electronic device with an information recording function, such as a personal computer. Illustratively, the user wishes to record the information collected by the information collecting device in a personal computer while displaying character information in a video frame in an overlapping manner, so as to facilitate later inquiry.
In the related art, image processing devices such as DVRs and NVRs often only support data input through a first type of interface (e.g., a serial port), while information recording devices such as personal computers often only can record information input through a second type of interface (USB), and the first type of interface and the second type of interface may be different.
Therefore, if the interface for outputting the acquired information in the information acquisition apparatus is the first type of interface, the output information cannot be recorded in the information recording apparatus. And if the interface used for outputting the acquired information in the information acquisition equipment is the second type interface, the output information cannot be normally superposed into the video picture by the image processing equipment. For example, when the information collecting device is a scanning gun, if the scanning gun is a USB scanning gun, the USB scanning gun outputs a signal using a USB protocol, that is, an interface through which the USB scanning gun outputs the collected information is a second type of interface, and at this time, the USB scanning gun cannot input the collected information to image processing devices such as a DVR and an NVR. If the scanning gun is a scanning gun supporting serial port protocol output, namely the interface of the scanning gun outputting the collected information is a first-class interface, at the moment, because the signal output by the scanning gun is serial port data, the signal cannot be directly recorded by information recording equipment such as a personal computer and the like.
Based on this, an embodiment of the present invention provides an information superimposition display method, which may be as shown in fig. 4, and includes:
s401, the information acquisition equipment acquires information and inputs the acquired information to the information recording equipment.
The information acquisition equipment is connected with the information recording equipment through a second type of interface. Taking the information acquisition device as a USB scanning gun as an example, the USB scanning gun can be used to scan a barcode so that the USB scanning gun scans to obtain barcode data, and the barcode can be a barcode on a commodity, a barcode on an express package, or other barcodes without any limitation to this embodiment.
S402, the information recording device generates a document based on the information collected by the information collecting device.
The format of the document may be different according to different application scenarios, and for example, the document may be in a word format, an excel format, or a txt format, which is not limited in this embodiment. And because the document is generated based on the information collected by the information collection device, the document can be used to record the information collected by the information collection device.
S403, the information recording device extracts characters in the document to obtain character information.
The character information may be obtained by extracting characters in a document by an application installed in advance in the information recording apparatus. And in one possible embodiment, in order to enable the application program to accurately extract the character information, a document identifier may be configured for the application program, the document identifier is used for identifying the document, so that the application program can accurately acquire the document according to the configured document identifier, and the document identifier may include a file name and/or a storage path of the document.
S404, the information recording apparatus transmits the character information to the image processing apparatus.
The aforementioned application program may send the extracted character information to the image processing apparatus after extracting the character information. And in order to enable the application program to accurately transmit the extracted character information to the image processing apparatus, a destination IP address, which is an IP address of the image processing apparatus, and a destination port, which is a port used for connecting the image processing apparatus and the information recording apparatus, may be configured for the application program.
Also, in one possible embodiment, the transmission interval may be further configured for the application program such that the application program transmits the extracted character information to the image processing apparatus in batches at the configured transmission interval.
S405, the image processing apparatus acquires character information transmitted by the information recording apparatus.
In a possible embodiment, the image processing apparatus may further obtain authentication information sent by the information recording apparatus, authenticate the information recording apparatus based on the authentication information, receive character information sent by the information recording apparatus if the information recording apparatus passes the authentication, and reject to receive character information sent by the information recording apparatus and disconnect the connection with the information recording apparatus if the information recording apparatus does not pass the authentication.
The authentication information and the authentication method may be different according to different application scenarios, and this embodiment does not limit this. For example, the authentication information may include a user name to be authenticated and a user password, the image processing apparatus may determine whether the user name to be authenticated in the authentication information is a user name of a valid user, and whether the user password is matched with the user name to be authenticated, determine that the information recording apparatus passes authentication if the user name to be authenticated is the user name of the valid user, and the user password is matched with the user name to be authenticated, and determine that the information recording apparatus fails authentication if the user name to be authenticated is not the user name of the valid user, or the user password is not matched with the user name to be authenticated.
S406, the image processing device sends the character information and the position information used for representing the display position to the image acquisition device according to the determined display position used for displaying the character information, so that the image acquisition device can overlay the character information at the display position of the acquired video frame in a layer form to obtain an overlaid video frame.
The step is the same as the step S102, and reference may be made to the related description of the step S102, which is not described herein again.
S407, the image processing device acquires the superposed video frame sent by the image acquisition device.
The step is the same as S103, and reference may be made to the related description of S103, which is not described herein again.
S408, the image processing equipment displays the superposed video frame.
The step is the same as the step S104, and reference may be made to the related description of the step S104, which is not described herein again.
By adopting the embodiment, the character information in the document is extracted by the information recording equipment, so that the information collected by the information collecting equipment can be superposed and displayed in the video frame while the information recording equipment can record the information collected by the information collecting equipment.
And in one possible embodiment, the video frames may also be presented by the platform. For example, the image processing device may obtain a video collected by the image collecting device from an image collecting device, such as an IPC, and send the obtained video and the character information to the platform in a code stream form according to a specified network protocol. The platform obtains character information and video by analyzing the code stream, and displays the obtained character information in the obtained video in an overlapping mode. And when the platform displays the video, the obtained character information can be displayed in a superposed manner in the video, and the information of the image acquisition equipment, the information of the image processing equipment, the information used for indicating the time when the image acquisition equipment acquires the information and the like can be displayed. The information of the image acquisition device may include information such as a name and a number of the image acquisition device, and the information of the image processing device may include information such as a name and a number of the image processing device.
As shown in fig. 5, an information superposition display system according to an embodiment of the present invention may include an image processing device 501, an image capturing device 502, and an information capturing device 503.
The information acquisition device 503 is configured to acquire character information;
the image processing device 501 is configured to send the character information and the position information indicating the display position to the image capturing device 502 according to the determined display position for displaying the character information;
the image collecting device 502 is configured to superimpose the character information on the display position of the collected video frame in a layer form to obtain a superimposed video frame; and sends the superimposed video frame to the image processing device 501;
the image processing device 501 is further configured to display the overlay video frame.
In a possible embodiment, the information collecting device 503 is specifically configured to collect first character sub information and second character sub information;
the image processing device 501 is specifically configured to send the first character sub-information and position information used for representing the first display position to the image acquisition device 502 according to the determined first display position used for displaying the first character sub-information;
the image capturing device 502 is specifically configured to superimpose the first character sub-information at the first display position of the captured video frame in a layer form, so as to obtain a superimposed video frame; and sends the superimposed video frame to the image processing device 501;
the image capturing device 502 is specifically configured to display the overlay video frame and the second character sub-information in an overlay manner according to a determined second display position for displaying the second character sub-information, where the second character sub-information is displayed at the second display position.
By adopting the embodiment, the superposed character information can be processed by the image acquisition equipment, the video frame received by the image processing equipment is the superposed video frame on which the character information is superposed, the display can be carried out based on the superposed video frame, and the character information is forwarded by only occupying less system resources of the image processing equipment, so that the system resources occupied by superposed display of the character information can be effectively reduced.
In a possible embodiment, the image processing apparatus 501 is specifically configured to, when the information amount of the character information is greater than a preset information amount threshold, send the first character sub-information and position information indicating the first display position to the image acquisition apparatus 502 according to the determined first display position for displaying the first character sub-information;
under the condition that the information amount of the character information is larger than a preset information amount threshold value, displaying the superposed video frame and the second character sub-information in a superposed manner according to a determined second display position for displaying the second character sub-information, wherein the second character sub-information is displayed at the second display position;
the image processing apparatus 501 is further configured to display the video frame, the first character sub-information, and the second character sub-information collected by the image collecting apparatus in an overlapping manner under the condition that the information amount of the character information is not greater than a preset information amount threshold, where the first character sub-information is displayed at the first display position, and the second character sub-information is displayed at the second display position.
In a possible embodiment, the image processing apparatus 501 is further configured to send a screen clearing instruction to the image capturing apparatus each time a preset screen clearing condition is reached;
the image acquisition device 502 is further configured to receive the screen clearing instruction; stopping overlaying the character information on the display position of the acquired video frame in a layer form;
wherein the screen clearing condition comprises:
the information collecting device 503 does not collect new character information within a preset time length, or receives a preset control instruction.
In a possible embodiment, the image processing apparatus 501 is further configured to correspondingly store the character information and the superimposed video frame; when a retrieval instruction aiming at a target character is received, searching a target superposed video frame from the stored superposed video frames, wherein the character information corresponding to the target superposed video frame is matched with the target character; and displaying the video clip to which the target superposition video frame belongs, or displaying the target superposition video frame.
In a possible embodiment, the system further comprises an information recording device;
the information recording device is used for receiving the information acquired by the information acquisition device, generating a document based on the information acquired by the information acquisition device, and extracting characters in the document to obtain the character information; and sending the character information to the image processing device;
the image processing device 501 is specifically configured to acquire character information sent by the information recording device.
Referring to fig. 6, fig. 6 is a schematic flow chart of an information superposition display method applied to an image capturing device according to an embodiment of the present invention, where the method may include:
s601, acquiring character information sent by the image processing equipment and position information used for representing a display position, wherein the display position is the position used for displaying the character information which is obtained by determination, and the character information is acquired by the information acquisition equipment.
And S602, overlapping the character information at the display position of the acquired video frame to obtain an overlapped video frame.
S603, sending the superimposed video frame to the image processing apparatus, so that the image processing apparatus displays the superimposed video frame.
By adopting the embodiment, the superposed character information can be processed by the image acquisition equipment, the video frame received by the image processing equipment is the superposed video frame on which the character information is superposed, the display can be carried out based on the superposed video frame, and the character information is forwarded by only occupying less system resources of the image processing equipment, so that the system resources occupied by superposed display of the character information can be effectively reduced.
In a possible embodiment, the character information collected by the information collecting device includes: first character sub information and second character sub information;
the acquiring of the character information and the position information used for representing the display position sent by the image processing device comprises:
acquiring the first character sub-information and position information used for representing a first display position, which are sent by image processing equipment;
the overlaying the character information at the display position of the collected video frame to obtain an overlaid video frame comprises:
superposing the first character sub-information on the first display position of the acquired video frame in a layer form to obtain a superposed video frame;
the sending the overlay video frame to the image processing device to enable the image processing device to display the overlay video frame includes:
and sending the superposed video frame to the image processing equipment, so that the image processing equipment superposes and displays the superposed video frame and the second character sub-information according to the determined second display position for displaying the second character sub-information, wherein the second character sub-information is displayed at the second display position.
In a possible embodiment, the method further comprises:
receiving a screen clearing instruction sent by the image processing equipment, wherein the screen clearing instruction is sent when the image processing equipment meets a preset screen clearing condition;
stopping overlaying the character information on the display position of the acquired video frame in a layer form;
wherein the screen clearing condition comprises:
the information acquisition equipment does not acquire new character information within a preset time length, or receives a preset control instruction.
In a possible embodiment, after the terminating superimposing the character information in an image layer form on the display position of the captured video frame, the method further includes:
locally storing the location information at the image capture device;
and when new character information sent by the image processing equipment is received, the new character information is superposed at the display position of the acquired video frame according to the display position represented by the stored position information.
Referring to fig. 7, fig. 7 is a schematic structural diagram of an information superposition display device applied to an image processing apparatus according to an embodiment of the present invention, which may include:
a character information acquisition module 701, configured to acquire character information acquired by the information acquisition device;
an information issuing module 702, configured to send the character information and position information used for representing the display position to an image acquisition device according to the determined display position used for displaying the character information, so that the image acquisition device superimposes the character information at the display position of the acquired video frame in a layer form to obtain a superimposed video frame;
a video frame acquiring module 703, configured to acquire a superimposed video frame sent by the image capturing device;
and a preview module 704 for displaying the overlay video frame.
In one possible embodiment, the character information includes: first character sub information and second character sub information;
the information issuing module 702 sends the character information and the position information used for representing the display position to image acquisition equipment according to the determined display position used for displaying the character information, so that the image acquisition equipment superimposes the character information at the display position of the acquired video frame in a layer form to obtain a superimposed video frame, including:
according to a determined first display position for displaying the first character sub-information, sending the first character sub-information and position information for representing the first display position to image acquisition equipment, so that the image acquisition equipment superposes the first character sub-information on the first display position of an acquired video frame in a layer form to obtain a superposed video frame;
the preview module 704 displays the overlaid video frames, including:
displaying the superposed video frame and the second character sub-information in a superposed manner according to a determined second display position for displaying the second character sub-information, wherein the second character sub-information is displayed at the second display position;
the information issuing module 702 sends the first character sub-information and the position information used for representing the first display position to image acquisition equipment according to the determined first display position used for displaying the first character sub-information, and the information issuing module includes:
under the condition that the information amount of the character information is larger than a preset information amount threshold value, according to a determined first display position for displaying the first character sub-information, sending the first character sub-information and position information for representing the first display position to image acquisition equipment;
the previewing module 704 displays the overlay video frame and the second character sub-information in an overlay manner according to the determined second display position for displaying the second character sub-information, where the second character sub-information is displayed at the second display position, including:
under the condition that the information amount of the character information is larger than a preset information amount threshold value, displaying the superposed video frame and the second character sub-information in a superposed manner according to a determined second display position for displaying the second character sub-information, wherein the second character sub-information is displayed at the second display position;
the preview module 704 is further configured to display, in a superimposed manner, the video frame, the first character sub-information, and the second character sub-information acquired by the image acquisition device when the information amount of the character information is not greater than a preset information amount threshold, where the first character sub-information is displayed at the first display position, and the second character sub-information is displayed at the second display position;
the device also comprises a screen clearing module used for sending a screen clearing instruction to the image acquisition equipment when a preset screen clearing condition is reached so that the image acquisition equipment stops superposing the character information on the display position of the acquired video frame in a layer form;
wherein the screen clearing condition comprises:
the information acquisition equipment does not acquire new character information within a preset time length, or receives a preset control instruction;
the device comprises a skipping module, a display module and a display module, wherein the skipping module is used for correspondingly storing the character information and the superposed video frame;
when a retrieval instruction aiming at a target character is received, searching a target superposed video frame from the stored superposed video frames, wherein the character information corresponding to the target superposed video frame is matched with the target character;
displaying the video clip to which the target superposition video frame belongs, or displaying the target superposition video frame;
the character information obtaining module 701 obtains character information collected by information collecting equipment, and includes:
the method comprises the steps of obtaining character information sent by information recording equipment, wherein the information recording equipment is used for receiving information collected by information collecting equipment, generating a document based on the information collected by the information collecting equipment, and extracting characters in the document to obtain the character information.
Referring to fig. 8, fig. 8 is a schematic structural diagram of an information superposition display device applied to an image capturing apparatus according to an embodiment of the present invention, where the information superposition display device may include:
an issued information acquisition module 801, configured to acquire character information sent by an image processing device and position information used for representing a display position, where the display position is a position determined to be used for displaying the character information, and the character information is acquired by an information acquisition device;
the layer overlaying module 802 is configured to overlay the character information at the display position of the acquired video frame to obtain an overlaid video frame;
an information uploading module 803, configured to send the overlay video frame to the image processing apparatus, so that the image processing apparatus displays the overlay video frame.
In a possible embodiment, the issued information obtaining module 801 is further configured to receive a screen clearing instruction sent by the image processing device, where the screen clearing instruction is sent when the image processing device meets a preset screen clearing condition;
the layer overlaying module 802 is further configured to terminate overlaying the character information on the display position of the acquired video frame in a layer form after receiving the screen clearing instruction;
wherein the screen clearing condition comprises:
the information acquisition equipment does not acquire new character information within a preset time length, or receives a preset control instruction;
the layer overlay module 802 is further configured to locally store the location information in the image capturing device; and when new character information sent by the image processing equipment is received, the new character information is superposed at the display position of the acquired video frame according to the display position represented by the stored position information.
An embodiment of the present invention further provides an image processing apparatus, as shown in fig. 9, including:
a first memory 901 for storing a computer program;
the first processor 902 is configured to implement the following steps when executing the program stored in the first memory 901:
acquiring character information acquired by information acquisition equipment;
according to the determined display position for displaying the character information, sending the character information and position information for representing the display position to image acquisition equipment, so that the image acquisition equipment superposes the character information on the display position of the acquired video frame in a layer form to obtain a superposed video frame;
acquiring a superposed video frame sent by the image acquisition equipment;
and displaying the superposed video frame.
An embodiment of the present invention further provides an image capturing apparatus, as shown in fig. 10, including:
a second memory 1001 for storing a computer program;
the second processor 1002 is configured to implement the following steps when executing the program stored in the second memory 1001:
acquiring character information sent by image processing equipment and position information used for representing a display position, wherein the display position is a position which is obtained by determination and used for displaying the character information, and the character information is acquired by information acquisition equipment;
superposing the character information on the display position of the collected video frame to obtain a superposed video frame;
and sending the overlay video frame to the image processing equipment so that the image processing equipment displays the overlay video frame.
The Memory mentioned in the image processing device and the image capturing device may include a Random Access Memory (RAM) or a Non-Volatile Memory (NVM), such as at least one disk Memory. Optionally, the memory may also be at least one memory device located remotely from the processor.
The Processor may be a general-purpose Processor, including a Central Processing Unit (CPU), a Network Processor (NP), and the like; but also Digital Signal Processors (DSPs), Application Specific Integrated Circuits (ASICs), Field Programmable Gate Arrays (FPGAs) or other Programmable logic devices, discrete Gate or transistor logic devices, discrete hardware components.
In another embodiment of the present invention, a computer-readable storage medium is further provided, in which a computer program is stored, and the computer program, when executed by a processor, implements the steps of any of the above-mentioned information superposition display methods.
In another embodiment of the present invention, there is also provided a computer program product containing instructions, which when run on a computer, causes the computer to execute any one of the above-mentioned information superimposition display methods.
In the above embodiments, all or part of the implementation may be realized by software, hardware, firmware, or any combination thereof. When implemented in software, may be implemented in whole or in part in the form of a computer program product. The computer program product includes one or more computer instructions. When loaded and executed on a computer, cause the processes or functions described in accordance with the embodiments of the invention to occur, in whole or in part. The computer may be a general purpose computer, a special purpose computer, a network of computers, or other programmable device. The computer instructions may be stored in a computer readable storage medium or transmitted from one computer readable storage medium to another, for example, from one website site, computer, server, or data center to another website site, computer, server, or data center via wired (e.g., coaxial cable, fiber optic, Digital Subscriber Line (DSL)) or wireless (e.g., infrared, wireless, microwave, etc.). The computer-readable storage medium can be any available medium that can be accessed by a computer or a data storage device, such as a server, a data center, etc., that incorporates one or more of the available media. The usable medium may be a magnetic medium (e.g., floppy Disk, hard Disk, magnetic tape), an optical medium (e.g., DVD), or a semiconductor medium (e.g., Solid State Disk (SSD)), among others.
It is noted that, herein, relational terms such as first and second, and the like may be used solely to distinguish one entity or action from another entity or action without necessarily requiring or implying any actual such relationship or order between such entities or actions. Also, the terms "comprises," "comprising," or any other variation thereof, are intended to cover a non-exclusive inclusion, such that a process, method, article, or apparatus that comprises a list of elements does not include only those elements but may include other elements not expressly listed or inherent to such process, method, article, or apparatus. Without further limitation, an element defined by the phrase "comprising an … …" does not exclude the presence of other identical elements in a process, method, article, or apparatus that comprises the element.
All the embodiments in the present specification are described in a related manner, and the same and similar parts among the embodiments may be referred to each other, and each embodiment focuses on the differences from the other embodiments. In particular, for embodiments of the system, the apparatus, the image processing device, the image acquisition device, the computer-readable storage medium, and the computer program product, since they are substantially similar to the method embodiments, the description is relatively simple, and in relation to the description, reference may be made to some of the description of the method embodiments.
The above description is only for the preferred embodiment of the present invention, and is not intended to limit the scope of the present invention. Any modification, equivalent replacement, or improvement made within the spirit and principle of the present invention shall fall within the protection scope of the present invention.

Claims (20)

1. An information superposition display method, which is applied to an image processing device, the method comprising:
acquiring character information acquired by information acquisition equipment;
according to the determined display position for displaying the character information, sending the character information and position information for representing the display position to image acquisition equipment, so that the image acquisition equipment superposes the character information on the display position of the acquired video frame in a layer form to obtain a superposed video frame;
acquiring a superposed video frame sent by the image acquisition equipment;
displaying the overlay video frame;
the character information includes: first character sub information and second character sub information; the union of the first character sub-information and the second character sub-information is the character information;
the step of sending the character information and the position information used for representing the display position to image acquisition equipment according to the determined display position used for displaying the character information so that the image acquisition equipment can overlay the character information at the display position of the acquired video frame in a layer form to obtain an overlaid video frame includes:
according to the determined first display position for displaying the first character sub-information, sending the first character sub-information and position information for representing the first display position to image acquisition equipment, so that the image acquisition equipment superimposes the first character sub-information on the first display position of the acquired video frame in a layer form to obtain a superimposed video frame;
the displaying the overlay video frame includes:
and displaying the superposed video frame and the second character sub-information in a superposed manner according to the determined second display position for displaying the second character sub-information, wherein the second character sub-information is displayed at the second display position.
2. The method according to claim 1, wherein the sending the first character sub-information and the position information for representing the first display position to an image acquisition device according to the determined first display position for displaying the first character sub-information comprises:
under the condition that the information amount of the character information is larger than a preset information amount threshold value, according to a determined first display position for displaying the first character sub-information, sending the first character sub-information and position information for representing the first display position to image acquisition equipment;
displaying the overlaid video frame and the second character sub-information in an overlaid manner according to the determined second display position for displaying the second character sub-information, wherein the displaying of the second character sub-information in the second display position comprises:
under the condition that the information amount of the character information is larger than a preset information amount threshold value, displaying the superposed video frame and the second character sub-information in a superposed manner according to a determined second display position for displaying the second character sub-information, wherein the second character sub-information is displayed at the second display position;
the method further comprises the following steps:
and under the condition that the information quantity of the character information is not larger than a preset information quantity threshold value, displaying the video frame acquired by the image acquisition equipment, the first character sub-information and the second character sub-information in an overlapping mode, wherein the first character sub-information is displayed at the first display position, and the second character sub-information is displayed at the second display position.
3. The method of claim 1, wherein after said presenting the overlay video frame, the method further comprises:
when a preset screen clearing condition is met, sending a screen clearing instruction to the image acquisition equipment so that the image acquisition equipment stops superposing the character information on the display position of the acquired video frame in a layer form;
wherein the screen clearing condition comprises:
the information acquisition equipment does not acquire new character information within a preset time length, or receives a preset control instruction.
4. The method of claim 1, further comprising:
correspondingly storing the character information and the superposed video frame;
when a retrieval instruction aiming at a target character is received, searching a target superposed video frame from the stored superposed video frames, wherein the character information corresponding to the target superposed video frame is matched with the target character;
and displaying the video clip to which the target superposition video frame belongs, or displaying the target superposition video frame.
5. The method according to claim 1, wherein the obtaining of the character information collected by the information collecting device comprises:
the method comprises the steps of obtaining character information sent by information recording equipment, wherein the information recording equipment is used for receiving information collected by information collecting equipment, generating a document based on the information collected by the information collecting equipment, and extracting characters in the document to obtain the character information.
6. An information superposition display method is applied to an image acquisition device, and comprises the following steps:
acquiring character information sent by image processing equipment and position information used for representing a display position, wherein the display position is a position which is obtained by determination and used for displaying the character information, and the character information is acquired by information acquisition equipment;
superposing the character information on the display position of the collected video frame to obtain a superposed video frame;
sending the overlay video frame to the image processing device so that the image processing device displays the overlay video frame;
the character information collected by the information collecting device comprises: first character sub information and second character sub information; the union of the first character sub-information and the second character sub-information is the character information;
the acquiring of the character information and the position information for representing the display position sent by the image processing device comprises:
acquiring the first character sub-information and position information used for representing a first display position, which are sent by image processing equipment;
the overlaying the character information at the display position of the collected video frame to obtain an overlaid video frame comprises:
superposing the first character sub-information on the first display position of the acquired video frame in a layer form to obtain a superposed video frame;
the sending the overlay video frame to the image processing device to enable the image processing device to display the overlay video frame includes:
and sending the superposed video frame to the image processing equipment, so that the image processing equipment superposes and displays the superposed video frame and the second character sub-information according to the determined second display position for displaying the second character sub-information, wherein the second character sub-information is displayed at the second display position.
7. The method of claim 6, further comprising:
receiving a screen clearing instruction sent by the image processing equipment, wherein the screen clearing instruction is sent when the image processing equipment reaches a preset screen clearing condition;
stopping overlaying the character information on the display position of the acquired video frame in a layer form;
wherein the screen clearing condition comprises:
the information acquisition equipment does not acquire new character information within a preset time length, or receives a preset control instruction.
8. The method according to claim 7, wherein after said terminating superimposing said character information in an image layer form on said presentation position of said captured video frame, said method further comprises:
locally storing the location information at the image capture device;
and when new character information sent by the image processing equipment is received, the new character information is superposed at the display position of the acquired video frame according to the display position represented by the stored position information.
9. An information overlay display system, the system comprising: the system comprises an image processing device, an image acquisition device and an information acquisition device;
the information acquisition equipment is used for acquiring character information;
the image processing device is used for sending the character information and the position information used for representing the display position to the image acquisition device according to the determined display position used for displaying the character information;
the image acquisition equipment is used for superposing the character information on the display position of the acquired video frame in a layer form to obtain a superposed video frame; sending the superposed video frame to the image processing equipment;
the image processing device is further configured to display the overlay video frame;
the information acquisition equipment is specifically used for acquiring first character sub-information and second character sub-information; the union of the first character sub-information and the second character sub-information is the character information;
the image processing device is specifically configured to send the first character sub-information and position information used for representing the first display position to an image acquisition device according to the determined first display position used for displaying the first character sub-information;
the image acquisition device is specifically configured to superimpose the first character sub-information at the first display position of the acquired video frame in a layer form to obtain a superimposed video frame; sending the superposed video frame to the image processing equipment;
the image acquisition device is specifically configured to display the overlay video frame and the second character sub-information in an overlay manner according to a determined second display position for displaying the second character sub-information, where the second character sub-information is displayed at the second display position.
10. The system according to claim 9, wherein the image processing device is specifically configured to, in a case that an information amount of the character information is greater than a preset information amount threshold, send the first character sub-information and position information indicating the first display position to an image capturing device according to a determined first display position for displaying the first character sub-information;
under the condition that the information amount of the character information is larger than a preset information amount threshold value, displaying the superposed video frame and the second character sub-information in a superposed manner according to a determined second display position for displaying the second character sub-information, wherein the second character sub-information is displayed at the second display position;
and the image processing device is further configured to display the video frame, the first character sub-information and the second character sub-information acquired by the image acquisition device in an overlapping manner under the condition that the information amount of the character information is not greater than a preset information amount threshold, where the first character sub-information is displayed at the first display position, and the second character sub-information is displayed at the second display position.
11. The system of claim 9, wherein the image processing device is further configured to send a screen clearing instruction to the image capturing device whenever a preset screen clearing condition is reached;
the image acquisition equipment is also used for receiving the screen clearing instruction; stopping overlaying the character information on the display position of the acquired video frame in a layer form;
wherein the screen clearing condition comprises:
the information acquisition equipment does not acquire new character information within a preset time length, or receives a preset control instruction.
12. The system of claim 9, wherein the image processing device is further configured to correspondingly save the character information and the overlay video frame; when a retrieval instruction aiming at a target character is received, searching a target superposed video frame from the stored superposed video frames, wherein the character information corresponding to the target superposed video frame is matched with the target character; and displaying the video clip to which the target superposition video frame belongs, or displaying the target superposition video frame.
13. The system of claim 9, further comprising an information recording device;
the information recording device is used for receiving the information acquired by the information acquisition device, generating a document based on the information acquired by the information acquisition device, and extracting characters in the document to obtain the character information; and sending the character information to the image processing device;
the image processing device is specifically configured to acquire character information sent by the information recording device.
14. An information superimposition display device, which is applied to an image processing apparatus, comprising:
the character information acquisition module is used for acquiring character information acquired by the information acquisition equipment;
the information issuing module is used for sending the character information and the position information used for representing the display position to image acquisition equipment according to the determined display position used for displaying the character information, so that the image acquisition equipment superposes the character information on the display position of the acquired video frame in a layer form to obtain a superposed video frame;
the video frame acquisition module is used for acquiring a superposed video frame sent by the image acquisition equipment;
the preview module is used for displaying the superposed video frames;
the character information includes: first character sub information and second character sub information; the union of the first character sub-information and the second character sub-information is the character information;
the information issuing module sends the character information and the position information used for representing the display position to image acquisition equipment according to the determined display position used for displaying the character information, so that the image acquisition equipment superposes the character information on the display position of the acquired video frame in a layer form to obtain a superposed video frame, and the method comprises the following steps:
according to a determined first display position for displaying the first character sub-information, sending the first character sub-information and position information for representing the first display position to image acquisition equipment, so that the image acquisition equipment superposes the first character sub-information on the first display position of an acquired video frame in a layer form to obtain a superposed video frame;
the preview module displays the overlay video frame, including:
and displaying the superposed video frame and the second character sub-information in a superposed manner according to the determined second display position for displaying the second character sub-information, wherein the second character sub-information is displayed at the second display position.
15. The apparatus according to claim 14, wherein the information issuing module sends the first character sub-information and the position information indicating the first display position to an image capturing device according to the determined first display position for displaying the first character sub-information, and includes:
under the condition that the information amount of the character information is larger than a preset information amount threshold value, according to a determined first display position for displaying the first character sub-information, sending the first character sub-information and position information for representing the first display position to image acquisition equipment;
the previewing module displays the overlay video frame and the second character sub-information in an overlay manner according to the determined second display position for displaying the second character sub-information, wherein the second character sub-information is displayed at the second display position, and the method comprises the following steps:
under the condition that the information amount of the character information is larger than a preset information amount threshold value, displaying the superposed video frame and the second character sub-information in a superposed manner according to a determined second display position for displaying the second character sub-information, wherein the second character sub-information is displayed at the second display position;
the preview module is further configured to display, in a superimposed manner, the video frame, the first character sub-information and the second character sub-information acquired by the image acquisition device under the condition that the information amount of the character information is not greater than a preset information amount threshold, where the first character sub-information is displayed at the first display position and the second character sub-information is displayed at the second display position;
the device also comprises a screen clearing module used for sending a screen clearing instruction to the image acquisition equipment when a preset screen clearing condition is reached so that the image acquisition equipment stops superposing the character information on the display position of the acquired video frame in a layer form;
wherein the screen clearing condition comprises:
the information acquisition equipment does not acquire new character information within a preset time length, or receives a preset control instruction;
the device comprises a skipping module, a display module and a display module, wherein the skipping module is used for correspondingly storing the character information and the superposed video frame;
when a retrieval instruction aiming at a target character is received, searching a target superposed video frame from the stored superposed video frames, wherein the character information corresponding to the target superposed video frame is matched with the target character;
displaying the video clip to which the target superposition video frame belongs, or displaying the target superposition video frame;
the character information acquisition module acquires character information acquired by the information acquisition equipment, and comprises:
the method comprises the steps of obtaining character information sent by information recording equipment, wherein the information recording equipment is used for receiving information collected by information collecting equipment, generating a document based on the information collected by the information collecting equipment, and extracting characters in the document to obtain the character information.
16. An information superposition display device, characterized in that the device is applied to an image acquisition device, and the device comprises:
the system comprises an issued information acquisition module, a display module and an information acquisition module, wherein the issued information acquisition module is used for acquiring character information sent by image processing equipment and position information used for representing a display position, the display position is a position which is obtained by determination and used for displaying the character information, and the character information is acquired by information acquisition equipment;
the layer overlapping module is used for overlapping the character information at the display position of the acquired video frame to obtain an overlapped video frame;
the information uploading module is used for sending the superposed video frame to the image processing equipment so that the image processing equipment can display the superposed video frame;
the character information collected by the information collecting device comprises: first character sub information and second character sub information; the union of the first character sub-information and the second character sub-information is the character information;
the acquiring of the character information and the position information for representing the display position sent by the image processing device comprises:
acquiring the first character sub-information and position information used for representing a first display position, which are sent by image processing equipment;
the overlaying the character information at the display position of the collected video frame to obtain an overlaid video frame comprises:
superposing the first character sub-information on the first display position of the acquired video frame in a layer form to obtain a superposed video frame;
the sending the overlay video frame to the image processing device to enable the image processing device to display the overlay video frame includes:
and sending the superposed video frame to the image processing equipment, so that the image processing equipment superposes and displays the superposed video frame and the second character sub-information according to the determined second display position for displaying the second character sub-information, wherein the second character sub-information is displayed at the second display position.
17. The apparatus according to claim 16, wherein the delivered information acquiring module is further configured to receive a screen clearing instruction sent by the image processing device, where the screen clearing instruction is sent when the image processing device meets a preset screen clearing condition;
the layer overlapping module is further configured to terminate the overlapping of the character information at the display position of the acquired video frame in a layer form after receiving the screen clearing instruction;
wherein the screen clearing condition comprises:
the information acquisition equipment does not acquire new character information within a preset time length, or receives a preset control instruction;
the layer superposition module is also used for locally storing the position information in the image acquisition equipment; and when new character information sent by the image processing equipment is received, the new character information is superposed at the display position of the acquired video frame according to the display position represented by the stored position information.
18. An image processing apparatus characterized by comprising:
a first memory for storing a computer program;
a first processor arranged to implement the method steps of any of claims 1 to 5 when executing a program stored in a memory.
19. An image acquisition apparatus, characterized by comprising:
a second memory for storing a computer program;
a second processor arranged to perform the method steps of any of claims 6 to 8 when executing the program stored in the memory.
20. A computer-readable storage medium, in which a computer program is stored which, when being executed by a processor, carries out the method steps of any one of claims 1 to 5 or 6 to 8.
CN202110644459.5A 2021-06-09 2021-06-09 Information superposition display method, device and system and image processing equipment Active CN113382167B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN202110644459.5A CN113382167B (en) 2021-06-09 2021-06-09 Information superposition display method, device and system and image processing equipment

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN202110644459.5A CN113382167B (en) 2021-06-09 2021-06-09 Information superposition display method, device and system and image processing equipment

Publications (2)

Publication Number Publication Date
CN113382167A CN113382167A (en) 2021-09-10
CN113382167B true CN113382167B (en) 2022-08-05

Family

ID=77573374

Family Applications (1)

Application Number Title Priority Date Filing Date
CN202110644459.5A Active CN113382167B (en) 2021-06-09 2021-06-09 Information superposition display method, device and system and image processing equipment

Country Status (1)

Country Link
CN (1) CN113382167B (en)

Family Cites Families (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
DE102009054000A1 (en) * 2009-11-19 2011-05-26 Schoeller Holding Gmbh Apparatus for image recording and display of objects, in particular digital binoculars, digital cameras or digital video cameras
CN104113732B (en) * 2014-07-18 2018-04-13 董瑞姝 POS machine monitors the monitoring method of dedicated video camera
CN109168034B (en) * 2018-08-28 2020-04-28 百度在线网络技术(北京)有限公司 Commodity information display method and device, electronic equipment and readable storage medium
CN110636259B (en) * 2019-09-10 2021-03-02 杭州亿圣信息技术有限公司 OSD (on-screen display) superposition method based on video detection
CN112261420B (en) * 2020-09-30 2022-07-01 北京市商汤科技开发有限公司 Live video processing method and related device
CN112861104A (en) * 2021-03-24 2021-05-28 重庆度小满优扬科技有限公司 Identity verification method and related device

Also Published As

Publication number Publication date
CN113382167A (en) 2021-09-10

Similar Documents

Publication Publication Date Title
US8667539B2 (en) System for scanable icon detection and management
US9449294B2 (en) Method and apparatus for managing user devices and contents by using quick response codes
EP2681922B1 (en) Synching one or more matrix codes to content related to a multimedia presentation
US7933809B2 (en) Method, medium, and system for automatically embedding information concerning items appearing in video using RFID tags
US10235574B2 (en) Image-capturing device, recording device, and video output control device
US20150170245A1 (en) Media content instance embedded product marketing
CN108062507B (en) Video processing method and device
US10043079B2 (en) Method and apparatus for providing multi-video summary
US20110138300A1 (en) Method and apparatus for sharing comments regarding content
CN106062801A (en) Tracking pixels and COOKIE for television event viewing
JP2008225904A (en) Data processing system and data processing method
US20080184132A1 (en) Media content tagging
JP2006285654A (en) Article information retrieval system
CN110740290A (en) Monitoring video previewing method and device
JP2015106862A (en) Content information acquisition device and program, and content distribution device
CN113382167B (en) Information superposition display method, device and system and image processing equipment
EP1696379A1 (en) CM searching method and apparatus, and CM-appendant information supplying method and apparatus
JP2012079351A (en) Server, store analysis system, and program
CA2476150C (en) Method and system for overlaying image with text
US11722726B2 (en) Television apparatus and display method
JP2020025273A (en) Program-related information processing server and program-related information processing system
US20050283793A1 (en) Advertising detection method and related system for detecting advertising according to specific beginning/ending images of advertising sections
JP6345726B2 (en) Program-related information processing method
KR20190088731A (en) Event video management system based on mobile
CN113596582A (en) Video preview method and device and electronic equipment

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant