CN113313634B - Monitoring image processing method, device, monitoring system and storage medium - Google Patents
Monitoring image processing method, device, monitoring system and storage medium Download PDFInfo
- Publication number
- CN113313634B CN113313634B CN202010121167.9A CN202010121167A CN113313634B CN 113313634 B CN113313634 B CN 113313634B CN 202010121167 A CN202010121167 A CN 202010121167A CN 113313634 B CN113313634 B CN 113313634B
- Authority
- CN
- China
- Prior art keywords
- image
- display area
- display
- aspect ratio
- picture
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
- 238000012544 monitoring process Methods 0.000 title claims abstract description 107
- 238000003672 processing method Methods 0.000 title claims abstract description 16
- 238000010801 machine learning Methods 0.000 claims description 49
- 238000000034 method Methods 0.000 claims description 35
- 230000004044 response Effects 0.000 claims description 25
- 238000004590 computer program Methods 0.000 claims description 6
- 230000008569 process Effects 0.000 claims description 6
- 239000000758 substrate Substances 0.000 claims 2
- 238000010586 diagram Methods 0.000 description 15
- 230000006870 function Effects 0.000 description 6
- 239000007787 solid Substances 0.000 description 6
- 230000005540 biological transmission Effects 0.000 description 4
- 230000008859 change Effects 0.000 description 2
- 238000001514 detection method Methods 0.000 description 2
- 230000000694 effects Effects 0.000 description 2
- 230000004048 modification Effects 0.000 description 2
- 238000012986 modification Methods 0.000 description 2
- 238000003491 array Methods 0.000 description 1
- 238000006243 chemical reaction Methods 0.000 description 1
- 238000013500 data storage Methods 0.000 description 1
- 238000013135 deep learning Methods 0.000 description 1
- 230000001419 dependent effect Effects 0.000 description 1
- 238000005516 engineering process Methods 0.000 description 1
- 239000000835 fiber Substances 0.000 description 1
- 230000006872 improvement Effects 0.000 description 1
- 230000010354 integration Effects 0.000 description 1
- 230000003287 optical effect Effects 0.000 description 1
- 239000004065 semiconductor Substances 0.000 description 1
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T3/00—Geometric image transformations in the plane of the image
- G06T3/60—Rotation of whole images or parts thereof
- G06T3/608—Rotation of whole images or parts thereof by skew deformation, e.g. two-pass or three-pass rotation
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T2207/00—Indexing scheme for image analysis or image enhancement
- G06T2207/30—Subject of image; Context of image processing
- G06T2207/30232—Surveillance
Landscapes
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- Closed-Circuit Television Systems (AREA)
Abstract
The embodiment of the application provides a monitoring image processing method, a device and a monitoring deviceThe system and the storage medium relate to the technical field of image processing and can reduce a monitoring blind area in a long and narrow depth monitoring scene. The monitoring image processing method comprises the following steps: receiving a first image sent by a camera, wherein the aspect ratio of the first image is that
Performing 90-degree rotation operation on the first image to form a rotated second image, wherein the aspect ratio of the second image is that
Generating a display screen including the second image, the second image having an aspect ratio in the display screen of
The technical scheme is mainly used for the image monitoring process.
Description
Technical Field
The present disclosure relates to the field of image processing technologies, and in particular, to a method and apparatus for processing a monitoring image, a monitoring system, and a storage medium.
Background
Under a long and narrow monitoring scene, as shown in fig. 1, fig. 1 is a schematic diagram of a monitoring image under an aisle scene in the prior art, and an effective monitoring area corresponding to the monitoring image is smaller, for example, the aisle monitoring scene in a passenger car, and because of the long and narrow depth of the aisle, the monitoring image has a monitoring blind area at a seat position close to a car head or a car tail, for example, when in-car personnel are left to be detected, the problem that the monitoring blind area cannot be identified or is inaccurate in identification is easily caused. Although a corridor mode is set through a network camera at present, an image with the aspect ratio of 9:16 is acquired to improve an effective monitoring area in a long and narrow depth scene, a traditional camera is still needed to be used for monitoring a scene without a network in a passenger car and the like, so that the problem that a monitoring blind area is larger in the long and narrow depth monitoring scene still exists when the camera is used for monitoring.
Disclosure of Invention
The technical scheme of the application provides a monitoring image processing method, a device, a monitoring system and a storage medium, which can reduce a monitoring blind area in a long and narrow monitoring scene.
In a first aspect, a technical solution of the present application provides a method for processing a monitoring image, including:
receiving camera transmitted firstAn image, the aspect ratio of the first image is
Performing 90-degree rotation operation on the first image to form a rotated second image, wherein the aspect ratio of the second image is that
Generating a display screen including the second image, the second image having an aspect ratio in the display screen of
In one embodiment of the present application: the generating a display screen includes:
in response to a single-screen output instruction, generating a single-display screen with a resolution of c×d, c being a horizontal pixel number, d being a vertical pixel number, c > d, the single-display screen including the second image, wherein in the single-display screen, the horizontal pixel number corresponding to the second image is
And the number of vertical pixels corresponding to the second image is d.
In one embodiment of the present application: displaying the second image centrally in the single display screen; and filling solid-color backgrounds on two sides of the second image on the single display picture.
In one embodiment of the present application: the generating a display screen includes: in response to the multi-screen output instruction, a plurality of display areas including one display area having an aspect ratio of less than 1 and one display area having an aspect ratio of greater than 1 are generated, and the second image is displayed in the display area having the aspect ratio of greater than 1.
In one embodiment of the present application: the generating a plurality of display areas in response to the multi-screen output instruction, wherein the plurality of display areas includes a display area with an aspect ratio smaller than 1 and a display area with an aspect ratio larger than 1, and the displaying the second image in the display area with the aspect ratio larger than 1 includes:
generating a display picture comprising a first display area, a second display area, a third display area and a fourth display area in response to a four-picture output instruction, wherein the second display area and the third display area are arranged along a vertical direction and form a spliced area, the first display area, the spliced area and the third display area are arranged along a horizontal direction, the aspect ratio of the first display area and the third display area is smaller than 1, and the aspect ratio of the second display area and the third display area is larger than 1;
the first display area and the third display area respectively include different second images.
In one embodiment of the present application: the generating a plurality of display areas in response to the multi-screen output instruction, wherein the plurality of display areas includes a display area with an aspect ratio smaller than 1 and a display area with an aspect ratio larger than 1, and the displaying the second image in the display area with the aspect ratio larger than 1 includes:
responding to an eight-picture output instruction, generating a display picture comprising nine areas, wherein the nine areas are distributed in three rows and three columns, two areas adjacent in the vertical direction form a first display area, and the rest seven areas except for the first display area in the nine areas are respectively seven second display areas;
the aspect ratio of the first display area is smaller than 1, and the first display area comprises the second image;
the aspect ratio of each of the second display areas is greater than 1.
In one embodiment of the present application: the method further comprises the following steps:
generating a machine learning pre-input image in response to a machine learning input instruction, wherein the machine learning pre-input image is formed by splicing the second image and the solid-color filling image, and the second image and the solid-color filling image are arranged along the horizontal direction;
the machine learning pre-input image is scaled to form a machine learning input image having an aspect ratio equal to an aspect ratio of the machine learning pre-input image.
In another aspect, the present application further provides a monitoring image processing apparatus, including:
a receiving module, configured to receive a first image sent by a camera, where an aspect ratio of the first image is
An image processing module for performing 90 ° rotation operation on the first image to form a rotated second image, the second image having an aspect ratio of
A picture generation unit for generating a display picture including the second image with an aspect ratio in the display picture of
In another aspect, the present application further provides a monitoring image processing apparatus, including:
a processor and a memory for storing at least one instruction which when loaded and executed by the processor implements the method described above.
In another aspect, the present application also provides a computer readable storage medium having a computer program stored therein, which when run on a computer causes the computer to perform the above-described method.
In another aspect, the present application further provides a monitoring system, including:
a camera;
an analog-to-digital converter communicatively coupled to the camera;
the above-mentioned monitoring image processing device is electrically connected to the analog-to-digital converter.
According to the monitoring image processing method, the device, the monitoring system and the storage medium, the first image shot by rotating the camera by 90 degrees is rotated to form the rotated second image, so that the second image accords with the viewing angle of a user, and the aspect ratio of the second image is 9:16, so that an effective monitoring area in a long and narrow and deep monitoring scene can be increased, the monitoring blind area is reduced, the monitoring recognition rate is improved, and the monitoring effect is improved. In addition, the embodiment of the application only improves the method for processing the signal sent by the analog-to-digital converter, and does not change the hardware structure and the transmission mode of the front-end camera, so that the method can still be compatible with the traditional monitoring mode.
Drawings
FIG. 1 is a schematic view of a monitoring image in an aisle scene in the prior art;
FIG. 2 is a block diagram of a monitoring system according to an embodiment of the present application;
fig. 3 is a schematic view of a monitoring image in an aisle scene according to an embodiment of the present application;
FIG. 4 is a schematic view of an image taken when the camera is mounted in the forward direction;
FIG. 5 is a schematic view of a first image taken when the camera is mounted rotated 90;
FIG. 6 is a flowchart of a method for processing a monitoring image according to an embodiment of the present application;
FIG. 7 is a schematic diagram of a second image in an embodiment of the present application;
FIG. 8 is a schematic diagram of a display screen according to an embodiment of the present disclosure;
FIG. 9 is a schematic diagram of another display screen according to an embodiment of the disclosure;
FIG. 10 is a schematic diagram of another display screen according to an embodiment of the disclosure;
FIG. 11 is a schematic diagram of a machine learning pre-input image according to an embodiment of the present application;
FIG. 12 is a flowchart of another method of monitoring image processing in the present application;
fig. 13 is a block diagram of a monitoring image processing apparatus in the embodiment of the present application.
Detailed Description
The terminology used in the description section of the present application is for the purpose of describing particular embodiments of the present application only and is not intended to be limiting of the present application.
As shown in fig. 2, fig. 2 is a block diagram of a monitoring system according to an embodiment of the present application, where the embodiment of the present application provides a monitoring system, including: a camera 10; an analog-to-digital converter 20 communicatively coupled to the camera 10; a monitoring image processing device 30 electrically connected to the analog-to-digital converter 20; and a display device 40 electrically connected to the monitoring image processing device 30.
Wherein, the sensor of the front-end camera 10 collects the monitoring image, converts and modulates the monitoring image into an analog signal after image signal processing (Image Signal Processing, ISP), the analog signal is transmitted to the analog-to-digital converter 20 of the back end, the analog-to-digital converter 20 converts the analog signal into a digital signal and then transmits the digital signal to the monitoring image processing device 30, the monitoring image processing device 30 performs a monitoring image processing method on the received monitoring image in the form of the digital signal, and generates a display screen, the display screen is displayed by the display device 40, and the specific process and principle of the monitoring image processing method performed by the monitoring image processing device 30 will be described in detail in the following.
As shown in fig. 3, fig. 3 is a schematic view of a surveillance image in an aisle scene in an embodiment of the present application, in which the front-end camera 10 is rotated 90 ° with respect to the camera shown in fig. 1 to capture a surveillance image, and the aspect ratio of the captured surveillance image is smaller than 1, that is, the width is smaller than the height, for example, the aspect ratio of the surveillance image shown in fig. 1 is 16:9, which is a conventional surveillance image ratio, and the aspect ratio of the surveillance image shown in fig. 3 is 9:16, which may be referred to as a aisle image, at which capturing angle, as shown in fig. 3, in comparison with fig. 1, only the capturing angle of the camera needs to be converted to obtain a larger effective surveillance area of the seat position in the passenger car, and in fact, for the camera 10, the image processing or transmission mode is not changed, but only the capturing angle is changed, as shown in fig. 4, fig. 4 is a schematic view of an image taken when the camera is installed in the forward direction, the image taken when the camera is installed in the forward direction is small in size in the longitudinal direction due to the large aspect ratio of the image, for example, only one person can be taken, as shown in fig. 5, fig. 5 is a schematic view of a first image taken when the camera is installed in a 90 ° rotation, namely, a first image taken by the camera 10 in the embodiment of the present application, after the camera 10 is installed in a rotation, although for a practical scene, the image information of a long and narrow area is more, for example, two persons can be taken, but the image is rotated by 90 °, that is, the image transmitted from the camera 10 to the analog-digital converter 20 is also an image rotated by 90 ° as shown in fig. 5, which is the first image in the embodiment of the present application, the analog-digital converter 20 performs analog-digital conversion on the first image signal, converted into a digital signal.
As shown in fig. 6 and fig. 7, fig. 6 is a flowchart of a monitoring image processing method in an embodiment of the present application, fig. 7 is a schematic diagram of a second image in an embodiment of the present application, and the embodiment of the present application provides a monitoring image processing method, an execution subject of which may be the monitoring image processing apparatus in fig. 2, where the monitoring image processing method includes:
For example, the aspect ratio of the first image is 16:9 or 4:3, and the aspect ratio of the first image is 16:9, that is, a > b, and since the camera 10 transmits an analog signal, the monitoring image processing apparatus 20 may receive the first image sent by the camera 10 through the analog-to-digital converter 20, that is, the received first image is a digital signal converted by the analog-to-digital converter 20.
After the first image is rotated, a second image is formed to conform to the viewing angle of the user, for example, the first image has a resolution of 1280×720, the second image has a resolution of 720×1280, and the second image has an aspect ratio of 9:16, which can be used to generate a display or for storage.
Specifically, since the conventional display screen is matched with the proportion of the image captured when the camera is installed forward, after the first image is rotated by 90 ° and the rotated second image is obtained, it is necessary to ensure that the proportion of the second image in the display screen is unchanged, that is, the aspect ratio is still 9:16, so as to avoid the distortion of the whole screen due to the fact that the image is stretched transversely and compressed longitudinally caused by the mismatch between the second image and the display screen. The monitoring image processing method in the embodiment of the application can be used for scenes with long and narrow depths, such as channels, buses (such as school buses and buses), subways, high-speed rails and airplanes.
According to the monitoring image processing method and the monitoring system, the first image shot by rotating the camera by 90 degrees is rotated to form the rotated second image, so that the second image accords with the viewing angle of a user, and the aspect ratio of the second image is 9:16, so that an effective monitoring area in a long and narrow and deep monitoring scene can be increased, a monitoring blind area is reduced, the monitoring recognition rate is improved, and the monitoring effect is improved. In addition, the embodiment of the application only improves the method for processing the signal sent by the analog-to-digital converter, and does not change the hardware structure and the transmission mode of the front-end camera, so that the method can still be compatible with the traditional monitoring mode.
Optionally, the generating the display screen in step 103 includes:in response to the single-screen output instruction, generating a single-display screen, wherein the resolution of the single-display screen is c×d, c is the number of horizontal pixels, d is the number of vertical pixels, c > d, the single-display screen comprises the second image, and in the single-display screen, the number of horizontal pixels corresponding to the second image is
The second image corresponds to a number of vertical pixels d.
Specifically, the single-screen output means that only one monitor image is displayed on the display device, as shown in fig. 8, fig. 8 is a schematic diagram of a display screen in the embodiment of the present application, for example, the resolution of the display screen is 1280×720, that is, the display screen has 1280 horizontal pixels and 720 vertical pixels, and the aspect ratio of the display screen is not matched with that of the second image, so that the height of the second image can be matched according to the height of the display screen, even if the number of vertical pixels corresponding to the second image is 720 as well, while keeping the aspect ratio of the second image unchanged, still is 9:16, and the number of horizontal pixels corresponding to the second image is calculated according to the aspect ratio, specifically
In this way, the second image can be maximized in the display while maintaining the aspect ratio in the display. The single-screen output instruction may be an instruction automatically generated by the system or an instruction generated for operation.
Alternatively, as shown in fig. 8, the second image is centrally displayed in the single display screen so that the user views the monitor screen. For example, at the time of centered display, the horizontal start coordinate of the second image is calculated as
Either 437 or 438 may be specifically selected.
Alternatively, as shown in fig. 8, the single display screen is filled with solid background on both sides of the second image. For example, black backgrounds (dot-like filled areas) are filled in both the left and right sides of the second image to highlight the second image as a monitor image.
Optionally, in addition to the manner of displaying the second image in the single display screen to implement monitoring as shown in fig. 8, there is generally a manner of displaying the monitoring image in multiple screens to implement displaying a plurality of different monitoring screens in the same display device, in the manner of displaying the line control image in multiple screens, the step 103 of generating the display screen includes: in response to the multi-screen output instruction, a plurality of display areas including one display area having an aspect ratio of less than 1 and one display area having an aspect ratio of greater than 1 are generated, the above-described second image is displayed in the display area having an aspect ratio of greater than 1, and a non-corridor image, that is, an image photographed when the camera is mounted forward, can be displayed in the display area having an aspect ratio of less than 1.
Optionally, as shown in fig. 9, fig. 9 is a schematic diagram of another display screen in an embodiment of the present application, where the generating, in response to a multi-screen output instruction, a plurality of display areas, including a display area with an aspect ratio smaller than 1 and a display area with an aspect ratio larger than 1, and the displaying the second image in the display area with an aspect ratio larger than 1 includes: in response to the four-screen output instruction, generating a display screen including a first display area A1, a second display area A2, a third display area A3 and a fourth display area A4, wherein the second display area A2 and the third display area A3 are arranged along a vertical direction and form a spliced area B, the first display area A1, the spliced area B and the third display area A3 are arranged along a horizontal direction, the aspect ratio of the first display area A1 and the third display area A3 is smaller than 1, and the aspect ratio of the second display area A2 and the fourth display area A4 is larger than 1; the first display area A1 and the third display area A3 respectively include different second images.
Specifically, in some situations, a plurality of monitor images need to be displayed on the same display device, and the conventional four-image output mode is to divide the display image into four areas according to a "field" shape, but this mode is not suitable for displaying corridor images, such as second images, so the embodiment of the present application provides a picture display mode shown in fig. 9, where the first display area A1 and the third display area A3 each have a feature of having a width-to-length ratio smaller than 1 and are suitable for displaying monitor images with long and narrow depths, so one second image may be displayed in the first display area A1, another second image may be displayed in the third display area A3, and the two second images may be different monitor images captured by two different cameras, and the second display area A2 and the fourth display area A4 may be used for displaying images captured when the cameras are installed in the forward direction. The four-picture output instruction can be an instruction automatically generated by the system or an instruction generated by user operation. In the picture display mode shown in fig. 9, the method can be applied to a monitoring system with a plurality of cameras, for example, the monitoring system comprises a first camera, a second camera, a third camera and a fourth camera, the four cameras are all connected to the same display device through the same monitoring image processing device, the second camera and the fourth camera are installed in the forward direction, the captured images are as shown in fig. 4, after the images captured by the second camera and the fourth camera are transmitted to the monitoring image processing device, rotation processing is not needed, the images captured by the second camera can be directly and correspondingly displayed in a second display area A2, the images captured by the fourth camera can be directly and correspondingly displayed in a fourth display area A4, the captured images are first images as shown in fig. 5 after the first images transmitted by the first camera and the third camera are received, the images captured by the monitoring image processing device are respectively processed according to the mode, the images captured by the second camera and the fourth camera can be respectively obtained, the images captured by the second camera and the fourth camera can be directly and correspondingly displayed in a third display area A3, and the second camera can be displayed in a second display area a corresponding to the third camera 1.
Optionally, as shown in fig. 10, fig. 10 is a schematic diagram of still another display screen in an embodiment of the present application, where in response to a multi-screen output instruction, a plurality of display areas are generated, where the plurality of display areas includes a display area with an aspect ratio smaller than 1 and a display area with an aspect ratio larger than 1, and a process of displaying the second image in the display area with an aspect ratio larger than 1: responding to the eight-picture output instruction, generating a display picture comprising nine areas C, wherein the nine areas C are distributed in three rows and three columns, two areas C adjacent in the vertical direction form a first display area C1, and the rest seven areas C except the first display area C1 in the nine areas C are respectively seven second display areas C2; the aspect ratio of the first display area C1 is smaller than 1, and the first display area C1 includes a second image; the aspect ratio of each second display area C2 is greater than 1.
Specifically, the conventional eight-screen output method is not suitable for displaying the corridor image, which is the second image, and therefore, the embodiment of the present application provides a screen display method as shown in fig. 10, in which the display screen is divided into eight display areas, wherein the first display area C1 is suitable for displaying the monitor image of long and narrow depth, and therefore, the second image can be displayed by using the first display area C1, and the second display area C2 can be used for displaying the image captured when the camera is installed in the forward direction. The eight-picture output instruction can be an instruction automatically generated by the system or an instruction generated by user operation.
It can be understood that the different display modes shown in fig. 8, 9 and 10 may be a fixed display mode configured in advance, or may be different display modes that can be switched according to needs, for example, the whole monitoring system only has one camera, and only needs to monitor the same position, i.e. the single-screen display mode shown in fig. 8 can be configured in advance; for example, the whole monitoring system is provided with four cameras, four different positions are required to be monitored simultaneously, two of the positions are long and narrow scenes, two display modes can be configured simultaneously at the moment, the two display modes can be switched in response to operation instructions of a user, when the user operates to enter four-picture display, the display device presents the display mode shown in fig. 9, when the user wants to specifically watch a monitoring picture at one position, the user can operate to enter a single-picture display mode at one of the positions, and at the moment, the display device is switched to the single-picture display mode shown in fig. 8.
Optionally, as shown in fig. 11, fig. 11 is a schematic diagram of a machine learning pre-input image in an embodiment of the present application, where the method for processing a monitored image further includes: generating a machine learning pre-input image in response to a machine learning input instruction, wherein the machine learning pre-input image is formed by splicing the second image and the solid color filling image, and the second image and the solid color filling image are arranged along the horizontal direction; the machine-learned pre-input image is scaled to form a machine-learned input image, the aspect ratio of the machine-learned input image being equal to the aspect ratio of the machine-learned pre-input image.
Specifically, for the monitoring image, in addition to displaying, it is also possible to use the monitoring image as an input image for machine learning, where the machine learning has a requirement for the input image, for example, for a convolution structure (Convolutional Architecture for Fast Feature Embedding, caffe) framework with fast feature embedding, the resolution requirement of the network input image is 448×448, assuming that the aspect ratio of the second image is 9:16, and the resolution is 405×720, if the second image is directly used as the network input image under the Caffe framework, image distortion may occur, resulting in inaccurate processing results of machine learning, in an embodiment of the present invention, after the second image is obtained, before machine learning is performed, the second image is first spliced to obtain a machine learning pre-input image, as shown in fig. 11, and the machine learning pre-input image is formed by splicing the second image and a solid-filled image (for example, a black-filled image, and a dot-filled region is a black-filled image), so that the machine learning pre-input image satisfies the aspect ratio of the network input image, for example, the aspect ratio of 1:1, even if the machine learning pre-input image is 720×720, then the aspect ratio is maintained, the machine learning pre-input image is then the machine learning is performed, the machine learning pre-input image is more than the machine learning is performed, and the machine learning input image is more specifically, the machine learning is performed, and the machine learning input image is scaled, and the machine learning image is performed, and the machine learning image is input is more, and the machine learning is input, and the image is performed, and the machine learning is input, and the image is made, and the image is further input, and the image is input, and the image is input and the image is input.
Specifically, for example, as shown in fig. 12, fig. 12 is a flowchart of another method for processing a monitoring image in the present application, where in the method for processing a monitoring image, after the first image is rotated in step 102 to form a rotated second image, on the one hand, in step 103, a display screen is generated based on the second image, so as to implement a function of displaying the monitoring screen; on the other hand, the method further comprises a step 104 of generating a machine learning input image based on the second image, and the specific process of generating and learning the input image comprises the following steps: firstly, splicing a second image and a solid-color image to generate a machine learning pre-input image with the same image proportion as that required by machine learning, and then scaling the machine learning pre-input image to generate a machine learning input image with the image size required by machine learning so as to realize the machine learning, for example, realizing intelligent detection functions such as personnel detection and the like through deep learning; in yet another aspect, the method further includes step 105 of encoding the second image and storing the encoded image, for example, in a storage medium such as a hard disk, to implement a storage function of the monitoring image.
As shown in fig. 13, fig. 13 is a block diagram of a monitoring image processing apparatus according to an embodiment of the present application, where the embodiment of the present application further provides a monitoring image processing apparatus, including: a receiving module 1 for receiving a first image sent by the camera, the first image having an aspect ratio of
An image processing module 2 for performing a 90 DEG rotation operation on the first image to form a rotated second image having an aspect ratio of +.>
A picture generation unit 3 for generating a display picture comprising a second image having an aspect ratio of +.>
The specific process and principle of the monitoring image processing device can be the same as the above embodiment, and are not repeated here,
optionally, the screen generating unit 3 is specifically configured to generate, in response to a single-screen output instruction, a single-display screen, where the resolution of the single-display screen is c×d, c is a horizontal pixel number, d is a vertical pixel number, and c > d, and the single-display screen includes the second image, and in the single-display screen, the horizontal pixel number corresponding to the second image is
And the number of vertical pixels corresponding to the second image is d.
Optionally, the screen generating unit 3 is specifically configured to display the second image centrally in the single display screen; and filling the single display picture with solid-color backgrounds at two sides of the second image.
Alternatively, the screen generating unit 3 is specifically configured to generate, in response to the multi-screen output instruction, a plurality of display areas including one display area having an aspect ratio smaller than 1 and one display area having an aspect ratio larger than 1, and display the second image in the display area having an aspect ratio larger than 1.
Optionally, the screen generating unit 3 is specifically configured to generate, in response to a four-screen output instruction, a display screen including a first display area, a second display area, a third display area, and a fourth display area, where the second display area and the third display area are arranged along a vertical direction and form a stitching area, the first display area, the stitching area, and the third display area are arranged along a horizontal direction, aspect ratios of the first display area and the third display area are all less than 1, and aspect ratios of the second display area and the fourth display area are all greater than 1; the first display area and the third display area respectively include different second images.
Optionally, the screen generating unit 3 is specifically configured to generate, in response to an eight-screen output instruction, a display screen including nine areas, where the nine areas are arranged in three rows and three columns, two areas adjacent in a vertical direction form a first display area, and seven other areas except for the first display area in the nine areas are respectively seven second display areas; the aspect ratio of the first display area is smaller than 1, and the first display area comprises the second image; the aspect ratio of each second display area is greater than 1.
Optionally, the image processing module 2 is further configured to generate a machine learning pre-input image in response to a machine learning input instruction, where the machine learning pre-input image is formed by stitching the second image and a solid-color filling image, and the second image and the solid-color filling image are arranged along a horizontal direction; the machine learning pre-input image is scaled to form a machine learning input image having an aspect ratio equal to an aspect ratio of the machine learning pre-input image.
It should be understood that the above division of the modules of the apparatus shown in fig. 13 is merely a division of a logic function, and may be fully or partially integrated into a physical entity or may be physically separated. And these modules may all be implemented in software in the form of calls by the processing element; or can be realized in hardware; it is also possible that part of the modules are implemented in the form of software called by the processing element and part of the modules are implemented in the form of hardware. The processing element described herein may be an integrated circuit having signal processing capabilities. In implementation, each step of the above method or each module above may be implemented by an integrated logic circuit of hardware in a processor element or an instruction in a software form.
For example, the modules above may be one or more integrated circuits configured to implement the methods above, such as: one or more specific integrated circuits (Application Specific Integrated Circuit, ASIC), or one or more microprocessors (digital singnal processor, DSP), or one or more field programmable gate arrays (Field Programmable Gate Array, FPGA), or the like. For another example, when a module above is implemented in the form of a processing element scheduler, the processing element may be a general purpose processor, such as a central processing unit (Central Processing Unit, CPU) or other processor that may invoke the program.
The embodiment of the application also provides a monitoring image processing device, which comprises: the monitoring image processing device comprises a processor and a memory, wherein the memory is used for storing at least one instruction, and the instruction is loaded and executed by the processor to realize the monitoring image processing method in the embodiment. The number of processors may be one or more, and the processors and memory may be connected by a bus or other means.
The monitoring image processing apparatus may specifically be the monitoring image processing apparatus 30 shown in fig. 2.
The memory, as a non-transitory computer readable storage medium, may be used to store a non-transitory software program, a non-transitory computer executable program, and modules, such as program instructions/modules corresponding to the transmission method in the embodiments of the present application. The processor executes various functional applications and data processing by running non-transitory software programs, instructions, and modules stored in memory, i.e., implementing the methods of any of the method embodiments described above.
The memory may include a memory program area and a memory data area, wherein the memory program area may store an operating system, at least one application program required for a function; and necessary data, etc. In addition, the memory may include high-speed random access memory, and may also include non-transitory memory, such as at least one magnetic disk storage device, flash memory device, or other non-transitory solid state storage device.
The present embodiment also provides a computer-readable storage medium in which a computer program is stored which, when run on a computer, causes the computer to execute the monitoring image processing method in the above embodiment.
In the above embodiments, it may be implemented in whole or in part by software, hardware, firmware, or any combination thereof. When implemented in software, may be implemented in whole or in part in the form of a computer program product. The computer program product includes one or more computer instructions. When the computer program instructions are loaded and executed on a computer, the processes or functions described in the present application are produced in whole or in part. The computer may be a general purpose computer, a special purpose computer, a computer network, or other programmable apparatus. The computer instructions may be stored in a computer-readable storage medium or transmitted from one computer-readable storage medium to another computer-readable storage medium, for example, the computer instructions may be transmitted from one website, computer, server, or data center to another website, computer, server, or data center by a wired (e.g., coaxial cable, fiber optic, digital subscriber line), or wireless (e.g., infrared, wireless, microwave, etc.). The computer readable storage medium may be any available medium that can be accessed by a computer or a data storage device such as a server, data center, etc. that contains an integration of one or more available media. The usable medium may be a magnetic medium (e.g., floppy Disk, hard Disk, tape), an optical medium (e.g., DVD), or a semiconductor medium (e.g., solid State Disk), etc.
In the embodiments of the present application, "at least one" means one or more, and "a plurality" means two or more. "and/or", describes an association relation of association objects, and indicates that there may be three kinds of relations, for example, a and/or B, and may indicate that a alone exists, a and B together, and B alone exists. Wherein A, B may be singular or plural. The character "/" generally indicates that the context-dependent object is an "or" relationship. "at least one of the following" and the like means any combination of these items, including any combination of single or plural items. For example, at least one of a, b and c may represent: a, b, c, a-b, a-c, b-c, or a-b-c, wherein a, b, c may be single or plural.
The foregoing is merely a preferred embodiment of the present application and is not intended to limit the present application, and various modifications and variations may be made to the present application by those skilled in the art. Any modification, equivalent replacement, improvement, etc. made within the spirit and principles of the present application should be included in the protection scope of the present application.
Claims (8)
1. A monitoring image processing method, characterized by comprising:
receiving an imageA first image sent by the machine, the aspect ratio of the first image being
Performing a rotation operation on the first image to form a rotated second image, wherein the aspect ratio of the second image is that
Generating a display screen including the second image, the second image having an aspect ratio in the display screen of
To increase the effective monitoring area;
the generating a display screen includes:
responding to the single-picture output instruction to generate a single display picture; or, in response to the multi-screen output instruction, generating a plurality of display areas including one display area having an aspect ratio of less than 1 and one display area having an aspect ratio of greater than 1, and displaying the second image in the display area having the aspect ratio of greater than 1;
the generating a plurality of display areas in response to the multi-screen output instruction, wherein the plurality of display areas includes a display area with an aspect ratio smaller than 1 and a display area with an aspect ratio larger than 1, and the displaying the second image in the display area with the aspect ratio larger than 1 includes:
generating a display picture comprising a first display area, a second display area, a third display area and a fourth display area in response to a four-picture output instruction, wherein the second display area and the third display area are arranged along a vertical direction and form a spliced area, the first display area, the spliced area and the third display area are arranged along a horizontal direction, the aspect ratio of the first display area and the third display area is smaller than 1, and the aspect ratio of the second display area and the fourth display area is larger than 1; the first display area and the third display area respectively comprise different second images; or alternatively, the process may be performed,
responding to an eight-picture output instruction, generating a display picture comprising nine areas, wherein the nine areas are distributed in three rows and three columns, two areas adjacent in the vertical direction form a first display area, and the rest seven areas except for the first display area in the nine areas are respectively seven second display areas; the aspect ratio of the first display area is smaller than 1, and the first display area comprises the second image; the aspect ratio of each of the second display areas is greater than 1.
2. The method of claim 1, wherein the step of determining the position of the substrate comprises,
the resolution of the single display picture is c×d, c is the number of horizontal pixels, d is the number of vertical pixels, c > d, the single display picture comprises the second image, and in the single display picture, the number of horizontal pixels corresponding to the second image is
And the number of vertical pixels corresponding to the second image is d.
3. The method of claim 2, wherein the step of determining the position of the substrate comprises,
displaying the second image centrally in the single display screen;
and filling solid-color backgrounds on two sides of the second image on the single display picture.
4. The method as recited in claim 1, further comprising:
generating a machine learning pre-input image in response to a machine learning input instruction, wherein the machine learning pre-input image is formed by splicing the second image and the solid-color filling image, and the second image and the solid-color filling image are arranged along the horizontal direction;
the machine learning pre-input image is scaled to form a machine learning input image having an aspect ratio equal to an aspect ratio of the machine learning pre-input image.
5. A monitoring image processing apparatus characterized by comprising:
a receiving module, configured to receive a first image sent by a camera, where an aspect ratio of the first image is
An image processing module for performing 90 ° rotation operation on the first image to form a rotated second image, the second image having an aspect ratio of
A picture generation unit for generating a display picture including the second image with an aspect ratio in the display picture of
To increase the effective monitoring area;
the picture generation unit is specifically used for responding to the single picture output instruction to generate a single display picture; or, in response to the multi-screen output instruction, generating a plurality of display areas including one display area having an aspect ratio of less than 1 and one display area having an aspect ratio of greater than 1, and displaying the second image in the display area having the aspect ratio of greater than 1;
the picture generation unit is specifically configured to generate a display picture including a first display area, a second display area, a third display area and a fourth display area in response to a four-picture output instruction, where the second display area and the third display area are arranged along a vertical direction and form a spliced area, the first display area, the spliced area and the third display area are arranged along a horizontal direction, the aspect ratio of the first display area and the third display area is smaller than 1, the aspect ratio of the second display area and the fourth display area is larger than 1, and the first display area and the third display area respectively include different second images; or, in response to an eight-picture output instruction, generating a display picture comprising nine areas, wherein the nine areas are arranged in three rows and three columns, two areas adjacent in the vertical direction form a first display area, and the rest seven areas except for the first display area in the nine areas are respectively seven second display areas; the aspect ratio of the first display area is smaller than 1, the first display area comprises said second images, and the aspect ratio of each second display area is larger than 1.
6. A monitoring image processing apparatus characterized by comprising:
a processor and a memory for storing at least one instruction which, when loaded and executed by the processor, implements the method of any one of claims 1 to 4.
7. A computer readable storage medium, characterized in that the computer readable storage medium has stored therein a computer program which, when run on a computer, causes the computer to perform the method according to any of claims 1 to 4.
8. A monitoring system, comprising:
a camera;
an analog-to-digital converter communicatively coupled to the camera;
the monitoring image processing apparatus of claim 6 electrically connected to the analog-to-digital converter.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202010121167.9A CN113313634B (en) | 2020-02-26 | 2020-02-26 | Monitoring image processing method, device, monitoring system and storage medium |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202010121167.9A CN113313634B (en) | 2020-02-26 | 2020-02-26 | Monitoring image processing method, device, monitoring system and storage medium |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN113313634A CN113313634A (en) | 2021-08-27 |
| CN113313634B true CN113313634B (en) | 2023-06-09 |
Family
ID=77369846
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202010121167.9A Active CN113313634B (en) | 2020-02-26 | 2020-02-26 | Monitoring image processing method, device, monitoring system and storage medium |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN113313634B (en) |
Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101639933A (en) * | 2009-07-16 | 2010-02-03 | 上海合合信息科技发展有限公司 | Image rotation correction method and system and electronic device |
| CN105230005A (en) * | 2013-05-10 | 2016-01-06 | 三星电子株式会社 | Display unit and control method thereof |
| CN105430331A (en) * | 2015-11-13 | 2016-03-23 | 浙江宇视科技有限公司 | Method and device for adjusting display direction of monitor image |
| CN105450918A (en) * | 2014-06-30 | 2016-03-30 | 杭州华为企业通信技术有限公司 | Image processing method and camera |
| CN109410122A (en) * | 2018-08-27 | 2019-03-01 | 上海途擎微电子有限公司 | The method of onboard system and its vehicle-mounted Image Adjusting |
Family Cites Families (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US9076242B2 (en) * | 2012-07-19 | 2015-07-07 | Qualcomm Incorporated | Automatic correction of skew in natural images and video |
-
2020
- 2020-02-26 CN CN202010121167.9A patent/CN113313634B/en active Active
Patent Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101639933A (en) * | 2009-07-16 | 2010-02-03 | 上海合合信息科技发展有限公司 | Image rotation correction method and system and electronic device |
| CN105230005A (en) * | 2013-05-10 | 2016-01-06 | 三星电子株式会社 | Display unit and control method thereof |
| CN105450918A (en) * | 2014-06-30 | 2016-03-30 | 杭州华为企业通信技术有限公司 | Image processing method and camera |
| CN105430331A (en) * | 2015-11-13 | 2016-03-23 | 浙江宇视科技有限公司 | Method and device for adjusting display direction of monitor image |
| CN109410122A (en) * | 2018-08-27 | 2019-03-01 | 上海途擎微电子有限公司 | The method of onboard system and its vehicle-mounted Image Adjusting |
Also Published As
| Publication number | Publication date |
|---|---|
| CN113313634A (en) | 2021-08-27 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| EP3816929B1 (en) | Method and apparatus for restoring image | |
| CN109005334B (en) | Imaging method, device, terminal and storage medium | |
| US9569688B2 (en) | Apparatus and method of detecting motion mask | |
| JP6568374B2 (en) | Information processing apparatus, information processing method, and program | |
| JP6882868B2 (en) | Image processing equipment, image processing method, system | |
| JP2007129709A (en) | Method for calibrating imaging device, method for calibrating imaging system including arrangement of imaging devices, and imaging system | |
| US11587259B2 (en) | Fixed pattern calibration for multi-view stitching | |
| CN105578129A (en) | Multipath multi-image video splicing device | |
| US10165257B2 (en) | Robust disparity estimation in the presence of significant intensity variations for camera arrays | |
| US9076268B2 (en) | Method and system for analyzing multi-channel images | |
| US20230394834A1 (en) | Method, system and computer readable media for object detection coverage estimation | |
| JP7089355B2 (en) | Image processing device, control method and program of image processing device | |
| US11032470B2 (en) | Sensors arrangement and shifting for multisensory super-resolution cameras in imaging environments | |
| US20140068514A1 (en) | Display controlling apparatus and display controlling method | |
| CN113313634B (en) | Monitoring image processing method, device, monitoring system and storage medium | |
| US20190197660A1 (en) | Information processing device, system, information processing method, and storage medium | |
| CN114363533A (en) | Display control method and device, display equipment and computer readable medium | |
| US8049748B2 (en) | System and method for digital video scan using 3-D geometry | |
| JP2011259089A5 (en) | ||
| US11494934B2 (en) | Image processing device, image processing method, and monitoring system | |
| US20180324475A1 (en) | Transmission device, transmission method, reception device, reception method, and transmission/reception system | |
| WO2022231693A1 (en) | Systems and methods for adding persistence to single photon avalanche diode imagery | |
| US11636708B2 (en) | Face detection in spherical images | |
| KR101936168B1 (en) | Image Process Apparatus and Method using Video Signal of Planar Coordinate System and Spherical Coordinate System | |
| TWI444909B (en) | Hand gesture image recognition method and system using singular value decompostion for light compensation |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |