WO2015125441A1 - 画像伝送装置及び画像伝送システム - Google Patents
画像伝送装置及び画像伝送システム Download PDFInfo
- Publication number
- WO2015125441A1 WO2015125441A1 PCT/JP2015/000649 JP2015000649W WO2015125441A1 WO 2015125441 A1 WO2015125441 A1 WO 2015125441A1 JP 2015000649 W JP2015000649 W JP 2015000649W WO 2015125441 A1 WO2015125441 A1 WO 2015125441A1
- Authority
- WO
- WIPO (PCT)
- Prior art keywords
- image
- unit
- transmission
- image processing
- processing unit
- Prior art date
Links
Images
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N7/00—Television systems
- H04N7/18—Closed-circuit television [CCTV] systems, i.e. systems in which the video signal is not broadcast
- H04N7/183—Closed-circuit television [CCTV] systems, i.e. systems in which the video signal is not broadcast for receiving images from a single remote source
Definitions
- the present invention relates to an image transmission apparatus configured to transmit an image captured by a camera via a transmission path, and an image transmission system including the image transmission apparatus.
- Document 1 an image transmission / reception system, a camera device, and a host device of Japanese Patent Application Publication No. 2001-28740 (hereinafter referred to as “Document 1”) are illustrated.
- a camera device (video camera) is alternatively connected to a host device (notebook personal computer) through two types of transmission lines, a wired transmission line and a wireless transmission line. Then, the host device identifies which transmission path is connected to the camera apparatus, and transmits control information corresponding to each transmission path (presence / absence of image encoding, compression rate, etc.) to the camera apparatus.
- the camera device performs processing such as encoding an image and changing the compression rate in accordance with the control information received from the host device. Note that when the camera device is connected to a plurality of host devices via a wireless transmission path, the captured image can be individually transmitted to the plurality of host devices.
- the camera device image transmission device
- the camera device in the conventional example is installed at an arbitrary place (indoor or outdoor)
- an unexpected situation may occur and the shooting state of the camera device may change.
- the camera device is used for monitoring the intrusion of a suspicious person, it is assumed that the suspicious person moves it to change the imaging range, or it is covered with cloth or the like and the monitoring area cannot be imaged. Is done.
- the present invention has been made in view of the above problems, and an object of the present invention is to suppress the waste of resources and reliably transmit a necessary image.
- the image transmission device of the present invention includes an imaging device, an image processing device, a transmission device, a storage device, and a control device.
- the imaging device is configured to capture an image.
- the image processing device is configured to perform image processing of an image captured by the imaging device.
- the transmission apparatus is configured to transmit an image obtained by the image processing to one or more image display apparatuses via a transmission path.
- the storage device is configured to store a plurality of operating conditions of the image processing device.
- the control device selects an operation condition corresponding to an image captured by the imaging device from the plurality of operation conditions stored in the storage device, and the image processing device is selected based on the selected operation condition. Configured to operate.
- the image transmission apparatus and the image transmission system of the present invention have an effect of suppressing resource waste and transmitting a necessary image with certainty.
- FIG. 1 is a system configuration diagram showing an embodiment of an image transmission apparatus according to the present invention and an embodiment of an image transmission system according to the present invention. It is a perspective view which shows an image transmission apparatus same as the above. It is a flowchart for demonstrating operation
- the image transmission system of the present embodiment is configured by connecting an image transmission device 1 and one or a plurality of image display devices 2 via a transmission path 3 as shown in FIG.
- the transmission path 3 may be a wired transmission path using a metal wire, an optical fiber, a coaxial cable, or the like as a transmission medium, or may be a wireless transmission path using a radio wave as a transmission medium.
- the transmission path 3 may be a wired transmission path using a metal wire, an optical fiber, a coaxial cable, or the like as a transmission medium, or may be a wireless transmission path using a radio wave as a transmission medium.
- the image transmission device 1 includes a control unit (control device) 10, an imaging unit (imaging device) 11, an image processing unit (image processing device) 12, a transmission unit (transmission device) 13, and a storage unit (storage device). 14.
- the imaging unit 11 is configured to capture an image (a still image or a moving image).
- the imaging unit 11 includes a solid-state imaging device, an optical component, a signal processing circuit, and the like.
- a CCD (Charge-Coupled Devices) image sensor, a CMOS (Complementary Metal-Oxide Semiconductor) image sensor, or the like is employed as the solid-state imaging device.
- the optical component includes a lens for condensing light on the solid-state image sensor, an iris (iris) for adjusting the amount of light received by the solid-state image sensor, and the like.
- the signal processing circuit scans all the pixels (light receiving elements) of the solid-state imaging device, reads the pixel value (charge) of each pixel as an analog electric signal, and converts the electric signal into a digital signal (image data) Configured as follows.
- the signal processing circuit is configured to generate image data at a predetermined frame rate (for example, 30 fps ⁇ frame ⁇ per second> or 60 fps).
- a predetermined frame rate for example, 30 fps ⁇ frame ⁇ per second> or 60 fps.
- the image processing unit 12 is configured to perform image processing of an image (captured image) captured by the imaging unit 11.
- the image processing unit 12 includes, for example, a frame memory and a DSP (Digital Signal Processor).
- the frame memory is also called a frame buffer, and is configured to store image data of one to a plurality of frames output from the imaging unit 11.
- the DSP is configured to perform various image processes by executing a product-sum operation on image data read from the frame memory.
- the image processing unit 12 may be configured by an MPU (Micro-Processing Unit) and image processing software executed by the MPU.
- MPU Micro-Processing Unit
- the image processing unit 12 performs image processing such as compression encoding processing that compresses and encodes image data using a predetermined compression encoding method, and human detection processing that analyzes image data and detects a moving object (person). Configured to do.
- image processing such as compression encoding processing that compresses and encodes image data using a predetermined compression encoding method, and human detection processing that analyzes image data and detects a moving object (person). Configured to do.
- the compression encoding method performed by the image processing unit 12 in the compression encoding process is preferably H.264 / MPEG-4CAVC for moving images and JPEG for still images, for example.
- the image processing unit 12 is configured to obtain (detect) the degree to which the image output from the imaging unit 11 changes in time series, and to output the obtained (detected) degree to the control unit 10. The degree will be described later.
- the transmission unit 13 is configured to transmit an image (processed image) obtained by image processing by the image processing unit 12 to one or a plurality of image display apparatuses 2 via the transmission path 3.
- the transmission unit 13 is configured to divide the image data after being compressed and encoded by the image processing unit 12 into a number of packets corresponding to the size of the image data.
- the transmission unit 13 digitally modulates the divided plurality of packets with a predetermined digital modulation method (BPSK method, QAM method, OFDM method, etc.), generates a transmission signal, and transmits the transmission signal via the transmission path 3. It is configured to transmit to the image display device 2.
- BPSK method BPSK method, QAM method, OFDM method, etc.
- the control unit 10 is composed of hardware including an MPU (Micro-Processing Unit) and a memory, and software including a program group stored in the memory and executed by the MPU. That is, the control part 10 is comprised so that various processes mentioned later may be performed by executing each program by MPU (computer).
- MPU Micro-Processing Unit
- the storage unit 14 is configured to store a plurality of operation conditions of the image processing unit 12.
- the storage unit 14 includes a rewritable nonvolatile semiconductor memory such as a flash memory.
- the operating conditions of the image processing unit 12 include at least the number of pixels of the image to be transmitted to the image display device 2, the number of frames, the frame interval, and the compression specification (compression method).
- the image transmission device 1 is connected to a plurality of image display devices 2 via a transmission path 3.
- the storage unit 14 includes a plurality of identification codes assigned to the plurality of image display devices 2 in order to individually identify the plurality of image display devices 2 (2A, 2B, 2C,. It is configured to store a data table representing the correspondence with a plurality of operation conditions for each display device 2.
- one or more user IDs assigned to one or more users together with a plurality of identification codes for identifying the plurality of image display devices 2 or instead of the plurality of identification codes The storage unit 14 may store a data table representing the correspondence with a plurality of operation conditions for each user ID.
- the user ID is preferably associated with a password.
- the control unit 10 is preferably configured to authenticate each user by a plurality of pairs stored in the storage unit 14 each including a user ID and a password.
- the image transmission apparatus 1 includes a housing 100 made of a rectangular parallelepiped synthetic resin molding as shown in FIG. 2, and the above-described control unit 10, imaging unit 11, and the like housed in the housing 100.
- An image processing unit 12, a transmission unit 13, a storage unit 14, and the like are included.
- a hemispherical lens cover 102 is rotatably provided on the front surface of the housing 100. Further, the lens cover 102 is fixed with the solid-state imaging device and the optical component (lens 101) of the imaging unit 11. That is, when the lens cover 102 is rotated by a driving mechanism (not shown), the posture (imaging range) of the solid-state imaging device and the lens 101 is changed.
- the drive mechanism is configured to be controlled by the control unit 10.
- the housing 100 is configured to be installed on a desk (not shown) or fixed to a wall, ceiling, or the like.
- the image transmission apparatus 1 is generally called a network camera.
- the image transmission apparatus 1 is installed in a residence, and an image obtained by capturing the inside of the residence is transmitted to the image display device 2 to monitor the inside of the residence. Used for.
- the installation location of the image transmission device 1 according to the present embodiment is not limited to the inside of the house (indoor), and may be outside the house (the house side or outdoors).
- the image display device 2 includes a control unit 20, a display unit (display device) 21, an image processing unit 22, a transmission unit (second transmission device) 23, and a storage unit 24. And an operation input unit (operation input device) 25.
- the transmission unit 23 is configured to receive a transmission signal transmitted via the transmission path 3 and digitally demodulate the transmission signal by a predetermined digital demodulation method to acquire the packet (data).
- the transmission unit 23 is configured to reconstruct original (one frame) image data from a plurality of received packets (data) and output the reconstructed image data to the image processing unit 22. Further, the transmission unit 23 is configured to transmit a transmission signal including data other than image data, for example, control data for giving an instruction to the image transmission apparatus 1 via the transmission path 3.
- the image processing unit 22 includes, for example, a frame memory and a DSP.
- the frame memory is configured to store image data output from the transmission unit 23.
- the DSP is configured to perform various image processes by executing a product-sum operation on image data read from the frame memory. The image processing performed by the image processing unit 22 will be described later.
- the display unit 21 includes, for example, a liquid crystal display and a driving circuit for the liquid crystal display.
- the display unit 21 may include an organic EL display and a drive circuit for the organic EL display instead of the liquid crystal display.
- the drive circuit receives image data from the image processing unit 22 via DVI (Digital Visual Interface) and drives the liquid crystal display to display images (moving images and still images) corresponding to the received image data. Configured to do.
- DVI Digital Visual Interface
- the operation input unit 25 is configured to receive an operation input by a person and output an electrical signal (operation signal) corresponding to the operation input to the control unit 20.
- Such an operation input part 25 is comprised by input devices, such as a touch panel and a keyboard, for example.
- the control unit 20 includes hardware including an MPU and a memory, and software including a group of programs stored in the memory and executed by the MPU. That is, the control unit 20 is configured to execute various processes to be described later by executing each program by the MPU.
- the storage unit 24 is composed of a rewritable nonvolatile semiconductor memory such as a flash memory, and stores a unique identification code.
- the image display device 2 includes a wired or wireless communication function and a device (such as a liquid crystal display) for displaying an image, such as a desktop or notebook personal computer, or a tablet terminal or a smartphone. If it is. However, when the image display device 2 is the personal computer, the tablet terminal, or the smartphone, the display unit 21 and the operation input unit 25 may be integrated as a touch panel (also referred to as a touch screen).
- a touch panel also referred to as a touch screen
- the control unit 20 when a predetermined operation input is received by the operation input unit 25, the control unit 20 generates a command (image request command) for requesting image transmission.
- the transmission unit 23 generates a transmission signal including the image request command received from the control unit 20, and transmits the transmission signal to the image transmission apparatus 1 via the transmission path 3.
- the transmission unit 13 receives the transmission signal and passes the image request command and the transmission source address demodulated from the transmission signal to the control unit 10.
- the source address is a unique identification code (for example, IP address) assigned to the image display device 2 (for example, 2A), and is assigned to the plurality of image display devices 2 (2A, 2B, 2C,). A plurality of identification codes are assigned in advance.
- control unit 10 When the control unit 10 receives the image request command and the transmission source address, the control unit 10 reads an operation condition corresponding to the transmission source address (identification code) from the data table of the storage unit 14. Then, the control unit 10 operates the image processing unit 12 under the read operating conditions.
- the image processing unit 12 obtains (detects) the degree of change of the image in time series according to the procedure shown in the flowchart of FIG. That is, the image processing unit 12 acquires new image data from the imaging unit 11 (step S1), and then resets the counter to zero (step S2). Subsequently, the image processing unit 12 acquires the next new image data from the imaging unit 11 (step S3), and calculates an inter-frame difference between the previous image data and the current image data (step S4).
- the image processing unit 12 determines whether or not the difference value of the interframe difference is within a predetermined range (step S5). Specifically, in the inter-frame difference, the image processing unit 12 determines whether or not each pixel difference value between the frames is equal to or greater than a threshold value, and sets a pixel area that is equal to or greater than the threshold value as a moving object area. Extract. Next, the image processing unit 12 determines whether or not the movement range (movement distance) of the extracted area of the moving object is within the predetermined range (below the predetermined distance). If the movement range is within the predetermined range (if the movement distance is equal to or less than the predetermined distance), the image processing unit 12 performs an edge (contour) extraction process on the current image data (step S6).
- a predetermined range Specifically, in the inter-frame difference, the image processing unit 12 determines whether or not each pixel difference value between the frames is equal to or greater than a threshold value, and sets a pixel area that is equal to or greater than the threshold value as
- the control unit 10 stores the result of the edge extraction processing (hereinafter referred to as “edge extraction result”) in the storage unit 14. As a result, the edge extraction result for the past image data is stored in the storage unit 14.
- the image processing unit 12 adds 1 to the counter (step S7). Further, the image processing unit 12 compares the counter value with a predetermined value (step S8), and if the counter value is equal to or smaller than the predetermined value, the process returns to step S3. When the value of the counter becomes larger than the predetermined value, the image processing unit 12 turns on the image instability flag (first flag) stored in the storage unit 14 (step S9), and then proceeds to step S6. Then, the edge extraction process is executed on the current image data.
- the image processing unit 12 compares the edge extraction result for the past image data with the edge extraction result for the current image data, and the difference obtained from the both edge extraction results (for example, the shape and position of the extracted edge). Etc.) is determined (detected) (step S10).
- the difference is obtained as a difference value between a past edge extraction result and a current edge extraction result, for example.
- the image processing unit 12 determines whether or not the difference (difference value) in the edge extraction result is within a predetermined range (step S11). For example, if the difference value of the size of the edge is less than or equal to a predetermined value, or the difference value of the edge position is less than or equal to the predetermined value, the process is terminated. On the other hand, if the difference between the edge extraction results is outside the predetermined range, the image processing unit 12 turns on the image change flag (second flag) stored in the storage unit 14 (step S12), and then ends the processing. To do. For example, if the difference value of the size of the edge shape exceeds a predetermined value or the difference value of the edge position exceeds a predetermined value, the image processing unit 12 turns on the second flag and ends the processing.
- the image processing unit 12 is configured to detect a specific subject (for example, a moving object carried by a person or a stationary object such as a window in addition to a moving object of a person) from the edge extraction result.
- a specific subject for example, a moving object carried by a person or a stationary object such as a window in addition to a moving object of a person
- FIG. 4 it is assumed that a person is hardly moving (or is still) in a plurality of continuous (three in the illustrated example) frames F n ⁇ 1 , F n , and F n + 1. .
- both the image instability flag and the image change flag are turned off in the image processing of the image processing unit 12 described above.
- the control unit 10 selects an operation condition corresponding to a case where the image instability flag and the image change flag are both off among the plurality of operation conditions stored in the storage unit 14 (first operation when no moving object is detected). Condition) is selected and read from the storage unit 14. Then, the control unit 10 converts the image (still image) of one frame F n of the plurality of frames F n ⁇ 1 , F n , F n + 1 into a JPEG image according to the read operation condition. It is preferable to instruct the processing unit 12.
- the image processing unit 12 receives the instruction from the control unit 10, and outputs to the transmission unit 13 converts the image of the one frame F n in JPEG images.
- the transmission unit 13 transmits the JPEG image output from the image processing unit 12 to the image display device 2 via the transmission path 3.
- the image transmission device 1 can transmit resources that are small in change of a subject as a still image instead of a moving image, and can reliably transmit necessary images while suppressing waste of resources.
- the attitude of the image transmission device 1 (the imaging unit 11). (Imaging range) is not changed, and it is assumed that a subject (a person and / or a moving object (for example, luggage)) is moving greatly. At this time, in the image processing of the image processing unit 12 described above, it is considered that the image instability flag is turned on because the subject (person and / or moving object) moves greatly.
- the image change flag is turned off because subjects other than humans (stationary objects such as furniture and windows) do not move.
- the rectangular figure shown by the lower left in each frame in FIG. 5 shows the luggage which a person carries.
- the control unit 10 selects an operation condition corresponding to the case where the image instability flag is on and the image change flag is off among the plurality of operation conditions stored in the storage unit 14 (first operation condition when detecting a moving object). ) Is selected and read from the storage unit 14. Then, the control unit 10 causes the image processing unit 12 to compress and encode an image composed of the plurality of frames F n ⁇ 2 , F n ⁇ 1 , F n , and F n + 1 as a moving image according to the read operation condition. It is preferable to indicate.
- the image processing unit 12 compresses and encodes an image composed of the plurality of frames F n ⁇ 2 , F n ⁇ 1 , F n , and F n + 1 as a moving image, and sends it to the transmission unit 13. Output.
- the transmission unit 13 transmits the image data (moving image data) output from the image processing unit 12 to the image display device 2 via the transmission path 3. That is, the image transmission apparatus 1 can monitor the state in the house in detail by transmitting an image with a large change in the subject as a moving image instead of a still image.
- control unit 10 read in accordance with operating conditions (operating conditions and different operating conditions of the FIG. 5), the plurality of frame F n-1, F n, of one of the F n + 1 frame F n
- the image processing unit 12 may be instructed to convert an image (still image) into a JPEG image.
- the image (frame) selected by the control unit 10 is preferably an image in which a person appears in the position closest to the center of the image.
- the image processing unit 12 receives the instruction from the control unit 10, and outputs to the transmission unit 13 converts the image of the one frame F n in JPEG images.
- the transmission unit 13 transmits the JPEG image output from the image processing unit 12 to the image display unit 2 via the transmission path 3. That is, the image transmission unit 1 transmits, as a still image, not a moving image, for an image in which the main subject (a person and / or a moving object) changes greatly and another subject (a stationary object such as furniture) changes little. Therefore, it is possible to suppress waste of resources and to reliably transmit a necessary image.
- the image transmission apparatus 1 when the state in which the posture of the image transmission apparatus 1 (the imaging range of the imaging unit 11) is changed or the state where the lens 101 is hidden by a cloth or the like is maintained, a plurality of consecutive frames are included. Since there is no significant change, the image instability flag is turned off. On the other hand, in the comparison with the past edge extraction results, the image change flag is turned on because the subject has moved greatly.
- control unit 10 selects an operation condition corresponding to the case where the image instability flag is off and the image change flag is on among the plurality of operation conditions stored in the storage unit 14 (when no moving object is detected).
- the second operation condition is selected and read from the storage unit 14.
- the control unit 10 reduces the plurality of frames F n ⁇ 2 , F n ⁇ 1 , F n , and F n + 1 , and reduces the plurality of reduced frames f n ⁇ 2 , f n ⁇ 1 , f n , and f n + 1 .
- the image processing unit 12 is instructed to arrange the images (thumbnail images) vertically and horizontally and combine them into one still image.
- the image processing unit 12 converts the images of the four frames F n ⁇ 2 , F n ⁇ 1 , F n , and F n + 1 into reduced JPEG images, and these four frames JPEG images of frames f n-2 , f n ⁇ 1 , f n , and f n + 1 are arranged vertically and horizontally to synthesize one frame of JPEG image (see FIG. 7).
- the transmission unit 13 transmits the JPEG image output from the image processing unit 12 to the image display device 2 via the transmission path 3. Then, by displaying the JPEG image on the display unit 21 of the image display device 2, it is possible to alert the user (monitoring person) to take an appropriate countermeasure.
- the image transmission apparatus 1 of the present embodiment when the image transmission apparatus 1 of the present embodiment is installed so as to be placed on a table top or a shelf of a desk, for example, the image transmission apparatus 1 is moved by a pet (dog or cat, etc.) raised indoors, or moved. There is a possibility of being.
- the image captured under such circumstances is the degree of change in time series, that is, the inter-frame difference between a plurality of (four in the illustrated example) frames F n ⁇ 2 , F n ⁇ 1 , F n , and F n + 1. Is expected to be considerably larger (see FIG. 7).
- control unit 10 selects an operation condition corresponding to the case where the image instability flag and the image change flag are both turned on among the plurality of operation conditions stored in the storage unit 14 (when the moving object is detected). 2 operation conditions) is selected and read from the storage unit 14.
- the control unit 10 preferably executes at least one of the following second to fourth processes according to the read operation condition. More preferably, the control unit 10 further executes the first process.
- control unit 10 In the first process, the control unit 10 generates a message notifying that the imaging unit 11 is not stationary, and transmits a transmission signal including the message from the transmission unit 13 to the image display device 2. In the image display device 2 that has received the message, the control unit 20 displays the message on the display unit 21 so that the user (monitoring person) can be alerted to take appropriate measures. .
- the control unit 10 selects any one of the plurality of frames F n ⁇ 2 , F n ⁇ 1 , F n , and F n + 1 (for example, F n ). Further, the control unit 10 instructs the image processing unit 12 to convert the JPEG image obtained by reducing an image (still image) of the frame F n selected. Alternatively, the control unit 10 instructs the image processing unit 12 to convert an image (still image) of the frame F n selected in highly compressed JPEG images.
- the image processing unit 12 receives the instruction from the control unit 10, and outputs to the transmitting unit 13 converts the one frame F n JPEG image or a high compression ratio JPEG image obtained by reducing the image.
- the transmission unit 13 transmits the JPEG image output from the image processing unit 12 to the image display device 2 via the transmission path 3. Then, by displaying the JPEG image on the display unit 21 of the image display device 2, it is possible to alert the user (monitoring person) to take an appropriate countermeasure.
- the control unit 10 reduces the plurality of frames F n ⁇ 2 , F n ⁇ 1 , F n , and F n + 1 and also reduces the plurality of reduced frames f n ⁇ 2 , f n ⁇ 1 ,
- the image processing unit 12 is instructed to arrange the images f n and f n + 1 (thumbnail images) vertically and horizontally and combine them into one still image (see FIG. 7).
- the image processing unit 12 converts the images of the four frames F n ⁇ 2 , F n ⁇ 1 , F n , and F n + 1 into reduced JPEG images, and these four frames JPEG images of frames f n ⁇ 2 , f n ⁇ 1 , f n , and f n + 1 are arranged vertically and horizontally to synthesize one frame of JPEG image.
- the transmission unit 13 transmits the JPEG image output from the image processing unit 12 to the image display device 2 via the transmission path 3. Then, by displaying the JPEG image on the display unit 21 of the image display device 2, it is possible to alert the user (monitoring person) to take an appropriate countermeasure.
- control unit 10 instructs the image processing unit 12 to generate a reduced moving image by reducing the number of pixels.
- the image processing unit 12 receives an instruction from the control unit 10 and generates a reduced moving image by reducing (thinning out) the number of pixels of a plurality of frames.
- the transmission unit 13 transmits the moving image generated by the image processing unit 12 to the image display device 2 via the transmission path 3. Then, by displaying the reduced moving image on the display unit 21 of the image display device 2, it is possible to alert the user (monitor) to take appropriate measures.
- the image transmission apparatus 1 After the image transmission apparatus 1 receives the previous image request command and transmits an image, it may fall into the abnormal situation as described above until the current image request command is received (see FIG. 8). .
- the image processing unit 12 follows the flowchart shown in FIG. 3 and the image F m corresponding to the previous image request command and the image F n corresponding to the current image request command are time-sequentially. Calculate the degree of change. If the image processing unit 12 determines that the degree exceeds the upper limit value (if the image instability flag is turned on), the image processing unit 12 notifies the control unit 10 of the determination result.
- the control unit 10 preferably selects an operation condition stored in the storage unit 14 and executes at least one of the following two processes.
- the control unit 10 In the first process, the control unit 10 generates a message notifying that an abnormality has occurred in the image transmission apparatus 1 (for example, falling down), and transmits a transmission signal including the message from the transmission unit 13. The image is transmitted to the image display device 2. In the image display device 2 that has received the message, the control unit 20 displays the message on the display unit 21 so that the user (monitoring person) can be alerted to take appropriate measures. .
- control unit 10 instructs the image processing unit 12 to convert images (still images) of a plurality of frames F n corresponding to the current image request command into reduced JPEG images f n. .
- control unit 10 instructs the image processing unit 12 to convert the frame F n of the image (still image) in highly compressed JPEG images.
- the image processing unit 12 receives the instruction from the control unit 10, and outputs to the transmitting unit 13 converts the one frame F n JPEG image or a high compression ratio JPEG image obtained by reducing the image.
- the transmission unit 13 transmits the JPEG image output from the image processing unit 12 to the image display device 2 via the transmission path 3. Then, by displaying the JPEG image on the display unit 21 of the image display device 2, it is possible to alert the user (monitoring person) to take an appropriate countermeasure.
- the image transmission device 1 includes the imaging unit 11, the image processing unit 12, the transmission unit 13, the storage unit 14, and the control unit 10.
- the imaging unit 11 is configured to capture an image.
- the image processing unit 12 is configured to perform image processing on the image captured by the imaging unit 11.
- the transmission unit 13 is configured to transmit an image obtained by image processing to one or more image display apparatuses 2 via the transmission path 3.
- the storage unit 14 is configured to store a plurality of operation conditions of the image processing unit 12.
- the control unit 10 selects an operation condition corresponding to the image captured by the imaging unit 11 from among a plurality of operation conditions stored in the storage unit 14, and operates the image processing unit 12 with the selected operation condition. Configured to let
- the image transmission system of the present embodiment includes the image transmission device 1 and one or more image display devices 2 connected to the image transmission device 1 via the transmission path 3.
- the image display device 2 includes a transmission unit 23 and a display unit 21. Further, the image display device 2 is configured to receive an image transmitted from the image transmission device 1 via the transmission path 3 by the transmission unit 23 and display the image received by the transmission unit 23 on the display unit 21. .
- the image transmission apparatus 1 and the image transmission system according to the present embodiment are configured as described above, resources are wasted when the image processing unit 12 operates under an operation condition corresponding to an image captured by the imaging unit 11. It is possible to suppress and transmit a necessary image reliably.
- the imaging unit 11 is preferably configured to capture an image at a predetermined frame rate.
- the image processing unit 12 obtains (detects) the degree to which the image obtained from the image processing unit 12 changes in time series, and selects one or more frames of images from the plurality of images obtained from the imaging unit 11.
- the control unit 10 preferably selects an operation condition corresponding to the degree from among a plurality of operation conditions stored in the storage unit 14. Further, the control unit 10 operates the image processing unit 12 under the selected operating condition, and transmits one or more frames of images corresponding to the number of pixels, the number of frames, the frame interval, and the compression specifications included in the operating condition. 13 is preferably configured to transmit to the image display device 2.
- the image transmission apparatus 1 is configured as described above, and operates the image processing unit 12 under operating conditions corresponding to the degree to which the image changes in time series (the state of the image instability flag and the image change flag). The time and power required for image transmission can be minimized.
- the control unit 10 determines that the predetermined operating condition is satisfied when the degree exceeds the threshold value for a predetermined time or longer (when the image instability flag is turned on). Is preferably configured to select. Further, the control unit 10 operates the image processing unit 12 under the predetermined operation condition to reduce a plurality of frames of images and arranges the reduced thumbnail images of the plurality of frames vertically and horizontally to form a composite image that is one frame. Preferably, it is generated (see FIG. 7). Furthermore, the control unit 10 is preferably configured to transmit the composite image from the transmission unit 13 to the image display device 2.
- the synthesized image is displayed on the display unit 21 of the image display device 2, so that the user (monitoring person) can be alerted to take appropriate measures.
- the image processing unit 12 is configured to generate the composite image so that the number of pixels of the composite image is the same as the number of pixels of the images of the plurality of frames before reduction. Is preferred.
- the control unit 10 determines a predetermined operation condition when the state where the degree exceeds the threshold value continues for a predetermined time or longer (when the image instability flag is turned on). Is preferably configured to select. Further, the control unit 10 operates the image processing unit 12 under the predetermined operating condition to select one frame image (still image), and transmits the selected one frame image from the transmission unit 13 to the image display device 2. It is preferable to be configured (see FIGS. 4 and 6).
- the image transmission apparatus 1 can transmit a necessary image reliably while suppressing waste of resources by transmitting an image with a small change in subject as a still image instead of a moving image.
- the control unit 10 performs a predetermined operation when the degree of the predetermined number of pixels or more in the image exceeds a predetermined threshold (when the image change flag is turned on). It is preferably configured to select conditions. Further, the control unit 10 operates the image processing unit 12 under the predetermined operation condition to select one frame image, and transmits the selected one frame image (still image) from the transmission unit 13 to the image display device 2. It is preferable to be configured (see FIG. 8).
- the image processing unit 12 is preferably configured to generate a thumbnail image obtained by reducing the image when operating under predetermined operating conditions (see FIG. 7).
- the control unit 10 is preferably configured to transmit the thumbnail image from the transmission unit 13 to the image display device 2.
- the image processing unit 12 is preferably configured to generate an image obtained by compressing the image at a relatively high compression rate when operating under the predetermined operating condition.
- the control unit 10 is preferably configured to transmit the compressed image from the transmission unit 13 to the image display device 2.
- the control unit 10 selects a predetermined operating condition when the degree in the specific area of the image is larger than the degree in the other area except the specific area. It is preferable to be configured as described above.
- the image processing unit 12 is configured to select an image of one frame (frame F n ) in which the distance between the specific area and the center of the image is minimized when operating under the predetermined operating condition. It is preferable (see FIG. 6).
- the control unit 10 is preferably configured to transmit the selected one-frame image (frame F n ) from the transmission unit 13 to the image display device 2.
- the image transmission device 1 includes an imaging unit 11, an image processing unit 12, a transmission unit 13, a storage unit 14, and a control unit 20.
- the imaging unit 11 is configured to capture an image at a predetermined frame rate to obtain a captured image.
- the image processing unit 12 is configured to perform image processing of a captured image and generate a processed image.
- the transmission unit 13 is configured to transmit the processed image to one or more image display devices 2 via the transmission path 3.
- the storage unit 14 performs a first operation condition for image processing of a captured image obtained from a preset area and a second operation for image processing of a captured image under an environment different from the captured image to be obtained from the area. It is configured to store at least the operating conditions.
- the control unit 20 compares the captured image from the imaging unit 11 with the captured image obtained in advance from the area, so that the captured image from the imaging unit 11 is the captured image obtained from the area or the area. It is comprised so that it may be determined whether it is a picked-up image of the environment different from the picked-up image which should be obtained from.
- the control unit 20 operates the image processing unit 12 according to the first operation condition stored in the storage unit 14 when the captured image from the imaging unit 11 is a captured image obtained from the above area.
- the image processing unit 12 is configured to operate according to the second operation condition stored in the storage unit 14 when the captured image from the unit 11 is a captured image under an environment different from the captured image to be obtained from the area. Is done. In this embodiment, it is possible to determine whether the imaging unit 11 has obtained a captured image from a preset area. As a result, the image processing unit 12 can be appropriately operated depending on whether the imaging unit 11 obtains a captured image from a preset area.
- control unit 20 performs in advance the first processing result that is the result of the edge extraction process performed on the captured image from the imaging unit 11 and the captured image obtained in advance from the area.
- the second processing result that is the result of the executed edge extraction processing is compared.
- the control unit 20 operates the image processing unit 12 according to the first operation condition if the difference obtained from the first processing result and the second processing result is within a predetermined range, and if the difference is outside the predetermined range.
- the image processing unit 12 is configured to operate according to the second operation condition.
- the first operation condition includes a condition for generating a processed image as a moving image or one still image from a plurality of captured images from the imaging unit 11.
- the second operation condition is a processing image as a single still image including a plurality of thumbnail images from a plurality of captured images from the imaging unit 11 or a moving image obtained by reducing the number of pixels of the plurality of captured images. Includes conditions for generating a processed image.
- the second operation condition is a condition for adding information (for example, a message) indicating that the captured image from the imaging unit 11 is a captured image under an environment different from the captured image to be obtained from the area to the processed image. Further, it may be included.
- the second operation condition may include a condition for generating a processed image as one still image from a plurality of captured images from the imaging unit 11 and adding the information to the processed image.
- the present invention is not limited to the image transmission apparatus 1 and may be an image transmission method or program to which various embodiments of the present specification can be applied.
- the image transmission method is executed by the image transmission apparatus 1 (specifically, the control unit 10).
- the image transmission device 1 includes an imaging unit 11, an image processing unit 12, a transmission unit 13, and a storage unit 14.
- the imaging unit 11 is configured to capture an image.
- the image processing unit 12 is configured to perform image processing on the image captured by the imaging unit 11.
- the transmission unit 13 is configured to transmit an image obtained by image processing to one or more image display apparatuses 2 via a transmission path.
- the storage unit 14 is configured to store a plurality of operation conditions of the image processing unit 12.
- the image transmission method selects an operation condition corresponding to an image captured by the imaging unit 11 from among a plurality of operation conditions stored in the storage unit 14, and the image is selected according to the selected operation condition. This includes operating the processing unit 12.
- the program according to an embodiment causes a computer to function as the control unit 10 of the image transmission apparatus 1.
- the image transmission device 1 includes an imaging unit 11, an image processing unit 12, a transmission unit 13, and a storage unit 14.
- the imaging unit 11 is configured to capture an image.
- the image processing unit 12 is configured to perform image processing on the image captured by the imaging unit 11.
- the transmission unit 13 is configured to transmit an image obtained by image processing to one or more image display apparatuses 2 via a transmission path.
- the storage unit 14 is configured to store a plurality of operation conditions of the image processing unit 12.
- the program of the present embodiment selects a computer from among a plurality of operation conditions stored in the storage unit 14 and selects an operation condition corresponding to an image captured by the image capturing unit 11, and an image with the selected operation condition.
- the processing unit 12 is caused to function as the control unit 10 configured to operate.
Landscapes
- Engineering & Computer Science (AREA)
- Multimedia (AREA)
- Signal Processing (AREA)
- Closed-Circuit Television Systems (AREA)
Abstract
Description
Claims (11)
- 画像を撮像するように構成される撮像部と、
前記撮像部で撮像された画像の画像処理を行うように構成される画像処理部と、
前記画像処理で得られた画像を伝送路を介して1乃至複数の画像表示装置に伝送するように構成される伝送部と、
前記画像処理部の複数通りの動作条件を記憶するように構成される記憶部と、
前記記憶部が記憶している前記複数通りの動作条件のうち、前記撮像部で撮像された画像に対応した動作条件を選択し、且つ選択した前記動作条件で前記画像処理部を動作させるように構成される制御部と
を備えることを特徴とする画像伝送装置。 - 前記撮像部は、所定のフレームレートで画像を撮像するように構成され、
前記画像処理部は、前記撮像部から得られる画像が時系列で変化する度合を求め、且つ前記撮像部から得られる複数の画像のうち、1乃至複数フレームの画像を選択して圧縮するように構成され、
前記制御部は、前記記憶部が記憶している前記複数通りの動作条件のうち、前記度合に対応した動作条件を選択し、前記画像処理部をその選択した動作条件で動作させ、前記動作条件に含まれる画素数とフレーム数とフレーム間隔と圧縮仕様に対応した1乃至複数フレームの画像を前記伝送部から前記画像表示装置へ伝送するように構成される
ことを特徴とする請求項1記載の画像伝送装置。 - 前記制御部は、
前記度合がしきい値を超える状態が所定時間以上継続した場合に所定の動作条件を選択し、
前記所定の動作条件で前記画像処理部を動作させて、複数フレームの画像を縮小し、
且つ当該縮小した複数フレームのサムネイル画像を縦横に並べて1フレームとした合成画像を生成し、
前記合成画像を前記伝送部から前記画像表示装置へ伝送する
ように構成されることを特徴とする請求項2記載の画像伝送装置。 - 前記画像処理部は、前記合成画像の画素数が、縮小前の前記複数フレームの画像の各画素数と同一の画素数になるように、前記合成画像を生成するように構成されることを特徴とする請求項3記載の画像伝送装置。
- 前記制御部は、
前記度合がしきい値を超える状態が所定時間以上継続した場合に所定の動作条件を選択し、
前記所定の動作条件で前記画像処理部を動作させて1フレームの画像を選択し、
選択した1フレームの画像を前記伝送部から前記画像表示装置へ伝送するように構成されることを特徴とする請求項2記載の画像伝送装置。 - 前記制御部は、
前記画像中の所定数以上の画素における前記度合が所定のしきい値を超える場合に所定の動作条件を選択し、
前記所定の動作条件で前記画像処理部を動作させて1フレームの画像を選択し、選択した1フレームの画像を前記伝送部から前記画像表示装置へ伝送するように構成されることを特徴とする請求項2記載の画像伝送装置。 - 前記画像処理部は、前記所定の動作条件で動作する場合、前記画像を縮小したサムネイル画像を生成するように構成され、
前記制御部は、前記サムネイル画像を前記伝送部から前記画像表示部へ送信するように構成されることを特徴とする請求項5又は6記載の画像伝送装置。 - 前記画像処理部は、前記所定の動作条件で動作する場合、前記画像を相対的に高い圧縮率で圧縮した画像を生成するように構成され、
前記制御部は、前記圧縮された画像を前記伝送部から前記画像表示装置へ送信するように構成されることを特徴とする請求項5又は6記載の画像伝送装置。 - 前記制御部は、前記画像の特定の領域における前記度合が、前記特定の領域を除く他の領域における前記度合よりも大きい場合に所定の動作条件を選択するように構成され、
前記画像処理部は、
前記所定の動作条件で動作する場合、前記特定の領域と、前記画像の中心との距離が極小となる1フレームの画像を選択し、
選択された1フレームの画像を前記伝送部から前記画像表示装置へ伝送するように構成されることを特徴とする請求項2記載の画像伝送装置。 - 前記撮像部は、所定のフレームレートで画像を撮像して撮像画像を得るように構成され、
前記画像処理部は、前記撮像画像の画像処理を行って処理画像を生成するように構成され、
前記伝送部は、前記伝送路を介して前記1乃至複数の画像表示装置に前記処理画像を伝送するように構成され、
前記記憶部は、予め設定されたエリアから得られた撮像画像の画像処理用の第1動作条件と、前記エリアから得られるべき撮像画像とは異なる環境下の撮像画像の画像処理用の第2動作条件とを少なくとも記憶するように構成され、
前記制御部は、
前記撮像部からの撮像画像を、前記エリアから予め得られた撮像画像と比較することにより、前記撮像部からの撮像画像が前記エリアから得られた撮像画像であるか前記エリアから得られるべき撮像画像とは異なる環境下の撮像画像であるかを判定し、
前記撮像部からの撮像画像が前記エリアから得られた撮像画像である場合には前記記憶部に記憶された前記第1動作条件に従って前記画像処理部を動作させる一方、前記撮像部からの撮像画像が前記エリアから得られるべき撮像画像とは異なる環境下の撮像画像である場合には前記記憶部に記憶された前記第2動作条件に従って前記画像処理部を動作させる
ように構成される
ことを特徴とする請求項1記載の画像伝送装置。 - 請求項1~10の何れかの画像伝送装置と、伝送路を介して前記画像伝送装置に接続される1乃至複数の画像表示装置とを備え、
前記画像表示装置は、第2の伝送部と、表示部とを備え、前記伝送路を介して前記画像伝送装置から伝送される前記画像を前記第2の伝送部で受信し、前記第2の伝送部で受信する前記画像を前記表示部で表示するように構成される
ことを特徴とする画像伝送システム。
Priority Applications (2)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
EP15751692.3A EP3110143A4 (en) | 2014-02-21 | 2015-02-13 | IMAGE TRANSMISSION DEVICE AND IMAGE TRANSMISSION SYSTEM |
JP2016503963A JPWO2015125441A1 (ja) | 2014-02-21 | 2015-02-13 | 画像伝送装置及び画像伝送システム |
Applications Claiming Priority (2)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
JP2014031985 | 2014-02-21 | ||
JP2014-031985 | 2014-02-21 |
Publications (1)
Publication Number | Publication Date |
---|---|
WO2015125441A1 true WO2015125441A1 (ja) | 2015-08-27 |
Family
ID=53877965
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
PCT/JP2015/000649 WO2015125441A1 (ja) | 2014-02-21 | 2015-02-13 | 画像伝送装置及び画像伝送システム |
Country Status (3)
Country | Link |
---|---|
EP (1) | EP3110143A4 (ja) |
JP (1) | JPWO2015125441A1 (ja) |
WO (1) | WO2015125441A1 (ja) |
Cited By (1)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US10171777B2 (en) | 2015-12-31 | 2019-01-01 | Amazon Technologies, Inc. | Streaming and storing video content captured by an audio/video recording and communication device |
Families Citing this family (1)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN111866457B (zh) * | 2020-07-14 | 2022-07-12 | 广州市宏视电子技术有限公司 | 监控图像处理方法、电子设备、存储介质及*** |
Citations (5)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
JPH08181975A (ja) * | 1994-12-22 | 1996-07-12 | Mitsubishi Denki Eng Kk | 画像監視装置 |
JP2000184367A (ja) * | 1998-12-14 | 2000-06-30 | Olympus Optical Co Ltd | カメラ制御装置及び記録媒体 |
JP2004056655A (ja) * | 2002-07-23 | 2004-02-19 | Sony Corp | 信号処理システムと信号処理方法と信号処理プログラムおよび撮像装置とコンテンツ提示装置 |
JP2006109251A (ja) * | 2004-10-07 | 2006-04-20 | Victor Co Of Japan Ltd | 画像認証方法及び画像認証装置 |
JP2010288230A (ja) * | 2009-06-15 | 2010-12-24 | Tokai Paudekkusu:Kk | 動画情報中継システム、及び動画情報中継プログラム |
Family Cites Families (2)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
KR100390672B1 (ko) * | 2000-12-01 | 2003-07-07 | (주)아이디스 | 영상 압축 장치 및 방법 |
JP4831017B2 (ja) * | 2007-08-27 | 2011-12-07 | ソニー株式会社 | 画像処理装置、現像装置、画像処理方法、現像方法、画像処理プログラム、および現像プログラム |
-
2015
- 2015-02-13 JP JP2016503963A patent/JPWO2015125441A1/ja active Pending
- 2015-02-13 WO PCT/JP2015/000649 patent/WO2015125441A1/ja active Application Filing
- 2015-02-13 EP EP15751692.3A patent/EP3110143A4/en not_active Withdrawn
Patent Citations (5)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
JPH08181975A (ja) * | 1994-12-22 | 1996-07-12 | Mitsubishi Denki Eng Kk | 画像監視装置 |
JP2000184367A (ja) * | 1998-12-14 | 2000-06-30 | Olympus Optical Co Ltd | カメラ制御装置及び記録媒体 |
JP2004056655A (ja) * | 2002-07-23 | 2004-02-19 | Sony Corp | 信号処理システムと信号処理方法と信号処理プログラムおよび撮像装置とコンテンツ提示装置 |
JP2006109251A (ja) * | 2004-10-07 | 2006-04-20 | Victor Co Of Japan Ltd | 画像認証方法及び画像認証装置 |
JP2010288230A (ja) * | 2009-06-15 | 2010-12-24 | Tokai Paudekkusu:Kk | 動画情報中継システム、及び動画情報中継プログラム |
Non-Patent Citations (1)
Title |
---|
See also references of EP3110143A4 * |
Cited By (1)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US10171777B2 (en) | 2015-12-31 | 2019-01-01 | Amazon Technologies, Inc. | Streaming and storing video content captured by an audio/video recording and communication device |
Also Published As
Publication number | Publication date |
---|---|
EP3110143A1 (en) | 2016-12-28 |
JPWO2015125441A1 (ja) | 2017-03-30 |
EP3110143A4 (en) | 2016-12-28 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
US10454986B2 (en) | Video synchronous playback method, apparatus, and system | |
JP6175587B2 (ja) | 撮像装置、フリッカ検出方法、及びフリッカ検出プログラム | |
US10574991B2 (en) | Apparatus and method for processing image | |
JP2006245746A (ja) | 監視システム | |
US10904423B2 (en) | Image providing apparatus and method | |
JP2017524284A (ja) | 動画像出力可能な監視カメラ及びその監視カメラを含む動画像送受信システム | |
WO2015125441A1 (ja) | 画像伝送装置及び画像伝送システム | |
JP6809114B2 (ja) | 情報処理装置、画像処理システム、プログラム | |
US9948903B2 (en) | Method for configuration of video stream output from a digital video camera | |
US11295589B2 (en) | Image processing device and method for simultaneously transmitting a plurality of pieces of image data obtained from a plurality of camera modules | |
KR101077777B1 (ko) | 네트워크 카메라 시스템, 그의 영상 데이터 처리 방법 및 그의 운용 방법 | |
KR101020670B1 (ko) | 원격테스트 기능을 구비한 방범 시스템 | |
KR20160104988A (ko) | 경찰청 영상 관제 시스템 | |
KR101278562B1 (ko) | 세대 보안 현관카메라를 이용한 홈 네트워크 시스템 | |
CN111782876A (zh) | 一种数据处理方法、装置、***及存储介质 | |
JP4325596B2 (ja) | ネットワーク監視カメラシステム | |
KR101431115B1 (ko) | 휴대용 단말기를 이용한 감시 장치 | |
EP3070598A1 (en) | Image processing system and method | |
JP2005328333A (ja) | 監視システム | |
US20120019672A1 (en) | Internet protocol camera for visual monitoring system | |
JP2016021716A (ja) | 追尾装置及びその制御方法 | |
TWM495585U (zh) | 居家保全影像監控系統 | |
JP3061430U (ja) | 遠隔監視セキュリティシステム | |
JP2004336127A (ja) | 監視システム | |
US20230056104A1 (en) | Modification of Camera Functionality Based on Orientation |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
121 | Ep: the epo has been informed by wipo that ep was designated in this application |
Ref document number: 15751692 Country of ref document: EP Kind code of ref document: A1 |
|
ENP | Entry into the national phase |
Ref document number: 2016503963 Country of ref document: JP Kind code of ref document: A |
|
REEP | Request for entry into the european phase |
Ref document number: 2015751692 Country of ref document: EP |
|
WWE | Wipo information: entry into national phase |
Ref document number: 2015751692 Country of ref document: EP |
|
NENP | Non-entry into the national phase |
Ref country code: DE |