WO2017068678A1 - Camera and code amount control program - Google Patents

Camera and code amount control program Download PDF

Info

Publication number
WO2017068678A1
WO2017068678A1 PCT/JP2015/079797 JP2015079797W WO2017068678A1 WO 2017068678 A1 WO2017068678 A1 WO 2017068678A1 JP 2015079797 W JP2015079797 W JP 2015079797W WO 2017068678 A1 WO2017068678 A1 WO 2017068678A1
Authority
WO
WIPO (PCT)
Prior art keywords
code amount
camera
encoded data
target
amount
Prior art date
Application number
PCT/JP2015/079797
Other languages
French (fr)
Japanese (ja)
Inventor
西川 博文
Original Assignee
三菱電機株式会社
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 三菱電機株式会社 filed Critical 三菱電機株式会社
Priority to PCT/JP2015/079797 priority Critical patent/WO2017068678A1/en
Priority to JP2017546335A priority patent/JP6253864B2/en
Publication of WO2017068678A1 publication Critical patent/WO2017068678A1/en

Links

Images

Classifications

    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N23/00Cameras or camera modules comprising electronic image sensors; Control thereof
    • H04N23/60Control of cameras or camera modules

Definitions

  • the present invention relates to a technique for stabilizing the code amount of video communicated by a camera system having a plurality of cameras.
  • a control device that controls the entire system.
  • Each camera requests permission from the control device to improve the image quality of the video, and the control device responds to each camera with permission or rejection in consideration of the request from each camera. This improves the image quality of a specific camera while stabilizing the operation of the entire system.
  • Patent Document 1 describes a message exchanged between each camera and a control device as means for constructing the monitoring system as described above.
  • a conventional monitoring system requires a control device that controls the entire system.
  • Each camera needs to request permission from the control device in order to improve the image quality of the video. Furthermore, it is necessary to design a message for exchanging between each camera and the control device.
  • An object of the present invention is to stabilize the code amount of video communicated by a camera system having a plurality of cameras.
  • the camera of the present invention is one of a plurality of cameras.
  • the camera An image sensor for generating first video data;
  • An encoder that encodes the first video data according to a target amount to generate first encoded data;
  • a receiver that receives code amount information that specifies the code amount of other encoded data generated by another camera for each other camera of the plurality of cameras;
  • a target amount calculation unit that calculates a code amount target of the first encoded data as the target amount using the code amount specified by the received code amount information.
  • the code amount of the first encoded data can be adjusted according to the code amount of the other encoded data. Therefore, it is possible to stabilize the code amount of video communicated by the camera system.
  • FIG. 1 is a configuration diagram of a camera system 100 according to Embodiment 1.
  • FIG. FIG. 2 is a schematic diagram of a configuration of a camera 200 according to Embodiment 1.
  • 2 is a configuration diagram of a camera 200 in Embodiment 1.
  • FIG. 4 is a flowchart of a first code amount control method according to the first embodiment.
  • 6 is a flowchart of target amount calculation processing (step S130) in the first embodiment.
  • 5 is a flowchart of a second code amount control method according to the first embodiment.
  • FIG. 6 is a configuration diagram of a camera 200 according to Embodiment 2.
  • 10 is a flowchart of a first code amount control method according to the second embodiment.
  • FIG. 10 is a configuration diagram of a camera 200 according to Embodiment 3.
  • FIG. 10 is a flowchart of a first code amount control method according to Embodiment 3.
  • 10 is a flowchart of a second code amount control method according to Embodiment 3.
  • FIG. 10 is a configuration diagram of a camera 200 according to Embodiment 4.
  • 10 is a flowchart of a first code amount control method according to the fourth embodiment.
  • FIG. 10 is a configuration diagram of a camera 200 according to Embodiment 5.
  • 10 is a flowchart of a first code amount control method according to the fifth embodiment.
  • 10 is a flowchart of a second code amount control method according to the fifth embodiment.
  • FIG. 10 is a configuration diagram of a camera 200 according to Embodiment 6.
  • 18 is a flowchart of a first code amount control method according to the sixth embodiment.
  • Embodiment 1 FIG. A camera system 100 having a plurality of cameras 200 will be described with reference to FIGS.
  • the configuration of the camera system 100 will be described with reference to FIG.
  • the camera system 100 includes a plurality of cameras 200, a hub 110 to which the plurality of cameras 200 are connected, and a video recording device 120 connected to the hub 110.
  • the camera system 100 can be used for a monitoring system or a security system.
  • the camera 200 is a photographing device that captures an image. Specifically, the camera 200 is a video camera that captures moving images.
  • the camera 200 transmits encoded data 202 generated by encoding video data to the video recording apparatus 120 via the hub 110.
  • the encoded data 202 is compressed video data.
  • the video is an image displayed on the display, and the video data is digital video data.
  • the camera 200 communicates with other cameras 200 code amount information 204 that specifies the code amount of the encoded data 202.
  • the code amount corresponds to the data amount of the encoded data 202.
  • the code amount of the encoded data 202 changes as the image changes. Specifically, when a person enters or exits the range captured by the camera 200, the code amount of the encoded data 202 increases or decreases. Also, the code amount of the encoded data 202 can be adjusted by changing the encoding method for generating the encoded data 202. Specifically, the code amount of the encoded data 202 can be adjusted by changing the value of the quantization parameter or the macroblock type.
  • the hub 110 is a relay device that relays data.
  • the hub 110 receives the encoded data 202 transmitted from the camera 200 and transmits the received encoded data 202 to the video recording device 120.
  • the video recording device 120 is a device having a function of recording the encoded data 202. Specifically, the video recording device 120 is a viewer or a recorder. The video recording device 120 receives the encoded data 202 transmitted from the hub 110 and records the received encoded data 202. The video recording apparatus 120 serving as a viewer restores an image using the encoded data 202 and displays the restored image on a display.
  • the configuration of the camera 200 will be described based on FIG.
  • the camera 200 includes hardware such as a computer 900, an image sensor 921, and an encoder 922.
  • the image sensor 921 generates video data 201.
  • the image sensor 921 is a CCD image sensor or a CMOS image sensor.
  • CCD is an abbreviation for Charge-Coupled Device.
  • CMOS is an abbreviation for Complementary MOS, and MOS is an abbreviation for Metal Oxide Semiconductor.
  • Video data 201 is input to encoder 922.
  • the encoder 922 generates the encoded data 202 by encoding the video data 201 according to the target amount 205.
  • the encoded data 202 is input to the computer 900.
  • the computer 900 transmits the encoded data 202 generated by the encoder 922 to the video recording device 120 via the hub 110.
  • the computer 900 transmits code amount information 204 for specifying the code amount of the encoded data 202 to the other camera 200. Further, the computer 900 receives the code amount information 204 from the other camera 200 and calculates a target amount 205 that is a target of the code amount of the encoded data 202. The target amount 205 is input to the encoder 922.
  • the computer 900 includes hardware such as a processor 901, a memory 902, an auxiliary storage device 903, and a communication device 910.
  • the processor 901 is connected to other hardware via a signal line.
  • the processor 901 is an IC (Integrated Circuit) that performs processing, and controls other hardware.
  • the processor 901 is a CPU, DSP, or GPU.
  • CPU is an abbreviation for Central Processing Unit
  • DSP is an abbreviation for Digital Signal Processor
  • GPU is an abbreviation for Graphics Processing Unit.
  • the memory 902 is a volatile storage device.
  • the memory 902 is also called main memory or main memory.
  • the memory 902 is a RAM (Random Access Memory).
  • the data stored in the memory 902 is saved in the auxiliary storage device 903 as necessary.
  • the data saved in the auxiliary storage device 903 is loaded into the memory 902 as necessary.
  • the memory 902 functions as a storage unit that stores data.
  • the auxiliary storage device 903 is a nonvolatile storage device. Specifically, the auxiliary storage device 906 is a ROM, HDD, or flash memory. ROM is an abbreviation for Read Only Memory, and HDD is an abbreviation for Hard Disk Drive.
  • the auxiliary storage device 903 functions as a storage unit that stores data.
  • the communication device 910 includes a receiver 911 and a transmitter 912. Specifically, the communication device 910 is a communication chip or a NIC (Network Interface Card).
  • the communication device 910 functions as a communication unit that communicates data
  • the receiver 911 functions as a reception unit that receives data
  • the transmitter 912 functions as a transmission unit that transmits data.
  • the memory 902 stores data used, generated or input / output by the computer 900. Specifically, the target total amount 291, the adjustment coefficient 292, the ratio coefficient 293, the code amount 203, and the like are stored in the memory 902. The contents of each data will be described later.
  • the auxiliary storage device 903 stores programs that realize the functions of “units” such as a code amount calculation unit 210, a target amount calculation unit 221, a target amount setting unit 222, and a communication management unit 230.
  • a program that realizes the function of “unit” is loaded into the memory 902 and executed by the processor 901.
  • the function of “part” will be described later.
  • the auxiliary storage device 906 stores an OS (Operating System). At least a part of the OS is loaded into the memory 902, and the processor 901 executes a program that realizes the function of “unit” while executing the OS.
  • the computer 900 may include a plurality of processors 901, and the plurality of processors 901 may execute a program that realizes the function of “unit” in cooperation with each other.
  • a program that realizes the function of “unit” can be stored in a nonvolatile storage medium such as a magnetic disk, an optical disk, or a flash memory.
  • the result of the “part” processing is stored in the memory 902, the auxiliary storage device 903, a register in the processor 901, or a cache memory in the processor 901.
  • Part Hardware in which the processor 901, the memory 902, and the auxiliary storage device 903 are collected is referred to as a “processing circuit”. “Part” may be read as “process”, “procedure”, or “processing”. The function of “unit” may be realized by firmware.
  • the operation of the camera 200 corresponds to a code amount control method.
  • the procedure of the code amount control method corresponds to the procedure of the code amount control program.
  • the code amount control method is a general term for the Xth code amount control method.
  • the procedure of the first code amount control method for controlling the code amount 203 of the first encoded data 202 which is the encoded data 202 generated by the encoder 922 in the camera 200, will be described based on FIG.
  • the procedure of the first code amount control method is executed every time code amount information 204 is transmitted from another camera 200.
  • Step S110 is information reception processing.
  • the receiver 911 receives the code amount information 204 transmitted from the other camera 200.
  • the other camera 200 transmits a packet including the code amount information 204 and a camera identifier for identifying itself to the network between the cameras by multicast.
  • the packet includes a header and a payload, and the code amount information 204 and the camera identifier are set in the payload.
  • the code amount information 204 included in this packet is information for specifying the code amount 203 of the other encoded data 202 that is the encoded data 202 generated by the other camera 200.
  • the code amount information 204 of the other camera 200 is the code amount 203 of the other encoded data 202.
  • the specific code amount 203 is a bit rate representing the data amount of the encoded data 202 to be transmitted. The bit rate indicates the number of bits per second.
  • the receiver 911 receives a packet including the code amount information 204 and the camera identifier.
  • Step S120 is a code amount storage process.
  • the communication management unit 230 stores the code amount 203 of the other encoded data 202 in the memory 902.
  • the code amount 203 of the other encoded data 202 is stored in the memory 902 as follows.
  • the communication management unit 230 acquires the code amount information 204 and the camera identifier of the other camera 200 from the received packet.
  • the acquired code amount information 204 is the code amount 203 of the other encoded data 202.
  • the communication management unit 230 stores the code amount 203 of the other encoded data 202 in the memory 902 in association with the camera identifier of the other camera 200.
  • the communication management unit 230 overwrites the code amount 203 stored in the memory 902 with the acquired code amount 203.
  • Step S130 is a target amount calculation process.
  • the target amount calculation unit 221 calculates the target of the code amount 203 of the first encoded data 202 as the target amount 205, using the code amount 203 specified by the received code amount information 204. That is, the target amount calculation unit 221 calculates the target amount 205 using the code amount 203 of the other encoded data 202.
  • the target amount calculation unit 221 calculates the target amount 205 using the target total amount 291 and the code amount of the other encoded data 202 for each of the other cameras 200.
  • the target total amount 291 is a target value of the total code amount of the first encoded data 202 and the other encoded data 202 for each other camera.
  • the target total amount 291 is a bit rate allowed for the entire camera system 100.
  • the target amount calculation unit 221 calculates the target amount 205 using the target total amount 291, the code amount of the other encoded data 202 for each other camera 200, and the ratio coefficient 293.
  • the ratio coefficient 293 is a value indicating a target of the ratio of the code amount of the first encoded data 202 to the total code amount of the encoded data 202 of each of the plurality of cameras 200.
  • the memory 902 stores a code amount of the first encoded data 202 and a code amount 203 of other encoded data 202 for each of the other cameras 200.
  • the target amount calculation unit 221 calculates the current total amount by adding the code amount of the first encoded data 202 and the code amount of the other encoded data 202 for each of the other cameras 200.
  • the current total amount is the sum of the code amount of the first encoded data 202 and the code amount of the other encoded data 202 for each of the other cameras 200.
  • the current total amount includes the code amount of the encoded data 202 generated by the first camera 200 and the encoding generated by the second camera 200. This is the sum of the code amount of the data 202 and the code amount of the encoded data 202 generated by the third camera 200.
  • step S132 the target amount calculation unit 221 calculates a difference amount by subtracting the current total amount from the target total amount 291.
  • the difference amount is a value obtained by subtracting the current total amount from the target total amount 291. That is, when the current total amount is smaller than the target total amount 291, the difference amount becomes a positive value. If the current total amount is larger than the target total amount 291, the difference amount becomes a negative value.
  • step S133 the target amount calculation unit 221 calculates the adjustment amount by multiplying the difference amount by the adjustment coefficient 292.
  • the adjustment amount is a value obtained by multiplying the difference amount by the adjustment coefficient 292.
  • the adjustment coefficient 292 is a positive coefficient for adjusting the difference amount.
  • a specific adjustment coefficient 292 is 1/2. That is, the adjustment amount is 1 ⁇ 2 of the difference amount.
  • step S134 the target amount calculation unit 221 calculates the adjustment total amount by adding the adjustment amount to the current total amount.
  • the adjusted total amount is a value obtained by adding the adjusted amount to the current total amount.
  • step S135 the target amount calculation unit 221 calculates the target amount 205 by multiplying the adjusted total amount by the ratio coefficient 293.
  • the target amount 205 is a value obtained by multiplying the adjustment total amount by the ratio coefficient 293.
  • Step S140 is a target amount setting process.
  • the target amount setting unit 222 sets the target amount 205 in the encoder 922. Specifically, the target amount setting unit 222 generates a setting code including the target amount 205 and inputs the generated setting code to the encoder 922. Then, the encoder 922 overwrites the target amount 205 included in the input setting code with the target amount 205 set in the memory in the encoder 922. After the target setting process (step S140), the encoder 922 generates the first encoded data 202 according to the newly set target amount 205.
  • the code amount 203 of the other encoded data 202 increases, the code amount 203 of the own encoded data 202 decreases and the code amount 203 of the other encoded data 202 decreases.
  • the code number decreases, the code amount 203 of its own encoded data 202 increases.
  • the procedure of the second code amount control method for controlling the code amount 203 of the other encoded data 202 will be described.
  • the procedure of the second code amount control method is executed every time the information transmission interval elapses.
  • the information transmission interval is a predetermined time.
  • a range in which the image sensor 921 in the camera 200 captures an image is referred to as a first capturing range.
  • Step S210 is a video data generation process.
  • the image sensor 921 generates first video data 201 that is digital data of a video in which the first shooting range is reflected, and outputs the generated first video data 201.
  • the output first video data 201 is input to the encoder 922.
  • the image sensor 921 generates and outputs the first video data 201 every time the shooting interval elapses.
  • the shooting interval is a predetermined time. When the frame rate is 10 frames / second, the shooting interval is 0.1 seconds. Since the operation of the image sensor 921 is the same as the operation of the conventional image sensor, the details of the video data generation process (step S210) will be omitted.
  • Step S220 is an encoded data generation process.
  • the encoder 922 encodes the first video data 201 according to the target amount 205 to generate the first encoded data 202, and outputs the generated first encoded data 202.
  • the output first encoded data 202 is input to the computer 900.
  • the encoder 922 selects a quantization parameter value and a macroblock type according to the target amount 205 set in the memory in the encoder 922.
  • the encoder 922 encodes the first video data 201 using the selected quantization parameter value and macroblock type. Accordingly, encoded data 202 having a code amount close to the target amount 205 is generated as the first encoded data 202.
  • the quantization parameter value is a quantization parameter value
  • the macroblock type is a macroblock coding type.
  • the encoder 922 generates and inputs the first encoded data 202 every time the first video data 201 is input. Since the operation of the encoder 922 is the same as the operation of the conventional encoder, the details of the encoded data generation process (step S220) will be omitted.
  • Step S230 is an encoded data transmission process.
  • the transmitter 912 transmits the first encoded data 202 to the video recording device 120.
  • the first encoded data 202 is transmitted as follows.
  • the communication management unit 230 generates a payload including the first encoded data 202, the shooting time, and the camera identifier, and inputs the generated payload to the transmitter 912.
  • the shooting time is the time when the first video data 201 is generated.
  • the transmitter 912 generates a packet including the input payload, and transmits the generated packet to the video recording device 120 via the hub 110.
  • the transmitted packet is received by the video recording device 120, and the first video data 201 is recorded in the video recording device 120 in association with the shooting time and the camera identifier.
  • Step S240 is a code amount calculation process.
  • the code amount calculation unit 210 calculates the code amount 203 of the first encoded data 202. Specifically, the code amount calculation unit 210 calculates the bit rate of the first encoded data 202 as the code amount 203 of the first encoded data 202. Then, the code amount calculation unit 210 stores the calculated code amount 203 in the memory 902 in association with the camera identifier of the camera 200. When the code amount 203 associated with the same camera identifier is already stored in the memory 902, the code amount calculation unit 210 overwrites the code amount 203 stored in the memory 902 with the calculated code amount 203.
  • Step S250 is information transmission processing.
  • the transmitter 912 transmits the first code amount information 204 to the other camera 200.
  • the first code amount information 204 is transmitted as follows.
  • the first code amount information 204 is the code amount 203 of the first encoded data 202.
  • the communication management unit 230 generates a payload that includes the code amount 203 of the first encoded data 202 and the camera identifier of the camera 200, and inputs the generated payload to the transmitter 912.
  • the transmitter 912 generates a packet including the input payload, and transmits the generated packet to the network between the cameras by multicast.
  • the transmitted packet is received by each other camera 200.
  • the code amount 203 of its own encoded data 202 increases, the code amount 203 of the other encoded data 202 decreases and the code amount 203 of its own encoded data 202 decreases.
  • the code amount 203 of the other encoded data 202 increases.
  • the camera 200 decreases the code amount 203 of its own encoded data 202 when the code amount 203 of the other encoded data 202 increases, and changes its own amount when the code amount 203 of the other encoded data 202 decreases.
  • the code amount 203 of the encoded data 202 can be increased.
  • the camera 200 decreases the code amount 203 of the other encoded data 202 when the code amount 203 of the own encoded data 202 increases, and decreases the code amount 203 of the own encoded data 202.
  • the code amount 203 of the other encoded data 202 can be increased. Therefore, the camera 200 can stabilize the entire code amount of the encoded data 202 communicated by the camera system 100. That is, the camera system 100 can stabilize the entire code amount without having a control device that controls the plurality of cameras 200. Therefore, it is not necessary to design a message exchanged between the plurality of cameras 200 and the control device.
  • the camera system 100 may include two cameras 200 or four or more cameras 200.
  • the camera 200 may transmit the encoded data 202 directly to the video recording device 120 without using the hub 110.
  • the encoded data 202 and the code amount information 204 may be communicated either by wire or wirelessly.
  • the first code amount control method and the second code amount control method may be executed at an arbitrary timing.
  • the target amount 205 may be calculated by a method different from the method described in the target amount calculation process (step S130).
  • FIG. A mode in which the operation of the other camera 200 is stopped when the code amount 203 of the other encoded data 202 is abnormal will be described with reference to FIGS. 7 and 8. However, the description which overlaps with Embodiment 1 is abbreviate
  • the camera 200 includes a computer 900, an image sensor 921, and an encoder 922.
  • the computer 900 includes a processor 901, a memory 902, an auxiliary storage device 903, and a communication device 910.
  • the auxiliary storage device 903 includes a program that realizes the functions of “units” such as a code amount calculation unit 210, a target amount calculation unit 221, a target amount setting unit 222, a communication management unit 230, an abnormality detection unit 241, and a stop command unit 242. It is remembered.
  • a program that realizes the function of “unit” is loaded into the memory 902 and executed by the processor 901.
  • a first code amount control method will be described with reference to FIG. 8 includes steps S111 and S112 in addition to steps S110 and S120 to S140 described in the first embodiment.
  • step S110 the receiver 911 receives a packet transmitted from another camera 200.
  • the received packet includes code amount information 204.
  • the code amount information 204 included in the received packet is the code amount 203 of the other encoded data 202.
  • Step S111 is an abnormality detection process.
  • the abnormality detection unit 241 detects, as abnormality information, code amount information 204 that specifies an abnormal code amount. Specifically, the abnormality detection unit 241 acquires the code amount 203 as the code amount information 204 from the received packet, and compares the acquired code amount 203 with a code amount threshold. When the code amount 203 is larger than the code amount threshold, the code amount information 204 included in the received packet is abnormality information.
  • the code amount threshold is a predetermined value. A specific code amount threshold is 1 ⁇ 2 of the target total amount 291.
  • the procedure of the first code amount control method proceeds to step S112. If the code amount information 204 is not detected as abnormality information, the procedure of the first code amount control method proceeds to step S120.
  • Step S112 is a stop command process.
  • the stop command unit 242 commands the other camera 200 corresponding to the abnormality information to stop the operation.
  • the stop command unit 242 commands the other camera 200 corresponding to the abnormality information to stop the operation as follows.
  • the stop command unit 242 acquires a transmission source address from the received packet.
  • the stop instruction unit 242 generates a payload including a stop instruction that instructs to stop the operation.
  • the stop command unit 242 inputs the generated payload and the acquired transmission source address to the transmitter 912.
  • the transmitter 912 generates a packet including the input payload, sets the transmission source address in the header of the generated packet, and transmits the packet to the network between the cameras.
  • the transmitted packet is received by another camera 200 which is a transmission source of the packet including the abnormality information.
  • the other camera 200 stops its operation according to the stop command. Thereafter, the encoded data 202 and the code amount information 204 are not transmitted from the other cameras 200 that have stopped operating.
  • the camera 200 can stop the operation of the other camera 200 when the code amount 203 of the other encoded data 202 is abnormal. Therefore, the camera 200 can stabilize the entire code amount of the encoded data 202 communicated by the camera system 100.
  • Embodiment 3 A form in which the quantization parameter value having a strong correlation with the code amount 203 is used as the code amount information 204 will be described with reference to FIGS. However, the description which overlaps with Embodiment 1 is abbreviate
  • the camera 200 includes a computer 900, an image sensor 921, and an encoder 922.
  • the computer 900 includes a processor 901, a memory 902, an auxiliary storage device 903, and a communication device 910.
  • the auxiliary storage device 903 stores programs that realize the functions of “units” such as a code amount calculation unit 210, a target amount calculation unit 221, a target amount setting unit 222, a communication management unit 230, and an information acquisition unit 250.
  • a program that realizes the function of “unit” is loaded into the memory 902 and executed by the processor 901.
  • a first code amount control method will be described with reference to FIG. 10 includes step S121 in addition to step S110, step S130, and step S140 described in the first embodiment.
  • step S ⁇ b> 110 the receiver 911 receives the code amount information 204 transmitted from the other camera 200.
  • the code amount information 204 of the other camera 200 is a quantization parameter value used as a quantization parameter value when other encoded data 202 is generated.
  • Step S121 is a code amount calculation process.
  • the code amount calculation unit 210 calculates the code amount 203 of the other encoded data 202 using the quantization parameter value that is the code amount information 204 of the other camera 200.
  • the code amount calculation unit 210 calculates the code amount 203 of the other encoded data 202 by calculating the code amount function with the quantization parameter value that is the code amount information 204 of the other camera 200 as an input.
  • the code amount function is a function in which an algorithm for calculating the code amount 203 using the quantization parameter value is defined. By calculating the code amount function, the code amount 203 having a magnitude inversely proportional to the magnitude of the quantization parameter value is calculated. That is, the larger the quantization parameter value, the smaller the code amount 203, and the smaller the quantization parameter value, the larger the code amount 203.
  • the code amount calculation unit 210 stores the code amount 203 of the other encoded data 202 in the memory 902, similarly to the communication management unit 230 in step S120 in the first embodiment.
  • step S ⁇ b> 130 the target amount calculation unit 221 calculates the target amount 205 using the code amount 203 of the other encoded data 202.
  • step S ⁇ b> 140 the target amount setting unit 222 sets the target amount 205 in the encoder 922.
  • a second code amount control method will be described with reference to FIG. 11 includes step S261 in addition to steps S210 to S250 described in the first embodiment.
  • step S210 the image sensor 921 generates first video data 201.
  • step S ⁇ b> 220 the encoder 922 encodes the first video data 201 according to the target amount 205 to generate first encoded data 202.
  • step S230 the transmitter 912 transmits the first encoded data 202 to the video recording device 120.
  • step S240 the code amount calculation unit 210 calculates the code amount 203 of the first encoded data 202, and stores the calculated code amount 203 in the memory 902. After step S240, the procedure of the second code amount control method proceeds to step S261.
  • Step S261 is information generation processing.
  • the information acquisition unit 250 acquires the first code amount information 204.
  • the first code amount information 204 is acquired as follows.
  • the first code amount information 204 is a quantization parameter value used as a quantization parameter value when the first encoded data 202 is generated.
  • the information acquisition unit 250 requests the encoder 922 for a quantization parameter value.
  • the encoder 922 returns the quantization parameter value set in the memory in the encoder 922 to the information acquisition unit 250. Then, the information acquisition unit 250 receives the returned quantization parameter value.
  • step S261 the procedure of the second code amount control method proceeds to step S250.
  • step S250 the transmitter 912 transmits the first code amount information 204 to the other camera 200.
  • the camera 200 can stabilize the entire code amount of the encoded data 202 communicated by the camera system 100, as in the first embodiment.
  • Embodiment 4 FIG. A mode in which the operation of the other camera 200 is stopped when the code amount 203 of the other encoded data 202 is abnormal will be described with reference to FIGS. 12 and 13. However, the description which overlaps with Embodiment 3 is omitted.
  • the camera 200 includes a computer 900, an image sensor 921, and an encoder 922.
  • the computer 900 includes a processor 901, a memory 902, an auxiliary storage device 903, and a communication device 910.
  • the auxiliary storage device 903 includes functions of “units” such as a code amount calculation unit 210, a target amount calculation unit 221, a target amount setting unit 222, a communication management unit 230, an abnormality detection unit 241, a stop command unit 242, and an information acquisition unit 250.
  • a program for realizing is stored.
  • a program that realizes the function of “unit” is loaded into the memory 902 and executed by the processor 901.
  • the first code amount control method will be described with reference to FIG. 13 includes steps S113 and S114 in addition to steps S110 and S121 to S140 described in the third embodiment.
  • the receiver 911 receives a packet transmitted from another camera 200.
  • the received packet includes code amount information 204.
  • the code amount information 204 included in the received packet is a quantization parameter value used as a quantization parameter value when other encoded data 202 is generated.
  • Step S113 is an abnormality detection process.
  • the abnormality detection unit 241 detects, as abnormality information, code amount information 204 that identifies an abnormal code amount. Specifically, the abnormality detection unit 241 acquires a quantization parameter value that is the code amount information 204 from the received packet, and compares the acquired quantization parameter value with a parameter threshold value. When the quantization parameter value is smaller than the parameter threshold value, the code amount information 204 included in the received packet is abnormal information.
  • the parameter threshold value is a predetermined value.
  • Step S114 is a stop command process.
  • the stop instruction unit 242 instructs the other camera 200 corresponding to the abnormality information to stop the operation.
  • This stop command process (step S114) is the same as the stop command process (step S112) described in the second embodiment.
  • the camera 200 can stabilize the entire code amount of the encoded data 202 communicated by the camera system 100.
  • Embodiment 5 A mode in which a macroblock type having a strong correlation with the code amount 203 is used as the code amount information 204 will be described with reference to FIGS. However, the description which overlaps with Embodiment 1 is abbreviate
  • the camera 200 includes a computer 900, an image sensor 921, and an encoder 922.
  • the computer 900 includes a processor 901, a memory 902, an auxiliary storage device 903, and a communication device 910.
  • the auxiliary storage device 903 stores programs that realize the functions of “units” such as a code amount calculation unit 210, a target amount calculation unit 221, a target amount setting unit 222, a communication management unit 230, and an information acquisition unit 250.
  • a program that realizes the function of “unit” is loaded into the memory 902 and executed by the processor 901.
  • the first code amount control method will be described based on FIG. 15 includes step S122 in addition to step S110, step S130, and step S140 described in the first embodiment.
  • step S ⁇ b> 110 the receiver 911 receives the code amount information 204 transmitted from the other camera 200.
  • the code amount information 204 of the other camera 200 is a macroblock type used when other encoded data 202 is generated.
  • Step S122 is a code amount calculation process.
  • the code amount calculation unit 210 calculates the code amount 203 of the other encoded data 202 using the macroblock type that is the code amount information 204 of the other camera 200.
  • the code amount calculation unit 210 calculates the code amount 203 of the other encoded data 202 as follows.
  • the type coefficient table and the reference amount are stored in the memory 902.
  • the type coefficient table is a table including type coefficients associated with macroblock types.
  • the reference amount is a reference code amount.
  • the code amount calculation unit 210 acquires a type coefficient associated with a macroblock type that is the code amount information 204 of another camera 200 from the type coefficient table. Then, the code amount calculation unit 210 calculates the code amount 203 by multiplying the acquired type coefficient by the reference amount.
  • the code amount 203 is a value obtained by multiplying the reference amount by the type coefficient.
  • the code amount calculation unit 210 stores the code amount 203 of the other encoded data 202 in the memory 902, similarly to the communication management unit 230 in step S120 in the first embodiment.
  • step S ⁇ b> 130 the target amount calculation unit 221 calculates the target amount 205 using the code amount 203 of the other encoded data 202.
  • step S ⁇ b> 140 the target amount setting unit 222 sets the target amount 205 in the encoder 922.
  • step S262 in addition to steps S210 to S250 described in the first embodiment.
  • step S210 the image sensor 921 generates first video data 201.
  • step S ⁇ b> 220 the encoder 922 encodes the first video data 201 according to the target amount 205 to generate first encoded data 202.
  • step S230 the transmitter 912 transmits the first encoded data 202 to the video recording device 120.
  • step S240 the code amount calculation unit 210 calculates the code amount 203 of the first encoded data 202, and stores the calculated code amount 203 in the memory 902. After step S240, the procedure of the second code amount control method proceeds to step S262.
  • Step S262 is information generation processing.
  • the information acquisition unit 250 acquires the first code amount information 204.
  • the first code amount information 204 is acquired as follows.
  • the first code amount information 204 is a macroblock type used when the first encoded data 202 is generated.
  • the information acquisition unit 250 requests the encoder 922 for the macro block type.
  • the encoder 922 returns the macro block type set in the memory in the encoder 922 to the information acquisition unit 250. Then, the information acquisition unit 250 receives the returned macro block type.
  • step S262 the procedure of the second code amount control method proceeds to step S250.
  • step S250 the transmitter 912 transmits the first code amount information 204 to the other camera 200.
  • the camera 200 can stabilize the entire code amount of the encoded data 202 communicated by the camera system 100, as in the first embodiment.
  • Embodiment 6 FIG. A mode in which the operation of the other camera 200 is stopped when the code amount 203 of the other encoded data 202 is abnormal will be described with reference to FIGS. 17 and 18. However, the description which overlaps with Embodiment 4 is abbreviate
  • the configuration of the camera 200 includes a computer 900, an image sensor 921, and an encoder 922.
  • the computer 900 includes a processor 901, a memory 902, an auxiliary storage device 903, and a communication device 910.
  • the auxiliary storage device 903 includes functions of “units” such as a code amount calculation unit 210, a target amount calculation unit 221, a target amount setting unit 222, a communication management unit 230, an abnormality detection unit 241, a stop command unit 242, and an information acquisition unit 250.
  • a program for realizing is stored.
  • a program that realizes the function of “unit” is loaded into the memory 902 and executed by the processor 901.
  • a first code amount control method will be described with reference to FIG. 18 includes steps S115 and S116 in addition to steps S110 and S122 to S140 described in the sixth embodiment.
  • the receiver 911 receives a packet transmitted from another camera 200.
  • the received packet includes code amount information 204.
  • the code amount information 204 included in the received packet is a macroblock type used when other encoded data 202 is generated.
  • Step S115 is an abnormality detection process.
  • the abnormality detection unit 241 detects code amount information 204 that identifies an abnormal code amount as abnormality information. Specifically, the abnormality detection unit 241 acquires the macroblock type that is the code amount information 204 from the received packet, and compares the acquired macroblock type with the abnormal type. When the macroblock type is the same as the abnormal type, the code amount information 204 included in the received packet is abnormal information.
  • the abnormal type is a macroblock type used when encoded data 202 having an abnormal code amount is generated.
  • the procedure of the first code amount control method proceeds to step S116. If the code amount information 204 is not detected as abnormality information, the procedure of the first code amount control method proceeds to step S122.
  • Step S116 is a stop command process.
  • the stop command unit 242 commands the other camera 200 corresponding to the abnormality information to stop the operation.
  • This stop command process (step S116) is the same as the stop command process (step S112) described in the second embodiment.
  • the camera 200 can stabilize the entire code amount of the encoded data 202 communicated by the camera system 100.
  • each embodiment is an example of a preferred embodiment and is not intended to limit the technical scope of the present invention. Each embodiment may be implemented partially or in combination with other embodiments. Specifically, in Embodiments 2, 4, and 6, the processor 901 of the camera 200 may not function as the target amount calculation unit 221 and the target amount setting unit 222.
  • the procedure described using the flowcharts is an example of the procedure of the camera, the code amount control method, and the code amount control program.
  • the function of the camera 200 may be realized by hardware.
  • FIG. 19 shows a configuration when the function of the camera 200 is realized by hardware.
  • the camera 200 includes a processing circuit 990.
  • the processing circuit 990 is also called a processing circuit.
  • the processing circuit 990 is a dedicated electronic circuit that realizes the function of the “unit” described in each embodiment.
  • the “unit” includes a memory unit that functions as the memory 902 and the auxiliary storage device 903.
  • the processing circuit 990 is a single circuit, a composite circuit, a programmed processor, a parallel programmed processor, a logic IC, a GA, an ASIC, an FPGA, or a combination thereof.
  • the camera 200 may include a plurality of processing circuits 990, and the plurality of processing circuits 990 may realize the function of “unit” in cooperation.
  • the function of the camera 200 may be realized by a combination of software and hardware. That is, a part of “part” may be realized by software, and the rest of “part” may be realized by hardware.

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Studio Devices (AREA)
  • Compression Or Coding Systems Of Tv Signals (AREA)

Abstract

A camera system (100) comprises: a plurality of cameras (200), each of which generates coded data (202) of video; and a video recording device (120) that recodes the coded data generated by each of the plurality of cameras. The camera receives code amount information (204) for identifying the code amount of the coded data generated by another camera. Next, by using the code amount identified in the received code amount information, the camera calculates a target amount which is a target of the code amount of the coded data for the camera. The camera then sets the target amount in an encoder thereof to generate code data having a code amount close to the target amount.

Description

カメラおよび符号量制御プログラムCamera and code amount control program
 本発明は、複数のカメラを有するカメラシステムで通信される映像の符号量を安定させる技術に関するものである。 The present invention relates to a technique for stabilizing the code amount of video communicated by a camera system having a plurality of cameras.
 多数台のカメラを用いた従来の監視システムでは、システム全体を統括する制御装置が設けられている。
 そして、各カメラは映像の画質を向上するための許可を制御装置に要求し、制御装置は各カメラの要求を勘案して各カメラに許可または拒否を応答する。
 これにより、システム全体の動作を安定させながら特定のカメラの画質が向上される。
In a conventional monitoring system using a large number of cameras, a control device that controls the entire system is provided.
Each camera requests permission from the control device to improve the image quality of the video, and the control device responds to each camera with permission or rejection in consideration of the request from each camera.
This improves the image quality of a specific camera while stabilizing the operation of the entire system.
 特許文献1には、上記のような監視システムを構築するための手段として、各カメラと制御装置との間でやり取りされるメッセージについて記載されている。 Patent Document 1 describes a message exchanged between each camera and a control device as means for constructing the monitoring system as described above.
 上記のように、従来の監視システムには、システム全体を統括する制御装置が必要である。そして、各カメラは、映像の画質を向上するために、制御装置に許可を要求する必要がある。さらに、各カメラと制御装置との間でやり取りを行うためのメッセージを設計する必要がある。 As described above, a conventional monitoring system requires a control device that controls the entire system. Each camera needs to request permission from the control device in order to improve the image quality of the video. Furthermore, it is necessary to design a message for exchanging between each camera and the control device.
特開2000-069455号公報JP 2000-0669455 A
 本発明は、複数のカメラを有するカメラシステムで通信される映像の符号量を安定させることを目的とする。 An object of the present invention is to stabilize the code amount of video communicated by a camera system having a plurality of cameras.
 本発明のカメラは、複数のカメラのうちの1つのカメラである。
 前記カメラは、
 第1の映像データを生成するイメージセンサと、
 前記第1の映像データを目標量に応じて符号化して第1の符号化データを生成するエンコーダと、
 前記複数のカメラのうちの他のカメラ毎に、他のカメラによって生成された他の符号化データの符号量を特定する符号量情報を受信するレシーバと、
 受信された符号量情報で特定される符号量を用いて、前記第1の符号化データの符号量の目標を前記目標量として算出する目標量算出部とを備える。
The camera of the present invention is one of a plurality of cameras.
The camera
An image sensor for generating first video data;
An encoder that encodes the first video data according to a target amount to generate first encoded data;
A receiver that receives code amount information that specifies the code amount of other encoded data generated by another camera for each other camera of the plurality of cameras;
A target amount calculation unit that calculates a code amount target of the first encoded data as the target amount using the code amount specified by the received code amount information.
 本発明によれば、他の符号化データの符号量に応じて第1の符号化データの符号量を調整することができる。そのため、カメラシステムで通信される映像の符号量を安定させることができる。 According to the present invention, the code amount of the first encoded data can be adjusted according to the code amount of the other encoded data. Therefore, it is possible to stabilize the code amount of video communicated by the camera system.
実施の形態1におけるカメラシステム100の構成図。1 is a configuration diagram of a camera system 100 according to Embodiment 1. FIG. 実施の形態1におけるカメラ200の構成の概要図。FIG. 2 is a schematic diagram of a configuration of a camera 200 according to Embodiment 1. 実施の形態1におけるカメラ200の構成図。2 is a configuration diagram of a camera 200 in Embodiment 1. FIG. 実施の形態1における第1の符号量制御方法のフローチャート。4 is a flowchart of a first code amount control method according to the first embodiment. 実施の形態1における目標量算出処理(ステップS130)のフローチャート。6 is a flowchart of target amount calculation processing (step S130) in the first embodiment. 実施の形態1における第2の符号量制御方法のフローチャート。5 is a flowchart of a second code amount control method according to the first embodiment. 実施の形態2におけるカメラ200の構成図。FIG. 6 is a configuration diagram of a camera 200 according to Embodiment 2. 実施の形態2における第1の符号量制御方法のフローチャート。10 is a flowchart of a first code amount control method according to the second embodiment. 実施の形態3におけるカメラ200の構成図。FIG. 10 is a configuration diagram of a camera 200 according to Embodiment 3. 実施の形態3における第1の符号量制御方法のフローチャート。10 is a flowchart of a first code amount control method according to Embodiment 3. 実施の形態3における第2の符号量制御方法のフローチャート。10 is a flowchart of a second code amount control method according to Embodiment 3. 実施の形態4におけるカメラ200の構成図。FIG. 10 is a configuration diagram of a camera 200 according to Embodiment 4. 実施の形態4における第1の符号量制御方法のフローチャート。10 is a flowchart of a first code amount control method according to the fourth embodiment. 実施の形態5におけるカメラ200の構成図。FIG. 10 is a configuration diagram of a camera 200 according to Embodiment 5. 実施の形態5における第1の符号量制御方法のフローチャート。10 is a flowchart of a first code amount control method according to the fifth embodiment. 実施の形態5における第2の符号量制御方法のフローチャート。10 is a flowchart of a second code amount control method according to the fifth embodiment. 実施の形態6におけるカメラ200の構成図。FIG. 10 is a configuration diagram of a camera 200 according to Embodiment 6. 実施の形態6における第1の符号量制御方法のフローチャート。18 is a flowchart of a first code amount control method according to the sixth embodiment. 実施の形態におけるカメラ200のハードウェア構成図。The hardware block diagram of the camera 200 in embodiment.
 実施の形態1.
 複数のカメラ200を有するカメラシステム100について、図1から図6に基づいて説明する。
Embodiment 1 FIG.
A camera system 100 having a plurality of cameras 200 will be described with reference to FIGS.
***構成の説明***
 図1に基づいて、カメラシステム100の構成について説明する。
 カメラシステム100は、複数のカメラ200と、複数のカメラ200が接続されるハブ110と、ハブ110に接続される映像記録装置120とを有する。
 カメラシステム100は、監視システムまたは防犯システム等に利用することができる。
*** Explanation of configuration ***
The configuration of the camera system 100 will be described with reference to FIG.
The camera system 100 includes a plurality of cameras 200, a hub 110 to which the plurality of cameras 200 are connected, and a video recording device 120 connected to the hub 110.
The camera system 100 can be used for a monitoring system or a security system.
 カメラ200は、画像を撮影する撮影装置である。具体的に、カメラ200は動画を撮影するビデオカメラである。
 カメラ200は、映像データを符号化して生成される符号化データ202を、ハブ110を介して、映像記録装置120に送信する。符号化データ202は、圧縮された映像データである。映像はディスプレイに表示される画像であり、映像データは映像のデジタルデータである。
 さらに、カメラ200は、符号化データ202の符号量を特定する符号量情報204を他のカメラ200と通信する。符号量は、符号化データ202のデータ量に相当する。
The camera 200 is a photographing device that captures an image. Specifically, the camera 200 is a video camera that captures moving images.
The camera 200 transmits encoded data 202 generated by encoding video data to the video recording apparatus 120 via the hub 110. The encoded data 202 is compressed video data. The video is an image displayed on the display, and the video data is digital video data.
Further, the camera 200 communicates with other cameras 200 code amount information 204 that specifies the code amount of the encoded data 202. The code amount corresponds to the data amount of the encoded data 202.
 符号化データ202の符号量は、画像の変化に伴って変化する。具体的には、カメラ200が撮影する範囲に人が出入りすると、符号化データ202の符号量が増減する。
 また、符号化データ202の符号量は、符号化データ202を生成するための符号化の方法を変更することによって、調整することができる。具体的には、量子化パラメタの値またはマクロブロックタイプを変更することによって、符号化データ202の符号量を調整することができる。
The code amount of the encoded data 202 changes as the image changes. Specifically, when a person enters or exits the range captured by the camera 200, the code amount of the encoded data 202 increases or decreases.
Also, the code amount of the encoded data 202 can be adjusted by changing the encoding method for generating the encoded data 202. Specifically, the code amount of the encoded data 202 can be adjusted by changing the value of the quantization parameter or the macroblock type.
 ハブ110は、データを中継する中継装置である。
 ハブ110は、カメラ200から送信される符号化データ202を受信し、受信した符号化データ202を映像記録装置120に送信する。
The hub 110 is a relay device that relays data.
The hub 110 receives the encoded data 202 transmitted from the camera 200 and transmits the received encoded data 202 to the video recording device 120.
 映像記録装置120は、符号化データ202を記録する機能を有する機器である。具体的に、映像記録装置120はビューアまたはレコーダである。
 映像記録装置120は、ハブ110から送信される符号化データ202を受信し、受信した符号化データ202を記録する。ビューアである映像記録装置120は、符号化データ202を用いて画像を復元し、復元した画像をディスプレイに表示する。
The video recording device 120 is a device having a function of recording the encoded data 202. Specifically, the video recording device 120 is a viewer or a recorder.
The video recording device 120 receives the encoded data 202 transmitted from the hub 110 and records the received encoded data 202. The video recording apparatus 120 serving as a viewer restores an image using the encoded data 202 and displays the restored image on a display.
 図2に基づいて、カメラ200の構成について説明する。
 カメラ200は、コンピュータ900とイメージセンサ921とエンコーダ922といったハードウェアを備える。
The configuration of the camera 200 will be described based on FIG.
The camera 200 includes hardware such as a computer 900, an image sensor 921, and an encoder 922.
 イメージセンサ921は、映像データ201を生成する。具体的に、イメージセンサ921は、CCDイメージセンサまたはCMOSイメージセンサである。CCDはCharge-Coupled Deviceの略称である。CMOSはComplementary MOSの略称であり、MOSはMetal Oxide Semiconductorの略称である。映像データ201はエンコーダ922に入力される。
 エンコーダ922は、映像データ201を目標量205に応じて符号化して符号化データ202を生成する。符号化データ202はコンピュータ900に入力される。
 コンピュータ900は、エンコーダ922によって生成された符号化データ202を、ハブ110を介して映像記録装置120に送信する。さらに、コンピュータ900は、この符号化データ202の符号量を特定する符号量情報204を、他のカメラ200に送信する。また、コンピュータ900は、他のカメラ200から符号量情報204を受信し、符号化データ202の符号量の目標となる目標量205を算出する。目標量205はエンコーダ922に入力される。
The image sensor 921 generates video data 201. Specifically, the image sensor 921 is a CCD image sensor or a CMOS image sensor. CCD is an abbreviation for Charge-Coupled Device. CMOS is an abbreviation for Complementary MOS, and MOS is an abbreviation for Metal Oxide Semiconductor. Video data 201 is input to encoder 922.
The encoder 922 generates the encoded data 202 by encoding the video data 201 according to the target amount 205. The encoded data 202 is input to the computer 900.
The computer 900 transmits the encoded data 202 generated by the encoder 922 to the video recording device 120 via the hub 110. Further, the computer 900 transmits code amount information 204 for specifying the code amount of the encoded data 202 to the other camera 200. Further, the computer 900 receives the code amount information 204 from the other camera 200 and calculates a target amount 205 that is a target of the code amount of the encoded data 202. The target amount 205 is input to the encoder 922.
 図3に基づいて、カメラ200に備わるコンピュータ900の構成について説明する。
 コンピュータ900は、プロセッサ901とメモリ902と補助記憶装置903と通信装置910といったハードウェアを備える。プロセッサ901は、信号線を介して他のハードウェアと接続されている。
Based on FIG. 3, the configuration of a computer 900 provided in the camera 200 will be described.
The computer 900 includes hardware such as a processor 901, a memory 902, an auxiliary storage device 903, and a communication device 910. The processor 901 is connected to other hardware via a signal line.
 プロセッサ901は、プロセッシングを行うIC(Integrated Circuit)であり、他のハードウェアを制御する。具体的に、プロセッサ901は、CPU、DSPまたはGPUである。CPUはCentral Processing Unitの略称であり、DSPはDigital Signal Processorの略称であり、GPUはGraphics Processing Unitの略称である。
 メモリ902は揮発性の記憶装置である。メモリ902は、主記憶装置またはメインメモリとも呼ばれる。具体的に、メモリ902はRAM(Random Access Memory)である。メモリ902に記憶されたデータは、必要に応じて補助記憶装置903に退避される。そして、補助記憶装置903に退避されたデータは、必要に応じてメモリ902にロードされる。メモリ902はデータを記憶する記憶部として機能する。
 補助記憶装置903は不揮発性の記憶装置である。具体的に、補助記憶装置906は、ROM、HDDまたはフラッシュメモリである。ROMはRead Only Memoryの略称であり、HDDはHard Disk Driveの略称である。補助記憶装置903はデータを記憶する記憶部として機能する。
 通信装置910はレシーバ911とトランスミッタ912とを備える。具体的に、通信装置910は通信チップまたはNIC(Network Interface Card)である。通信装置910はデータを通信する通信部として機能し、レシーバ911はデータを受信する受信部として機能し、トランスミッタ912はデータを送信する送信部として機能する。
The processor 901 is an IC (Integrated Circuit) that performs processing, and controls other hardware. Specifically, the processor 901 is a CPU, DSP, or GPU. CPU is an abbreviation for Central Processing Unit, DSP is an abbreviation for Digital Signal Processor, and GPU is an abbreviation for Graphics Processing Unit.
The memory 902 is a volatile storage device. The memory 902 is also called main memory or main memory. Specifically, the memory 902 is a RAM (Random Access Memory). The data stored in the memory 902 is saved in the auxiliary storage device 903 as necessary. The data saved in the auxiliary storage device 903 is loaded into the memory 902 as necessary. The memory 902 functions as a storage unit that stores data.
The auxiliary storage device 903 is a nonvolatile storage device. Specifically, the auxiliary storage device 906 is a ROM, HDD, or flash memory. ROM is an abbreviation for Read Only Memory, and HDD is an abbreviation for Hard Disk Drive. The auxiliary storage device 903 functions as a storage unit that stores data.
The communication device 910 includes a receiver 911 and a transmitter 912. Specifically, the communication device 910 is a communication chip or a NIC (Network Interface Card). The communication device 910 functions as a communication unit that communicates data, the receiver 911 functions as a reception unit that receives data, and the transmitter 912 functions as a transmission unit that transmits data.
 メモリ902には、コンピュータ900で使用、生成または入出力されるデータが記憶される。
 具体的に、メモリ902には、目標合計量291、調整係数292、割合係数293および符号量203等が記憶される。各データの内容については後述する。
The memory 902 stores data used, generated or input / output by the computer 900.
Specifically, the target total amount 291, the adjustment coefficient 292, the ratio coefficient 293, the code amount 203, and the like are stored in the memory 902. The contents of each data will be described later.
 補助記憶装置903には、符号量算出部210と目標量算出部221と目標量設定部222と通信管理部230といった「部」の機能を実現するプログラムが記憶されている。「部」の機能を実現するプログラムは、メモリ902にロードされて、プロセッサ901によって実行される。「部」の機能については後述する。
 さらに、補助記憶装置906にはOS(Operating System)が記憶されている。
 そして、OSの少なくとも一部がメモリ902にロードされ、プロセッサ901はOSを実行しながら「部」の機能を実現するプログラムを実行する。
 なお、コンピュータ900が複数のプロセッサ901を備えて、複数のプロセッサ901が「部」の機能を実現するプログラムを連携して実行してもよい。
The auxiliary storage device 903 stores programs that realize the functions of “units” such as a code amount calculation unit 210, a target amount calculation unit 221, a target amount setting unit 222, and a communication management unit 230. A program that realizes the function of “unit” is loaded into the memory 902 and executed by the processor 901. The function of “part” will be described later.
Further, the auxiliary storage device 906 stores an OS (Operating System).
At least a part of the OS is loaded into the memory 902, and the processor 901 executes a program that realizes the function of “unit” while executing the OS.
The computer 900 may include a plurality of processors 901, and the plurality of processors 901 may execute a program that realizes the function of “unit” in cooperation with each other.
 「部」の機能を実現するプログラムは、磁気ディスク、光ディスクまたはフラッシュメモリ等の不揮発性の記憶媒体に記憶することができる。
 「部」の処理の結果は、メモリ902、補助記憶装置903、プロセッサ901内のレジスタまたはプロセッサ901内のキャッシュメモリに記憶される。
A program that realizes the function of “unit” can be stored in a nonvolatile storage medium such as a magnetic disk, an optical disk, or a flash memory.
The result of the “part” processing is stored in the memory 902, the auxiliary storage device 903, a register in the processor 901, or a cache memory in the processor 901.
 プロセッサ901とメモリ902と補助記憶装置903とをまとめたハードウェアを「プロセッシングサーキットリ」という。
 「部」は「工程」、「手順」または「処理」に読み替えてもよい。「部」の機能はファームウェアで実現してもよい。
Hardware in which the processor 901, the memory 902, and the auxiliary storage device 903 are collected is referred to as a “processing circuit”.
“Part” may be read as “process”, “procedure”, or “processing”. The function of “unit” may be realized by firmware.
***動作の説明***
 カメラ200の動作は符号量制御方法に相当する。また、符号量制御方法の手順は符号量制御プログラムの手順に相当する。符号量制御方法は第Xの符号量制御方法の総称である。
*** Explanation of operation ***
The operation of the camera 200 corresponds to a code amount control method. The procedure of the code amount control method corresponds to the procedure of the code amount control program. The code amount control method is a general term for the Xth code amount control method.
 図4に基づいて、カメラ200内のエンコーダ922によって生成される符号化データ202である第1の符号化データ202の符号量203を制御する第1の符号量制御方法の手順について説明する。
 第1の符号量制御方法の手順は、他のカメラ200から符号量情報204が送信される毎に実行される。
The procedure of the first code amount control method for controlling the code amount 203 of the first encoded data 202, which is the encoded data 202 generated by the encoder 922 in the camera 200, will be described based on FIG.
The procedure of the first code amount control method is executed every time code amount information 204 is transmitted from another camera 200.
 ステップS110は情報受信処理である。
 ステップS110において、レシーバ911は、他のカメラ200から送信された符号量情報204を受信する。
Step S110 is information reception processing.
In step S <b> 110, the receiver 911 receives the code amount information 204 transmitted from the other camera 200.
 具体的に、他のカメラ200は、符号量情報204と自己を識別するカメラ識別子とを含んだパケットを、カメラ間のネットワークにマルチキャストで送信する。パケットはヘッダとペイロードとを含み、符号量情報204およびカメラ識別子はペイロードに設定される。
 このパケットに含まれる符号量情報204は、他のカメラ200によって生成された符号化データ202である他の符号化データ202の符号量203を特定する情報である。
 実施の形態1において、他のカメラ200の符号量情報204は、他の符号化データ202の符号量203である。具体的な符号量203は、送信される符号化データ202のデータ量を表すビットレートである。ビットレートは1秒当たりのビット数を示す。
 そして、レシーバ911は、符号量情報204とカメラ識別子とを含んだパケットを受信する。
Specifically, the other camera 200 transmits a packet including the code amount information 204 and a camera identifier for identifying itself to the network between the cameras by multicast. The packet includes a header and a payload, and the code amount information 204 and the camera identifier are set in the payload.
The code amount information 204 included in this packet is information for specifying the code amount 203 of the other encoded data 202 that is the encoded data 202 generated by the other camera 200.
In the first embodiment, the code amount information 204 of the other camera 200 is the code amount 203 of the other encoded data 202. The specific code amount 203 is a bit rate representing the data amount of the encoded data 202 to be transmitted. The bit rate indicates the number of bits per second.
The receiver 911 receives a packet including the code amount information 204 and the camera identifier.
 ステップS120は符号量記憶処理である。
 ステップS120において、通信管理部230は、他の符号化データ202の符号量203をメモリ902に記憶する。
Step S120 is a code amount storage process.
In step S120, the communication management unit 230 stores the code amount 203 of the other encoded data 202 in the memory 902.
 具体的に、他の符号化データ202の符号量203はメモリ902に以下のように記憶される。
 通信管理部230は、受信されたパケットから符号量情報204と他のカメラ200のカメラ識別子とを取得する。取得される符号量情報204は、他の符号化データ202の符号量203である。
 そして、通信管理部230は、他のカメラ200のカメラ識別子に対応付けて、他の符号化データ202の符号量203をメモリ902に記憶する。同じカメラ識別子に対応付けられた符号量203がメモリ902に既に記憶されている場合、通信管理部230は、メモリ902に記憶されている符号量203を、取得した符号量203で上書きする。
Specifically, the code amount 203 of the other encoded data 202 is stored in the memory 902 as follows.
The communication management unit 230 acquires the code amount information 204 and the camera identifier of the other camera 200 from the received packet. The acquired code amount information 204 is the code amount 203 of the other encoded data 202.
Then, the communication management unit 230 stores the code amount 203 of the other encoded data 202 in the memory 902 in association with the camera identifier of the other camera 200. When the code amount 203 associated with the same camera identifier is already stored in the memory 902, the communication management unit 230 overwrites the code amount 203 stored in the memory 902 with the acquired code amount 203.
 ステップS130は目標量算出処理である。
 ステップS130において、目標量算出部221は、受信された符号量情報204で特定される符号量203を用いて、第1の符号化データ202の符号量203の目標を目標量205として算出する。つまり、目標量算出部221は、他の符号化データ202の符号量203を用いて、目標量205を算出する。
Step S130 is a target amount calculation process.
In step S130, the target amount calculation unit 221 calculates the target of the code amount 203 of the first encoded data 202 as the target amount 205, using the code amount 203 specified by the received code amount information 204. That is, the target amount calculation unit 221 calculates the target amount 205 using the code amount 203 of the other encoded data 202.
 具体的に、目標量算出部221は、目標合計量291と他のカメラ200毎の他の符号化データ202の符号量とを用いて、目標量205を算出する。
 目標合計量291は、第1の符号化データ202と他のカメラ毎の他の符号化データ202との合計の符号量の目標となる値である。具体的に、目標合計量291は、カメラシステム100の全体で許容されるビットレートである。
Specifically, the target amount calculation unit 221 calculates the target amount 205 using the target total amount 291 and the code amount of the other encoded data 202 for each of the other cameras 200.
The target total amount 291 is a target value of the total code amount of the first encoded data 202 and the other encoded data 202 for each other camera. Specifically, the target total amount 291 is a bit rate allowed for the entire camera system 100.
 より具体的には、目標量算出部221は、目標合計量291と他のカメラ200毎の他の符号化データ202の符号量と割合係数293とを用いて、目標量205を算出する。
 割合係数293は、複数のカメラ200のそれぞれの符号化データ202の合計の符号量に対する第1の符号化データ202の符号量の割合の目標を示す値である。
More specifically, the target amount calculation unit 221 calculates the target amount 205 using the target total amount 291, the code amount of the other encoded data 202 for each other camera 200, and the ratio coefficient 293.
The ratio coefficient 293 is a value indicating a target of the ratio of the code amount of the first encoded data 202 to the total code amount of the encoded data 202 of each of the plurality of cameras 200.
 図5に基づいて、目標量算出処理(ステップS130)の詳細について説明する。
 なお、メモリ902には、第1の符号化データ202の符号量と他のカメラ200毎の他の符号化データ202の符号量203とが記憶されている。
The details of the target amount calculation process (step S130) will be described with reference to FIG.
The memory 902 stores a code amount of the first encoded data 202 and a code amount 203 of other encoded data 202 for each of the other cameras 200.
 ステップS131において、目標量算出部221は、第1の符号化データ202の符号量と他のカメラ200毎の他の符号化データ202の符号量とを合計して現合計量を算出する。現合計量は、第1の符号化データ202の符号量と他のカメラ200毎の他の符号化データ202の符号量との合計である。カメラシステム100が第1~第3のカメラ200を有する場合、現合計量は、第1のカメラ200によって生成された符号化データ202の符号量と、第2のカメラ200によって生成された符号化データ202の符号量と、第3のカメラ200によって生成された符号化データ202の符号量との合計である。 In step S131, the target amount calculation unit 221 calculates the current total amount by adding the code amount of the first encoded data 202 and the code amount of the other encoded data 202 for each of the other cameras 200. The current total amount is the sum of the code amount of the first encoded data 202 and the code amount of the other encoded data 202 for each of the other cameras 200. When the camera system 100 includes the first to third cameras 200, the current total amount includes the code amount of the encoded data 202 generated by the first camera 200 and the encoding generated by the second camera 200. This is the sum of the code amount of the data 202 and the code amount of the encoded data 202 generated by the third camera 200.
 ステップS132において、目標量算出部221は、目標合計量291から現合計量を引いて差分量を算出する。差分量は、目標合計量291から現合計量を引いて得られる値である。つまり、現合計量が目標合計量291よりも小さい場合、差分量はプラスの値になる。また、現合計量が目標合計量291よりも大きい場合、差分量はマイナスの値になる。 In step S132, the target amount calculation unit 221 calculates a difference amount by subtracting the current total amount from the target total amount 291. The difference amount is a value obtained by subtracting the current total amount from the target total amount 291. That is, when the current total amount is smaller than the target total amount 291, the difference amount becomes a positive value. If the current total amount is larger than the target total amount 291, the difference amount becomes a negative value.
 ステップS133において、目標量算出部221は、差分量に調整係数292を掛けて調整量を算出する。調整量は差分量に調整係数292を掛けて得られる値である。調整係数292は、差分量を調整するためのプラスの係数である。具体的な調整係数292は1/2である。つまり、調整量は差分量の1/2である。差分量がプラスの値である場合、調整量はプラスの値になり、差分量がマイナスの値である場合、調整量はマイナスの値になる。 In step S133, the target amount calculation unit 221 calculates the adjustment amount by multiplying the difference amount by the adjustment coefficient 292. The adjustment amount is a value obtained by multiplying the difference amount by the adjustment coefficient 292. The adjustment coefficient 292 is a positive coefficient for adjusting the difference amount. A specific adjustment coefficient 292 is 1/2. That is, the adjustment amount is ½ of the difference amount. When the difference amount is a positive value, the adjustment amount is a positive value, and when the difference amount is a negative value, the adjustment amount is a negative value.
 ステップS134において、目標量算出部221は、現合計量に調整量を足して調整合計量を算出する。調整合計量は現合計量に調整量を足して得られる値である。 In step S134, the target amount calculation unit 221 calculates the adjustment total amount by adding the adjustment amount to the current total amount. The adjusted total amount is a value obtained by adding the adjusted amount to the current total amount.
 ステップS135において、目標量算出部221は、調整合計量に割合係数293を掛けて目標量205を算出する。目標量205は、調整合計量に割合係数293を掛けて得られる値である。具体的な割合係数293は、カメラシステム100が有するカメラ200の台数Nを用いて、1/Nで表すことができる。つまり、N=3である場合、目標量205は調整合計量の1/3である。 In step S135, the target amount calculation unit 221 calculates the target amount 205 by multiplying the adjusted total amount by the ratio coefficient 293. The target amount 205 is a value obtained by multiplying the adjustment total amount by the ratio coefficient 293. The specific ratio coefficient 293 can be expressed by 1 / N using the number N of cameras 200 included in the camera system 100. That is, when N = 3, the target amount 205 is 1/3 of the total adjustment amount.
 図4に戻り、ステップS140から説明を続ける。
 ステップS140は目標量設定処理である。
 ステップS140において、目標量設定部222は、目標量205をエンコーダ922に設定する。
 具体的には、目標量設定部222は、目標量205を含んだ設定コードを生成し、生成した設定コードをエンコーダ922に入力する。そして、エンコーダ922は、入力された設定コードに含まれる目標量205を、エンコーダ922内のメモリに設定されている目標量205に上書きする。
 目標設定処理(ステップS140)の後、エンコーダ922は、新たに設定された目標量205に応じて、第1の符号化データ202を生成する
Returning to FIG. 4, the description will be continued from step S140.
Step S140 is a target amount setting process.
In step S <b> 140, the target amount setting unit 222 sets the target amount 205 in the encoder 922.
Specifically, the target amount setting unit 222 generates a setting code including the target amount 205 and inputs the generated setting code to the encoder 922. Then, the encoder 922 overwrites the target amount 205 included in the input setting code with the target amount 205 set in the memory in the encoder 922.
After the target setting process (step S140), the encoder 922 generates the first encoded data 202 according to the newly set target amount 205.
 上記した第1の符号量制御方法により、他の符号化データ202の符号量203が増加した場合に自己の符号化データ202の符号量203が減少し、他の符号化データ202の符号量203が減少した場合に自己の符号化データ202の符号量203が増加する。 According to the first code amount control method described above, when the code amount 203 of the other encoded data 202 increases, the code amount 203 of the own encoded data 202 decreases and the code amount 203 of the other encoded data 202 decreases. When the code number decreases, the code amount 203 of its own encoded data 202 increases.
 図6に基づいて、他の符号化データ202の符号量203を制御する第2の符号量制御方法の手順について説明する。
 第2の符号量制御方法の手順は情報送信間隔が経過する毎に実行される。情報送信間隔は予め決められた時間である
 カメラ200内のイメージセンサ921が撮影する範囲を第1の撮影範囲という。
Based on FIG. 6, the procedure of the second code amount control method for controlling the code amount 203 of the other encoded data 202 will be described.
The procedure of the second code amount control method is executed every time the information transmission interval elapses. The information transmission interval is a predetermined time. A range in which the image sensor 921 in the camera 200 captures an image is referred to as a first capturing range.
 ステップS210は映像データ生成処理である。
 ステップS210において、イメージセンサ921は、第1の撮影範囲が映った映像のデジタルデータである第1の映像データ201を生成し、生成した第1の映像データ201を出力する。出力された第1の映像データ201はエンコーダ922に入力される。
 なお、イメージセンサ921は、撮影間隔が経過する毎に第1の映像データ201を生成および出力している。撮影間隔は予め決められた時間である。フレームレートが10フレーム/秒である場合、撮影間隔は0.1秒である。
 イメージセンサ921の動作は従来のイメージセンサの動作と同じであるため、映像データ生成処理(ステップS210)の詳細については説明を省略する。
Step S210 is a video data generation process.
In step S <b> 210, the image sensor 921 generates first video data 201 that is digital data of a video in which the first shooting range is reflected, and outputs the generated first video data 201. The output first video data 201 is input to the encoder 922.
The image sensor 921 generates and outputs the first video data 201 every time the shooting interval elapses. The shooting interval is a predetermined time. When the frame rate is 10 frames / second, the shooting interval is 0.1 seconds.
Since the operation of the image sensor 921 is the same as the operation of the conventional image sensor, the details of the video data generation process (step S210) will be omitted.
 ステップS220は符号化データ生成処理である。
 ステップS220において、エンコーダ922は、第1の映像データ201を目標量205に応じて符号化して第1の符号化データ202を生成し、生成した第1の符号化データ202を出力する。出力された第1の符号化データ202はコンピュータ900に入力される。
 具体的に、エンコーダ922は、エンコーダ922内のメモリに設定された目標量205に応じて量子化パラメタ値およびマクロブロックタイプを選択する。そして、エンコーダ922は、選択した量子化パラメタ値およびマクロブロックタイプを用いて、第1の映像データ201を符号化する。これにより、目標量205に近い符号量を有する符号化データ202が、第1の符号化データ202として生成される。量子化パラメタ値は量子化パラメタの値であり、マクロブロックタイプはマクロブロックの符号化タイプである。
 なお、エンコーダ922は、第1の映像データ201が入力される毎に第1の符号化データ202を生成および入力している。
 エンコーダ922の動作は従来のエンコーダの動作と同じであるため、符号化データ生成処理(ステップS220)の詳細については説明を省略する。
Step S220 is an encoded data generation process.
In step S220, the encoder 922 encodes the first video data 201 according to the target amount 205 to generate the first encoded data 202, and outputs the generated first encoded data 202. The output first encoded data 202 is input to the computer 900.
Specifically, the encoder 922 selects a quantization parameter value and a macroblock type according to the target amount 205 set in the memory in the encoder 922. Then, the encoder 922 encodes the first video data 201 using the selected quantization parameter value and macroblock type. Accordingly, encoded data 202 having a code amount close to the target amount 205 is generated as the first encoded data 202. The quantization parameter value is a quantization parameter value, and the macroblock type is a macroblock coding type.
The encoder 922 generates and inputs the first encoded data 202 every time the first video data 201 is input.
Since the operation of the encoder 922 is the same as the operation of the conventional encoder, the details of the encoded data generation process (step S220) will be omitted.
 ステップS230は符号化データ送信処理である。
 ステップS230において、トランスミッタ912は、第1の符号化データ202を映像記録装置120に送信する。
Step S230 is an encoded data transmission process.
In step S230, the transmitter 912 transmits the first encoded data 202 to the video recording device 120.
 具体的に、第1の符号化データ202は以下のように送信される。
 通信管理部230は、第1の符号化データ202と撮影時刻とカメラ識別子とを含んだペイロードを生成し、生成したペイロードをトランスミッタ912に入力する。具体的に、撮影時刻は、第1の映像データ201が生成された時刻である。
 そして、トランスミッタ912は、入力されたペイロードを含んだパケットを生成し、生成したパケットをハブ110を介して映像記録装置120に送信する。送信されたパケットは映像記録装置120によって受信され、第1の映像データ201は撮影時刻とカメラ識別子とに対応付けられて映像記録装置120に記録される。
Specifically, the first encoded data 202 is transmitted as follows.
The communication management unit 230 generates a payload including the first encoded data 202, the shooting time, and the camera identifier, and inputs the generated payload to the transmitter 912. Specifically, the shooting time is the time when the first video data 201 is generated.
Then, the transmitter 912 generates a packet including the input payload, and transmits the generated packet to the video recording device 120 via the hub 110. The transmitted packet is received by the video recording device 120, and the first video data 201 is recorded in the video recording device 120 in association with the shooting time and the camera identifier.
 ステップS240は符号量算出処理である。
 ステップS240において、符号量算出部210は、第1の符号化データ202の符号量203を算出する。具体的に、符号量算出部210は、第1の符号化データ202のビットレートを第1の符号化データ202の符号量203として算出する。
 そして、符号量算出部210は、算出した符号量203をカメラ200のカメラ識別子に対応付けてメモリ902に記憶する。同じカメラ識別子に対応付けられた符号量203がメモリ902に既に記憶されている場合、符号量算出部210は、メモリ902に記憶されている符号量203を、算出した符号量203で上書きする。
Step S240 is a code amount calculation process.
In step S240, the code amount calculation unit 210 calculates the code amount 203 of the first encoded data 202. Specifically, the code amount calculation unit 210 calculates the bit rate of the first encoded data 202 as the code amount 203 of the first encoded data 202.
Then, the code amount calculation unit 210 stores the calculated code amount 203 in the memory 902 in association with the camera identifier of the camera 200. When the code amount 203 associated with the same camera identifier is already stored in the memory 902, the code amount calculation unit 210 overwrites the code amount 203 stored in the memory 902 with the calculated code amount 203.
 ステップS250は情報送信処理である。
 ステップS250において、トランスミッタ912は、第1の符号量情報204を他のカメラ200に送信する。
Step S250 is information transmission processing.
In step S <b> 250, the transmitter 912 transmits the first code amount information 204 to the other camera 200.
 具体的に、第1の符号量情報204は以下のように送信される。第1の符号量情報204は、第1の符号化データ202の符号量203である。
 通信管理部230は、第1の符号化データ202の符号量203とカメラ200のカメラ識別子とを含んだペイロードを生成し、生成したペイロードをトランスミッタ912に入力する。
 そして、トランスミッタ912は、入力されたペイロードを含んだパケットを生成し、生成したパケットを、カメラ間のネットワークにマルチキャストで送信する。送信されたパケットは、各他のカメラ200によって受信される。
Specifically, the first code amount information 204 is transmitted as follows. The first code amount information 204 is the code amount 203 of the first encoded data 202.
The communication management unit 230 generates a payload that includes the code amount 203 of the first encoded data 202 and the camera identifier of the camera 200, and inputs the generated payload to the transmitter 912.
Then, the transmitter 912 generates a packet including the input payload, and transmits the generated packet to the network between the cameras by multicast. The transmitted packet is received by each other camera 200.
 上記した第2の符号量制御方法により、自己の符号化データ202の符号量203が増加した場合に他の符号化データ202の符号量203が減少し、自己の符号化データ202の符号量203が減少した場合に他の符号化データ202の符号量203が増加する。 According to the second code amount control method described above, when the code amount 203 of its own encoded data 202 increases, the code amount 203 of the other encoded data 202 decreases and the code amount 203 of its own encoded data 202 decreases. When the number decreases, the code amount 203 of the other encoded data 202 increases.
***実施の形態の効果***
 カメラ200は、他の符号化データ202の符号量203が増加した場合に自己の符号化データ202の符号量203を減少させ、他の符号化データ202の符号量203が減少した場合に自己の符号化データ202の符号量203を増加させることができる。さらに、カメラ200は、自己の符号化データ202の符号量203が増加した場合に他の符号化データ202の符号量203を減少させ、自己の符号化データ202の符号量203が減少した場合に他の符号化データ202の符号量203を増加させることができる。そのため、カメラ200は、カメラシステム100で通信される符号化データ202の全体の符号量を安定させることができる。
 つまり、カメラシステム100は、複数のカメラ200を制御する制御装置を有することなく、全体の符号量を安定させることができる。そのため、複数のカメラ200と制御装置との間でやり取りするメッセージを設計する必要もない。
*** Effect of the embodiment ***
The camera 200 decreases the code amount 203 of its own encoded data 202 when the code amount 203 of the other encoded data 202 increases, and changes its own amount when the code amount 203 of the other encoded data 202 decreases. The code amount 203 of the encoded data 202 can be increased. Further, the camera 200 decreases the code amount 203 of the other encoded data 202 when the code amount 203 of the own encoded data 202 increases, and decreases the code amount 203 of the own encoded data 202. The code amount 203 of the other encoded data 202 can be increased. Therefore, the camera 200 can stabilize the entire code amount of the encoded data 202 communicated by the camera system 100.
That is, the camera system 100 can stabilize the entire code amount without having a control device that controls the plurality of cameras 200. Therefore, it is not necessary to design a message exchanged between the plurality of cameras 200 and the control device.
***他の構成***
 カメラシステム100は、2台のカメラ200または4台以上のカメラ200を備えてもよい。
 カメラ200は、ハブ110を介さず映像記録装置120に直接、符号化データ202を送信してもよい。
 符号化データ202および符号量情報204は、有線または無線のいずれで通信されてもよい。
 第1の符号量制御方法および第2の符号量制御方法は、任意のタイミングで実行されてもよい。
 目標量205は、目標量算出処理(ステップS130)で説明した方法とは異なる方法で算出してもよい。
*** Other configurations ***
The camera system 100 may include two cameras 200 or four or more cameras 200.
The camera 200 may transmit the encoded data 202 directly to the video recording device 120 without using the hub 110.
The encoded data 202 and the code amount information 204 may be communicated either by wire or wirelessly.
The first code amount control method and the second code amount control method may be executed at an arbitrary timing.
The target amount 205 may be calculated by a method different from the method described in the target amount calculation process (step S130).
 実施の形態2.
 他の符号化データ202の符号量203が異常である場合に他のカメラ200の動作を停止させる形態について、図7および図8に基づいて説明する。但し、実施の形態1と重複する説明は省略する。
Embodiment 2. FIG.
A mode in which the operation of the other camera 200 is stopped when the code amount 203 of the other encoded data 202 is abnormal will be described with reference to FIGS. 7 and 8. However, the description which overlaps with Embodiment 1 is abbreviate | omitted.
***構成の説明***
 図7に基づいて、カメラ200の構成について説明する。
 カメラ200は、コンピュータ900とイメージセンサ921とエンコーダ922とを備える。
 コンピュータ900は、プロセッサ901とメモリ902と補助記憶装置903と通信装置910とを備える。
 補助記憶装置903には、符号量算出部210と目標量算出部221と目標量設定部222と通信管理部230と異常検出部241と停止命令部242といった「部」の機能を実現するプログラムが記憶されている。「部」の機能を実現するプログラムは、メモリ902にロードされて、プロセッサ901によって実行される。
*** Explanation of configuration ***
Based on FIG. 7, the configuration of the camera 200 will be described.
The camera 200 includes a computer 900, an image sensor 921, and an encoder 922.
The computer 900 includes a processor 901, a memory 902, an auxiliary storage device 903, and a communication device 910.
The auxiliary storage device 903 includes a program that realizes the functions of “units” such as a code amount calculation unit 210, a target amount calculation unit 221, a target amount setting unit 222, a communication management unit 230, an abnormality detection unit 241, and a stop command unit 242. It is remembered. A program that realizes the function of “unit” is loaded into the memory 902 and executed by the processor 901.
***動作の説明***
 図8に基づいて、第1の符号量制御方法について説明する。
 図8に基づいて説明する方法は、実施の形態1で説明したステップS110およびステップS120~S140に加えて、ステップS111とステップS112とを有する。
*** Explanation of operation ***
A first code amount control method will be described with reference to FIG.
The method described with reference to FIG. 8 includes steps S111 and S112 in addition to steps S110 and S120 to S140 described in the first embodiment.
 ステップS110において、レシーバ911は、他のカメラ200から送信されたパケットを受信する。受信されたパケットは符号量情報204を含んでいる。受信されたパケットに含まれる符号量情報204は、他の符号化データ202の符号量203である。 In step S110, the receiver 911 receives a packet transmitted from another camera 200. The received packet includes code amount information 204. The code amount information 204 included in the received packet is the code amount 203 of the other encoded data 202.
 ステップS111は異常検出処理である。
 ステップS111において、異常検出部241は、異常な符号量を特定する符号量情報204を異常情報として検出する。
 具体的には、異常検出部241は、受信されたパケットから符号量情報204である符号量203を取得し、取得した符号量203を符号量閾値と比較する。符号量203が符号量閾値より大きい場合、受信されたパケットに含まれる符号量情報204は異常情報である。符号量閾値は予め決められた値である。具体的な符号量閾値は目標合計量291の1/2である。
 符号量情報204が異常情報として検出された場合、第1の符号量制御方法の手順はステップS112に進む。
 符号量情報204が異常情報として検出されなかった場合、第1の符号量制御方法の手順はステップS120に進む。
Step S111 is an abnormality detection process.
In step S111, the abnormality detection unit 241 detects, as abnormality information, code amount information 204 that specifies an abnormal code amount.
Specifically, the abnormality detection unit 241 acquires the code amount 203 as the code amount information 204 from the received packet, and compares the acquired code amount 203 with a code amount threshold. When the code amount 203 is larger than the code amount threshold, the code amount information 204 included in the received packet is abnormality information. The code amount threshold is a predetermined value. A specific code amount threshold is ½ of the target total amount 291.
When the code amount information 204 is detected as abnormality information, the procedure of the first code amount control method proceeds to step S112.
If the code amount information 204 is not detected as abnormality information, the procedure of the first code amount control method proceeds to step S120.
 ステップS112は停止命令処理である。
 ステップS112において、停止命令部242は、異常情報に対応する他のカメラ200に動作の停止を命令する。
Step S112 is a stop command process.
In step S112, the stop command unit 242 commands the other camera 200 corresponding to the abnormality information to stop the operation.
 具体的に、停止命令部242は、異常情報に対応する他のカメラ200に動作の停止を以下のように命令する。
 停止命令部242は、受信されたパケットから送信元アドレスを取得する。また、停止命令部242は、動作の停止を命令する停止命令を含んだペイロードを生成する。そして、停止命令部242は、生成したペイロードと取得した送信元アドレスとをトランスミッタ912に入力する。
 トランスミッタ912は、入力されたペイロードを含んだパケットを生成し、生成したパケットのヘッダに入力された送信元アドレスを設定し、このパケットをカメラ間のネットワークに送信する。送信されたパケットは、異常情報を含んだパケットの送信元である他のカメラ200によって受信される。そして、この他のカメラ200は、停止命令に従って動作を停止する。以後、動作を停止した他のカメラ200から符号化データ202および符号量情報204は送信されなくなる。
Specifically, the stop command unit 242 commands the other camera 200 corresponding to the abnormality information to stop the operation as follows.
The stop command unit 242 acquires a transmission source address from the received packet. In addition, the stop instruction unit 242 generates a payload including a stop instruction that instructs to stop the operation. Then, the stop command unit 242 inputs the generated payload and the acquired transmission source address to the transmitter 912.
The transmitter 912 generates a packet including the input payload, sets the transmission source address in the header of the generated packet, and transmits the packet to the network between the cameras. The transmitted packet is received by another camera 200 which is a transmission source of the packet including the abnormality information. Then, the other camera 200 stops its operation according to the stop command. Thereafter, the encoded data 202 and the code amount information 204 are not transmitted from the other cameras 200 that have stopped operating.
***実施の形態の効果***
 カメラ200は、他の符号化データ202の符号量203が異常である場合に他のカメラ200の動作を停止させることができる。そのため、カメラ200は、カメラシステム100で通信される符号化データ202の全体の符号量を安定させることができる。
*** Effect of the embodiment ***
The camera 200 can stop the operation of the other camera 200 when the code amount 203 of the other encoded data 202 is abnormal. Therefore, the camera 200 can stabilize the entire code amount of the encoded data 202 communicated by the camera system 100.
 実施の形態3.
 符号量203と強い相関を持つ量子化パラメタ値を符号量情報204とする形態について、図9から図11に基づいて説明する。但し、実施の形態1と重複する説明は省略する。
Embodiment 3 FIG.
A form in which the quantization parameter value having a strong correlation with the code amount 203 is used as the code amount information 204 will be described with reference to FIGS. However, the description which overlaps with Embodiment 1 is abbreviate | omitted.
***構成の説明***
 図9に基づいて、カメラ200の構成について説明する。
 カメラ200は、コンピュータ900とイメージセンサ921とエンコーダ922とを備える。
 コンピュータ900は、プロセッサ901とメモリ902と補助記憶装置903と通信装置910とを備える。
 補助記憶装置903には、符号量算出部210と目標量算出部221と目標量設定部222と通信管理部230と情報取得部250といった「部」の機能を実現するプログラムが記憶されている。「部」の機能を実現するプログラムは、メモリ902にロードされて、プロセッサ901によって実行される。
*** Explanation of configuration ***
Based on FIG. 9, the configuration of the camera 200 will be described.
The camera 200 includes a computer 900, an image sensor 921, and an encoder 922.
The computer 900 includes a processor 901, a memory 902, an auxiliary storage device 903, and a communication device 910.
The auxiliary storage device 903 stores programs that realize the functions of “units” such as a code amount calculation unit 210, a target amount calculation unit 221, a target amount setting unit 222, a communication management unit 230, and an information acquisition unit 250. A program that realizes the function of “unit” is loaded into the memory 902 and executed by the processor 901.
***動作の説明***
 図10に基づいて、第1の符号量制御方法について説明する。
 図10に基づいて説明する方法は、実施の形態1で説明したステップS110、ステップS130およびステップS140に加えて、ステップS121を有する。
*** Explanation of operation ***
A first code amount control method will be described with reference to FIG.
The method described based on FIG. 10 includes step S121 in addition to step S110, step S130, and step S140 described in the first embodiment.
 ステップS110において、レシーバ911は、他のカメラ200から送信された符号量情報204を受信する。
 実施の形態3において、他のカメラ200の符号量情報204は、他の符号化データ202が生成されるときに量子化パラメタの値として用いられる量子化パラメタ値である。
In step S <b> 110, the receiver 911 receives the code amount information 204 transmitted from the other camera 200.
In Embodiment 3, the code amount information 204 of the other camera 200 is a quantization parameter value used as a quantization parameter value when other encoded data 202 is generated.
 ステップS121は符号量算出処理である。
 ステップS121において、符号量算出部210は、他のカメラ200の符号量情報204である量子化パラメタ値を用いて、他の符号化データ202の符号量203を算出する。
Step S121 is a code amount calculation process.
In step S <b> 121, the code amount calculation unit 210 calculates the code amount 203 of the other encoded data 202 using the quantization parameter value that is the code amount information 204 of the other camera 200.
 具体的に、符号量算出部210は、他のカメラ200の符号量情報204である量子化パラメタ値を入力として符号量関数を演算して、他の符号化データ202の符号量203を算出する。
 符号量関数は、量子化パラメタ値を用いて符号量203を算出するためのアルゴリズムが定義された関数である。符号量関数を演算することによって、量子化パラメタ値の大きさに反比例する大きさの符号量203が算出される。つまり、量子化パラメタ値が大きいほど符号量203は小さく、量子化パラメタ値が小さいほど符号量203は大きい。
Specifically, the code amount calculation unit 210 calculates the code amount 203 of the other encoded data 202 by calculating the code amount function with the quantization parameter value that is the code amount information 204 of the other camera 200 as an input. .
The code amount function is a function in which an algorithm for calculating the code amount 203 using the quantization parameter value is defined. By calculating the code amount function, the code amount 203 having a magnitude inversely proportional to the magnitude of the quantization parameter value is calculated. That is, the larger the quantization parameter value, the smaller the code amount 203, and the smaller the quantization parameter value, the larger the code amount 203.
 そして、符号量算出部210は、実施の形態1におけるステップS120の通信管理部230と同じく、他の符号化データ202の符号量203をメモリ902に記憶する。 Then, the code amount calculation unit 210 stores the code amount 203 of the other encoded data 202 in the memory 902, similarly to the communication management unit 230 in step S120 in the first embodiment.
 ステップS130において、目標量算出部221は、他の符号化データ202の符号量203を用いて、目標量205を算出する。
 ステップS140において、目標量設定部222は、目標量205をエンコーダ922に設定する。
In step S <b> 130, the target amount calculation unit 221 calculates the target amount 205 using the code amount 203 of the other encoded data 202.
In step S <b> 140, the target amount setting unit 222 sets the target amount 205 in the encoder 922.
 図11に基づいて、第2の符号量制御方法について説明する。
 図11に基づいて説明する方法は、実施の形態1で説明したステップS210~ステップS250に加えて、ステップS261を有する。
A second code amount control method will be described with reference to FIG.
The method described based on FIG. 11 includes step S261 in addition to steps S210 to S250 described in the first embodiment.
 ステップS210において、イメージセンサ921は第1の映像データ201を生成する。
 ステップS220において、エンコーダ922は、第1の映像データ201を目標量205に応じて符号化して第1の符号化データ202を生成する。
 ステップS230において、トランスミッタ912は、第1の符号化データ202を映像記録装置120に送信する。
 ステップS240において、符号量算出部210は、第1の符号化データ202の符号量203を算出し、算出した符号量203をメモリ902に記憶する。
 ステップS240の後、第2の符号量制御方法の手順はステップS261に進む。
In step S210, the image sensor 921 generates first video data 201.
In step S <b> 220, the encoder 922 encodes the first video data 201 according to the target amount 205 to generate first encoded data 202.
In step S230, the transmitter 912 transmits the first encoded data 202 to the video recording device 120.
In step S240, the code amount calculation unit 210 calculates the code amount 203 of the first encoded data 202, and stores the calculated code amount 203 in the memory 902.
After step S240, the procedure of the second code amount control method proceeds to step S261.
 ステップS261は情報生成処理である。
 ステップS261において、情報取得部250は、第1の符号量情報204を取得する。
Step S261 is information generation processing.
In step S261, the information acquisition unit 250 acquires the first code amount information 204.
 具体的に、第1の符号量情報204は以下のように取得される。第1の符号量情報204は、第1の符号化データ202が生成されるときに量子化パラメタ値として用いられる量子化パラメタ値である。
 情報取得部250は、量子化パラメタ値をエンコーダ922に要求する。
 エンコーダ922は、エンコーダ922内のメモリに設定されている量子化パラメタ値を情報取得部250に応答する。
 そして、情報取得部250は、応答された量子化パラメタ値を受け取る。
 ステップS261の後、第2の符号量制御方法の手順はステップS250に進む。
Specifically, the first code amount information 204 is acquired as follows. The first code amount information 204 is a quantization parameter value used as a quantization parameter value when the first encoded data 202 is generated.
The information acquisition unit 250 requests the encoder 922 for a quantization parameter value.
The encoder 922 returns the quantization parameter value set in the memory in the encoder 922 to the information acquisition unit 250.
Then, the information acquisition unit 250 receives the returned quantization parameter value.
After step S261, the procedure of the second code amount control method proceeds to step S250.
 ステップS250において、トランスミッタ912は、第1の符号量情報204を他のカメラ200に送信する。 In step S250, the transmitter 912 transmits the first code amount information 204 to the other camera 200.
***実施の形態の効果***
 カメラ200は、実施の形態1と同じく、カメラシステム100で通信される符号化データ202の全体の符号量を安定させることができる。
*** Effect of the embodiment ***
The camera 200 can stabilize the entire code amount of the encoded data 202 communicated by the camera system 100, as in the first embodiment.
 実施の形態4.
 他の符号化データ202の符号量203が異常である場合に他のカメラ200の動作を停止させる形態について、図12および図13に基づいて説明する。但し、実施の形態3と重複する説明は省略する。
Embodiment 4 FIG.
A mode in which the operation of the other camera 200 is stopped when the code amount 203 of the other encoded data 202 is abnormal will be described with reference to FIGS. 12 and 13. However, the description which overlaps with Embodiment 3 is omitted.
***構成の説明***
 図12に基づいて、カメラ200の構成について説明する。
 カメラ200は、コンピュータ900とイメージセンサ921とエンコーダ922とを備える。
 コンピュータ900は、プロセッサ901とメモリ902と補助記憶装置903と通信装置910とを備える。
 補助記憶装置903には、符号量算出部210と目標量算出部221と目標量設定部222と通信管理部230と異常検出部241と停止命令部242と情報取得部250といった「部」の機能を実現するプログラムが記憶されている。「部」の機能を実現するプログラムは、メモリ902にロードされて、プロセッサ901によって実行される。
*** Explanation of configuration ***
Based on FIG. 12, the configuration of the camera 200 will be described.
The camera 200 includes a computer 900, an image sensor 921, and an encoder 922.
The computer 900 includes a processor 901, a memory 902, an auxiliary storage device 903, and a communication device 910.
The auxiliary storage device 903 includes functions of “units” such as a code amount calculation unit 210, a target amount calculation unit 221, a target amount setting unit 222, a communication management unit 230, an abnormality detection unit 241, a stop command unit 242, and an information acquisition unit 250. A program for realizing is stored. A program that realizes the function of “unit” is loaded into the memory 902 and executed by the processor 901.
***動作の説明***
 図13に基づいて、第1の符号量制御方法について説明する。
 図13に基づいて説明する方法は、実施の形態3で説明したステップS110およびステップS121~S140に加えて、ステップS113とステップS114とを有する。
*** Explanation of operation ***
The first code amount control method will be described with reference to FIG.
The method described based on FIG. 13 includes steps S113 and S114 in addition to steps S110 and S121 to S140 described in the third embodiment.
 ステップS110において、レシーバ911は、他のカメラ200から送信されたパケットを受信する。受信されたパケットは符号量情報204を含んでいる。受信されたパケットに含まれる符号量情報204は、他の符号化データ202が生成されるときに量子化パラメタの値として用いられる量子化パラメタ値である。 In step S110, the receiver 911 receives a packet transmitted from another camera 200. The received packet includes code amount information 204. The code amount information 204 included in the received packet is a quantization parameter value used as a quantization parameter value when other encoded data 202 is generated.
 ステップS113は異常検出処理である。
 ステップS113において、異常検出部241は、異常な符号量を特定する符号量情報204を異常情報として検出する。
 具体的には、異常検出部241は、受信されたパケットから符号量情報204である量子化パラメタ値を取得し、取得した量子化パラメタ値をパラメタ閾値と比較する。量子化パラメタ値がパラメタ閾値より小さい場合、受信されたパケットに含まれる符号量情報204は異常情報である。パラメタ閾値は予め決められた値である。
 符号量情報204が異常情報として検出された場合、第1の符号量制御方法の手順はステップS114に進む。
 符号量情報204が異常情報として検出されなかった場合、第1の符号量制御方法の手順はステップS121に進む。
Step S113 is an abnormality detection process.
In step S113, the abnormality detection unit 241 detects, as abnormality information, code amount information 204 that identifies an abnormal code amount.
Specifically, the abnormality detection unit 241 acquires a quantization parameter value that is the code amount information 204 from the received packet, and compares the acquired quantization parameter value with a parameter threshold value. When the quantization parameter value is smaller than the parameter threshold value, the code amount information 204 included in the received packet is abnormal information. The parameter threshold value is a predetermined value.
When the code amount information 204 is detected as abnormality information, the procedure of the first code amount control method proceeds to step S114.
If the code amount information 204 is not detected as abnormality information, the procedure of the first code amount control method proceeds to step S121.
 ステップS114は停止命令処理である。
 ステップS114において、停止命令部242は、異常情報に対応する他のカメラ200に動作の停止を命令する。
 この停止命令処理(ステップS114)は、実施の形態2で説明した停止命令処理(ステップS112)と同じである。
Step S114 is a stop command process.
In step S114, the stop instruction unit 242 instructs the other camera 200 corresponding to the abnormality information to stop the operation.
This stop command process (step S114) is the same as the stop command process (step S112) described in the second embodiment.
***実施の形態の効果***
 カメラ200は、実施の形態2と同じく、カメラシステム100で通信される符号化データ202の全体の符号量を安定させることができる。
*** Effect of the embodiment ***
Similarly to the second embodiment, the camera 200 can stabilize the entire code amount of the encoded data 202 communicated by the camera system 100.
 実施の形態5.
 符号量203と強い相関を持つマクロブロックタイプを符号量情報204とする形態について、図14から図16に基づいて説明する。但し、実施の形態1と重複する説明は省略する。
Embodiment 5 FIG.
A mode in which a macroblock type having a strong correlation with the code amount 203 is used as the code amount information 204 will be described with reference to FIGS. However, the description which overlaps with Embodiment 1 is abbreviate | omitted.
***構成の説明***
 図14に基づいて、カメラ200の構成について説明する。
 カメラ200は、コンピュータ900とイメージセンサ921とエンコーダ922とを備える。
 コンピュータ900は、プロセッサ901とメモリ902と補助記憶装置903と通信装置910とを備える。
 補助記憶装置903には、符号量算出部210と目標量算出部221と目標量設定部222と通信管理部230と情報取得部250といった「部」の機能を実現するプログラムが記憶されている。「部」の機能を実現するプログラムは、メモリ902にロードされて、プロセッサ901によって実行される。
*** Explanation of configuration ***
Based on FIG. 14, the configuration of the camera 200 will be described.
The camera 200 includes a computer 900, an image sensor 921, and an encoder 922.
The computer 900 includes a processor 901, a memory 902, an auxiliary storage device 903, and a communication device 910.
The auxiliary storage device 903 stores programs that realize the functions of “units” such as a code amount calculation unit 210, a target amount calculation unit 221, a target amount setting unit 222, a communication management unit 230, and an information acquisition unit 250. A program that realizes the function of “unit” is loaded into the memory 902 and executed by the processor 901.
***動作の説明***
 図15に基づいて、第1の符号量制御方法について説明する。
 図15に基づいて説明する方法は、実施の形態1で説明したステップS110、ステップS130およびステップS140に加えて、ステップS122を有する。
*** Explanation of operation ***
The first code amount control method will be described based on FIG.
The method described based on FIG. 15 includes step S122 in addition to step S110, step S130, and step S140 described in the first embodiment.
 ステップS110において、レシーバ911は、他のカメラ200から送信された符号量情報204を受信する。
 実施の形態5において、他のカメラ200の符号量情報204は、他の符号化データ202が生成されるときに用いられるマクロブロックタイプである。
In step S <b> 110, the receiver 911 receives the code amount information 204 transmitted from the other camera 200.
In the fifth embodiment, the code amount information 204 of the other camera 200 is a macroblock type used when other encoded data 202 is generated.
 ステップS122は符号量算出処理である。
 ステップS122において、符号量算出部210は、他のカメラ200の符号量情報204であるマクロブロックタイプを用いて、他の符号化データ202の符号量203を算出する。
Step S122 is a code amount calculation process.
In step S <b> 122, the code amount calculation unit 210 calculates the code amount 203 of the other encoded data 202 using the macroblock type that is the code amount information 204 of the other camera 200.
 具体的に、符号量算出部210は、他の符号化データ202の符号量203を以下のように算出する。
 ここで、タイプ係数テーブルと基準量とがメモリ902に記憶されているものとする。タイプ係数テーブルは、マクロブロックタイプに対応付けられたタイプ係数を含んだテーブルである。基準量は、基準となる符号量である。
Specifically, the code amount calculation unit 210 calculates the code amount 203 of the other encoded data 202 as follows.
Here, it is assumed that the type coefficient table and the reference amount are stored in the memory 902. The type coefficient table is a table including type coefficients associated with macroblock types. The reference amount is a reference code amount.
 まず、符号量算出部210は、他のカメラ200の符号量情報204であるマクロブロックタイプに対応付けられたタイプ係数をタイプ係数テーブルから取得する。
 そして、符号量算出部210は、取得したタイプ係数を基準量に掛けて符号量203を算出する。符号量203は基準量にタイプ係数を掛けて得られる値である。
First, the code amount calculation unit 210 acquires a type coefficient associated with a macroblock type that is the code amount information 204 of another camera 200 from the type coefficient table.
Then, the code amount calculation unit 210 calculates the code amount 203 by multiplying the acquired type coefficient by the reference amount. The code amount 203 is a value obtained by multiplying the reference amount by the type coefficient.
 そして、符号量算出部210は、実施の形態1におけるステップS120の通信管理部230と同じく、他の符号化データ202の符号量203をメモリ902に記憶する。 Then, the code amount calculation unit 210 stores the code amount 203 of the other encoded data 202 in the memory 902, similarly to the communication management unit 230 in step S120 in the first embodiment.
 ステップS130において、目標量算出部221は、他の符号化データ202の符号量203を用いて、目標量205を算出する。
 ステップS140において、目標量設定部222は、目標量205をエンコーダ922に設定する。
In step S <b> 130, the target amount calculation unit 221 calculates the target amount 205 using the code amount 203 of the other encoded data 202.
In step S <b> 140, the target amount setting unit 222 sets the target amount 205 in the encoder 922.
 図16に基づいて、第2の符号量制御方法について説明する。
 図16に基づいて説明する方法は、実施の形態1で説明したステップS210~ステップS250に加えて、ステップS262を有する。
Based on FIG. 16, the second code amount control method will be described.
The method described with reference to FIG. 16 includes step S262 in addition to steps S210 to S250 described in the first embodiment.
 ステップS210において、イメージセンサ921は第1の映像データ201を生成する。
 ステップS220において、エンコーダ922は、第1の映像データ201を目標量205に応じて符号化して第1の符号化データ202を生成する。
 ステップS230において、トランスミッタ912は、第1の符号化データ202を映像記録装置120に送信する。
 ステップS240において、符号量算出部210は、第1の符号化データ202の符号量203を算出し、算出した符号量203をメモリ902に記憶する。
 ステップS240の後、第2の符号量制御方法の手順はステップS262に進む。
In step S210, the image sensor 921 generates first video data 201.
In step S <b> 220, the encoder 922 encodes the first video data 201 according to the target amount 205 to generate first encoded data 202.
In step S230, the transmitter 912 transmits the first encoded data 202 to the video recording device 120.
In step S240, the code amount calculation unit 210 calculates the code amount 203 of the first encoded data 202, and stores the calculated code amount 203 in the memory 902.
After step S240, the procedure of the second code amount control method proceeds to step S262.
 ステップS262は情報生成処理である。
 ステップS262において、情報取得部250は、第1の符号量情報204を取得する。
Step S262 is information generation processing.
In step S262, the information acquisition unit 250 acquires the first code amount information 204.
 具体的に、第1の符号量情報204は以下のように取得される。第1の符号量情報204は、第1の符号化データ202が生成されるときに用いられるマクロブロックタイプである。
 情報取得部250は、マクロブロックタイプをエンコーダ922に要求する。
 エンコーダ922は、エンコーダ922内のメモリに設定されているマクロブロックタイプを情報取得部250に応答する。
 そして、情報取得部250は、応答されたマクロブロックタイプを受け取る。
 ステップS262の後、第2の符号量制御方法の手順はステップS250に進む。
Specifically, the first code amount information 204 is acquired as follows. The first code amount information 204 is a macroblock type used when the first encoded data 202 is generated.
The information acquisition unit 250 requests the encoder 922 for the macro block type.
The encoder 922 returns the macro block type set in the memory in the encoder 922 to the information acquisition unit 250.
Then, the information acquisition unit 250 receives the returned macro block type.
After step S262, the procedure of the second code amount control method proceeds to step S250.
 ステップS250において、トランスミッタ912は、第1の符号量情報204を他のカメラ200に送信する。 In step S250, the transmitter 912 transmits the first code amount information 204 to the other camera 200.
***実施の形態の効果***
 カメラ200は、実施の形態1と同じく、カメラシステム100で通信される符号化データ202の全体の符号量を安定させることができる。
*** Effect of the embodiment ***
The camera 200 can stabilize the entire code amount of the encoded data 202 communicated by the camera system 100, as in the first embodiment.
 実施の形態6.
 他の符号化データ202の符号量203が異常である場合に他のカメラ200の動作を停止させる形態について、図17および図18に基づいて説明する。但し、実施の形態4と重複する説明は省略する。
Embodiment 6 FIG.
A mode in which the operation of the other camera 200 is stopped when the code amount 203 of the other encoded data 202 is abnormal will be described with reference to FIGS. 17 and 18. However, the description which overlaps with Embodiment 4 is abbreviate | omitted.
***構成の説明***
 図18に基づいて、カメラ200の構成について説明する。
 カメラ200は、コンピュータ900とイメージセンサ921とエンコーダ922とを備える。
 コンピュータ900は、プロセッサ901とメモリ902と補助記憶装置903と通信装置910とを備える。
 補助記憶装置903には、符号量算出部210と目標量算出部221と目標量設定部222と通信管理部230と異常検出部241と停止命令部242と情報取得部250といった「部」の機能を実現するプログラムが記憶されている。「部」の機能を実現するプログラムは、メモリ902にロードされて、プロセッサ901によって実行される。
*** Explanation of configuration ***
The configuration of the camera 200 will be described based on FIG.
The camera 200 includes a computer 900, an image sensor 921, and an encoder 922.
The computer 900 includes a processor 901, a memory 902, an auxiliary storage device 903, and a communication device 910.
The auxiliary storage device 903 includes functions of “units” such as a code amount calculation unit 210, a target amount calculation unit 221, a target amount setting unit 222, a communication management unit 230, an abnormality detection unit 241, a stop command unit 242, and an information acquisition unit 250. A program for realizing is stored. A program that realizes the function of “unit” is loaded into the memory 902 and executed by the processor 901.
***動作の説明***
 図18に基づいて、第1の符号量制御方法について説明する。
 図18に基づいて説明する方法は、実施の形態6で説明したステップS110およびステップS122~S140に加えて、ステップS115とステップS116とを有する。
*** Explanation of operation ***
A first code amount control method will be described with reference to FIG.
The method described with reference to FIG. 18 includes steps S115 and S116 in addition to steps S110 and S122 to S140 described in the sixth embodiment.
 ステップS110において、レシーバ911は、他のカメラ200から送信されたパケットを受信する。受信されたパケットは符号量情報204を含んでいる。受信されたパケットに含まれる符号量情報204は、他の符号化データ202が生成されるときに用いられるマクロブロックタイプである。 In step S110, the receiver 911 receives a packet transmitted from another camera 200. The received packet includes code amount information 204. The code amount information 204 included in the received packet is a macroblock type used when other encoded data 202 is generated.
 ステップS115は異常検出処理である。
 ステップS115において、異常検出部241は、異常な符号量を特定する符号量情報204を異常情報として検出する。
 具体的には、異常検出部241は、受信されたパケットから符号量情報204であるマクロブロックタイプを取得し、取得したマクロブロックタイプを異常タイプと比較する。マクロブロックタイプが異常タイプと同じである場合、受信されたパケットに含まれる符号量情報204は異常情報である。異常タイプは、異常な符号量を有する符号化データ202が生成されるときに用いられるマクロブロックタイプである。
 符号量情報204が異常情報として検出された場合、第1の符号量制御方法の手順はステップS116に進む。
 符号量情報204が異常情報として検出されなかった場合、第1の符号量制御方法の手順はステップS122に進む。
Step S115 is an abnormality detection process.
In step S115, the abnormality detection unit 241 detects code amount information 204 that identifies an abnormal code amount as abnormality information.
Specifically, the abnormality detection unit 241 acquires the macroblock type that is the code amount information 204 from the received packet, and compares the acquired macroblock type with the abnormal type. When the macroblock type is the same as the abnormal type, the code amount information 204 included in the received packet is abnormal information. The abnormal type is a macroblock type used when encoded data 202 having an abnormal code amount is generated.
When the code amount information 204 is detected as abnormality information, the procedure of the first code amount control method proceeds to step S116.
If the code amount information 204 is not detected as abnormality information, the procedure of the first code amount control method proceeds to step S122.
 ステップS116は停止命令処理である。
 ステップS116において、停止命令部242は、異常情報に対応する他のカメラ200に動作の停止を命令する。
 この停止命令処理(ステップS116)は、実施の形態2で説明した停止命令処理(ステップS112)と同じである。
Step S116 is a stop command process.
In step S116, the stop command unit 242 commands the other camera 200 corresponding to the abnormality information to stop the operation.
This stop command process (step S116) is the same as the stop command process (step S112) described in the second embodiment.
***実施の形態の効果***
 カメラ200は、実施の形態2と同じく、カメラシステム100で通信される符号化データ202の全体の符号量を安定させることができる。
*** Effect of the embodiment ***
Similarly to the second embodiment, the camera 200 can stabilize the entire code amount of the encoded data 202 communicated by the camera system 100.
 各実施の形態は、好ましい形態の例示であり、本発明の技術的範囲を制限することを意図するものではない。各実施の形態は、部分的に実施してもよいし、他の形態と組み合わせて実施してもよい。具体的には、実施の形態2,4,6において、カメラ200のプロセッサ901は目標量算出部221および目標量設定部222として機能しなくてもよい。
 フローチャート等を用いて説明した手順は、カメラ、符号量制御方法および符号量制御プログラムの手順の一例である。
Each embodiment is an example of a preferred embodiment and is not intended to limit the technical scope of the present invention. Each embodiment may be implemented partially or in combination with other embodiments. Specifically, in Embodiments 2, 4, and 6, the processor 901 of the camera 200 may not function as the target amount calculation unit 221 and the target amount setting unit 222.
The procedure described using the flowcharts is an example of the procedure of the camera, the code amount control method, and the code amount control program.
 各実施の形態においてカメラ200の機能はハードウェアで実現してもよい。
 図19に、カメラ200の機能がハードウェアで実現される場合の構成を示す。
 カメラ200は処理回路990を備える。処理回路990はプロセッシングサーキットリともいう。
 処理回路990は、各実施の形態で説明した「部」の機能を実現する専用の電子回路である。この「部」にはメモリ902および補助記憶装置903として機能する記憶部も含まれる。
 具体的に、処理回路990は、単一回路、複合回路、プログラム化したプロセッサ、並列プログラム化したプロセッサ、ロジックIC、GA、ASIC、FPGAまたはこれらの組み合わせである。GAはGate Arrayの略称であり、ASICはApplication Specific Integrated Circuitの略称であり、FPGAはField Programmable Gate Arrayの略称である。
 なお、カメラ200が複数の処理回路990を備えて、複数の処理回路990が「部」の機能を連携して実現してもよい。
In each embodiment, the function of the camera 200 may be realized by hardware.
FIG. 19 shows a configuration when the function of the camera 200 is realized by hardware.
The camera 200 includes a processing circuit 990. The processing circuit 990 is also called a processing circuit.
The processing circuit 990 is a dedicated electronic circuit that realizes the function of the “unit” described in each embodiment. The “unit” includes a memory unit that functions as the memory 902 and the auxiliary storage device 903.
Specifically, the processing circuit 990 is a single circuit, a composite circuit, a programmed processor, a parallel programmed processor, a logic IC, a GA, an ASIC, an FPGA, or a combination thereof. GA is an abbreviation for Gate Array, ASIC is an abbreviation for Application Specific Integrated Circuit, and FPGA is an abbreviation for Field Programmable Gate Array.
The camera 200 may include a plurality of processing circuits 990, and the plurality of processing circuits 990 may realize the function of “unit” in cooperation.
 カメラ200の機能は、ソフトウェアとハードウェアとの組み合わせで実現してもよい。つまり、「部」の一部をソフトウェアで実現し、「部」の残りをハードウェアで実現してもよい。 The function of the camera 200 may be realized by a combination of software and hardware. That is, a part of “part” may be realized by software, and the rest of “part” may be realized by hardware.
 100 カメラシステム、110 ハブ、120 映像記録装置、200 カメラ、201 映像データ、202 符号化データ、203 符号量、204 符号量情報、205 目標量、210 符号量算出部、221 目標量算出部、222 目標量設定部、230 通信管理部、241 異常検出部、242 停止命令部、250 情報取得部、291 目標合計量、292 調整係数、293 割合係数、900 コンピュータ、901 プロセッサ、902 メモリ、903 補助記憶装置、910 通信装置、911 レシーバ、912 トランスミッタ、990 処理回路。 100 camera system, 110 hub, 120 video recording device, 200 camera, 201 video data, 202 encoded data, 203 code amount, 204 code amount information, 205 target amount, 210 code amount calculation unit, 221 target amount calculation unit, 222 Target amount setting unit, 230 communication management unit, 241 abnormality detection unit, 242 stop command unit, 250 information acquisition unit, 291 target total amount, 292 adjustment factor, 293 ratio factor, 900 computer, 901 processor, 902 memory, 903 auxiliary storage Device, 910 communication device, 911 receiver, 912 transmitter, 990 processing circuit.

Claims (11)

  1.  複数のカメラのうちの1つのカメラであって、
     第1の映像データを生成するイメージセンサと、
     前記第1の映像データを目標量に応じて符号化して第1の符号化データを生成するエンコーダと、
     前記複数のカメラのうちの他のカメラ毎に、他のカメラによって生成された他の符号化データの符号量を特定する符号量情報を受信するレシーバと、
     受信された符号量情報で特定される符号量を用いて、前記第1の符号化データの符号量の目標を前記目標量として算出する目標量算出部と
    を備えるカメラ。
    One of a plurality of cameras,
    An image sensor for generating first video data;
    An encoder that encodes the first video data according to a target amount to generate first encoded data;
    A receiver that receives code amount information that specifies the code amount of other encoded data generated by another camera for each other camera of the plurality of cameras;
    A camera comprising: a target amount calculation unit that calculates a code amount target of the first encoded data as the target amount using a code amount specified by the received code amount information.
  2.  前記符号量情報は、前記他の符号化データの符号量であり、
     前記目標量算出部は、前記第1の符号化データと他のカメラ毎の他の符号化データとの合計の符号量の目標となる目標合計量と、他のカメラ毎の他の符号化データの符号量とを用いて、前記目標量を算出する
    請求項1に記載のカメラ。
    The code amount information is a code amount of the other encoded data,
    The target amount calculation unit includes a target total amount that is a target of a total code amount of the first encoded data and other encoded data for each other camera, and other encoded data for each other camera. The camera according to claim 1, wherein the target amount is calculated using a code amount.
  3.  前記目標量算出部は、前記目標合計量と、他のカメラ毎の他の符号化データの符号量と、前記複数のカメラのそれぞれの符号化データの合計の符号量に対する前記第1の符号化データの符号量の割合の目標を示す割合係数とを用いて、前記目標量を算出する
    請求項2に記載のカメラ。
    The target amount calculation unit includes the first encoding for the target total amount, the code amount of other encoded data for each of the other cameras, and the total code amount of the encoded data of each of the plurality of cameras. The camera according to claim 2, wherein the target amount is calculated using a ratio coefficient indicating a target of the ratio of the data code amount.
  4.  前記符号量情報は、前記他の符号化データが生成されるときに量子化パラメタの値として用いられる量子化パラメタ値であり、
     前記カメラは、他のカメラ毎に量子化パラメタ値を用いて他の符号化データの符号量を算出する符号量算出部を備え、
     前記目標量算出部は、前記第1の符号化データと他のカメラ毎の他の符号化データとの合計の符号量の目標となる目標合計量と、他のカメラ毎の他の符号化データの符号量とを用いて、前記目標量を算出する
    請求項1に記載のカメラ。
    The code amount information is a quantization parameter value used as a quantization parameter value when the other encoded data is generated,
    The camera includes a code amount calculation unit that calculates a code amount of other encoded data using a quantization parameter value for each other camera,
    The target amount calculation unit includes a target total amount that is a target of a total code amount of the first encoded data and other encoded data for each other camera, and other encoded data for each other camera. The camera according to claim 1, wherein the target amount is calculated using a code amount.
  5.  前記目標量算出部は、前記目標合計量と、他のカメラ毎の他の符号化データの符号量と、前記複数のカメラのそれぞれの符号化データの合計の符号量に対する前記第1の符号化データの符号量の割合の目標を示す割合係数とを用いて、前記目標量を算出する
    請求項4に記載のカメラ。
    The target amount calculation unit includes the first encoding for the target total amount, the code amount of other encoded data for each of the other cameras, and the total code amount of the encoded data of each of the plurality of cameras. The camera according to claim 4, wherein the target amount is calculated using a ratio coefficient indicating a target of the ratio of the data code amount.
  6.  前記符号量情報は、前記他の符号化データが生成されるときに用いられるマクロブロックタイプであり、
     前記カメラは、他のカメラ毎にマクロブロックタイプを用いて他の符号化データの符号量を算出する符号量算出部を備え、
     前記目標量算出部は、前記第1の符号化データと他のカメラ毎の他の符号化データとの合計の符号量の目標となる目標合計量と、他のカメラ毎の他の符号化データの符号量とを用いて、前記目標量を算出する
    請求項1に記載のカメラ。
    The code amount information is a macroblock type used when the other encoded data is generated,
    The camera includes a code amount calculation unit that calculates a code amount of other encoded data using a macroblock type for each other camera,
    The target amount calculation unit includes a target total amount that is a target of a total code amount of the first encoded data and other encoded data for each other camera, and other encoded data for each other camera. The camera according to claim 1, wherein the target amount is calculated using a code amount.
  7.  前記目標量算出部は、前記目標合計量と、他のカメラ毎の他の符号化データの符号量と、前記複数のカメラのそれぞれの符号化データの合計の符号量に対する前記第1の符号化データの符号量の割合の目標を示す割合係数とを用いて、前記目標量を算出する
    請求項6に記載のカメラ。
    The target amount calculation unit includes the first encoding for the target total amount, the code amount of other encoded data for each of the other cameras, and the total code amount of the encoded data of each of the plurality of cameras. The camera according to claim 6, wherein the target amount is calculated using a ratio coefficient indicating a target of the ratio of the data code amount.
  8.  受信された符号量情報のうち、異常な符号量を特定する符号量情報を、異常情報として検出する異常検出部と、
     前記異常情報に対応する他のカメラに動作の停止を命令する停止命令部と
    を備える請求項1に記載のカメラ。
    Among the received code amount information, an abnormality detection unit that detects, as abnormality information, code amount information that identifies an abnormal code amount;
    The camera according to claim 1, further comprising: a stop command unit that commands other cameras corresponding to the abnormality information to stop the operation.
  9.  複数のカメラのうちの1つのカメラであって、
     前記複数のカメラのうちの他のカメラ毎に、他のカメラによって生成された他の符号化データの符号量を特定する符号量情報を受信するレシーバと、
     受信された符号量情報のうち、異常な符号量を特定する符号量情報を、異常情報として検出する異常検出部と、
     前記異常情報に対応する他のカメラに動作の停止を命令する停止命令部と
    を備えるカメラ。
    One of a plurality of cameras,
    A receiver that receives code amount information that specifies the code amount of other encoded data generated by another camera for each other camera of the plurality of cameras;
    Among the received code amount information, an abnormality detection unit that detects, as abnormality information, code amount information that identifies an abnormal code amount;
    A camera comprising: a stop command unit that commands other cameras corresponding to the abnormality information to stop the operation.
  10.  第1の映像データを生成するイメージセンサと、
     前記第1の映像データを目標量に応じて符号化して第1の符号化データを生成するエンコーダと、
     他のカメラ毎に、他のカメラによって生成された他の符号化データの符号量を特定する符号量情報を受信するレシーバと、
     コンピュータと、を備えるカメラの符号量制御プログラムであって、
     受信された符号量情報で特定される符号量を用いて、前記第1の符号化データの符号量の目標を前記目標量として算出する目標量算出処理
    を前記コンピュータに実行させるための符号量制御プログラム。
    An image sensor for generating first video data;
    An encoder that encodes the first video data according to a target amount to generate first encoded data;
    For each other camera, a receiver that receives code amount information that specifies the code amount of other encoded data generated by the other camera;
    A code amount control program for a camera comprising a computer,
    Code amount control for causing the computer to execute a target amount calculation process for calculating the target of the code amount of the first encoded data as the target amount using the code amount specified by the received code amount information program.
  11.  他のカメラ毎に、他のカメラによって生成された他の符号化データの符号量を特定する符号量情報を受信するレシーバと、
     コンピュータと、を備えるカメラのカメラ制御プログラムであって、
     受信された符号量情報のうち、異常な符号量を特定する符号量情報を、異常情報として検出する異常検出処理と、
     前記異常情報に対応する他のカメラに動作の停止を命令する停止命令処理と
    を前記コンピュータに実行させるための符号量制御プログラム。
    For each other camera, a receiver that receives code amount information that specifies the code amount of other encoded data generated by the other camera;
    A camera control program for a camera comprising a computer,
    Among the received code amount information, an abnormality detection process for detecting, as abnormality information, code amount information that identifies an abnormal code amount;
    A code amount control program for causing the computer to execute stop command processing for instructing another camera corresponding to the abnormality information to stop operation.
PCT/JP2015/079797 2015-10-22 2015-10-22 Camera and code amount control program WO2017068678A1 (en)

Priority Applications (2)

Application Number Priority Date Filing Date Title
PCT/JP2015/079797 WO2017068678A1 (en) 2015-10-22 2015-10-22 Camera and code amount control program
JP2017546335A JP6253864B2 (en) 2015-10-22 2015-10-22 Camera and code amount control program

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
PCT/JP2015/079797 WO2017068678A1 (en) 2015-10-22 2015-10-22 Camera and code amount control program

Publications (1)

Publication Number Publication Date
WO2017068678A1 true WO2017068678A1 (en) 2017-04-27

Family

ID=58556811

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/JP2015/079797 WO2017068678A1 (en) 2015-10-22 2015-10-22 Camera and code amount control program

Country Status (2)

Country Link
JP (1) JP6253864B2 (en)
WO (1) WO2017068678A1 (en)

Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2008035291A (en) * 2006-07-28 2008-02-14 Sony Computer Entertainment Inc Camera device
WO2008035745A1 (en) * 2006-09-20 2008-03-27 Panasonic Corporation Monitor system, camera and video image coding method
JP2012010097A (en) * 2010-06-24 2012-01-12 Sony Corp Connection setting method, camera system, and storage medium
JP2014127847A (en) * 2012-12-26 2014-07-07 Panasonic Corp Image monitoring system

Patent Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2008035291A (en) * 2006-07-28 2008-02-14 Sony Computer Entertainment Inc Camera device
WO2008035745A1 (en) * 2006-09-20 2008-03-27 Panasonic Corporation Monitor system, camera and video image coding method
JP2012010097A (en) * 2010-06-24 2012-01-12 Sony Corp Connection setting method, camera system, and storage medium
JP2014127847A (en) * 2012-12-26 2014-07-07 Panasonic Corp Image monitoring system

Also Published As

Publication number Publication date
JP6253864B2 (en) 2017-12-27
JPWO2017068678A1 (en) 2018-01-18

Similar Documents

Publication Publication Date Title
JP6479621B2 (en) Video encoding method and video encoder system
US8988491B2 (en) Apparatus, system, and method of transmitting encoded image data, and recording medium storing control program
US10904423B2 (en) Image providing apparatus and method
US10999577B2 (en) Quantization parameter determination method and image capture apparatus
EP2868107A2 (en) System and method for encoding video content using virtual intra-frames
US9930345B2 (en) Image encoding apparatus, image encoding method, and image encoding program
JP2008219479A (en) Image transmission system, imaging apparatus and image transmitting method
US10362308B2 (en) Apparatus and method for processing image
US10531087B2 (en) Image processing apparatus, imaging apparatus, and image processing method
US10154188B2 (en) Camera system, master camera device, and slave camera device
JP2017163527A (en) Bit rate controller and method for limiting output bit rate
US10531001B2 (en) Controller, video camera, and method for controlling a video camera
US20130007206A1 (en) Transmission apparatus, control method for transmission apparatus, and storage medium
JP6253864B2 (en) Camera and code amount control program
US9565395B1 (en) Video image processing apparatus and recording medium
KR102315524B1 (en) A method for adjusting bitrate of the image and image capture apparatus
US20240104920A1 (en) Image processing apparatus, image processing method, and non-transitory computer-readable storage medium
KR102546764B1 (en) Apparatus and method for image processing
JP6989330B2 (en) Infrared camera for temperature detection
JP2022007104A (en) Image processing apparatus, image processing method, and program
KR20150026446A (en) Method and Apparatus for Lossless Network Video Transmission
CN118158429A (en) Video failover recording
JP2005117229A (en) Image transmitter
JP2007329787A (en) Image encoding apparatus
JP2019029817A (en) Video processing apparatus and method

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 15906684

Country of ref document: EP

Kind code of ref document: A1

ENP Entry into the national phase

Ref document number: 2017546335

Country of ref document: JP

Kind code of ref document: A

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 15906684

Country of ref document: EP

Kind code of ref document: A1