WO2018100614A1 - Information transmission method and on-board camera system - Google Patents
Information transmission method and on-board camera system Download PDFInfo
- Publication number
- WO2018100614A1 WO2018100614A1 PCT/JP2016/085330 JP2016085330W WO2018100614A1 WO 2018100614 A1 WO2018100614 A1 WO 2018100614A1 JP 2016085330 W JP2016085330 W JP 2016085330W WO 2018100614 A1 WO2018100614 A1 WO 2018100614A1
- Authority
- WO
- WIPO (PCT)
- Prior art keywords
- transmission
- information
- display device
- control unit
- image
- Prior art date
Links
Images
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N1/00—Scanning, transmission or reproduction of documents or the like, e.g. facsimile transmission; Details thereof
- H04N1/387—Composing, repositioning or otherwise geometrically modifying originals
Definitions
- the present invention relates to an information transmission method using an imaging device and an in-vehicle camera system.
- Patent Document 1 describes that a mobile terminal sequentially reads a plurality of two-dimensional codes printed on paper, restores the read two-dimensional codes into program data, and updates the operating system of the mobile terminal. Yes.
- Patent Document 1 Since the invention according to Patent Document 1 uses a two-dimensional code printed on paper, the data capacity included in the two-dimensional code cannot be increased according to the performance of the portable terminal, and the portable terminal can be surely provided with a margin. Only the amount of data that can be read could be included in the two-dimensional code. For this reason, there is a problem that the data capacity per two-dimensional code cannot be increased and the transmission speed cannot be increased.
- This invention has been made to solve the above-described problems, and aims to increase the transmission speed.
- the imaging device and the display device transmit and receive the setting information via a communication path connecting the imaging device and the display device, and the display device sets based on the setting information.
- the data capacity included in one image can be increased by adjusting the imaging device and the display device by sending and receiving the setting information via the communication path, and the transmission speed can be increased.
- FIG. 3A shows a display apparatus
- FIG. 3B shows an imaging device.
- FIG. 3A shows a display apparatus
- FIG. 3B shows an imaging device.
- FIG. 3A shows a display apparatus
- FIG. 3B shows an imaging device.
- FIG. 3A shows a display apparatus
- FIG. 3B shows an imaging device.
- FIG. 3A shows a display apparatus
- FIG. 3B shows an imaging device.
- FIG. 3A shows a display apparatus
- FIG. 3B shows an imaging device.
- FIG. 3A shows a display apparatus
- FIG. 3B shows an imaging device.
- FIGS. 7A to 7D are diagrams showing correspondence tables between transmission luminance and reception luminance. It is a flowchart which shows the detail of step ST20 of FIG. It is a flowchart which shows the detail of step ST30 of FIG. It is a figure which shows the correspondence table of transmission brightness
- FIG. 1 is a diagram showing an outline of an in-vehicle camera system according to Embodiment 1 of the present invention.
- the in-vehicle camera system according to Embodiment 1 includes a display device 10, an imaging device 20, a communication path 30, an in-vehicle device 40, a fixture 50, and an optical device 60.
- the imaging device 20 includes an imaging unit such as a digital camera and is mounted on a vehicle.
- the imaging device 20 is, for example, an image processing device with a camera for detecting a driver's line of sight or detecting a road lane.
- the imaging device 20 and the in-vehicle device 40 are connected by a communication path 30 such as a CAN (Controller Area Network).
- the imaging device 20 transmits the line-of-sight detection result or the lane detection result to the in-vehicle device 40 through the communication path 30.
- the in-vehicle device 40 operates using the line-of-sight detection result or the lane detection result.
- the in-vehicle camera system according to Embodiment 1 will be described using an example in which the image processing program of the imaging device 20 is updated to improve the gaze detection accuracy or the lane detection accuracy.
- the display device 10 displays images such as a two-dimensional code one after another, and the imaging device 20 sequentially captures the displayed images, thereby transmitting a large amount of data at high speed.
- the display device 10 includes a display unit such as a liquid crystal display.
- the display device 10 is arranged so that the display unit faces the imaging unit of the imaging device 20, and is fixed to the imaging device 20 by a simple fixing tool 50 such as a hook or a suction cup. Is done.
- An optical device 60 such as a lens may be installed between the display device 10 and the imaging device 20.
- the installation method of the optical apparatus 60 is not ask
- the optical device 60 may be fixed between the display device 10 and the imaging device 20 by a fixture (not shown), may be fixed by the fixture 50, or is fixed to the display device 10 in advance. May be.
- the display device 10 is connected to the communication path 30, and the display device 10 and the imaging device 20 can communicate with each other via the communication path 30.
- FIG. 2 is a block diagram showing a configuration example of the in-vehicle camera system according to Embodiment 1 of the present invention.
- the display device 10 includes a communication unit 11, an input unit 12, a transmission / reception control unit 13, a transmission control unit 14, a transmission information storage unit 15, a display control unit 16, and a display unit 17.
- the imaging device 20 includes a communication unit 21, a reception control unit 22, a reception information storage unit 23, an imaging unit 24, and an image analysis unit 25.
- illustration is abbreviate
- FIG. 3 is a hardware configuration diagram of the in-vehicle camera system according to the first embodiment of the present invention.
- FIG. 3A shows the display device 10
- FIG. 3B shows the imaging device 20.
- the display unit 17 in the display device 10 is a display 101.
- the communication unit 11 in the display device 10 is a communication device 102 that communicates using CAN or the like.
- the input unit 12 in the display device 10 is an input device 105 such as a switch or a touch panel.
- the transmission information storage unit 15 in the display device 10 is a memory 104.
- Each function of the transmission / reception control unit 13, the transmission control unit 14, and the display control unit 16 in the display device 10 is a processor 103 that executes a program stored in the memory 104.
- Each function of the transmission / reception control unit 13, the transmission control unit 14, and the display control unit 16 is realized by software.
- the software is described as a program and stored in the memory 104.
- the processor 103 reads out and executes the program stored in the memory 104, thereby realizing the functions of the respective units. That is, the display device 10 includes a memory 104 for storing a program that, when executed by the processor 103, results in the steps shown in the flowchart of FIG. It can also be said that this program causes a computer to execute the procedure or method of the transmission / reception control unit 13, the transmission control unit 14, and the display control unit 16.
- the imaging unit 24 in the imaging device 20 is a camera 201.
- the communication unit 21 in the imaging device 20 is a communication device 202 that communicates using CAN or the like.
- the reception information storage unit 23 in the imaging device 20 is a memory 204.
- the reception control unit 22 and the image analysis unit 25 in the imaging device 20 are a processor 203 that executes a program stored in the memory 204.
- Each function of the reception control unit 22 and the image analysis unit 25 is realized by software.
- the software is described as a program and stored in the memory 204.
- the processor 203 reads out and executes the program stored in the memory 204, thereby realizing the functions of the respective units.
- the imaging apparatus 20 includes a memory 204 for storing a program that, when executed by the processor 203, results in the steps shown in the flowchart of FIG. It can also be said that this program causes a computer to execute the procedures or methods of the reception control unit 22 and the image analysis unit 25.
- a function for detecting the driver's line of sight or detecting a road lane is also realized by software.
- the software is described as an image processing program and stored in the memory 204.
- the processor 203 reads and executes an image processing program stored in the memory 204, thereby realizing a function for detecting the driver's line of sight or detecting a road lane.
- the in-vehicle camera system according to Embodiment 1 updates this image processing program.
- the processors 103 and 203 are a CPU (Central Processing Unit), a processing device, an arithmetic device, a microprocessor, a microcomputer, or the like.
- the memories 104 and 204 may be a RAM (Random Access Memory), a ROM (Read Only Memory), an EPROM (Erasable Programmable ROM), or a nonvolatile or volatile semiconductor memory such as a flash memory, or a hard disk or the like. There may be.
- FIG. 4 is a flowchart showing an information transmission method by the in-vehicle camera system according to Embodiment 1 of the present invention.
- the input unit 12 instructs the transmission / reception control unit 13 to start processing.
- the display device 10 and the imaging device 20 execute the processing shown in the flowchart of FIG.
- step ST1 the display device 10 and the imaging device 20 transmit / receive setting information via the communication path 30 having a low transmission speed.
- the input unit 12 receives a user operation instruction and instructs the transmission / reception control unit 13 to start processing.
- the transmission / reception control unit 13 controls the transmission control unit 14 and the reception control unit 22 through the communication units 11 and 21 in order to transmit the information held by the transmission information storage unit 15 to the reception information storage unit 23 of the imaging device 20.
- the transmission / reception control unit 13 Upon receiving an instruction to start processing from the input unit 12, the transmission / reception control unit 13 first sets the transmission control unit 14 and the reception control unit 22 in a transmission / reception preparation state, and performs negotiation for determining the specifications for image generation. Start.
- the transmission / reception control unit 13 compares the image displayed on the display unit 17 by the transmission control unit 14 via the display control unit 16 with the feature information obtained from the reception control unit 22, and then the next image is displayed. The process of displaying and comparing is repeated, and specifications relating to image display and imaging are determined.
- the specifications and feature information are setting information.
- the transmission / reception control unit 13 When the transmission / reception control unit 13 is in a transmission / reception preparation state, the positional relationship between the display unit 17 and the imaging unit 24, the relationship between the brightness displayed by the display unit 17 and the brightness received by the imaging unit 24, and the imaging from the display unit 17.
- An image for examining the maximum resolution that can be transmitted to the unit 24 is generated and provided to the display control unit 16.
- the display control unit 16 gives the image received from the transmission control unit 14 to the display unit 17 for display.
- the display unit 17 displays the image received from the display control unit 16.
- the imaging unit 24 captures an image displayed on the display unit 17 in accordance with an instruction from the reception control unit 22, converts the image into image data, and supplies the image data to the image analysis unit 25.
- the image analysis unit 25 extracts feature information in the image from the image data received from the imaging unit 24 and provides the feature information to the reception control unit 22.
- the reception control unit 22 gives the feature information received from the image analysis unit 25 to the transmission / reception control unit 13 through the communication units 21 and 11.
- the display device 10 converts transmission information having a capacity larger than the capacity of the setting information into an image based on the setting information and displays the image.
- the transmission information is the above-described image processing program. If the capacity of transmission information is larger than the capacity per image determined as specifications, the transmission information is converted into a plurality of images.
- the transmission control unit 14 acquires transmission information from the transmission information storage unit 15, converts it into an image according to specifications, and provides the image to the display control unit 16.
- the display control unit 16 gives the image received from the transmission control unit 14 to the display unit 17 for display.
- the display unit 17 displays the image received from the display control unit 16.
- the imaging device 20 captures an image displayed by the display device 10 based on the setting information and restores it to transmission information.
- the imaging unit 24 captures an image displayed on the display unit 17, converts the image into image data, and provides the image data to the image analysis unit 25.
- the image analysis unit 25 restores the image data received from the imaging unit 24 to transmission information according to the specifications, and provides the transmission information to the reception control unit 22.
- the reception control unit 22 gives the transmission information received from the image analysis unit 25 to the reception information storage unit 23 for storage.
- the display device 10 and the imaging device 20 transmit a plurality of images by repeating step ST2 and step ST3 a plurality of times according to the specifications.
- FIG. 5 is a flowchart showing details of step ST1 of FIG.
- the transmission / reception preparation state in step ST1 includes brightness adjustment in step ST10, image display range adjustment in step ST20, image gradation adjustment in step ST30, image resolution adjustment in step ST40, and response speed adjustment in step ST50.
- the instructions given to the display device 10 and the imaging device 20 by the transmission / reception control unit 13 via the communication path 30 in steps ST10 to ST50 are setting information.
- the order in which steps ST10 to ST50 are executed is not limited to the order shown in FIG.
- FIG. 6 is a flowchart showing details of step ST10 of FIG.
- the transmission / reception control unit 13 controls the imaging unit 24 through the communication units 11 and 21 and the reception control unit 22, and sets a shutter speed, an aperture, an ND (Neutral Density) filter, and the like to predetermined values.
- the predetermined value is assumed to be given to the transmission / reception control unit 13 in advance.
- the transmission / reception control unit 13 displays a specific luminance on the entire display screen of the display unit 17 through the communication unit 11, the transmission control unit 14, and the display control unit 16, and sequentially changes the luminance.
- the transmission / reception control unit 13 causes the imaging unit 24 to capture images for each luminance through the communication units 11 and 21 and the reception control unit 22, and the image analysis unit 25 has predetermined pixels (for example, a pixel at the center of the screen) in the image.
- the received luminance is acquired and transmitted to the transmission / reception control unit 13 as feature information.
- the transmission / reception control unit 13 creates a correspondence table between the transmission luminance displayed by the display unit 17 and the reception luminance captured by the imaging unit 24.
- 7A to 7D are diagrams showing correspondence tables between transmission luminance and reception luminance.
- the transmission / reception control unit 13 includes a predetermined number or more (for example, 10% or more) of transmission luminance samples within a predetermined range (for example, within 5%) from the lowest value of the reception luminance in the created correspondence table. If included, it is detected as lower saturation. In the case of the correspondence table as shown in FIG. 7A, since 10% or more of the transmission luminance samples are included within 5% from the lowest value of the reception luminance, it is detected as lower saturation. Similarly, the transmission / reception control unit 13 detects upper side saturation on the maximum value side of the reception luminance. In the case of the correspondence table as shown in FIG. 7B, since 10% or more of transmission luminance samples are included within 5% from the maximum value of the reception luminance, upper saturation is detected.
- step ST14 the transmission / reception control unit 13 ends the brightness adjustment when the upper saturation and the lower saturation are not detected as shown in FIG. 7C, for example (step ST14 “YES”). Further, even if both the upper saturation and the lower saturation are detected, the transmission / reception control unit 13 has the same upper and lower saturations as shown in FIG. 7D (step ST14 “YES”). End brightness adjustment.
- the transmission / reception control unit 13 detects upper saturation or lower saturation as shown in FIG. 7A or 7B, for example, or when the degree of saturation is different between the upper side and the lower side (step ST14 “NO”), the step Proceed to ST15.
- step ST15 the transmission / reception control unit 13 decreases the sensitivity on the reception side when only the upper saturation is present or when the upper saturation is larger than the lower saturation.
- the transmission / reception control unit 13 increases the sensitivity on the reception side when there is only lower saturation or when the lower saturation is larger than the upper saturation.
- the sensitivity on the reception side can be adjusted by, for example, the ND filter of the imaging unit 24.
- the transmission / reception control part 13 returns to step ST11 again, and controls the imaging part 24 based on the reception sensitivity corrected by step ST15.
- the transmission / reception control unit 13 may lower the luminance standard on the transmission side when only the upper saturation is present or when the upper saturation is larger than the lower saturation. Further, the transmission / reception control unit 13 may increase the luminance standard on the transmission side when only the lower saturation is present or when the lower saturation is greater than the upper saturation.
- the luminance reference on the transmission side can be adjusted by, for example, the backlight of the display unit 17 or the like.
- FIG. 8 is a flowchart showing details of step ST20 in FIG.
- the transmission / reception control unit 13 controls the display control unit 16 through the communication unit 11 and the transmission control unit 14, and causes the display unit 17 to display an image for specifying the position.
- One or more feature points that can be extracted by image processing are included in the position specifying image.
- the transmission / reception control unit 13 has a list of feature points and their transmission positions.
- the position specifying image is, for example, a checkered flag image.
- step ST22 the display screen of the display unit 17 is imaged by the imaging unit 24 and converted into image data, and the image analysis unit 25 performs image processing on the image data to extract the reception position of the feature point.
- the image analysis unit 25 gives the feature point and its reception position as feature information to the transmission / reception control unit 13 through the reception control unit 22 and the communication units 21 and 11.
- the transmission / reception control unit 13 compares the feature points and their transmission positions with the feature points that are feature information and the reception positions, and associates the feature points with each other. A discrete positional relationship of reception positions is obtained. And the transmission / reception control part 13 estimates the parameter of the conversion type showing the transmission / reception positional relationship in the whole display screen using the obtained discrete transmission / reception positional relationship. For example, assuming that the transmission position and the reception position are in a projective transformation relationship, the transmission / reception control unit 13 estimates the projection matrix by the method of least squares. Further, when lens distortion becomes a problem, the transmission / reception control unit 13 may use a positional relationship conversion formula including a lens distortion coefficient, such as a camera parameter in the Tsai method.
- step ST24 when there is a feature point for which the reception position cannot be extracted (step ST24 “NO”), the transmission / reception control unit 13 proceeds to step ST25. Or the transmission / reception control part 13 progresses to step ST25, when the number of feature point samples sufficient to estimate the parameter of the conversion formula showing transmission / reception positional relationship cannot be extracted (step ST24 “NO”). In other cases (step ST24 “YES”), the transmission / reception control unit 13 ends the image display range adjustment.
- step ST25 the transmission / reception control unit 13 moves the transmission position of the feature point for which the reception position could not be extracted to the inside of the display screen, or reduces the position specifying image. Or the transmission / reception control part 13 moves the transmission position of a feature point, when the feature point sample number enough to estimate the parameter of the transformation formula showing transmission / reception position relationship cannot be extracted. Then, the transmission / reception control unit 13 returns to step ST21 again and causes the display unit 17 to display the position specifying image corrected in step ST25.
- the relationship between the transmission position and the reception position is obtained, and the imaging range, that is, the part displayed on the display unit 17 and imaged by the imaging unit 24 is also known.
- the transmission / reception control unit 13 sets the imaging range as the transmission range, and does not use it outside the transmission range in future processing. Thereby, the largest transmission image size according to the performance of the display device 10 and the imaging device 20 can be determined.
- FIG. 9 is a flowchart showing details of step ST30 in FIG. This is a process for correcting brightness unevenness due to a lens and an imaging angle.
- the transmission / reception control unit 13 sequentially changes the luminance of the display unit 17 as in step ST12 of FIG. 6, and acquires the reception luminance for each transmission position.
- the entire display screen of the display unit 17 is divided into a lattice shape, and a transmission / reception luminance relationship is obtained for each lattice.
- a grid composed of a plurality of pixels is referred to as a block.
- step ST32 the transmission / reception control unit 13 divides the relationship between the transmission luminance and the reception luminance obtained for each block with reference to the reception luminance, and assigns a representative transmission luminance to each.
- FIG. 10 is a diagram showing a correspondence table between transmission luminance and reception luminance. In the example of FIG. 10, the range from the lowest received luminance value 10 to the highest value 70 is equally divided by ten. Then, a transmission luminance range is obtained for each divided reception luminance range, and the respective centers are set as representative transmission luminances 13, 33, 46, 56, 65, 78.
- FIG. 11 is a flowchart showing details of step ST40 in FIG.
- the transmission / reception control unit 13 controls the display control unit 16 through the communication unit 11 and the transmission control unit 14, and causes the display unit 17 to display an image for resolution adjustment.
- the resolution adjustment image is for displaying the representative transmission luminance for each block on the transmission side.
- step ST42 the image capturing unit 24 captures the display screen of the display unit 17 into image data, and the image analysis unit 25 performs image processing on the image data, and transmits the received luminance to the transmission / reception control unit 13 as feature information.
- the transmission / reception control unit 13 extracts reception luminance corresponding to the representative transmission luminance for each block in the resolution adjustment image based on the feature information.
- the transmission / reception control unit 13 determines, for each block, whether or not the representative transmission luminance matches the corresponding reception luminance. However, if the representative transmission luminance differs between a plurality of consecutive blocks, the reception luminance is mixed with the representative transmission luminance of those blocks, and the representative transmission luminance and the corresponding reception luminance do not completely match. Therefore, the transmission / reception control unit 13 may determine that they match when the difference between the representative transmission luminance and the reception luminance is within a preset allowable range.
- step ST44 the transmission / reception control unit 13 has a predetermined ratio (for example, 90% or more) of the block in which the representative transmission luminance and the reception luminance match with respect to all the blocks of the resolution adjustment image (for example, 90% or more).
- step ST44 “YES”) the image resolution adjustment is terminated.
- step ST44 “NO”) the transmission / reception control unit 13 proceeds to step ST45. For example, if the image is divided into 10 blocks, the image resolution adjustment ends if there are 9 or more blocks whose representative transmission brightness and reception brightness match. Note that, in order to correct transmission information in a receiving state, which will be described later, the block matching ratio need not be 100%.
- step ST45 the transmission / reception control unit 13 reduces the number of blocks included in the resolution adjustment image by lowering the resolution of the resolution adjustment image, that is, by increasing the number of pixels included in one block. Then, the transmission / reception control unit 13 returns to step ST41 again and causes the display unit 17 to display the resolution adjustment image corrected in step ST45. Thereby, the highest resolution according to the performance of the display device 10 and the imaging device 20 can be determined.
- FIG. 12 is a flowchart showing details of step ST50 in FIG.
- the transmission / reception control unit 13 controls the display control unit 16 through the communication unit 11 and the transmission control unit 14, displays an image for adjusting the response speed on the display unit 17, and acquires the reception luminance.
- step ST52 the transmission / reception control unit 13 controls the display control unit 16 through the communication unit 11 and the transmission control unit 14, displays a response speed adjustment image different from that in step ST51 on the display unit 17, and sets the reception luminance. get.
- the response speed adjustment image is an image having a predetermined representative transmission luminance.
- the transmission / reception control unit 13 displays a white color image
- step ST52 displays a black color image.
- step ST53 the transmission / reception controller 13 changes the reception luminance corresponding to the representative transmission luminance of the response speed adjustment image in step ST52 from the reception luminance corresponding to the representative transmission luminance of the response speed adjustment image in step ST51. Is measured as a response speed, and the measured time interval is defined as a transmission cycle. Thereby, the shortest transmission cycle according to the performance of the display device 10 and the imaging device 20 can be determined.
- the transmission / reception control unit 13 obtains specifications including the transmission / reception position correspondence and the transmission range, the transmission / reception luminance correspondence and the representative transmission luminance, the transmission resolution, and the transmission cycle in the transmission / reception ready state. After that, the transmission / reception control unit 13 sets the transmission control unit 14 to the transmission state and the reception control unit 22 to the reception state through the communication units 11 and 21, and transmits and receives transmission information according to the determined specifications. Further, the transmission / reception control unit 13 gives an instruction to switch the image to be displayed on the display unit 17 to the next image to the display control unit 16 through the communication unit 11 and the transmission control unit 14 according to the transmission cycle. This instruction is setting information. Further, the transmission / reception control unit 13 instructs the reception control unit 22 through the communication units 11 and 21 according to the transmission cycle to the timing for causing the imaging unit 24 to capture an image. This instruction is also setting information.
- the transmission control unit 14 When in the transmission state of step ST2, the transmission control unit 14 obtains the number N of data used for transmission from the transmission range and the transmission resolution. The number of data N corresponds to the number of blocks. Also, the transmission control unit 14 assigns a code value for each divided representative transmission luminance, with the division number M when the transmission luminance is divided into the representative transmission luminance. For example, in the example of FIG. 10, one code value is assigned to the representative transmission luminance 13 corresponding to the range of the reception luminances 0 to 10. The transmission control unit 14 has a list of representative transmission luminances and their code values in advance. This list is transmitted as setting information to the image analysis unit 25 through the communication units 11 and 21 and the reception control unit 22.
- an M-digit N-digit code value can be included in one transmission image. This is expressed in binary, a log 2 M N bits.
- control information such as a sequence number indicating the current image number, and transmission information and an error correction code of the control information are included in this bit string. Include. Therefore, the capacity of transmission information included in one transmission image is smaller than log 2 MN bits.
- the transmission control unit 14 acquires transmission information from the transmission information storage unit 15, divides the acquired transmission information into a capacity smaller than log 2 MN bits, and makes one or more pieces of divided transmission information. Then, the transmission control unit 14 adds control information and an error correction code to each divided transmission information.
- FIG. 13 is a diagram showing an example of transmission information converted into one transmission image in the first embodiment of the present invention.
- the transmission information 70 converted into one transmission image includes control information 71, one piece of transmission information 72, and an error correction code 73.
- the capacity of this transmission information 70 is log 2 MN bits.
- the transmission control unit 14 converts the transmission information 70 into an M-ary N-digit code value, determines a representative transmission luminance corresponding to the code value for each digit, and generates one transmission image.
- FIG. 14 is a diagram showing an example of a transmission image 80 according to Embodiment 1 of the present invention.
- One transmission image 80 is divided into N blocks 81, and one block 81 is assigned a luminance of one of the M gradations.
- the transmission control unit 14 sequentially provides the generated transmission images to the display control unit 16 according to the instruction timing from the transmission / reception control unit 13 through the communication unit 11.
- the display control unit 16 causes the display unit 17 to sequentially display the transmission images from the transmission control unit 14.
- the imaging unit 24 captures the transmission image displayed on the display unit 17 in accordance with the instruction timing from the transmission / reception control unit 13 through the communication units 11 and 21 and the reception control unit 22.
- the data is converted into data and given to the image analysis unit 25.
- the image analysis unit 25 extracts the reception luminance from each reception position corresponding to each block of the transmission image, and obtains a code value assigned to the representative transmission luminance corresponding to the reception luminance. Note that the image analysis unit 25 may obtain the code value assigned to the representative transmission luminance using the list of the representative transmission luminance and its code value. In the example of FIG. 10, when the reception luminance extracted by the image analysis unit 25 is 35, the code value assigned to the representative transmission luminance 46 corresponding to the reception luminances 30 to 40 including the reception luminance 35 is acquired.
- the image analysis unit 25 converts the code value N digits obtained from one transmission image into a binary number, performs error correction, and restores the control information and the divided transmission information. At this time, the image analysis unit 25 also performs error detection and error correction using an error correction code.
- the reception control unit 22 When no error is detected by the image analysis unit 25 or when an error is detected and corrected, the reception control unit 22 stores the restored divided transmission information in the storage destination corresponding to the control information in the reception information storage unit 23. Write. On the other hand, when an error is detected by the image analysis unit 25 but cannot be corrected, that is, when the information amount of the error correction code is insufficient and the correction capability is low, the reception control unit 22 transmits the transmission control unit through the communication units 21 and 11. 14 is requested to retransmit the transmission image.
- the input unit 12 exists in the display device 10, but may exist in the imaging device 20 or the in-vehicle device 40 connected via the communication path 30.
- the transmission / reception control unit 13 that controls the entire in-vehicle camera system exists in the display device 10, but may exist in the imaging device 20 or the in-vehicle device 40 connected through the communication path 30.
- the input unit 12 and the transmission / reception control unit 13 only need to be able to communicate with the display device 10 and the imaging device 20 via the communication path 30.
- the imaging device 20 and the display device 10 transmit and receive setting information via the communication path 30 that connects the imaging device 20 and the display device 10.
- the display device 10 converts transmission information having a capacity larger than the capacity of the setting information into one or more images based on the setting information and displays the information, and the imaging device 20 displays the display device based on the setting information. And capturing one or more images displayed by 10 and restoring them to transmission information.
- one of the imaging device 20 or the display device 10 includes the transmission / reception control unit 13. And in step ST1 which transmits / receives setting information via the communication path 30, the transmission / reception control part 13 adjusts setting information based on the image for position specification etc. which were imaged, etc., to the imaging device 20 or the display apparatus 10.
- the transmission / reception control unit 13 transmits setting information to the display device 10, the display device 10 displays an image based on the setting information transmitted by the transmission / reception control unit 13, and the imaging device 20 An image displayed by the display device 10 is captured to generate feature information and transmitted to the transmission / reception control unit 13, and the transmission / reception control unit 13 has no adjustment based on the feature information of the image transmitted by the imaging device 20.
- the setting information is adjusted and transmitted to the imaging device 20 or the display device 10.
- the imaging device 20 and the display device 10 negotiate through the communication path 30, the settings of the imaging device 20 and the display device 10 can be automated. Therefore, it is easy to install the display device 10 when updating the image processing program.
- the setting information instructs the display device 10 to switch the display to the next image in step ST2. Accordingly, a plurality of images can be transmitted without changing the positions of the display device 10 and the imaging device 20, and the transmission time interval can be shortened.
- the transmission time interval is long.
- the setting information is at least one of the range for displaying the image, the brightness, the resolution, the gradation, or the cycle for switching the image display on the display device 10 in step ST1.
- One is instructed.
- the negotiation can be automatically performed through the communication path 30, and the installation of the display device 10 when the image processing program is updated is easy.
- the in-vehicle camera system includes a display device 10 and an imaging device 20 mounted on the vehicle.
- the display device 10 converts transmission information having a capacity larger than the capacity of the setting information into one or more images based on the setting information transmitted / received via the communication path 30 connecting the imaging device 20 and the display device 10. And display.
- the imaging device 20 captures one or more images displayed by the display device 10 based on the setting information transmitted / received via the communication path 30, and restores the transmission information. With this configuration, it is possible to increase the data capacity included in one image by transmitting / receiving setting information via the communication path 30 and increase the transmission speed.
- the in-vehicle camera system according to Embodiment 1 may be configured to include the optical device 60 that shortens the distance between the imaging device 20 and the display device 10 between the imaging device 20 and the display device 10. According to this structure, a vehicle-mounted camera system can be reduced in size.
- any component of the embodiment can be modified or any component of the embodiment can be omitted within the scope of the invention.
- a large amount of information is transmitted using an image from a display device connected via a low-speed communication path to the imaging device. Suitable for use.
- 10 display device 11 communication unit, 12 input unit, 13 transmission / reception control unit, 14 transmission control unit, 15 transmission information storage unit, 16 display control unit, 17 display unit, 20 imaging device, 21 communication unit, 22 reception control unit, 23 reception information storage unit, 24 imaging unit, 25 image analysis unit, 30 communication path, 40 in-vehicle device, 50 fixture, 60 optical device, 70 transmission information, 71 control information, 72 divided transmission information, 73 error correction code, 80 Transmission image, 81 block, 101 display, 102, 202 communication device, 103, 203 processor, 104, 204 memory, 105 input device, 201 camera.
Landscapes
- Engineering & Computer Science (AREA)
- Multimedia (AREA)
- Signal Processing (AREA)
- Studio Devices (AREA)
Abstract
In the present invention, an imaging device (20) and a display device (10) transmit and receive setting information through a communication path (30). Next, the display device (10), on the basis of the setting information, converts transmission information with a larger volume than that of the setting information to one or more images and displays the images. Then, the imaging device (20), on the basis of the setting information, captures one or more images displayed by the display device (10) and reverts the images to transmission information.
Description
この発明は、撮像装置を用いた情報伝送方法および車載カメラシステムに関するものである。
The present invention relates to an information transmission method using an imaging device and an in-vehicle camera system.
特許文献1では、携帯端末が、紙に印刷された複数の二次元コードを順次読み込み、読み込んだ複数の二次元コードをプログラムデータに復元し、携帯端末のオペレーティングシステムを更新することが記載されている。
Patent Document 1 describes that a mobile terminal sequentially reads a plurality of two-dimensional codes printed on paper, restores the read two-dimensional codes into program data, and updates the operating system of the mobile terminal. Yes.
特許文献1に係る発明では紙に印刷された二次元コードを使用する構成のため、携帯端末の性能に応じて二次元コードに含めるデータ容量を増やすことはできず、携帯端末が余裕をもって確実に読み取ることができるデータ容量しか二次元コードに含めることができなかった。そのため、二次元コード一枚あたりのデータ容量を大きくできず、伝送速度を大きくすることができないという課題があった。
Since the invention according to Patent Document 1 uses a two-dimensional code printed on paper, the data capacity included in the two-dimensional code cannot be increased according to the performance of the portable terminal, and the portable terminal can be surely provided with a margin. Only the amount of data that can be read could be included in the two-dimensional code. For this reason, there is a problem that the data capacity per two-dimensional code cannot be increased and the transmission speed cannot be increased.
この発明は、上記のような課題を解決するためになされたもので、伝送速度を大きくすることを目的とする。
This invention has been made to solve the above-described problems, and aims to increase the transmission speed.
この発明に係る情報伝送方法は、撮像装置および表示装置が、撮像装置と表示装置とを接続する通信路を経由して設定情報を送受するステップと、表示装置が、設定情報に基づいて、設定情報の容量より大きい容量の伝送情報を一枚以上の画像に変換して表示するステップと、撮像装置が、設定情報に基づいて、表示装置により表示された画像を撮像して伝送情報に復元するステップとを備えるものである。
In the information transmission method according to the present invention, the imaging device and the display device transmit and receive the setting information via a communication path connecting the imaging device and the display device, and the display device sets based on the setting information. The step of converting and displaying transmission information having a capacity larger than the information capacity into one or more images, and the imaging device capturing the image displayed by the display device based on the setting information and restoring the transmission information to the transmission information Steps.
この発明によれば、通信路を経由した設定情報の送受によって撮像装置および表示装置を調整することで一枚の画像に含めるデータ容量を大きくすることができ、伝送速度を大きくすることができる。
According to the present invention, the data capacity included in one image can be increased by adjusting the imaging device and the display device by sending and receiving the setting information via the communication path, and the transmission speed can be increased.
以下、この発明をより詳細に説明するために、この発明を実施するための形態について、添付の図面に従って説明する。
実施の形態1.
図1は、この発明の実施の形態1に係る車載カメラシステムの概要を示す図である。実施の形態1に係る車載カメラシステムは、表示装置10、撮像装置20、通信路30、車載装置40、固定具50、および光学装置60を備える。撮像装置20は、ディジタルカメラなどの撮像部を備えており、車両に搭載されている。撮像装置20は、例えば、運転者の視線を検出するための、または道路の車線を検出するための、カメラ付き画像処理装置である。また、撮像装置20と車載装置40との間は、CAN(Controller Area Network)などの通信路30により接続されている。撮像装置20は、視線検出結果または車線検出結果を、通信路30を通じて車載装置40へ送信する。車載装置40は、視線検出結果または車線検出結果を用いて動作する。 Hereinafter, in order to explain the present invention in more detail, modes for carrying out the present invention will be described with reference to the accompanying drawings.
Embodiment 1 FIG.
1 is a diagram showing an outline of an in-vehicle camera system according to Embodiment 1 of the present invention. The in-vehicle camera system according to Embodiment 1 includes adisplay device 10, an imaging device 20, a communication path 30, an in-vehicle device 40, a fixture 50, and an optical device 60. The imaging device 20 includes an imaging unit such as a digital camera and is mounted on a vehicle. The imaging device 20 is, for example, an image processing device with a camera for detecting a driver's line of sight or detecting a road lane. Further, the imaging device 20 and the in-vehicle device 40 are connected by a communication path 30 such as a CAN (Controller Area Network). The imaging device 20 transmits the line-of-sight detection result or the lane detection result to the in-vehicle device 40 through the communication path 30. The in-vehicle device 40 operates using the line-of-sight detection result or the lane detection result.
実施の形態1.
図1は、この発明の実施の形態1に係る車載カメラシステムの概要を示す図である。実施の形態1に係る車載カメラシステムは、表示装置10、撮像装置20、通信路30、車載装置40、固定具50、および光学装置60を備える。撮像装置20は、ディジタルカメラなどの撮像部を備えており、車両に搭載されている。撮像装置20は、例えば、運転者の視線を検出するための、または道路の車線を検出するための、カメラ付き画像処理装置である。また、撮像装置20と車載装置40との間は、CAN(Controller Area Network)などの通信路30により接続されている。撮像装置20は、視線検出結果または車線検出結果を、通信路30を通じて車載装置40へ送信する。車載装置40は、視線検出結果または車線検出結果を用いて動作する。 Hereinafter, in order to explain the present invention in more detail, modes for carrying out the present invention will be described with reference to the accompanying drawings.
Embodiment 1 FIG.
1 is a diagram showing an outline of an in-vehicle camera system according to Embodiment 1 of the present invention. The in-vehicle camera system according to Embodiment 1 includes a
以下では、視線検出精度または車線検出精度向上のために撮像装置20の画像処理プログラムを更新する例を用いて、実施の形態1に係る車載カメラシステムを説明する。
画像処理プログラムの更新等、臨時の用途で、大量のデータを撮像装置20に与える必要がある場合、伝送速度が低い通信路30を用いると時間がかかる。そこで、実施の形態1では、表示装置10が二次元コードのような画像を次々に表示し、撮像装置20が表示された画像を次々に撮像することで、大量のデータを高速に伝送する。 Hereinafter, the in-vehicle camera system according to Embodiment 1 will be described using an example in which the image processing program of theimaging device 20 is updated to improve the gaze detection accuracy or the lane detection accuracy.
When it is necessary to provide a large amount of data to theimaging device 20 for temporary use such as updating an image processing program, it takes time to use the communication path 30 having a low transmission rate. Therefore, in the first embodiment, the display device 10 displays images such as a two-dimensional code one after another, and the imaging device 20 sequentially captures the displayed images, thereby transmitting a large amount of data at high speed.
画像処理プログラムの更新等、臨時の用途で、大量のデータを撮像装置20に与える必要がある場合、伝送速度が低い通信路30を用いると時間がかかる。そこで、実施の形態1では、表示装置10が二次元コードのような画像を次々に表示し、撮像装置20が表示された画像を次々に撮像することで、大量のデータを高速に伝送する。 Hereinafter, the in-vehicle camera system according to Embodiment 1 will be described using an example in which the image processing program of the
When it is necessary to provide a large amount of data to the
表示装置10は、液晶ディスプレイなどの表示部を備えている。撮像装置20の画像処理プログラムを更新する場合に、表示部が撮像装置20の撮像部に相対するように表示装置10が配置され、フックまたは吸盤などの簡易な固定具50により撮像装置20に固定される。表示装置10と撮像装置20との間に、レンズなどの光学装置60が設置されてもよい。なお、光学装置60の設置方法は問わない。例えば、光学装置60は、不図示の固定具によって表示装置10と撮像装置20との間に固定されてもよいし、固定具50によって固定されてもよいし、表示装置10に予め固定されていてもよい。さらに、表示装置10は通信路30に接続され、通信路30を経由して表示装置10と撮像装置20とが通信可能となる。
The display device 10 includes a display unit such as a liquid crystal display. When the image processing program of the imaging device 20 is updated, the display device 10 is arranged so that the display unit faces the imaging unit of the imaging device 20, and is fixed to the imaging device 20 by a simple fixing tool 50 such as a hook or a suction cup. Is done. An optical device 60 such as a lens may be installed between the display device 10 and the imaging device 20. In addition, the installation method of the optical apparatus 60 is not ask | required. For example, the optical device 60 may be fixed between the display device 10 and the imaging device 20 by a fixture (not shown), may be fixed by the fixture 50, or is fixed to the display device 10 in advance. May be. Further, the display device 10 is connected to the communication path 30, and the display device 10 and the imaging device 20 can communicate with each other via the communication path 30.
図2は、この発明の実施の形態1に係る車載カメラシステムの構成例を示すブロック図である。表示装置10は、通信部11、入力部12、送受制御部13、送信制御部14、送信情報蓄積部15、表示制御部16、および表示部17を備える。
撮像装置20は、通信部21、受信制御部22、受信情報蓄積部23、撮像部24、および画像解析部25を備える。なお、図2では、運転者の視線を検出するための、または道路の車線を検出するための機能について、図示を省略する。 FIG. 2 is a block diagram showing a configuration example of the in-vehicle camera system according to Embodiment 1 of the present invention. Thedisplay device 10 includes a communication unit 11, an input unit 12, a transmission / reception control unit 13, a transmission control unit 14, a transmission information storage unit 15, a display control unit 16, and a display unit 17.
Theimaging device 20 includes a communication unit 21, a reception control unit 22, a reception information storage unit 23, an imaging unit 24, and an image analysis unit 25. In addition, in FIG. 2, illustration is abbreviate | omitted about the function for detecting a driver | operator's eyes | visual_axis or the road lane.
撮像装置20は、通信部21、受信制御部22、受信情報蓄積部23、撮像部24、および画像解析部25を備える。なお、図2では、運転者の視線を検出するための、または道路の車線を検出するための機能について、図示を省略する。 FIG. 2 is a block diagram showing a configuration example of the in-vehicle camera system according to Embodiment 1 of the present invention. The
The
図3は、この発明の実施の形態1に係る車載カメラシステムのハードウェア構成図であり、図3Aは表示装置10、図3Bは撮像装置20を示す。
表示装置10における表示部17は、ディスプレイ101である。表示装置10における通信部11は、CANなどを用いて通信する通信装置102である。表示装置10における入力部12は、スイッチまたはタッチパネルなどの入力装置105である。表示装置10における送信情報蓄積部15は、メモリ104である。表示装置10における送受制御部13、送信制御部14および表示制御部16の各機能は、メモリ104に格納されるプログラムを実行するプロセッサ103である。送受制御部13、送信制御部14および表示制御部16の各機能は、ソフトウェアにより実現される。ソフトウェアはプログラムとして記述され、メモリ104に格納される。プロセッサ103は、メモリ104に格納されたプログラムを読みだして実行することにより、各部の機能を実現する。即ち、表示装置10は、プロセッサ103により実行されるときに、後述する図4のフローチャートで示されるステップが結果的に実行されることになるプログラムを格納するためのメモリ104を備える。また、このプログラムは、送受制御部13、送信制御部14および表示制御部16の手順または方法をコンピュータに実行させるものであるとも言える。 3 is a hardware configuration diagram of the in-vehicle camera system according to the first embodiment of the present invention. FIG. 3A shows thedisplay device 10, and FIG. 3B shows the imaging device 20.
Thedisplay unit 17 in the display device 10 is a display 101. The communication unit 11 in the display device 10 is a communication device 102 that communicates using CAN or the like. The input unit 12 in the display device 10 is an input device 105 such as a switch or a touch panel. The transmission information storage unit 15 in the display device 10 is a memory 104. Each function of the transmission / reception control unit 13, the transmission control unit 14, and the display control unit 16 in the display device 10 is a processor 103 that executes a program stored in the memory 104. Each function of the transmission / reception control unit 13, the transmission control unit 14, and the display control unit 16 is realized by software. The software is described as a program and stored in the memory 104. The processor 103 reads out and executes the program stored in the memory 104, thereby realizing the functions of the respective units. That is, the display device 10 includes a memory 104 for storing a program that, when executed by the processor 103, results in the steps shown in the flowchart of FIG. It can also be said that this program causes a computer to execute the procedure or method of the transmission / reception control unit 13, the transmission control unit 14, and the display control unit 16.
表示装置10における表示部17は、ディスプレイ101である。表示装置10における通信部11は、CANなどを用いて通信する通信装置102である。表示装置10における入力部12は、スイッチまたはタッチパネルなどの入力装置105である。表示装置10における送信情報蓄積部15は、メモリ104である。表示装置10における送受制御部13、送信制御部14および表示制御部16の各機能は、メモリ104に格納されるプログラムを実行するプロセッサ103である。送受制御部13、送信制御部14および表示制御部16の各機能は、ソフトウェアにより実現される。ソフトウェアはプログラムとして記述され、メモリ104に格納される。プロセッサ103は、メモリ104に格納されたプログラムを読みだして実行することにより、各部の機能を実現する。即ち、表示装置10は、プロセッサ103により実行されるときに、後述する図4のフローチャートで示されるステップが結果的に実行されることになるプログラムを格納するためのメモリ104を備える。また、このプログラムは、送受制御部13、送信制御部14および表示制御部16の手順または方法をコンピュータに実行させるものであるとも言える。 3 is a hardware configuration diagram of the in-vehicle camera system according to the first embodiment of the present invention. FIG. 3A shows the
The
撮像装置20における撮像部24は、カメラ201である。撮像装置20における通信部21は、CANなどを用いて通信する通信装置202である。撮像装置20における受信情報蓄積部23は、メモリ204である。撮像装置20における受信制御部22および画像解析部25は、メモリ204に格納されるプログラムを実行するプロセッサ203である。受信制御部22および画像解析部25の各機能は、ソフトウェアにより実現される。ソフトウェアはプログラムとして記述され、メモリ204に格納される。プロセッサ203は、メモリ204に格納されたプログラムを読みだして実行することにより、各部の機能を実現する。即ち、撮像装置20は、プロセッサ203により実行されるときに、後述する図4のフローチャートで示されるステップが結果的に実行されることになるプログラムを格納するためのメモリ204を備える。また、このプログラムは、受信制御部22および画像解析部25の手順または方法をコンピュータに実行させるものであるとも言える。
The imaging unit 24 in the imaging device 20 is a camera 201. The communication unit 21 in the imaging device 20 is a communication device 202 that communicates using CAN or the like. The reception information storage unit 23 in the imaging device 20 is a memory 204. The reception control unit 22 and the image analysis unit 25 in the imaging device 20 are a processor 203 that executes a program stored in the memory 204. Each function of the reception control unit 22 and the image analysis unit 25 is realized by software. The software is described as a program and stored in the memory 204. The processor 203 reads out and executes the program stored in the memory 204, thereby realizing the functions of the respective units. That is, the imaging apparatus 20 includes a memory 204 for storing a program that, when executed by the processor 203, results in the steps shown in the flowchart of FIG. It can also be said that this program causes a computer to execute the procedures or methods of the reception control unit 22 and the image analysis unit 25.
なお、撮像装置20において、運転者の視線を検出するための、または道路の車線を検出するための機能も、ソフトウェアにより実現される。ソフトウェアは画像処理プログラムとして記述され、メモリ204に格納される。プロセッサ203は、メモリ204に格納された画像処理プログラムを読みだして実行することにより、運転者の視線を検出するための、または道路の車線を検出するための機能を実現する。実施の形態1に係る車載カメラシステムは、この画像処理プログラムを更新する。
In the imaging device 20, a function for detecting the driver's line of sight or detecting a road lane is also realized by software. The software is described as an image processing program and stored in the memory 204. The processor 203 reads and executes an image processing program stored in the memory 204, thereby realizing a function for detecting the driver's line of sight or detecting a road lane. The in-vehicle camera system according to Embodiment 1 updates this image processing program.
ここで、プロセッサ103,203とは、CPU(Central Processing Unit)、処理装置、演算装置、マイクロプロセッサ、またはマイクロコンピュータ等のことである。
メモリ104,204は、RAM(Random Access Memory)、ROM(Read Only Memory)、EPROM(Erasable Programmable ROM)、またはフラッシュメモリ等の不揮発性もしくは揮発性の半導体メモリであってもよいし、ハードディスク等であってもよい。 Here, the processors 103 and 203 are a CPU (Central Processing Unit), a processing device, an arithmetic device, a microprocessor, a microcomputer, or the like.
The memories 104 and 204 may be a RAM (Random Access Memory), a ROM (Read Only Memory), an EPROM (Erasable Programmable ROM), or a nonvolatile or volatile semiconductor memory such as a flash memory, or a hard disk or the like. There may be.
メモリ104,204は、RAM(Random Access Memory)、ROM(Read Only Memory)、EPROM(Erasable Programmable ROM)、またはフラッシュメモリ等の不揮発性もしくは揮発性の半導体メモリであってもよいし、ハードディスク等であってもよい。 Here, the
The
図4は、この発明の実施の形態1に係る車載カメラシステムによる情報伝送方法を示すフローチャートである。表示装置10において、入力部12は、ユーザの操作指示を受けると、送受制御部13へ処理の開始を指示する。これにより、表示装置10と撮像装置20は、図4のフローチャートに示される処理を実行する。
FIG. 4 is a flowchart showing an information transmission method by the in-vehicle camera system according to Embodiment 1 of the present invention. In the display device 10, upon receiving a user operation instruction, the input unit 12 instructs the transmission / reception control unit 13 to start processing. As a result, the display device 10 and the imaging device 20 execute the processing shown in the flowchart of FIG.
ステップST1の送受準備状態において、表示装置10および撮像装置20は、伝送速度が低い通信路30を経由して設定情報を送受する。
In the transmission / reception preparation state of step ST1, the display device 10 and the imaging device 20 transmit / receive setting information via the communication path 30 having a low transmission speed.
より具体的には、入力部12は、ユーザの操作指示を受けて、送受制御部13に処理の開始を指示する。送受制御部13は、送信情報蓄積部15がもつ情報を、撮像装置20の受信情報蓄積部23へ伝送するために、通信部11,21を通じて送信制御部14と受信制御部22を制御する。送受制御部13は、入力部12より処理の開始の指示を受けると、まず、送信制御部14と受信制御部22を送受準備状態にし、画像生成のための諸元を確定させるためのネゴシエーションを開始する。送受制御部13は、ネゴシエーションにおいて、送信制御部14が表示制御部16を介して表示部17に表示させた画像と受信制御部22から得た特徴情報とを比較し、その後、次の画像の表示と比較に移ることを繰り返し、画像の表示および撮像に関わる諸元を確定させる。諸元および特徴情報は、設定情報である。
More specifically, the input unit 12 receives a user operation instruction and instructs the transmission / reception control unit 13 to start processing. The transmission / reception control unit 13 controls the transmission control unit 14 and the reception control unit 22 through the communication units 11 and 21 in order to transmit the information held by the transmission information storage unit 15 to the reception information storage unit 23 of the imaging device 20. Upon receiving an instruction to start processing from the input unit 12, the transmission / reception control unit 13 first sets the transmission control unit 14 and the reception control unit 22 in a transmission / reception preparation state, and performs negotiation for determining the specifications for image generation. Start. In the negotiation, the transmission / reception control unit 13 compares the image displayed on the display unit 17 by the transmission control unit 14 via the display control unit 16 with the feature information obtained from the reception control unit 22, and then the next image is displayed. The process of displaying and comparing is repeated, and specifications relating to image display and imaging are determined. The specifications and feature information are setting information.
送受制御部13は、送受準備状態にあるとき、表示部17と撮像部24との位置関係、表示部17が表示した明るさと撮像部24が受けた明るさとの関係、および表示部17から撮像部24へ伝達可能な最大解像度などを調べるための画像を生成し、表示制御部16に与える。表示制御部16は、送信制御部14より受けた画像を表示部17に与え、表示させる。表示部17は、表示制御部16より受けた画像を表示する。
撮像部24は、受信制御部22の指示に従って表示部17に表示された画像を撮像し、画像データに変換し、画像解析部25に与える。画像解析部25は、撮像部24から受けた画像データから画像中の特徴情報を抽出し、受信制御部22に与える。受信制御部22は、画像解析部25より受けた特徴情報を、通信部21,11を通じて送受制御部13に与える。 When the transmission /reception control unit 13 is in a transmission / reception preparation state, the positional relationship between the display unit 17 and the imaging unit 24, the relationship between the brightness displayed by the display unit 17 and the brightness received by the imaging unit 24, and the imaging from the display unit 17. An image for examining the maximum resolution that can be transmitted to the unit 24 is generated and provided to the display control unit 16. The display control unit 16 gives the image received from the transmission control unit 14 to the display unit 17 for display. The display unit 17 displays the image received from the display control unit 16.
Theimaging unit 24 captures an image displayed on the display unit 17 in accordance with an instruction from the reception control unit 22, converts the image into image data, and supplies the image data to the image analysis unit 25. The image analysis unit 25 extracts feature information in the image from the image data received from the imaging unit 24 and provides the feature information to the reception control unit 22. The reception control unit 22 gives the feature information received from the image analysis unit 25 to the transmission / reception control unit 13 through the communication units 21 and 11.
撮像部24は、受信制御部22の指示に従って表示部17に表示された画像を撮像し、画像データに変換し、画像解析部25に与える。画像解析部25は、撮像部24から受けた画像データから画像中の特徴情報を抽出し、受信制御部22に与える。受信制御部22は、画像解析部25より受けた特徴情報を、通信部21,11を通じて送受制御部13に与える。 When the transmission /
The
ステップST2の送信状態において、表示装置10は、設定情報に基づいて、設定情報の容量より大きい容量の伝送情報を画像に変換して表示する。伝送情報は、上述した画像処理プログラムである。諸元として確定した画像一枚あたりの容量より、伝送情報の容量のほうが大きい場合、伝送情報は複数の画像に変換される。
In the transmission state of step ST2, the display device 10 converts transmission information having a capacity larger than the capacity of the setting information into an image based on the setting information and displays the image. The transmission information is the above-described image processing program. If the capacity of transmission information is larger than the capacity per image determined as specifications, the transmission information is converted into a plurality of images.
より具体的には、送信制御部14は、送信情報蓄積部15から伝送情報を取得し、諸元に従い画像に変換して、表示制御部16に与える。表示制御部16は、送信制御部14より受けた画像を表示部17に与え、表示させる。表示部17は、表示制御部16より受けた画像を表示する。
More specifically, the transmission control unit 14 acquires transmission information from the transmission information storage unit 15, converts it into an image according to specifications, and provides the image to the display control unit 16. The display control unit 16 gives the image received from the transmission control unit 14 to the display unit 17 for display. The display unit 17 displays the image received from the display control unit 16.
ステップST3の受信状態において、撮像装置20は、設定情報に基づいて、表示装置10により表示された画像を撮像して伝送情報に復元する。
In the reception state of step ST3, the imaging device 20 captures an image displayed by the display device 10 based on the setting information and restores it to transmission information.
より具体的には、撮像部24は、表示部17に表示された画像を撮像し、画像データに変換し、画像解析部25に与える。画像解析部25は、撮像部24から受けた画像データを諸元に従い伝送情報に復元し、受信制御部22に与える。受信制御部22は、画像解析部25から受けた伝送情報を受信情報蓄積部23に与え、蓄積させる。
More specifically, the imaging unit 24 captures an image displayed on the display unit 17, converts the image into image data, and provides the image data to the image analysis unit 25. The image analysis unit 25 restores the image data received from the imaging unit 24 to transmission information according to the specifications, and provides the transmission information to the reception control unit 22. The reception control unit 22 gives the transmission information received from the image analysis unit 25 to the reception information storage unit 23 for storage.
伝送情報を変換した画像が複数枚ある場合、表示装置10と撮像装置20は諸元に従いステップST2とステップST3とを複数回繰り返すことにより、複数枚の画像を伝送する。
When there are a plurality of images obtained by converting the transmission information, the display device 10 and the imaging device 20 transmit a plurality of images by repeating step ST2 and step ST3 a plurality of times according to the specifications.
次に、ステップST1~ST3の詳細を説明する。
Next, details of steps ST1 to ST3 will be described.
図5は、図4のステップST1の詳細を示すフローチャートである。
ステップST1の送受準備状態には、ステップST10の明るさ調整、ステップST20の画像表示範囲調整、ステップST30の画像階調調整、ステップST40の画像解像度調整、およびステップST50の応答速度調整が含まれる。ステップST10~ST50において送受制御部13が通信路30を経由して表示装置10および撮像装置20へ与える指示は、設定情報である。なお、ステップST10~ST50を実行する順序は、図5の順序に限定されない。 FIG. 5 is a flowchart showing details of step ST1 of FIG.
The transmission / reception preparation state in step ST1 includes brightness adjustment in step ST10, image display range adjustment in step ST20, image gradation adjustment in step ST30, image resolution adjustment in step ST40, and response speed adjustment in step ST50. The instructions given to thedisplay device 10 and the imaging device 20 by the transmission / reception control unit 13 via the communication path 30 in steps ST10 to ST50 are setting information. The order in which steps ST10 to ST50 are executed is not limited to the order shown in FIG.
ステップST1の送受準備状態には、ステップST10の明るさ調整、ステップST20の画像表示範囲調整、ステップST30の画像階調調整、ステップST40の画像解像度調整、およびステップST50の応答速度調整が含まれる。ステップST10~ST50において送受制御部13が通信路30を経由して表示装置10および撮像装置20へ与える指示は、設定情報である。なお、ステップST10~ST50を実行する順序は、図5の順序に限定されない。 FIG. 5 is a flowchart showing details of step ST1 of FIG.
The transmission / reception preparation state in step ST1 includes brightness adjustment in step ST10, image display range adjustment in step ST20, image gradation adjustment in step ST30, image resolution adjustment in step ST40, and response speed adjustment in step ST50. The instructions given to the
図6は、図5のステップST10の詳細を示すフローチャートである。
ステップST11において、送受制御部13は、通信部11,21および受信制御部22を通じて撮像部24を制御し、シャッタ速度、絞りまたはND(Neutral Density)フィルタ等を所定の値に設定する。所定の値は、あらかじめ送受制御部13に与えられているものとする。 FIG. 6 is a flowchart showing details of step ST10 of FIG.
In step ST11, the transmission /reception control unit 13 controls the imaging unit 24 through the communication units 11 and 21 and the reception control unit 22, and sets a shutter speed, an aperture, an ND (Neutral Density) filter, and the like to predetermined values. The predetermined value is assumed to be given to the transmission / reception control unit 13 in advance.
ステップST11において、送受制御部13は、通信部11,21および受信制御部22を通じて撮像部24を制御し、シャッタ速度、絞りまたはND(Neutral Density)フィルタ等を所定の値に設定する。所定の値は、あらかじめ送受制御部13に与えられているものとする。 FIG. 6 is a flowchart showing details of step ST10 of FIG.
In step ST11, the transmission /
ステップST12において、送受制御部13は、通信部11、送信制御部14および表示制御部16を通じて、表示部17の表示画面全体に特定の輝度を表示させ、その輝度を順次変更させる。また、送受制御部13は、通信部11,21および受信制御部22を通じて、撮像部24に輝度ごとに撮像させ、画像解析部25に画像中の所定の画素(例えば、画面中央の画素)が受けた輝度を取得させ、特徴情報として送受制御部13へ送信させる。送受制御部13は、表示部17が表示した送信輝度と、撮像部24が撮像した受信輝度との対応表を作成する。図7A~図7Dは、送信輝度と受信輝度の対応表を示す図である。
In step ST12, the transmission / reception control unit 13 displays a specific luminance on the entire display screen of the display unit 17 through the communication unit 11, the transmission control unit 14, and the display control unit 16, and sequentially changes the luminance. The transmission / reception control unit 13 causes the imaging unit 24 to capture images for each luminance through the communication units 11 and 21 and the reception control unit 22, and the image analysis unit 25 has predetermined pixels (for example, a pixel at the center of the screen) in the image. The received luminance is acquired and transmitted to the transmission / reception control unit 13 as feature information. The transmission / reception control unit 13 creates a correspondence table between the transmission luminance displayed by the display unit 17 and the reception luminance captured by the imaging unit 24. 7A to 7D are diagrams showing correspondence tables between transmission luminance and reception luminance.
ステップST13において、送受制御部13は、作成した対応表において、受信輝度の最低値から所定の範囲内(例えば、5%以内)に所定の数以上(例えば、10%以上)の送信輝度サンプルが含まれる場合に、下側飽和と検知する。図7Aのような対応表の場合、受信輝度の最低値から5%以内に、10%以上の送信輝度サンプルが含まれているため、下側飽和と検知される。
また、送受制御部13は、受信輝度の最大値側に関しても同様に、上側飽和を検知する。図7Bのような対応表の場合、受信輝度の最高値から5%以内に、10%以上の送信輝度サンプルが含まれているため、上側飽和と検知される。 In step ST13, the transmission /reception control unit 13 includes a predetermined number or more (for example, 10% or more) of transmission luminance samples within a predetermined range (for example, within 5%) from the lowest value of the reception luminance in the created correspondence table. If included, it is detected as lower saturation. In the case of the correspondence table as shown in FIG. 7A, since 10% or more of the transmission luminance samples are included within 5% from the lowest value of the reception luminance, it is detected as lower saturation.
Similarly, the transmission /reception control unit 13 detects upper side saturation on the maximum value side of the reception luminance. In the case of the correspondence table as shown in FIG. 7B, since 10% or more of transmission luminance samples are included within 5% from the maximum value of the reception luminance, upper saturation is detected.
また、送受制御部13は、受信輝度の最大値側に関しても同様に、上側飽和を検知する。図7Bのような対応表の場合、受信輝度の最高値から5%以内に、10%以上の送信輝度サンプルが含まれているため、上側飽和と検知される。 In step ST13, the transmission /
Similarly, the transmission /
ステップST14において、送受制御部13は、例えば図7Cのように上側飽和および下側飽和を検知しなかった場合(ステップST14“YES”)、明るさ調整を終了する。また、送受制御部13は、上側飽和および下側飽和の両方を検知した場合であっても、図7Dのように上側と下側の飽和が同程度であれば(ステップST14“YES”)、明るさ調整を終了する。
一方、送受制御部13は、例えば図7Aまたは図7Bのように上側飽和もしくは下側飽和を検知した場合、または上側と下側とで飽和の程度が異なる場合(ステップST14“NO”)、ステップST15に進む。 In step ST14, the transmission /reception control unit 13 ends the brightness adjustment when the upper saturation and the lower saturation are not detected as shown in FIG. 7C, for example (step ST14 “YES”). Further, even if both the upper saturation and the lower saturation are detected, the transmission / reception control unit 13 has the same upper and lower saturations as shown in FIG. 7D (step ST14 “YES”). End brightness adjustment.
On the other hand, when the transmission /reception control unit 13 detects upper saturation or lower saturation as shown in FIG. 7A or 7B, for example, or when the degree of saturation is different between the upper side and the lower side (step ST14 “NO”), the step Proceed to ST15.
一方、送受制御部13は、例えば図7Aまたは図7Bのように上側飽和もしくは下側飽和を検知した場合、または上側と下側とで飽和の程度が異なる場合(ステップST14“NO”)、ステップST15に進む。 In step ST14, the transmission /
On the other hand, when the transmission /
ステップST15において、送受制御部13は、上側飽和のみある場合、または下側飽和に対して上側飽和が大きい場合、受信側の感度を下げる。一方、送受制御部13は、下側飽和のみある場合、または上側飽和に対して下側飽和が大きい場合、受信側の感度を上げる。受信側の感度は、例えば撮像部24のNDフィルタ等により調整可能である。
そして、送受制御部13は、再びステップST11に戻り、ステップST15で修正した受信感度に基づいて撮像部24を制御する。 In step ST15, the transmission /reception control unit 13 decreases the sensitivity on the reception side when only the upper saturation is present or when the upper saturation is larger than the lower saturation. On the other hand, the transmission / reception control unit 13 increases the sensitivity on the reception side when there is only lower saturation or when the lower saturation is larger than the upper saturation. The sensitivity on the reception side can be adjusted by, for example, the ND filter of the imaging unit 24.
And the transmission /reception control part 13 returns to step ST11 again, and controls the imaging part 24 based on the reception sensitivity corrected by step ST15.
そして、送受制御部13は、再びステップST11に戻り、ステップST15で修正した受信感度に基づいて撮像部24を制御する。 In step ST15, the transmission /
And the transmission /
なお、送受制御部13は、上側飽和のみある場合、または下側飽和に対して上側飽和が大きい場合、送信側の輝度基準を下げてもよい。また、送受制御部13は、下側飽和のみある場合、または上側飽和に対して下側飽和が大きい場合、送信側の輝度基準を上げてもよい。送信側の輝度基準は、例えば表示部17のバックライト等により調整可能である。
Note that the transmission / reception control unit 13 may lower the luminance standard on the transmission side when only the upper saturation is present or when the upper saturation is larger than the lower saturation. Further, the transmission / reception control unit 13 may increase the luminance standard on the transmission side when only the lower saturation is present or when the lower saturation is greater than the upper saturation. The luminance reference on the transmission side can be adjusted by, for example, the backlight of the display unit 17 or the like.
図8は、図5のステップST20の詳細を示すフローチャートである。
ステップST21において、送受制御部13は、通信部11および送信制御部14を通じて表示制御部16を制御し、表示部17に位置特定用の画像を表示させる。位置特定用の画像中には、画像処理により抽出可能な特徴点が一つまたは複数含まれている。送受制御部13は、特徴点とその送信位置のリストを持つ。位置特定用の画像は、例えば、チェッカーフラッグ状の画像である。 FIG. 8 is a flowchart showing details of step ST20 in FIG.
In step ST21, the transmission /reception control unit 13 controls the display control unit 16 through the communication unit 11 and the transmission control unit 14, and causes the display unit 17 to display an image for specifying the position. One or more feature points that can be extracted by image processing are included in the position specifying image. The transmission / reception control unit 13 has a list of feature points and their transmission positions. The position specifying image is, for example, a checkered flag image.
ステップST21において、送受制御部13は、通信部11および送信制御部14を通じて表示制御部16を制御し、表示部17に位置特定用の画像を表示させる。位置特定用の画像中には、画像処理により抽出可能な特徴点が一つまたは複数含まれている。送受制御部13は、特徴点とその送信位置のリストを持つ。位置特定用の画像は、例えば、チェッカーフラッグ状の画像である。 FIG. 8 is a flowchart showing details of step ST20 in FIG.
In step ST21, the transmission /
ステップST22において、表示部17の表示画面を撮像部24が撮像して画像データにし、画像解析部25がその画像データを画像処理し、特徴点の受信位置を抽出する。画像解析部25は、特徴点とその受信位置を特徴情報として、受信制御部22および通信部21,11を通じて送受制御部13に与える。
In step ST22, the display screen of the display unit 17 is imaged by the imaging unit 24 and converted into image data, and the image analysis unit 25 performs image processing on the image data to extract the reception position of the feature point. The image analysis unit 25 gives the feature point and its reception position as feature information to the transmission / reception control unit 13 through the reception control unit 22 and the communication units 21 and 11.
ステップST23において、送受制御部13は、特徴点とその送信位置のリストを、特徴情報である特徴点とその受信位置と比較して特徴点の対応付けを行い、全ての特徴点に関して送信位置と受信位置の離散的な位置関係を得る。そして、送受制御部13は、得られた離散的な送受位置関係を用いて、表示画面全体における送受位置関係を表す変換式のパラメータを推定する。送受制御部13は、例えば、送信位置と受信位置とが射影変換の関係にあると仮定して、最小自乗法により射影行列を推定する。
また、送受制御部13は、レンズの歪みが問題になる場合には、Tsaiの方法におけるカメラパラメータなど、レンズ歪係数を含む位置関係の変換式を使用してもよい。 In step ST23, the transmission /reception control unit 13 compares the feature points and their transmission positions with the feature points that are feature information and the reception positions, and associates the feature points with each other. A discrete positional relationship of reception positions is obtained. And the transmission / reception control part 13 estimates the parameter of the conversion type showing the transmission / reception positional relationship in the whole display screen using the obtained discrete transmission / reception positional relationship. For example, assuming that the transmission position and the reception position are in a projective transformation relationship, the transmission / reception control unit 13 estimates the projection matrix by the method of least squares.
Further, when lens distortion becomes a problem, the transmission /reception control unit 13 may use a positional relationship conversion formula including a lens distortion coefficient, such as a camera parameter in the Tsai method.
また、送受制御部13は、レンズの歪みが問題になる場合には、Tsaiの方法におけるカメラパラメータなど、レンズ歪係数を含む位置関係の変換式を使用してもよい。 In step ST23, the transmission /
Further, when lens distortion becomes a problem, the transmission /
ステップST24において、送受制御部13は、受信位置が抽出できなかった特徴点があった場合(ステップST24“NO”)、ステップST25に進む。あるいは、送受制御部13は、送受位置関係を表す変換式のパラメータを推定するのに十分な特徴点サンプル数を抽出できなかった場合(ステップST24“NO”)、ステップST25に進む。それら以外の場合(ステップST24“YES”)、送受制御部13は、画像表示範囲調整を終了する。
In step ST24, when there is a feature point for which the reception position cannot be extracted (step ST24 “NO”), the transmission / reception control unit 13 proceeds to step ST25. Or the transmission / reception control part 13 progresses to step ST25, when the number of feature point samples sufficient to estimate the parameter of the conversion formula showing transmission / reception positional relationship cannot be extracted (step ST24 "NO"). In other cases (step ST24 “YES”), the transmission / reception control unit 13 ends the image display range adjustment.
ステップST25において、送受制御部13は、受信位置が抽出できなかった特徴点の送信位置を表示画面のより内側に移動させたり、位置特定用の画像を縮小したりする。あるいは、送受制御部13は、送受位置関係を表す変換式のパラメータを推定するのに十分な特徴点サンプル数を抽出できなかった場合、特徴点の送信位置を移動させる。
そして、送受制御部13は、再びステップST21に戻り、ステップST25で修正した位置特定用の画像を表示部17に表示させる。 In step ST25, the transmission /reception control unit 13 moves the transmission position of the feature point for which the reception position could not be extracted to the inside of the display screen, or reduces the position specifying image. Or the transmission / reception control part 13 moves the transmission position of a feature point, when the feature point sample number enough to estimate the parameter of the transformation formula showing transmission / reception position relationship cannot be extracted.
Then, the transmission /reception control unit 13 returns to step ST21 again and causes the display unit 17 to display the position specifying image corrected in step ST25.
そして、送受制御部13は、再びステップST21に戻り、ステップST25で修正した位置特定用の画像を表示部17に表示させる。 In step ST25, the transmission /
Then, the transmission /
ステップST21~ST25の処理により、送信位置と受信位置の関係が得られ、また、撮像範囲、つまり表示部17に表示して撮像部24で撮像される部分もわかる。送受制御部13は、撮像範囲を送信範囲とし、送信範囲外は今後の処理では使用しない。
これにより、表示装置10と撮像装置20の性能に応じた、最も大きい送信画像サイズを決定することができる。 Through the processing in steps ST21 to ST25, the relationship between the transmission position and the reception position is obtained, and the imaging range, that is, the part displayed on thedisplay unit 17 and imaged by the imaging unit 24 is also known. The transmission / reception control unit 13 sets the imaging range as the transmission range, and does not use it outside the transmission range in future processing.
Thereby, the largest transmission image size according to the performance of thedisplay device 10 and the imaging device 20 can be determined.
これにより、表示装置10と撮像装置20の性能に応じた、最も大きい送信画像サイズを決定することができる。 Through the processing in steps ST21 to ST25, the relationship between the transmission position and the reception position is obtained, and the imaging range, that is, the part displayed on the
Thereby, the largest transmission image size according to the performance of the
図9は、図5のステップST30の詳細を示すフローチャートである。これは、レンズおよび撮像角度などによる明るさムラを補正するための処理である。
ステップST31において、送受制御部13は、図6のステップST12のように表示部17の輝度を順次変更させ、送信位置ごとの受信輝度を取得する。ただし、全ての送信画素ごとに本処理を行うのはコストがかかるため、ここでは、表示部17の表示画面全体を格子状に区切り、格子ごとに送受輝度関係を得ることとする。以下では、複数の画素からなる格子を、ブロックと呼ぶ。 FIG. 9 is a flowchart showing details of step ST30 in FIG. This is a process for correcting brightness unevenness due to a lens and an imaging angle.
In step ST31, the transmission /reception control unit 13 sequentially changes the luminance of the display unit 17 as in step ST12 of FIG. 6, and acquires the reception luminance for each transmission position. However, since it is costly to perform this process for every transmission pixel, here, the entire display screen of the display unit 17 is divided into a lattice shape, and a transmission / reception luminance relationship is obtained for each lattice. Hereinafter, a grid composed of a plurality of pixels is referred to as a block.
ステップST31において、送受制御部13は、図6のステップST12のように表示部17の輝度を順次変更させ、送信位置ごとの受信輝度を取得する。ただし、全ての送信画素ごとに本処理を行うのはコストがかかるため、ここでは、表示部17の表示画面全体を格子状に区切り、格子ごとに送受輝度関係を得ることとする。以下では、複数の画素からなる格子を、ブロックと呼ぶ。 FIG. 9 is a flowchart showing details of step ST30 in FIG. This is a process for correcting brightness unevenness due to a lens and an imaging angle.
In step ST31, the transmission /
ステップST32において、送受制御部13は、ブロックごとに得られた送信輝度と受信輝度との関係を、受信輝度を基準に分割し、それぞれに対して代表の送信輝度を割り当てる。図10は、送信輝度と受信輝度の対応表を示す図である。図10の例では、受信輝度の最低値10から最高値70までの範囲が10ずつ等分割されている。そして、分割した受信輝度範囲ごとに送信輝度の範囲を求め、各中心を代表送信輝度13,33,46,56,65,78とする。
In step ST32, the transmission / reception control unit 13 divides the relationship between the transmission luminance and the reception luminance obtained for each block with reference to the reception luminance, and assigns a representative transmission luminance to each. FIG. 10 is a diagram showing a correspondence table between transmission luminance and reception luminance. In the example of FIG. 10, the range from the lowest received luminance value 10 to the highest value 70 is equally divided by ten. Then, a transmission luminance range is obtained for each divided reception luminance range, and the respective centers are set as representative transmission luminances 13, 33, 46, 56, 65, 78.
図11は、図5のステップST40の詳細を示すフローチャートである。
ステップST41において、送受制御部13は、通信部11および送信制御部14を通じて表示制御部16を制御し、表示部17に解像度調整用の画像を表示させる。解像度調整用の画像は、送信側のブロックごとに代表送信輝度を表示するためのものである。 FIG. 11 is a flowchart showing details of step ST40 in FIG.
In step ST41, the transmission /reception control unit 13 controls the display control unit 16 through the communication unit 11 and the transmission control unit 14, and causes the display unit 17 to display an image for resolution adjustment. The resolution adjustment image is for displaying the representative transmission luminance for each block on the transmission side.
ステップST41において、送受制御部13は、通信部11および送信制御部14を通じて表示制御部16を制御し、表示部17に解像度調整用の画像を表示させる。解像度調整用の画像は、送信側のブロックごとに代表送信輝度を表示するためのものである。 FIG. 11 is a flowchart showing details of step ST40 in FIG.
In step ST41, the transmission /
ステップST42において、表示部17の表示画面を撮像部24が撮像して画像データにし、画像解析部25がその画像データを画像処理し、受信輝度を特徴情報として送受制御部13に送信する。送受制御部13は、特徴情報に基づいて、解像度調整用の画像におけるブロックごとの代表送信輝度に対応する受信輝度を抽出する。
In step ST42, the image capturing unit 24 captures the display screen of the display unit 17 into image data, and the image analysis unit 25 performs image processing on the image data, and transmits the received luminance to the transmission / reception control unit 13 as feature information. The transmission / reception control unit 13 extracts reception luminance corresponding to the representative transmission luminance for each block in the resolution adjustment image based on the feature information.
ステップST43において、送受制御部13は、ブロックごとに、代表送信輝度と対応する受信輝度とが一致するか否かを判定する。ただし、連続する複数のブロック間で代表送信輝度が異なると、受信輝度はそれらのブロックの代表送信輝度が混色し、代表送信輝度と対応する受信輝度とが完全一致しない。そこで、送受制御部13は、代表送信輝度と受信輝度とのずれがあらかじめ設定された許容範囲内である場合に一致と判定してもよい。
In step ST43, the transmission / reception control unit 13 determines, for each block, whether or not the representative transmission luminance matches the corresponding reception luminance. However, if the representative transmission luminance differs between a plurality of consecutive blocks, the reception luminance is mixed with the representative transmission luminance of those blocks, and the representative transmission luminance and the corresponding reception luminance do not completely match. Therefore, the transmission / reception control unit 13 may determine that they match when the difference between the representative transmission luminance and the reception luminance is within a preset allowable range.
ステップST44において、送受制御部13は、代表送信輝度と受信輝度とが一致したブロックの、解像度調整用の画像の全ブロックに占める割合が、所定の割合(例えば、90%以上)である場合(ステップST44“YES”)、画像解像度調整を終了する。それ以外の場合(ステップST44“NO”)、送受制御部13は、ステップST45に進む。例えば、画像が10ブロックに分割されている場合、代表送信輝度と受信輝度とが一致するブロックが9以上あれば、画像解像度調整は終了する。なお、後述する受信状態において伝送情報を誤り訂正するため、ここではブロック一致の割合を100%にしなくてもよい。
In step ST44, the transmission / reception control unit 13 has a predetermined ratio (for example, 90% or more) of the block in which the representative transmission luminance and the reception luminance match with respect to all the blocks of the resolution adjustment image (for example, 90% or more). In step ST44 “YES”), the image resolution adjustment is terminated. In other cases (step ST44 “NO”), the transmission / reception control unit 13 proceeds to step ST45. For example, if the image is divided into 10 blocks, the image resolution adjustment ends if there are 9 or more blocks whose representative transmission brightness and reception brightness match. Note that, in order to correct transmission information in a receiving state, which will be described later, the block matching ratio need not be 100%.
ステップST45において、送受制御部13は、解像度調整用の画像の解像度を下げる、つまり一つのブロックに含まれる画素数を増やすことによって解像度調整用の画像に含まれるブロック数を減らす。
そして、送受制御部13は、再びステップST41に戻り、ステップST45で修正した解像度調整用の画像を表示部17に表示させる。
これにより、表示装置10と撮像装置20の性能に応じた、最も高い解像度を決定することができる。 In step ST45, the transmission /reception control unit 13 reduces the number of blocks included in the resolution adjustment image by lowering the resolution of the resolution adjustment image, that is, by increasing the number of pixels included in one block.
Then, the transmission /reception control unit 13 returns to step ST41 again and causes the display unit 17 to display the resolution adjustment image corrected in step ST45.
Thereby, the highest resolution according to the performance of thedisplay device 10 and the imaging device 20 can be determined.
そして、送受制御部13は、再びステップST41に戻り、ステップST45で修正した解像度調整用の画像を表示部17に表示させる。
これにより、表示装置10と撮像装置20の性能に応じた、最も高い解像度を決定することができる。 In step ST45, the transmission /
Then, the transmission /
Thereby, the highest resolution according to the performance of the
図12は、図5のステップST50の詳細を示すフローチャートである。
ステップST51において、送受制御部13は、通信部11および送信制御部14を通じて表示制御部16を制御し、表示部17に応答速度調整用の画像を表示させ、受信輝度を取得する。 FIG. 12 is a flowchart showing details of step ST50 in FIG.
In step ST51, the transmission /reception control unit 13 controls the display control unit 16 through the communication unit 11 and the transmission control unit 14, displays an image for adjusting the response speed on the display unit 17, and acquires the reception luminance.
ステップST51において、送受制御部13は、通信部11および送信制御部14を通じて表示制御部16を制御し、表示部17に応答速度調整用の画像を表示させ、受信輝度を取得する。 FIG. 12 is a flowchart showing details of step ST50 in FIG.
In step ST51, the transmission /
ステップST52において、送受制御部13は、通信部11および送信制御部14を通じて表示制御部16を制御し、ステップST51とは別の応答速度調整用の画像を表示部17に表示させ、受信輝度を取得する。
In step ST52, the transmission / reception control unit 13 controls the display control unit 16 through the communication unit 11 and the transmission control unit 14, displays a response speed adjustment image different from that in step ST51 on the display unit 17, and sets the reception luminance. get.
応答速度調整用の画像は、所定の代表送信輝度の画像である。送受制御部13は、例えば、ステップST51では白一色の画像を表示させ、ステップST52では黒一色の画像を表示させる。
The response speed adjustment image is an image having a predetermined representative transmission luminance. For example, in step ST51, the transmission / reception control unit 13 displays a white color image, and in step ST52, displays a black color image.
ステップST53において、送受制御部13は、ステップST51における応答速度調整用の画像の代表送信輝度に対応する受信輝度から、ステップST52における応答速度調整用の画像の代表送信輝度に対応する受信輝度になるまでの時間を計測して応答速度とし、計測した時間間隔を送信周期とする。
これにより、表示装置10と撮像装置20の性能に応じた、最も短い送信周期を決定することができる。 In step ST53, the transmission /reception controller 13 changes the reception luminance corresponding to the representative transmission luminance of the response speed adjustment image in step ST52 from the reception luminance corresponding to the representative transmission luminance of the response speed adjustment image in step ST51. Is measured as a response speed, and the measured time interval is defined as a transmission cycle.
Thereby, the shortest transmission cycle according to the performance of thedisplay device 10 and the imaging device 20 can be determined.
これにより、表示装置10と撮像装置20の性能に応じた、最も短い送信周期を決定することができる。 In step ST53, the transmission /
Thereby, the shortest transmission cycle according to the performance of the
送受制御部13は、これらの処理により、送受準備状態において、送受位置対応関係と送信範囲、送受輝度対応関係と代表送信輝度、送信解像度、および送信周期からなる諸元を得る。その後、送受制御部13は、通信部11,21を通じて、送信制御部14を送信状態にするとともに受信制御部22を受信状態にし、確定した諸元に従って伝送情報の送受を行わせる。また、送受制御部13は、送信周期に従って、通信部11および送信制御部14を通じて表示制御部16に対し、表示部17に表示させる画像を次の画像に切り替える指示を与える。この指示は、設定情報である。さらに、送受制御部13は、送信周期に従って、通信部11,21を通じて受信制御部22に対し、撮像部24に撮像させるタイミングの指示を与える。この指示も、設定情報である。
Through these processes, the transmission / reception control unit 13 obtains specifications including the transmission / reception position correspondence and the transmission range, the transmission / reception luminance correspondence and the representative transmission luminance, the transmission resolution, and the transmission cycle in the transmission / reception ready state. After that, the transmission / reception control unit 13 sets the transmission control unit 14 to the transmission state and the reception control unit 22 to the reception state through the communication units 11 and 21, and transmits and receives transmission information according to the determined specifications. Further, the transmission / reception control unit 13 gives an instruction to switch the image to be displayed on the display unit 17 to the next image to the display control unit 16 through the communication unit 11 and the transmission control unit 14 according to the transmission cycle. This instruction is setting information. Further, the transmission / reception control unit 13 instructs the reception control unit 22 through the communication units 11 and 21 according to the transmission cycle to the timing for causing the imaging unit 24 to capture an image. This instruction is also setting information.
ステップST2の送信状態にあるとき、送信制御部14は、送信範囲と送信解像度とから、送信に使用するデータ数Nを得る。データ数Nは、ブロック数に相当する。また、送信制御部14は、送信輝度を代表送信輝度に分割したときの分割数Mとし、分割した代表送信輝度ごとに符号値を割り当てる。例えば、図10の例では、受信輝度0~10の範囲に対応する代表送信輝度13に対して一つの符号値が割り当てられる。なお、送信制御部14は、代表送信輝度とその符号値のリストをあらかじめ持つ。このリストは、設定情報として、通信部11,21および受信制御部22を通じて画像解析部25に送信される。
When in the transmission state of step ST2, the transmission control unit 14 obtains the number N of data used for transmission from the transmission range and the transmission resolution. The number of data N corresponds to the number of blocks. Also, the transmission control unit 14 assigns a code value for each divided representative transmission luminance, with the division number M when the transmission luminance is divided into the representative transmission luminance. For example, in the example of FIG. 10, one code value is assigned to the representative transmission luminance 13 corresponding to the range of the reception luminances 0 to 10. The transmission control unit 14 has a list of representative transmission luminances and their code values in advance. This list is transmitted as setting information to the image analysis unit 25 through the communication units 11 and 21 and the reception control unit 22.
このとき、一枚の送信画像には、M進数N桁の符号値を含めることができる。これは、二進数で表すと、log2MNビットである。ただし、実施の形態1では、このビット列中に、伝送情報だけでなく、現在が何枚目の画像であるかを表すシーケンス番号などの制御情報と、伝送情報および制御情報の誤り訂正符号とを含めることとする。そのため、一枚の送信画像に含められる伝送情報の容量は、log2MNビットより小さくなる。
At this time, an M-digit N-digit code value can be included in one transmission image. This is expressed in binary, a log 2 M N bits. However, in the first embodiment, not only the transmission information but also control information such as a sequence number indicating the current image number, and transmission information and an error correction code of the control information are included in this bit string. Include. Therefore, the capacity of transmission information included in one transmission image is smaller than log 2 MN bits.
送信制御部14は、送信情報蓄積部15から伝送情報を取得し、取得した伝送情報をlog2MNビットより小さい容量に分割し、一つ以上の分割伝送情報にする。そして、送信制御部14は、各分割伝送情報に対して制御情報と誤り訂正符号とを付加する。図13は、この発明の実施の形態1において一枚の送信画像に変換される伝送情報の例を示す図である。一枚の送信画像に変換される伝送情報70には、制御情報71、一つの分割伝送情報72、および誤り訂正符号73が含まれる。この伝送情報70の容量は、log2MNビットである。
The transmission control unit 14 acquires transmission information from the transmission information storage unit 15, divides the acquired transmission information into a capacity smaller than log 2 MN bits, and makes one or more pieces of divided transmission information. Then, the transmission control unit 14 adds control information and an error correction code to each divided transmission information. FIG. 13 is a diagram showing an example of transmission information converted into one transmission image in the first embodiment of the present invention. The transmission information 70 converted into one transmission image includes control information 71, one piece of transmission information 72, and an error correction code 73. The capacity of this transmission information 70 is log 2 MN bits.
送信制御部14は、伝送情報70をM進数N桁の符号値に変換し、一桁ごとに符号値に対応する代表送信輝度を決定し、一枚の送信画像を生成する。図14は、この発明の実施の形態1における送信画像80の例を示す図である。一枚の送信画像80がN個のブロック81に分割され、一つのブロック81にはM階調のうちの一つの階調の輝度が割り当てられている。
送信制御部14は、通信部11を通じた送受制御部13からの指示タイミングに従い、生成した送信画像を順次表示制御部16に与える。表示制御部16は、送信制御部14からの送信画像を順次表示部17に表示させる。 Thetransmission control unit 14 converts the transmission information 70 into an M-ary N-digit code value, determines a representative transmission luminance corresponding to the code value for each digit, and generates one transmission image. FIG. 14 is a diagram showing an example of a transmission image 80 according to Embodiment 1 of the present invention. One transmission image 80 is divided into N blocks 81, and one block 81 is assigned a luminance of one of the M gradations.
Thetransmission control unit 14 sequentially provides the generated transmission images to the display control unit 16 according to the instruction timing from the transmission / reception control unit 13 through the communication unit 11. The display control unit 16 causes the display unit 17 to sequentially display the transmission images from the transmission control unit 14.
送信制御部14は、通信部11を通じた送受制御部13からの指示タイミングに従い、生成した送信画像を順次表示制御部16に与える。表示制御部16は、送信制御部14からの送信画像を順次表示部17に表示させる。 The
The
ステップST3の受信状態にあるとき、撮像部24は、通信部11,21および受信制御部22を通じた送受制御部13からの指示タイミングに従い、表示部17に表示された送信画像を撮像し、画像データに変換し、画像解析部25に与える。画像解析部25は、送信画像の各ブロックに対応する各受信位置から受信輝度を抽出し、受信輝度に対応する代表送信輝度に割り当てられた符号値を得る。なお、画像解析部25は、代表送信輝度とその符号値のリストを用いて、代表送信輝度に割り当てられた符号値を得ればよい。図10の例において、画像解析部25が抽出した受信輝度が35だった場合、受信輝度35を含む受信輝度30~40に対応する代表送信輝度46に割り当てられた符号値が取得される。
When in the reception state of step ST3, the imaging unit 24 captures the transmission image displayed on the display unit 17 in accordance with the instruction timing from the transmission / reception control unit 13 through the communication units 11 and 21 and the reception control unit 22. The data is converted into data and given to the image analysis unit 25. The image analysis unit 25 extracts the reception luminance from each reception position corresponding to each block of the transmission image, and obtains a code value assigned to the representative transmission luminance corresponding to the reception luminance. Note that the image analysis unit 25 may obtain the code value assigned to the representative transmission luminance using the list of the representative transmission luminance and its code value. In the example of FIG. 10, when the reception luminance extracted by the image analysis unit 25 is 35, the code value assigned to the representative transmission luminance 46 corresponding to the reception luminances 30 to 40 including the reception luminance 35 is acquired.
画像解析部25は、一枚の送信画像から得た符号値N桁を二進数に変換し、誤り訂正を行って、制御情報と分割伝送情報とを復元する。この際、画像解析部25は、誤り訂正符号を用いた誤り検出および誤り訂正も行う。
The image analysis unit 25 converts the code value N digits obtained from one transmission image into a binary number, performs error correction, and restores the control information and the divided transmission information. At this time, the image analysis unit 25 also performs error detection and error correction using an error correction code.
受信制御部22は、画像解析部25により誤りが検出されなかった場合、または誤りが検出され訂正された場合、受信情報蓄積部23における制御情報に対応する蓄積先に、復元した分割伝送情報を書き込む。一方、画像解析部25により誤りが検出されたが訂正できなかった場合、つまり誤り訂正符号の情報量が足りず訂正能力が低い場合、受信制御部22は、通信部21,11を通じて送信制御部14に対し、送信画像の再送を要求する。
When no error is detected by the image analysis unit 25 or when an error is detected and corrected, the reception control unit 22 stores the restored divided transmission information in the storage destination corresponding to the control information in the reception information storage unit 23. Write. On the other hand, when an error is detected by the image analysis unit 25 but cannot be corrected, that is, when the information amount of the error correction code is insufficient and the correction capability is low, the reception control unit 22 transmits the transmission control unit through the communication units 21 and 11. 14 is requested to retransmit the transmission image.
なお、図2の構成例では、入力部12は表示装置10に存在するが、通信路30で接続された撮像装置20内または車載装置40内に存在してもよい。また、車載カメラシステム全体を制御する送受制御部13は表示装置10に存在するが、通信路30で接続された撮像装置20内または車載装置40内に存在してもよい。即ち、入力部12および送受制御部13は、通信路30を経由して表示装置10および撮像装置20との通信が可能であればよい。
In the configuration example of FIG. 2, the input unit 12 exists in the display device 10, but may exist in the imaging device 20 or the in-vehicle device 40 connected via the communication path 30. In addition, the transmission / reception control unit 13 that controls the entire in-vehicle camera system exists in the display device 10, but may exist in the imaging device 20 or the in-vehicle device 40 connected through the communication path 30. In other words, the input unit 12 and the transmission / reception control unit 13 only need to be able to communicate with the display device 10 and the imaging device 20 via the communication path 30.
以上のように、実施の形態1に係る情報伝送方法は、撮像装置20および表示装置10が、撮像装置20と表示装置10とを接続する通信路30を経由して設定情報を送受するステップと、表示装置10が、設定情報に基づいて、設定情報の容量より大きい容量の伝送情報を一枚以上の画像に変換して表示するステップと、撮像装置20が、設定情報に基づいて、表示装置10により表示された一枚以上の画像を撮像して伝送情報に復元するステップとを備えるものである。通信路30を経由した設定情報の送受によって撮像装置20および表示装置10の調整をすることで、最も大きい送信画像サイズ、最も高い解像度、および最も短い送信周期等による画像の送受が可能となる。したがって、一枚の画像に含めるデータ容量を大きくすることができ、伝送速度を大きくすることができる。
As described above, in the information transmission method according to the first embodiment, the imaging device 20 and the display device 10 transmit and receive setting information via the communication path 30 that connects the imaging device 20 and the display device 10. The display device 10 converts transmission information having a capacity larger than the capacity of the setting information into one or more images based on the setting information and displays the information, and the imaging device 20 displays the display device based on the setting information. And capturing one or more images displayed by 10 and restoring them to transmission information. By adjusting the imaging device 20 and the display device 10 by sending and receiving setting information via the communication path 30, it is possible to send and receive images with the largest transmission image size, the highest resolution, and the shortest transmission cycle. Therefore, the data capacity included in one image can be increased, and the transmission speed can be increased.
また、実施の形態1によれば、撮像装置20または表示装置10の一方は、送受制御部13を有する。そして、通信路30を経由して設定情報を送受するステップST1において、送受制御部13は、撮像された位置特定用の画像などに基づいて設定情報を調整して撮像装置20または表示装置10へ送信する。より具体的には、送受制御部13が、表示装置10へ設定情報を送信し、表示装置10が、送受制御部13により送信された設定情報に基づいた画像を表示し、撮像装置20が、表示装置10により表示された画像を撮像して特徴情報を生成して送受制御部13へ送信し、送受制御部13が、撮像装置20により送信された画像の特徴情報に基づいて、調整が不十分と判断した場合に設定情報を調整して撮像装置20または表示装置10へ送信する。このように、撮像装置20および表示装置10が通信路30を通じてネゴシエーションを行うため、撮像装置20および表示装置10の設定を自動化できる。そのため、画像処理プログラム更新時の表示装置10の設置等が容易である。
Further, according to the first embodiment, one of the imaging device 20 or the display device 10 includes the transmission / reception control unit 13. And in step ST1 which transmits / receives setting information via the communication path 30, the transmission / reception control part 13 adjusts setting information based on the image for position specification etc. which were imaged, etc., to the imaging device 20 or the display apparatus 10. Send. More specifically, the transmission / reception control unit 13 transmits setting information to the display device 10, the display device 10 displays an image based on the setting information transmitted by the transmission / reception control unit 13, and the imaging device 20 An image displayed by the display device 10 is captured to generate feature information and transmitted to the transmission / reception control unit 13, and the transmission / reception control unit 13 has no adjustment based on the feature information of the image transmitted by the imaging device 20. When it is determined that the setting is sufficient, the setting information is adjusted and transmitted to the imaging device 20 or the display device 10. As described above, since the imaging device 20 and the display device 10 negotiate through the communication path 30, the settings of the imaging device 20 and the display device 10 can be automated. Therefore, it is easy to install the display device 10 when updating the image processing program.
また、実施の形態1によれば、設定情報は、ステップST2において、表示装置10に対して、次の画像に表示を切り替えるよう指示するものである。これにより、表示装置10および撮像装置20の位置を変えずに、複数の画像を伝送することができ、伝送の時間間隔を短くできる。
一方、例えば特許文献1に係る発明では、二次元コードが印刷された紙、または二次元コードを読み込む携帯端末の位置を移動する必要があるため、伝送の時間間隔が長い。 Further, according to the first embodiment, the setting information instructs thedisplay device 10 to switch the display to the next image in step ST2. Accordingly, a plurality of images can be transmitted without changing the positions of the display device 10 and the imaging device 20, and the transmission time interval can be shortened.
On the other hand, for example, in the invention according to Patent Document 1, since it is necessary to move the position of the paper on which the two-dimensional code is printed or the portable terminal that reads the two-dimensional code, the transmission time interval is long.
一方、例えば特許文献1に係る発明では、二次元コードが印刷された紙、または二次元コードを読み込む携帯端末の位置を移動する必要があるため、伝送の時間間隔が長い。 Further, according to the first embodiment, the setting information instructs the
On the other hand, for example, in the invention according to Patent Document 1, since it is necessary to move the position of the paper on which the two-dimensional code is printed or the portable terminal that reads the two-dimensional code, the transmission time interval is long.
また、実施の形態1によれば、設定情報は、ステップST1において、表示装置10に対して、画像を表示する範囲、明るさ、解像度、階調、または画像の表示を切り替える周期のうちの少なくとも一つを指示するものである。これにより、通信路30を通じてネゴシエーションを自動的に行うことができ、画像処理プログラム更新時の表示装置10の設置等が容易である。
Further, according to the first embodiment, the setting information is at least one of the range for displaying the image, the brightness, the resolution, the gradation, or the cycle for switching the image display on the display device 10 in step ST1. One is instructed. Thereby, the negotiation can be automatically performed through the communication path 30, and the installation of the display device 10 when the image processing program is updated is easy.
また、実施の形態1に係る車載カメラシステムは、表示装置10と、車両に搭載されている撮像装置20とを備える。表示装置10は、撮像装置20と表示装置10とを接続する通信路30を経由して送受される設定情報に基づいて、設定情報の容量より大きい容量の伝送情報を一枚以上の画像に変換して表示する。撮像装置20は、通信路30を経由して送受される設定情報に基づいて、表示装置10により表示された一枚以上の画像を撮像して伝送情報に復元する。この構成により、通信路30を経由した設定情報の送受によって一枚の画像に含めるデータ容量を大きくすることができ、伝送速度を大きくすることができる。
Further, the in-vehicle camera system according to Embodiment 1 includes a display device 10 and an imaging device 20 mounted on the vehicle. The display device 10 converts transmission information having a capacity larger than the capacity of the setting information into one or more images based on the setting information transmitted / received via the communication path 30 connecting the imaging device 20 and the display device 10. And display. The imaging device 20 captures one or more images displayed by the display device 10 based on the setting information transmitted / received via the communication path 30, and restores the transmission information. With this configuration, it is possible to increase the data capacity included in one image by transmitting / receiving setting information via the communication path 30 and increase the transmission speed.
また、実施の形態1に係る車載カメラシステムは、撮像装置20と表示装置10との間に、撮像装置20と表示装置10との距離を短縮する光学装置60を備える構成であってもよい。この構成によれば、車載カメラシステムを小型にすることができる。
Further, the in-vehicle camera system according to Embodiment 1 may be configured to include the optical device 60 that shortens the distance between the imaging device 20 and the display device 10 between the imaging device 20 and the display device 10. According to this structure, a vehicle-mounted camera system can be reduced in size.
なお、本発明はその発明の範囲内において、実施の形態の任意の構成要素の変形、または実施の形態の任意の構成要素の省略が可能である。
In the present invention, any component of the embodiment can be modified or any component of the embodiment can be omitted within the scope of the invention.
この発明に係る情報伝送方法は、低速な通信路で接続された表示装置から撮像装置へ、画像を用いて大量の情報を伝送するようにしたので、車載カメラシステムにおける撮像装置のプログラム更新などに用いるのに適している。
In the information transmission method according to the present invention, a large amount of information is transmitted using an image from a display device connected via a low-speed communication path to the imaging device. Suitable for use.
10 表示装置、11 通信部、12 入力部、13 送受制御部、14 送信制御部、15 送信情報蓄積部、16 表示制御部、17 表示部、20 撮像装置、21 通信部、22 受信制御部、23 受信情報蓄積部、24 撮像部、25 画像解析部、30 通信路、40 車載装置、50 固定具、60 光学装置、70 伝送情報、71 制御情報、72 分割伝送情報、73 誤り訂正符号、80 送信画像、81 ブロック、101 ディスプレイ、102,202 通信装置、103,203 プロセッサ、104,204 メモリ、105 入力装置、201 カメラ。
10 display device, 11 communication unit, 12 input unit, 13 transmission / reception control unit, 14 transmission control unit, 15 transmission information storage unit, 16 display control unit, 17 display unit, 20 imaging device, 21 communication unit, 22 reception control unit, 23 reception information storage unit, 24 imaging unit, 25 image analysis unit, 30 communication path, 40 in-vehicle device, 50 fixture, 60 optical device, 70 transmission information, 71 control information, 72 divided transmission information, 73 error correction code, 80 Transmission image, 81 block, 101 display, 102, 202 communication device, 103, 203 processor, 104, 204 memory, 105 input device, 201 camera.
Claims (7)
- 撮像装置および表示装置が、前記撮像装置と前記表示装置とを接続する通信路を経由して設定情報を送受するステップと、
前記表示装置が、前記設定情報に基づいて、前記設定情報の容量より大きい容量の伝送情報を一枚以上の画像に変換して表示するステップと、
前記撮像装置が、前記設定情報に基づいて、前記表示装置により表示された前記一枚以上の画像を撮像して前記伝送情報に復元するステップとを備える情報伝送方法。 An imaging device and a display device transmitting and receiving setting information via a communication path connecting the imaging device and the display device;
The display device, based on the setting information, converting transmission information having a capacity larger than the capacity of the setting information into one or more images and displaying the information;
An information transmission method comprising: the imaging device capturing the one or more images displayed by the display device based on the setting information and restoring the images to the transmission information. - 前記撮像装置または前記表示装置の一方は、送受制御部を有し、
前記通信路を経由して前記設定情報を送受する場合に、前記送受制御部が、撮像された画像に基づいて前記設定情報を調整して前記撮像装置または前記表示装置へ送信することを特徴とする請求項1記載の情報伝送方法。 One of the imaging device or the display device has a transmission / reception control unit,
When transmitting / receiving the setting information via the communication path, the transmission / reception control unit adjusts the setting information based on a captured image and transmits the adjusted setting information to the imaging device or the display device. The information transmission method according to claim 1. - 前記通信路を経由して前記設定情報を送受する場合に、
前記送受制御部が、前記表示装置へ前記設定情報を送信し、
前記表示装置が、前記送受制御部により送信された前記設定情報に基づいた画像を表示し、
前記撮像装置が、前記表示装置により表示された前記画像を撮像して前記画像の特徴情報を生成して前記送受制御部へ送信し、
前記送受制御部が、前記撮像装置により送信された前記画像の特徴情報に基づいて、調整が不十分と判断した場合に前記設定情報を調整して前記撮像装置または前記表示装置へ送信することを特徴とする請求項2記載の情報伝送方法。 When sending and receiving the setting information via the communication path,
The transmission / reception control unit transmits the setting information to the display device,
The display device displays an image based on the setting information transmitted by the transmission / reception control unit;
The imaging device captures the image displayed by the display device, generates feature information of the image, and transmits the feature information to the transmission / reception control unit,
When the transmission / reception control unit determines that the adjustment is insufficient based on the feature information of the image transmitted by the imaging device, the setting information is adjusted and transmitted to the imaging device or the display device. The information transmission method according to claim 2, wherein: - 前記設定情報は、前記表示装置に対して、次の画像に表示を切り替えるよう指示するものであることを特徴とする請求項1記載の情報伝送方法。 The information transmission method according to claim 1, wherein the setting information instructs the display device to switch the display to the next image.
- 前記設定情報は、前記表示装置に対して、画像を表示する範囲、明るさ、解像度、階調、または画像の表示を切り替える周期のうちの少なくとも一つを指示するものであることを特徴とする請求項1記載の情報伝送方法。 The setting information instructs the display device at least one of an image display range, brightness, resolution, gradation, or a cycle for switching image display. The information transmission method according to claim 1.
- 表示装置と、車両に搭載されている撮像装置とを備え、
前記表示装置は、前記撮像装置と前記表示装置とを接続する通信路を経由して送受される設定情報に基づいて、前記設定情報の容量より大きい容量の伝送情報を一枚以上の画像に変換して表示し、
前記撮像装置は、前記通信路を経由して送受される前記設定情報に基づいて、前記表示装置により表示された前記一枚以上の画像を撮像して前記伝送情報に復元することを特徴とする車載カメラシステム。 A display device and an imaging device mounted on the vehicle;
The display device converts transmission information having a capacity larger than the capacity of the setting information into one or more images based on setting information transmitted / received via a communication path connecting the imaging device and the display device. And display
The imaging device captures the one or more images displayed by the display device based on the setting information transmitted / received via the communication path and restores the transmission information to the transmission information. In-vehicle camera system. - 前記撮像装置と前記表示装置との間に、前記撮像装置と前記表示装置との距離を短縮する光学装置を備えることを特徴とする請求項6記載の車載カメラシステム。 The in-vehicle camera system according to claim 6, further comprising an optical device that shortens a distance between the imaging device and the display device between the imaging device and the display device.
Priority Applications (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
PCT/JP2016/085330 WO2018100614A1 (en) | 2016-11-29 | 2016-11-29 | Information transmission method and on-board camera system |
Applications Claiming Priority (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
PCT/JP2016/085330 WO2018100614A1 (en) | 2016-11-29 | 2016-11-29 | Information transmission method and on-board camera system |
Publications (1)
Publication Number | Publication Date |
---|---|
WO2018100614A1 true WO2018100614A1 (en) | 2018-06-07 |
Family
ID=62242387
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
PCT/JP2016/085330 WO2018100614A1 (en) | 2016-11-29 | 2016-11-29 | Information transmission method and on-board camera system |
Country Status (1)
Country | Link |
---|---|
WO (1) | WO2018100614A1 (en) |
Cited By (1)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
WO2023181206A1 (en) * | 2022-03-23 | 2023-09-28 | ファナック株式会社 | Robot programming system and robot control device |
Citations (5)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
JP2005309756A (en) * | 2004-04-21 | 2005-11-04 | Mitsubishi Electric Corp | Information transfer system, information conversion apparatus, information reproduction device and display device |
JP2007028575A (en) * | 2005-07-19 | 2007-02-01 | Vimicro Corp | Two-dimensional code image transmission system and two-dimensional code image transmission rate control method |
JP2007034625A (en) * | 2005-07-26 | 2007-02-08 | Aruze Corp | Information display device |
JP2009163632A (en) * | 2008-01-09 | 2009-07-23 | Aplix Corp | Data providing system, data providing apparatus, and content manufacturing method |
JP2014216734A (en) * | 2013-04-24 | 2014-11-17 | 日立マクセル株式会社 | Imaging apparatus and imaging system |
-
2016
- 2016-11-29 WO PCT/JP2016/085330 patent/WO2018100614A1/en active Application Filing
Patent Citations (5)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
JP2005309756A (en) * | 2004-04-21 | 2005-11-04 | Mitsubishi Electric Corp | Information transfer system, information conversion apparatus, information reproduction device and display device |
JP2007028575A (en) * | 2005-07-19 | 2007-02-01 | Vimicro Corp | Two-dimensional code image transmission system and two-dimensional code image transmission rate control method |
JP2007034625A (en) * | 2005-07-26 | 2007-02-08 | Aruze Corp | Information display device |
JP2009163632A (en) * | 2008-01-09 | 2009-07-23 | Aplix Corp | Data providing system, data providing apparatus, and content manufacturing method |
JP2014216734A (en) * | 2013-04-24 | 2014-11-17 | 日立マクセル株式会社 | Imaging apparatus and imaging system |
Cited By (1)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
WO2023181206A1 (en) * | 2022-03-23 | 2023-09-28 | ファナック株式会社 | Robot programming system and robot control device |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
US10554880B2 (en) | Image processing system, imaging apparatus, image processing method, and computer-readable storage medium | |
US8493467B2 (en) | Camera control apparatus, camera control method, and camera system | |
CN107786813B (en) | Multifunction camera imaging control system | |
JP5414910B2 (en) | Display unit, imaging unit, and display system apparatus | |
US20110050927A1 (en) | Information processing apparatus and control method therefor | |
CN101340566A (en) | Image processing system and method | |
CN111083458B (en) | Brightness correction method, system, equipment and computer readable storage medium | |
CN109905594B (en) | Method of providing image and electronic device for supporting the same | |
US8996577B2 (en) | Object information provision device, object information provision system, terminal, and object information provision method | |
US20030156073A1 (en) | Apparatus for adjusting proximate video monitors to output substantially identical video images and corresponding methods therefor | |
JP4793449B2 (en) | Network video composition display system | |
WO2018100614A1 (en) | Information transmission method and on-board camera system | |
JP2020194998A (en) | Control arrangement, projection system, control method, program and storage medium | |
CN105354813A (en) | Method and device for driving pan-tilt-zoom (PTZ) to generate spliced image | |
US8848237B2 (en) | Wireless scanning device and method for scanning and transmitting scan data | |
US20190073558A1 (en) | Information processing apparatus, information processing method, and computer program | |
JP6091133B2 (en) | Projection type display device, control method used therefor, and program | |
CN107147901A (en) | A kind of sensor calibration method, device, equipment and storage medium | |
US11064103B2 (en) | Video image transmission apparatus, information processing apparatus, system, information processing method, and recording medium | |
CN108174058B (en) | A kind of multifunction camera image formation control method | |
JP2008244950A (en) | Remote operation apparatus and video display system | |
WO2018066161A1 (en) | Display device, control device, and multi-display system | |
JP2020184724A (en) | Communication system, mobile terminal, on-vehicle device and communication program | |
CN115909427A (en) | Page display method and device, integrated circuit and equipment | |
JP2020088430A (en) | Image display system, server, display device, control method of server, and control method of display device |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
121 | Ep: the epo has been informed by wipo that ep was designated in this application |
Ref document number: 16922895 Country of ref document: EP Kind code of ref document: A1 |
|
NENP | Non-entry into the national phase |
Ref country code: DE |
|
NENP | Non-entry into the national phase |
Ref country code: JP |
|
122 | Ep: pct application non-entry in european phase |
Ref document number: 16922895 Country of ref document: EP Kind code of ref document: A1 |