WO2018100614A1 - Information transmission method and on-board camera system - Google Patents

Information transmission method and on-board camera system Download PDF

Info

Publication number
WO2018100614A1
WO2018100614A1 PCT/JP2016/085330 JP2016085330W WO2018100614A1 WO 2018100614 A1 WO2018100614 A1 WO 2018100614A1 JP 2016085330 W JP2016085330 W JP 2016085330W WO 2018100614 A1 WO2018100614 A1 WO 2018100614A1
Authority
WO
WIPO (PCT)
Prior art keywords
transmission
information
display device
control unit
image
Prior art date
Application number
PCT/JP2016/085330
Other languages
French (fr)
Japanese (ja)
Inventor
康明 瀧本
武史 三井
Original Assignee
三菱電機株式会社
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 三菱電機株式会社 filed Critical 三菱電機株式会社
Priority to PCT/JP2016/085330 priority Critical patent/WO2018100614A1/en
Publication of WO2018100614A1 publication Critical patent/WO2018100614A1/en

Links

Images

Classifications

    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N1/00—Scanning, transmission or reproduction of documents or the like, e.g. facsimile transmission; Details thereof
    • H04N1/387—Composing, repositioning or otherwise geometrically modifying originals

Definitions

  • the present invention relates to an information transmission method using an imaging device and an in-vehicle camera system.
  • Patent Document 1 describes that a mobile terminal sequentially reads a plurality of two-dimensional codes printed on paper, restores the read two-dimensional codes into program data, and updates the operating system of the mobile terminal. Yes.
  • Patent Document 1 Since the invention according to Patent Document 1 uses a two-dimensional code printed on paper, the data capacity included in the two-dimensional code cannot be increased according to the performance of the portable terminal, and the portable terminal can be surely provided with a margin. Only the amount of data that can be read could be included in the two-dimensional code. For this reason, there is a problem that the data capacity per two-dimensional code cannot be increased and the transmission speed cannot be increased.
  • This invention has been made to solve the above-described problems, and aims to increase the transmission speed.
  • the imaging device and the display device transmit and receive the setting information via a communication path connecting the imaging device and the display device, and the display device sets based on the setting information.
  • the data capacity included in one image can be increased by adjusting the imaging device and the display device by sending and receiving the setting information via the communication path, and the transmission speed can be increased.
  • FIG. 3A shows a display apparatus
  • FIG. 3B shows an imaging device.
  • FIG. 3A shows a display apparatus
  • FIG. 3B shows an imaging device.
  • FIG. 3A shows a display apparatus
  • FIG. 3B shows an imaging device.
  • FIG. 3A shows a display apparatus
  • FIG. 3B shows an imaging device.
  • FIG. 3A shows a display apparatus
  • FIG. 3B shows an imaging device.
  • FIG. 3A shows a display apparatus
  • FIG. 3B shows an imaging device.
  • FIG. 3A shows a display apparatus
  • FIG. 3B shows an imaging device.
  • FIGS. 7A to 7D are diagrams showing correspondence tables between transmission luminance and reception luminance. It is a flowchart which shows the detail of step ST20 of FIG. It is a flowchart which shows the detail of step ST30 of FIG. It is a figure which shows the correspondence table of transmission brightness
  • FIG. 1 is a diagram showing an outline of an in-vehicle camera system according to Embodiment 1 of the present invention.
  • the in-vehicle camera system according to Embodiment 1 includes a display device 10, an imaging device 20, a communication path 30, an in-vehicle device 40, a fixture 50, and an optical device 60.
  • the imaging device 20 includes an imaging unit such as a digital camera and is mounted on a vehicle.
  • the imaging device 20 is, for example, an image processing device with a camera for detecting a driver's line of sight or detecting a road lane.
  • the imaging device 20 and the in-vehicle device 40 are connected by a communication path 30 such as a CAN (Controller Area Network).
  • the imaging device 20 transmits the line-of-sight detection result or the lane detection result to the in-vehicle device 40 through the communication path 30.
  • the in-vehicle device 40 operates using the line-of-sight detection result or the lane detection result.
  • the in-vehicle camera system according to Embodiment 1 will be described using an example in which the image processing program of the imaging device 20 is updated to improve the gaze detection accuracy or the lane detection accuracy.
  • the display device 10 displays images such as a two-dimensional code one after another, and the imaging device 20 sequentially captures the displayed images, thereby transmitting a large amount of data at high speed.
  • the display device 10 includes a display unit such as a liquid crystal display.
  • the display device 10 is arranged so that the display unit faces the imaging unit of the imaging device 20, and is fixed to the imaging device 20 by a simple fixing tool 50 such as a hook or a suction cup. Is done.
  • An optical device 60 such as a lens may be installed between the display device 10 and the imaging device 20.
  • the installation method of the optical apparatus 60 is not ask
  • the optical device 60 may be fixed between the display device 10 and the imaging device 20 by a fixture (not shown), may be fixed by the fixture 50, or is fixed to the display device 10 in advance. May be.
  • the display device 10 is connected to the communication path 30, and the display device 10 and the imaging device 20 can communicate with each other via the communication path 30.
  • FIG. 2 is a block diagram showing a configuration example of the in-vehicle camera system according to Embodiment 1 of the present invention.
  • the display device 10 includes a communication unit 11, an input unit 12, a transmission / reception control unit 13, a transmission control unit 14, a transmission information storage unit 15, a display control unit 16, and a display unit 17.
  • the imaging device 20 includes a communication unit 21, a reception control unit 22, a reception information storage unit 23, an imaging unit 24, and an image analysis unit 25.
  • illustration is abbreviate
  • FIG. 3 is a hardware configuration diagram of the in-vehicle camera system according to the first embodiment of the present invention.
  • FIG. 3A shows the display device 10
  • FIG. 3B shows the imaging device 20.
  • the display unit 17 in the display device 10 is a display 101.
  • the communication unit 11 in the display device 10 is a communication device 102 that communicates using CAN or the like.
  • the input unit 12 in the display device 10 is an input device 105 such as a switch or a touch panel.
  • the transmission information storage unit 15 in the display device 10 is a memory 104.
  • Each function of the transmission / reception control unit 13, the transmission control unit 14, and the display control unit 16 in the display device 10 is a processor 103 that executes a program stored in the memory 104.
  • Each function of the transmission / reception control unit 13, the transmission control unit 14, and the display control unit 16 is realized by software.
  • the software is described as a program and stored in the memory 104.
  • the processor 103 reads out and executes the program stored in the memory 104, thereby realizing the functions of the respective units. That is, the display device 10 includes a memory 104 for storing a program that, when executed by the processor 103, results in the steps shown in the flowchart of FIG. It can also be said that this program causes a computer to execute the procedure or method of the transmission / reception control unit 13, the transmission control unit 14, and the display control unit 16.
  • the imaging unit 24 in the imaging device 20 is a camera 201.
  • the communication unit 21 in the imaging device 20 is a communication device 202 that communicates using CAN or the like.
  • the reception information storage unit 23 in the imaging device 20 is a memory 204.
  • the reception control unit 22 and the image analysis unit 25 in the imaging device 20 are a processor 203 that executes a program stored in the memory 204.
  • Each function of the reception control unit 22 and the image analysis unit 25 is realized by software.
  • the software is described as a program and stored in the memory 204.
  • the processor 203 reads out and executes the program stored in the memory 204, thereby realizing the functions of the respective units.
  • the imaging apparatus 20 includes a memory 204 for storing a program that, when executed by the processor 203, results in the steps shown in the flowchart of FIG. It can also be said that this program causes a computer to execute the procedures or methods of the reception control unit 22 and the image analysis unit 25.
  • a function for detecting the driver's line of sight or detecting a road lane is also realized by software.
  • the software is described as an image processing program and stored in the memory 204.
  • the processor 203 reads and executes an image processing program stored in the memory 204, thereby realizing a function for detecting the driver's line of sight or detecting a road lane.
  • the in-vehicle camera system according to Embodiment 1 updates this image processing program.
  • the processors 103 and 203 are a CPU (Central Processing Unit), a processing device, an arithmetic device, a microprocessor, a microcomputer, or the like.
  • the memories 104 and 204 may be a RAM (Random Access Memory), a ROM (Read Only Memory), an EPROM (Erasable Programmable ROM), or a nonvolatile or volatile semiconductor memory such as a flash memory, or a hard disk or the like. There may be.
  • FIG. 4 is a flowchart showing an information transmission method by the in-vehicle camera system according to Embodiment 1 of the present invention.
  • the input unit 12 instructs the transmission / reception control unit 13 to start processing.
  • the display device 10 and the imaging device 20 execute the processing shown in the flowchart of FIG.
  • step ST1 the display device 10 and the imaging device 20 transmit / receive setting information via the communication path 30 having a low transmission speed.
  • the input unit 12 receives a user operation instruction and instructs the transmission / reception control unit 13 to start processing.
  • the transmission / reception control unit 13 controls the transmission control unit 14 and the reception control unit 22 through the communication units 11 and 21 in order to transmit the information held by the transmission information storage unit 15 to the reception information storage unit 23 of the imaging device 20.
  • the transmission / reception control unit 13 Upon receiving an instruction to start processing from the input unit 12, the transmission / reception control unit 13 first sets the transmission control unit 14 and the reception control unit 22 in a transmission / reception preparation state, and performs negotiation for determining the specifications for image generation. Start.
  • the transmission / reception control unit 13 compares the image displayed on the display unit 17 by the transmission control unit 14 via the display control unit 16 with the feature information obtained from the reception control unit 22, and then the next image is displayed. The process of displaying and comparing is repeated, and specifications relating to image display and imaging are determined.
  • the specifications and feature information are setting information.
  • the transmission / reception control unit 13 When the transmission / reception control unit 13 is in a transmission / reception preparation state, the positional relationship between the display unit 17 and the imaging unit 24, the relationship between the brightness displayed by the display unit 17 and the brightness received by the imaging unit 24, and the imaging from the display unit 17.
  • An image for examining the maximum resolution that can be transmitted to the unit 24 is generated and provided to the display control unit 16.
  • the display control unit 16 gives the image received from the transmission control unit 14 to the display unit 17 for display.
  • the display unit 17 displays the image received from the display control unit 16.
  • the imaging unit 24 captures an image displayed on the display unit 17 in accordance with an instruction from the reception control unit 22, converts the image into image data, and supplies the image data to the image analysis unit 25.
  • the image analysis unit 25 extracts feature information in the image from the image data received from the imaging unit 24 and provides the feature information to the reception control unit 22.
  • the reception control unit 22 gives the feature information received from the image analysis unit 25 to the transmission / reception control unit 13 through the communication units 21 and 11.
  • the display device 10 converts transmission information having a capacity larger than the capacity of the setting information into an image based on the setting information and displays the image.
  • the transmission information is the above-described image processing program. If the capacity of transmission information is larger than the capacity per image determined as specifications, the transmission information is converted into a plurality of images.
  • the transmission control unit 14 acquires transmission information from the transmission information storage unit 15, converts it into an image according to specifications, and provides the image to the display control unit 16.
  • the display control unit 16 gives the image received from the transmission control unit 14 to the display unit 17 for display.
  • the display unit 17 displays the image received from the display control unit 16.
  • the imaging device 20 captures an image displayed by the display device 10 based on the setting information and restores it to transmission information.
  • the imaging unit 24 captures an image displayed on the display unit 17, converts the image into image data, and provides the image data to the image analysis unit 25.
  • the image analysis unit 25 restores the image data received from the imaging unit 24 to transmission information according to the specifications, and provides the transmission information to the reception control unit 22.
  • the reception control unit 22 gives the transmission information received from the image analysis unit 25 to the reception information storage unit 23 for storage.
  • the display device 10 and the imaging device 20 transmit a plurality of images by repeating step ST2 and step ST3 a plurality of times according to the specifications.
  • FIG. 5 is a flowchart showing details of step ST1 of FIG.
  • the transmission / reception preparation state in step ST1 includes brightness adjustment in step ST10, image display range adjustment in step ST20, image gradation adjustment in step ST30, image resolution adjustment in step ST40, and response speed adjustment in step ST50.
  • the instructions given to the display device 10 and the imaging device 20 by the transmission / reception control unit 13 via the communication path 30 in steps ST10 to ST50 are setting information.
  • the order in which steps ST10 to ST50 are executed is not limited to the order shown in FIG.
  • FIG. 6 is a flowchart showing details of step ST10 of FIG.
  • the transmission / reception control unit 13 controls the imaging unit 24 through the communication units 11 and 21 and the reception control unit 22, and sets a shutter speed, an aperture, an ND (Neutral Density) filter, and the like to predetermined values.
  • the predetermined value is assumed to be given to the transmission / reception control unit 13 in advance.
  • the transmission / reception control unit 13 displays a specific luminance on the entire display screen of the display unit 17 through the communication unit 11, the transmission control unit 14, and the display control unit 16, and sequentially changes the luminance.
  • the transmission / reception control unit 13 causes the imaging unit 24 to capture images for each luminance through the communication units 11 and 21 and the reception control unit 22, and the image analysis unit 25 has predetermined pixels (for example, a pixel at the center of the screen) in the image.
  • the received luminance is acquired and transmitted to the transmission / reception control unit 13 as feature information.
  • the transmission / reception control unit 13 creates a correspondence table between the transmission luminance displayed by the display unit 17 and the reception luminance captured by the imaging unit 24.
  • 7A to 7D are diagrams showing correspondence tables between transmission luminance and reception luminance.
  • the transmission / reception control unit 13 includes a predetermined number or more (for example, 10% or more) of transmission luminance samples within a predetermined range (for example, within 5%) from the lowest value of the reception luminance in the created correspondence table. If included, it is detected as lower saturation. In the case of the correspondence table as shown in FIG. 7A, since 10% or more of the transmission luminance samples are included within 5% from the lowest value of the reception luminance, it is detected as lower saturation. Similarly, the transmission / reception control unit 13 detects upper side saturation on the maximum value side of the reception luminance. In the case of the correspondence table as shown in FIG. 7B, since 10% or more of transmission luminance samples are included within 5% from the maximum value of the reception luminance, upper saturation is detected.
  • step ST14 the transmission / reception control unit 13 ends the brightness adjustment when the upper saturation and the lower saturation are not detected as shown in FIG. 7C, for example (step ST14 “YES”). Further, even if both the upper saturation and the lower saturation are detected, the transmission / reception control unit 13 has the same upper and lower saturations as shown in FIG. 7D (step ST14 “YES”). End brightness adjustment.
  • the transmission / reception control unit 13 detects upper saturation or lower saturation as shown in FIG. 7A or 7B, for example, or when the degree of saturation is different between the upper side and the lower side (step ST14 “NO”), the step Proceed to ST15.
  • step ST15 the transmission / reception control unit 13 decreases the sensitivity on the reception side when only the upper saturation is present or when the upper saturation is larger than the lower saturation.
  • the transmission / reception control unit 13 increases the sensitivity on the reception side when there is only lower saturation or when the lower saturation is larger than the upper saturation.
  • the sensitivity on the reception side can be adjusted by, for example, the ND filter of the imaging unit 24.
  • the transmission / reception control part 13 returns to step ST11 again, and controls the imaging part 24 based on the reception sensitivity corrected by step ST15.
  • the transmission / reception control unit 13 may lower the luminance standard on the transmission side when only the upper saturation is present or when the upper saturation is larger than the lower saturation. Further, the transmission / reception control unit 13 may increase the luminance standard on the transmission side when only the lower saturation is present or when the lower saturation is greater than the upper saturation.
  • the luminance reference on the transmission side can be adjusted by, for example, the backlight of the display unit 17 or the like.
  • FIG. 8 is a flowchart showing details of step ST20 in FIG.
  • the transmission / reception control unit 13 controls the display control unit 16 through the communication unit 11 and the transmission control unit 14, and causes the display unit 17 to display an image for specifying the position.
  • One or more feature points that can be extracted by image processing are included in the position specifying image.
  • the transmission / reception control unit 13 has a list of feature points and their transmission positions.
  • the position specifying image is, for example, a checkered flag image.
  • step ST22 the display screen of the display unit 17 is imaged by the imaging unit 24 and converted into image data, and the image analysis unit 25 performs image processing on the image data to extract the reception position of the feature point.
  • the image analysis unit 25 gives the feature point and its reception position as feature information to the transmission / reception control unit 13 through the reception control unit 22 and the communication units 21 and 11.
  • the transmission / reception control unit 13 compares the feature points and their transmission positions with the feature points that are feature information and the reception positions, and associates the feature points with each other. A discrete positional relationship of reception positions is obtained. And the transmission / reception control part 13 estimates the parameter of the conversion type showing the transmission / reception positional relationship in the whole display screen using the obtained discrete transmission / reception positional relationship. For example, assuming that the transmission position and the reception position are in a projective transformation relationship, the transmission / reception control unit 13 estimates the projection matrix by the method of least squares. Further, when lens distortion becomes a problem, the transmission / reception control unit 13 may use a positional relationship conversion formula including a lens distortion coefficient, such as a camera parameter in the Tsai method.
  • step ST24 when there is a feature point for which the reception position cannot be extracted (step ST24 “NO”), the transmission / reception control unit 13 proceeds to step ST25. Or the transmission / reception control part 13 progresses to step ST25, when the number of feature point samples sufficient to estimate the parameter of the conversion formula showing transmission / reception positional relationship cannot be extracted (step ST24 “NO”). In other cases (step ST24 “YES”), the transmission / reception control unit 13 ends the image display range adjustment.
  • step ST25 the transmission / reception control unit 13 moves the transmission position of the feature point for which the reception position could not be extracted to the inside of the display screen, or reduces the position specifying image. Or the transmission / reception control part 13 moves the transmission position of a feature point, when the feature point sample number enough to estimate the parameter of the transformation formula showing transmission / reception position relationship cannot be extracted. Then, the transmission / reception control unit 13 returns to step ST21 again and causes the display unit 17 to display the position specifying image corrected in step ST25.
  • the relationship between the transmission position and the reception position is obtained, and the imaging range, that is, the part displayed on the display unit 17 and imaged by the imaging unit 24 is also known.
  • the transmission / reception control unit 13 sets the imaging range as the transmission range, and does not use it outside the transmission range in future processing. Thereby, the largest transmission image size according to the performance of the display device 10 and the imaging device 20 can be determined.
  • FIG. 9 is a flowchart showing details of step ST30 in FIG. This is a process for correcting brightness unevenness due to a lens and an imaging angle.
  • the transmission / reception control unit 13 sequentially changes the luminance of the display unit 17 as in step ST12 of FIG. 6, and acquires the reception luminance for each transmission position.
  • the entire display screen of the display unit 17 is divided into a lattice shape, and a transmission / reception luminance relationship is obtained for each lattice.
  • a grid composed of a plurality of pixels is referred to as a block.
  • step ST32 the transmission / reception control unit 13 divides the relationship between the transmission luminance and the reception luminance obtained for each block with reference to the reception luminance, and assigns a representative transmission luminance to each.
  • FIG. 10 is a diagram showing a correspondence table between transmission luminance and reception luminance. In the example of FIG. 10, the range from the lowest received luminance value 10 to the highest value 70 is equally divided by ten. Then, a transmission luminance range is obtained for each divided reception luminance range, and the respective centers are set as representative transmission luminances 13, 33, 46, 56, 65, 78.
  • FIG. 11 is a flowchart showing details of step ST40 in FIG.
  • the transmission / reception control unit 13 controls the display control unit 16 through the communication unit 11 and the transmission control unit 14, and causes the display unit 17 to display an image for resolution adjustment.
  • the resolution adjustment image is for displaying the representative transmission luminance for each block on the transmission side.
  • step ST42 the image capturing unit 24 captures the display screen of the display unit 17 into image data, and the image analysis unit 25 performs image processing on the image data, and transmits the received luminance to the transmission / reception control unit 13 as feature information.
  • the transmission / reception control unit 13 extracts reception luminance corresponding to the representative transmission luminance for each block in the resolution adjustment image based on the feature information.
  • the transmission / reception control unit 13 determines, for each block, whether or not the representative transmission luminance matches the corresponding reception luminance. However, if the representative transmission luminance differs between a plurality of consecutive blocks, the reception luminance is mixed with the representative transmission luminance of those blocks, and the representative transmission luminance and the corresponding reception luminance do not completely match. Therefore, the transmission / reception control unit 13 may determine that they match when the difference between the representative transmission luminance and the reception luminance is within a preset allowable range.
  • step ST44 the transmission / reception control unit 13 has a predetermined ratio (for example, 90% or more) of the block in which the representative transmission luminance and the reception luminance match with respect to all the blocks of the resolution adjustment image (for example, 90% or more).
  • step ST44 “YES”) the image resolution adjustment is terminated.
  • step ST44 “NO”) the transmission / reception control unit 13 proceeds to step ST45. For example, if the image is divided into 10 blocks, the image resolution adjustment ends if there are 9 or more blocks whose representative transmission brightness and reception brightness match. Note that, in order to correct transmission information in a receiving state, which will be described later, the block matching ratio need not be 100%.
  • step ST45 the transmission / reception control unit 13 reduces the number of blocks included in the resolution adjustment image by lowering the resolution of the resolution adjustment image, that is, by increasing the number of pixels included in one block. Then, the transmission / reception control unit 13 returns to step ST41 again and causes the display unit 17 to display the resolution adjustment image corrected in step ST45. Thereby, the highest resolution according to the performance of the display device 10 and the imaging device 20 can be determined.
  • FIG. 12 is a flowchart showing details of step ST50 in FIG.
  • the transmission / reception control unit 13 controls the display control unit 16 through the communication unit 11 and the transmission control unit 14, displays an image for adjusting the response speed on the display unit 17, and acquires the reception luminance.
  • step ST52 the transmission / reception control unit 13 controls the display control unit 16 through the communication unit 11 and the transmission control unit 14, displays a response speed adjustment image different from that in step ST51 on the display unit 17, and sets the reception luminance. get.
  • the response speed adjustment image is an image having a predetermined representative transmission luminance.
  • the transmission / reception control unit 13 displays a white color image
  • step ST52 displays a black color image.
  • step ST53 the transmission / reception controller 13 changes the reception luminance corresponding to the representative transmission luminance of the response speed adjustment image in step ST52 from the reception luminance corresponding to the representative transmission luminance of the response speed adjustment image in step ST51. Is measured as a response speed, and the measured time interval is defined as a transmission cycle. Thereby, the shortest transmission cycle according to the performance of the display device 10 and the imaging device 20 can be determined.
  • the transmission / reception control unit 13 obtains specifications including the transmission / reception position correspondence and the transmission range, the transmission / reception luminance correspondence and the representative transmission luminance, the transmission resolution, and the transmission cycle in the transmission / reception ready state. After that, the transmission / reception control unit 13 sets the transmission control unit 14 to the transmission state and the reception control unit 22 to the reception state through the communication units 11 and 21, and transmits and receives transmission information according to the determined specifications. Further, the transmission / reception control unit 13 gives an instruction to switch the image to be displayed on the display unit 17 to the next image to the display control unit 16 through the communication unit 11 and the transmission control unit 14 according to the transmission cycle. This instruction is setting information. Further, the transmission / reception control unit 13 instructs the reception control unit 22 through the communication units 11 and 21 according to the transmission cycle to the timing for causing the imaging unit 24 to capture an image. This instruction is also setting information.
  • the transmission control unit 14 When in the transmission state of step ST2, the transmission control unit 14 obtains the number N of data used for transmission from the transmission range and the transmission resolution. The number of data N corresponds to the number of blocks. Also, the transmission control unit 14 assigns a code value for each divided representative transmission luminance, with the division number M when the transmission luminance is divided into the representative transmission luminance. For example, in the example of FIG. 10, one code value is assigned to the representative transmission luminance 13 corresponding to the range of the reception luminances 0 to 10. The transmission control unit 14 has a list of representative transmission luminances and their code values in advance. This list is transmitted as setting information to the image analysis unit 25 through the communication units 11 and 21 and the reception control unit 22.
  • an M-digit N-digit code value can be included in one transmission image. This is expressed in binary, a log 2 M N bits.
  • control information such as a sequence number indicating the current image number, and transmission information and an error correction code of the control information are included in this bit string. Include. Therefore, the capacity of transmission information included in one transmission image is smaller than log 2 MN bits.
  • the transmission control unit 14 acquires transmission information from the transmission information storage unit 15, divides the acquired transmission information into a capacity smaller than log 2 MN bits, and makes one or more pieces of divided transmission information. Then, the transmission control unit 14 adds control information and an error correction code to each divided transmission information.
  • FIG. 13 is a diagram showing an example of transmission information converted into one transmission image in the first embodiment of the present invention.
  • the transmission information 70 converted into one transmission image includes control information 71, one piece of transmission information 72, and an error correction code 73.
  • the capacity of this transmission information 70 is log 2 MN bits.
  • the transmission control unit 14 converts the transmission information 70 into an M-ary N-digit code value, determines a representative transmission luminance corresponding to the code value for each digit, and generates one transmission image.
  • FIG. 14 is a diagram showing an example of a transmission image 80 according to Embodiment 1 of the present invention.
  • One transmission image 80 is divided into N blocks 81, and one block 81 is assigned a luminance of one of the M gradations.
  • the transmission control unit 14 sequentially provides the generated transmission images to the display control unit 16 according to the instruction timing from the transmission / reception control unit 13 through the communication unit 11.
  • the display control unit 16 causes the display unit 17 to sequentially display the transmission images from the transmission control unit 14.
  • the imaging unit 24 captures the transmission image displayed on the display unit 17 in accordance with the instruction timing from the transmission / reception control unit 13 through the communication units 11 and 21 and the reception control unit 22.
  • the data is converted into data and given to the image analysis unit 25.
  • the image analysis unit 25 extracts the reception luminance from each reception position corresponding to each block of the transmission image, and obtains a code value assigned to the representative transmission luminance corresponding to the reception luminance. Note that the image analysis unit 25 may obtain the code value assigned to the representative transmission luminance using the list of the representative transmission luminance and its code value. In the example of FIG. 10, when the reception luminance extracted by the image analysis unit 25 is 35, the code value assigned to the representative transmission luminance 46 corresponding to the reception luminances 30 to 40 including the reception luminance 35 is acquired.
  • the image analysis unit 25 converts the code value N digits obtained from one transmission image into a binary number, performs error correction, and restores the control information and the divided transmission information. At this time, the image analysis unit 25 also performs error detection and error correction using an error correction code.
  • the reception control unit 22 When no error is detected by the image analysis unit 25 or when an error is detected and corrected, the reception control unit 22 stores the restored divided transmission information in the storage destination corresponding to the control information in the reception information storage unit 23. Write. On the other hand, when an error is detected by the image analysis unit 25 but cannot be corrected, that is, when the information amount of the error correction code is insufficient and the correction capability is low, the reception control unit 22 transmits the transmission control unit through the communication units 21 and 11. 14 is requested to retransmit the transmission image.
  • the input unit 12 exists in the display device 10, but may exist in the imaging device 20 or the in-vehicle device 40 connected via the communication path 30.
  • the transmission / reception control unit 13 that controls the entire in-vehicle camera system exists in the display device 10, but may exist in the imaging device 20 or the in-vehicle device 40 connected through the communication path 30.
  • the input unit 12 and the transmission / reception control unit 13 only need to be able to communicate with the display device 10 and the imaging device 20 via the communication path 30.
  • the imaging device 20 and the display device 10 transmit and receive setting information via the communication path 30 that connects the imaging device 20 and the display device 10.
  • the display device 10 converts transmission information having a capacity larger than the capacity of the setting information into one or more images based on the setting information and displays the information, and the imaging device 20 displays the display device based on the setting information. And capturing one or more images displayed by 10 and restoring them to transmission information.
  • one of the imaging device 20 or the display device 10 includes the transmission / reception control unit 13. And in step ST1 which transmits / receives setting information via the communication path 30, the transmission / reception control part 13 adjusts setting information based on the image for position specification etc. which were imaged, etc., to the imaging device 20 or the display apparatus 10.
  • the transmission / reception control unit 13 transmits setting information to the display device 10, the display device 10 displays an image based on the setting information transmitted by the transmission / reception control unit 13, and the imaging device 20 An image displayed by the display device 10 is captured to generate feature information and transmitted to the transmission / reception control unit 13, and the transmission / reception control unit 13 has no adjustment based on the feature information of the image transmitted by the imaging device 20.
  • the setting information is adjusted and transmitted to the imaging device 20 or the display device 10.
  • the imaging device 20 and the display device 10 negotiate through the communication path 30, the settings of the imaging device 20 and the display device 10 can be automated. Therefore, it is easy to install the display device 10 when updating the image processing program.
  • the setting information instructs the display device 10 to switch the display to the next image in step ST2. Accordingly, a plurality of images can be transmitted without changing the positions of the display device 10 and the imaging device 20, and the transmission time interval can be shortened.
  • the transmission time interval is long.
  • the setting information is at least one of the range for displaying the image, the brightness, the resolution, the gradation, or the cycle for switching the image display on the display device 10 in step ST1.
  • One is instructed.
  • the negotiation can be automatically performed through the communication path 30, and the installation of the display device 10 when the image processing program is updated is easy.
  • the in-vehicle camera system includes a display device 10 and an imaging device 20 mounted on the vehicle.
  • the display device 10 converts transmission information having a capacity larger than the capacity of the setting information into one or more images based on the setting information transmitted / received via the communication path 30 connecting the imaging device 20 and the display device 10. And display.
  • the imaging device 20 captures one or more images displayed by the display device 10 based on the setting information transmitted / received via the communication path 30, and restores the transmission information. With this configuration, it is possible to increase the data capacity included in one image by transmitting / receiving setting information via the communication path 30 and increase the transmission speed.
  • the in-vehicle camera system according to Embodiment 1 may be configured to include the optical device 60 that shortens the distance between the imaging device 20 and the display device 10 between the imaging device 20 and the display device 10. According to this structure, a vehicle-mounted camera system can be reduced in size.
  • any component of the embodiment can be modified or any component of the embodiment can be omitted within the scope of the invention.
  • a large amount of information is transmitted using an image from a display device connected via a low-speed communication path to the imaging device. Suitable for use.
  • 10 display device 11 communication unit, 12 input unit, 13 transmission / reception control unit, 14 transmission control unit, 15 transmission information storage unit, 16 display control unit, 17 display unit, 20 imaging device, 21 communication unit, 22 reception control unit, 23 reception information storage unit, 24 imaging unit, 25 image analysis unit, 30 communication path, 40 in-vehicle device, 50 fixture, 60 optical device, 70 transmission information, 71 control information, 72 divided transmission information, 73 error correction code, 80 Transmission image, 81 block, 101 display, 102, 202 communication device, 103, 203 processor, 104, 204 memory, 105 input device, 201 camera.

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Studio Devices (AREA)

Abstract

In the present invention, an imaging device (20) and a display device (10) transmit and receive setting information through a communication path (30). Next, the display device (10), on the basis of the setting information, converts transmission information with a larger volume than that of the setting information to one or more images and displays the images. Then, the imaging device (20), on the basis of the setting information, captures one or more images displayed by the display device (10) and reverts the images to transmission information.

Description

情報伝送方法および車載カメラシステムInformation transmission method and in-vehicle camera system
　この発明は、撮像装置を用いた情報伝送方法および車載カメラシステムに関するものである。 The present invention relates to an information transmission method using an imaging device and an in-vehicle camera system.
　特許文献１では、携帯端末が、紙に印刷された複数の二次元コードを順次読み込み、読み込んだ複数の二次元コードをプログラムデータに復元し、携帯端末のオペレーティングシステムを更新することが記載されている。 Patent Document 1 describes that a mobile terminal sequentially reads a plurality of two-dimensional codes printed on paper, restores the read two-dimensional codes into program data, and updates the operating system of the mobile terminal. Yes.
特開２００６－３４３９３４号公報JP 2006-343934 A
　特許文献１に係る発明では紙に印刷された二次元コードを使用する構成のため、携帯端末の性能に応じて二次元コードに含めるデータ容量を増やすことはできず、携帯端末が余裕をもって確実に読み取ることができるデータ容量しか二次元コードに含めることができなかった。そのため、二次元コード一枚あたりのデータ容量を大きくできず、伝送速度を大きくすることができないという課題があった。 Since the invention according to Patent Document 1 uses a two-dimensional code printed on paper, the data capacity included in the two-dimensional code cannot be increased according to the performance of the portable terminal, and the portable terminal can be surely provided with a margin. Only the amount of data that can be read could be included in the two-dimensional code. For this reason, there is a problem that the data capacity per two-dimensional code cannot be increased and the transmission speed cannot be increased.
　この発明は、上記のような課題を解決するためになされたもので、伝送速度を大きくすることを目的とする。 This invention has been made to solve the above-described problems, and aims to increase the transmission speed.
　この発明に係る情報伝送方法は、撮像装置および表示装置が、撮像装置と表示装置とを接続する通信路を経由して設定情報を送受するステップと、表示装置が、設定情報に基づいて、設定情報の容量より大きい容量の伝送情報を一枚以上の画像に変換して表示するステップと、撮像装置が、設定情報に基づいて、表示装置により表示された画像を撮像して伝送情報に復元するステップとを備えるものである。 In the information transmission method according to the present invention, the imaging device and the display device transmit and receive the setting information via a communication path connecting the imaging device and the display device, and the display device sets based on the setting information. The step of converting and displaying transmission information having a capacity larger than the information capacity into one or more images, and the imaging device capturing the image displayed by the display device based on the setting information and restoring the transmission information to the transmission information Steps.
　この発明によれば、通信路を経由した設定情報の送受によって撮像装置および表示装置を調整することで一枚の画像に含めるデータ容量を大きくすることができ、伝送速度を大きくすることができる。 According to the present invention, the data capacity included in one image can be increased by adjusting the imaging device and the display device by sending and receiving the setting information via the communication path, and the transmission speed can be increased.
この発明の実施の形態１に係る車載カメラシステムの概要を示す図である。It is a figure which shows the outline | summary of the vehicle-mounted camera system which concerns on Embodiment 1 of this invention. この発明の実施の形態１に係る車載カメラシステムの構成例を示すブロック図である。It is a block diagram which shows the structural example of the vehicle-mounted camera system which concerns on Embodiment 1 of this invention. この発明の実施の形態１に係る車載カメラシステムのハードウェア構成図であり、図３Ａは表示装置、図３Ｂは撮像装置を示す。It is a hardware block diagram of the vehicle-mounted camera system which concerns on Embodiment 1 of this invention, FIG. 3A shows a display apparatus and FIG. 3B shows an imaging device. この発明の実施の形態１に係る車載カメラシステムによる情報伝送方法を示すフローチャートである。It is a flowchart which shows the information transmission method by the vehicle-mounted camera system which concerns on Embodiment 1 of this invention. 図４のステップＳＴ１の詳細を示すフローチャートである。It is a flowchart which shows the detail of step ST1 of FIG. 図５のステップＳＴ１０の詳細を示すフローチャートである。It is a flowchart which shows the detail of step ST10 of FIG. 図７Ａ～図７Ｄは、送信輝度と受信輝度の対応表を示す図である。7A to 7D are diagrams showing correspondence tables between transmission luminance and reception luminance. 図５のステップＳＴ２０の詳細を示すフローチャートである。It is a flowchart which shows the detail of step ST20 of FIG. 図５のステップＳＴ３０の詳細を示すフローチャートである。It is a flowchart which shows the detail of step ST30 of FIG. 送信輝度と受信輝度の対応表を示す図である。It is a figure which shows the correspondence table of transmission brightness | luminance and reception brightness | luminance. 図５のステップＳＴ４０の詳細を示すフローチャートである。It is a flowchart which shows the detail of step ST40 of FIG. 図５のステップＳＴ５０の詳細を示すフローチャートである。It is a flowchart which shows the detail of step ST50 of FIG. この発明の実施の形態１において一枚の送信画像に変換される伝送情報の例を示す図である。It is a figure which shows the example of the transmission information converted into one transmission image in Embodiment 1 of this invention. この発明の実施の形態１における送信画像の例を示す図である。It is a figure which shows the example of the transmission image in Embodiment 1 of this invention.
　以下、この発明をより詳細に説明するために、この発明を実施するための形態について、添付の図面に従って説明する。
実施の形態１．
　図１は、この発明の実施の形態１に係る車載カメラシステムの概要を示す図である。実施の形態１に係る車載カメラシステムは、表示装置１０、撮像装置２０、通信路３０、車載装置４０、固定具５０、および光学装置６０を備える。撮像装置２０は、ディジタルカメラなどの撮像部を備えており、車両に搭載されている。撮像装置２０は、例えば、運転者の視線を検出するための、または道路の車線を検出するための、カメラ付き画像処理装置である。また、撮像装置２０と車載装置４０との間は、ＣＡＮ（Ｃｏｎｔｒｏｌｌｅｒ　Ａｒｅａ　Ｎｅｔｗｏｒｋ）などの通信路３０により接続されている。撮像装置２０は、視線検出結果または車線検出結果を、通信路３０を通じて車載装置４０へ送信する。車載装置４０は、視線検出結果または車線検出結果を用いて動作する。 Hereinafter, in order to explain the present invention in more detail, modes for carrying out the present invention will be described with reference to the accompanying drawings.
Embodiment 1 FIG.
1 is a diagram showing an outline of an in-vehicle camera system according to Embodiment 1 of the present invention. The in-vehicle camera system according to Embodiment 1 includes a display device 10, an imaging device 20, a communication path 30, an in-vehicle device 40, a fixture 50, and an optical device 60. The imaging device 20 includes an imaging unit such as a digital camera and is mounted on a vehicle. The imaging device 20 is, for example, an image processing device with a camera for detecting a driver's line of sight or detecting a road lane. Further, the imaging device 20 and the in-vehicle device 40 are connected by a communication path 30 such as a CAN (Controller Area Network). The imaging device 20 transmits the line-of-sight detection result or the lane detection result to the in-vehicle device 40 through the communication path 30. The in-vehicle device 40 operates using the line-of-sight detection result or the lane detection result.
　以下では、視線検出精度または車線検出精度向上のために撮像装置２０の画像処理プログラムを更新する例を用いて、実施の形態１に係る車載カメラシステムを説明する。
　画像処理プログラムの更新等、臨時の用途で、大量のデータを撮像装置２０に与える必要がある場合、伝送速度が低い通信路３０を用いると時間がかかる。そこで、実施の形態１では、表示装置１０が二次元コードのような画像を次々に表示し、撮像装置２０が表示された画像を次々に撮像することで、大量のデータを高速に伝送する。 Hereinafter, the in-vehicle camera system according to Embodiment 1 will be described using an example in which the image processing program of the imaging device 20 is updated to improve the gaze detection accuracy or the lane detection accuracy.
When it is necessary to provide a large amount of data to the imaging device 20 for temporary use such as updating an image processing program, it takes time to use the communication path 30 having a low transmission rate. Therefore, in the first embodiment, the display device 10 displays images such as a two-dimensional code one after another, and the imaging device 20 sequentially captures the displayed images, thereby transmitting a large amount of data at high speed.
　表示装置１０は、液晶ディスプレイなどの表示部を備えている。撮像装置２０の画像処理プログラムを更新する場合に、表示部が撮像装置２０の撮像部に相対するように表示装置１０が配置され、フックまたは吸盤などの簡易な固定具５０により撮像装置２０に固定される。表示装置１０と撮像装置２０との間に、レンズなどの光学装置６０が設置されてもよい。なお、光学装置６０の設置方法は問わない。例えば、光学装置６０は、不図示の固定具によって表示装置１０と撮像装置２０との間に固定されてもよいし、固定具５０によって固定されてもよいし、表示装置１０に予め固定されていてもよい。さらに、表示装置１０は通信路３０に接続され、通信路３０を経由して表示装置１０と撮像装置２０とが通信可能となる。 The display device 10 includes a display unit such as a liquid crystal display. When the image processing program of the imaging device 20 is updated, the display device 10 is arranged so that the display unit faces the imaging unit of the imaging device 20, and is fixed to the imaging device 20 by a simple fixing tool 50 such as a hook or a suction cup. Is done. An optical device 60 such as a lens may be installed between the display device 10 and the imaging device 20. In addition, the installation method of the optical apparatus 60 is not ask | required. For example, the optical device 60 may be fixed between the display device 10 and the imaging device 20 by a fixture (not shown), may be fixed by the fixture 50, or is fixed to the display device 10 in advance. May be. Further, the display device 10 is connected to the communication path 30, and the display device 10 and the imaging device 20 can communicate with each other via the communication path 30.
　図２は、この発明の実施の形態１に係る車載カメラシステムの構成例を示すブロック図である。表示装置１０は、通信部１１、入力部１２、送受制御部１３、送信制御部１４、送信情報蓄積部１５、表示制御部１６、および表示部１７を備える。
　撮像装置２０は、通信部２１、受信制御部２２、受信情報蓄積部２３、撮像部２４、および画像解析部２５を備える。なお、図２では、運転者の視線を検出するための、または道路の車線を検出するための機能について、図示を省略する。 FIG. 2 is a block diagram showing a configuration example of the in-vehicle camera system according to Embodiment 1 of the present invention. The display device 10 includes a communication unit 11, an input unit 12, a transmission / reception control unit 13, a transmission control unit 14, a transmission information storage unit 15, a display control unit 16, and a display unit 17.
The imaging device 20 includes a communication unit 21, a reception control unit 22, a reception information storage unit 23, an imaging unit 24, and an image analysis unit 25. In addition, in FIG. 2, illustration is abbreviate | omitted about the function for detecting a driver | operator's eyes | visual_axis or the road lane.
　図３は、この発明の実施の形態１に係る車載カメラシステムのハードウェア構成図であり、図３Ａは表示装置１０、図３Ｂは撮像装置２０を示す。
　表示装置１０における表示部１７は、ディスプレイ１０１である。表示装置１０における通信部１１は、ＣＡＮなどを用いて通信する通信装置１０２である。表示装置１０における入力部１２は、スイッチまたはタッチパネルなどの入力装置１０５である。表示装置１０における送信情報蓄積部１５は、メモリ１０４である。表示装置１０における送受制御部１３、送信制御部１４および表示制御部１６の各機能は、メモリ１０４に格納されるプログラムを実行するプロセッサ１０３である。送受制御部１３、送信制御部１４および表示制御部１６の各機能は、ソフトウェアにより実現される。ソフトウェアはプログラムとして記述され、メモリ１０４に格納される。プロセッサ１０３は、メモリ１０４に格納されたプログラムを読みだして実行することにより、各部の機能を実現する。即ち、表示装置１０は、プロセッサ１０３により実行されるときに、後述する図４のフローチャートで示されるステップが結果的に実行されることになるプログラムを格納するためのメモリ１０４を備える。また、このプログラムは、送受制御部１３、送信制御部１４および表示制御部１６の手順または方法をコンピュータに実行させるものであるとも言える。 3 is a hardware configuration diagram of the in-vehicle camera system according to the first embodiment of the present invention. FIG. 3A shows the display device 10, and FIG. 3B shows the imaging device 20.
The display unit 17 in the display device 10 is a display 101. The communication unit 11 in the display device 10 is a communication device 102 that communicates using CAN or the like. The input unit 12 in the display device 10 is an input device 105 such as a switch or a touch panel. The transmission information storage unit 15 in the display device 10 is a memory 104. Each function of the transmission / reception control unit 13, the transmission control unit 14, and the display control unit 16 in the display device 10 is a processor 103 that executes a program stored in the memory 104. Each function of the transmission / reception control unit 13, the transmission control unit 14, and the display control unit 16 is realized by software. The software is described as a program and stored in the memory 104. The processor 103 reads out and executes the program stored in the memory 104, thereby realizing the functions of the respective units. That is, the display device 10 includes a memory 104 for storing a program that, when executed by the processor 103, results in the steps shown in the flowchart of FIG. It can also be said that this program causes a computer to execute the procedure or method of the transmission / reception control unit 13, the transmission control unit 14, and the display control unit 16.
　撮像装置２０における撮像部２４は、カメラ２０１である。撮像装置２０における通信部２１は、ＣＡＮなどを用いて通信する通信装置２０２である。撮像装置２０における受信情報蓄積部２３は、メモリ２０４である。撮像装置２０における受信制御部２２および画像解析部２５は、メモリ２０４に格納されるプログラムを実行するプロセッサ２０３である。受信制御部２２および画像解析部２５の各機能は、ソフトウェアにより実現される。ソフトウェアはプログラムとして記述され、メモリ２０４に格納される。プロセッサ２０３は、メモリ２０４に格納されたプログラムを読みだして実行することにより、各部の機能を実現する。即ち、撮像装置２０は、プロセッサ２０３により実行されるときに、後述する図４のフローチャートで示されるステップが結果的に実行されることになるプログラムを格納するためのメモリ２０４を備える。また、このプログラムは、受信制御部２２および画像解析部２５の手順または方法をコンピュータに実行させるものであるとも言える。 The imaging unit 24 in the imaging device 20 is a camera 201. The communication unit 21 in the imaging device 20 is a communication device 202 that communicates using CAN or the like. The reception information storage unit 23 in the imaging device 20 is a memory 204. The reception control unit 22 and the image analysis unit 25 in the imaging device 20 are a processor 203 that executes a program stored in the memory 204. Each function of the reception control unit 22 and the image analysis unit 25 is realized by software. The software is described as a program and stored in the memory 204. The processor 203 reads out and executes the program stored in the memory 204, thereby realizing the functions of the respective units. That is, the imaging apparatus 20 includes a memory 204 for storing a program that, when executed by the processor 203, results in the steps shown in the flowchart of FIG. It can also be said that this program causes a computer to execute the procedures or methods of the reception control unit 22 and the image analysis unit 25.
　なお、撮像装置２０において、運転者の視線を検出するための、または道路の車線を検出するための機能も、ソフトウェアにより実現される。ソフトウェアは画像処理プログラムとして記述され、メモリ２０４に格納される。プロセッサ２０３は、メモリ２０４に格納された画像処理プログラムを読みだして実行することにより、運転者の視線を検出するための、または道路の車線を検出するための機能を実現する。実施の形態１に係る車載カメラシステムは、この画像処理プログラムを更新する。 In the imaging device 20, a function for detecting the driver's line of sight or detecting a road lane is also realized by software. The software is described as an image processing program and stored in the memory 204. The processor 203 reads and executes an image processing program stored in the memory 204, thereby realizing a function for detecting the driver's line of sight or detecting a road lane. The in-vehicle camera system according to Embodiment 1 updates this image processing program.
　ここで、プロセッサ１０３，２０３とは、ＣＰＵ（Ｃｅｎｔｒａｌ　Ｐｒｏｃｅｓｓｉｎｇ　Ｕｎｉｔ）、処理装置、演算装置、マイクロプロセッサ、またはマイクロコンピュータ等のことである。
　メモリ１０４，２０４は、ＲＡＭ（Ｒａｎｄｏｍ　Ａｃｃｅｓｓ　Ｍｅｍｏｒｙ）、ＲＯＭ（Ｒｅａｄ　Ｏｎｌｙ　Ｍｅｍｏｒｙ）、ＥＰＲＯＭ（Ｅｒａｓａｂｌｅ　Ｐｒｏｇｒａｍｍａｂｌｅ　ＲＯＭ）、またはフラッシュメモリ等の不揮発性もしくは揮発性の半導体メモリであってもよいし、ハードディスク等であってもよい。 Here, the processors 103 and 203 are a CPU (Central Processing Unit), a processing device, an arithmetic device, a microprocessor, a microcomputer, or the like.
The memories 104 and 204 may be a RAM (Random Access Memory), a ROM (Read Only Memory), an EPROM (Erasable Programmable ROM), or a nonvolatile or volatile semiconductor memory such as a flash memory, or a hard disk or the like. There may be.
　図４は、この発明の実施の形態１に係る車載カメラシステムによる情報伝送方法を示すフローチャートである。表示装置１０において、入力部１２は、ユーザの操作指示を受けると、送受制御部１３へ処理の開始を指示する。これにより、表示装置１０と撮像装置２０は、図４のフローチャートに示される処理を実行する。 FIG. 4 is a flowchart showing an information transmission method by the in-vehicle camera system according to Embodiment 1 of the present invention. In the display device 10, upon receiving a user operation instruction, the input unit 12 instructs the transmission / reception control unit 13 to start processing. As a result, the display device 10 and the imaging device 20 execute the processing shown in the flowchart of FIG.
　ステップＳＴ１の送受準備状態において、表示装置１０および撮像装置２０は、伝送速度が低い通信路３０を経由して設定情報を送受する。 In the transmission / reception preparation state of step ST1, the display device 10 and the imaging device 20 transmit / receive setting information via the communication path 30 having a low transmission speed.
　より具体的には、入力部１２は、ユーザの操作指示を受けて、送受制御部１３に処理の開始を指示する。送受制御部１３は、送信情報蓄積部１５がもつ情報を、撮像装置２０の受信情報蓄積部２３へ伝送するために、通信部１１，２１を通じて送信制御部１４と受信制御部２２を制御する。送受制御部１３は、入力部１２より処理の開始の指示を受けると、まず、送信制御部１４と受信制御部２２を送受準備状態にし、画像生成のための諸元を確定させるためのネゴシエーションを開始する。送受制御部１３は、ネゴシエーションにおいて、送信制御部１４が表示制御部１６を介して表示部１７に表示させた画像と受信制御部２２から得た特徴情報とを比較し、その後、次の画像の表示と比較に移ることを繰り返し、画像の表示および撮像に関わる諸元を確定させる。諸元および特徴情報は、設定情報である。 More specifically, the input unit 12 receives a user operation instruction and instructs the transmission / reception control unit 13 to start processing. The transmission / reception control unit 13 controls the transmission control unit 14 and the reception control unit 22 through the communication units 11 and 21 in order to transmit the information held by the transmission information storage unit 15 to the reception information storage unit 23 of the imaging device 20. Upon receiving an instruction to start processing from the input unit 12, the transmission / reception control unit 13 first sets the transmission control unit 14 and the reception control unit 22 in a transmission / reception preparation state, and performs negotiation for determining the specifications for image generation. Start. In the negotiation, the transmission / reception control unit 13 compares the image displayed on the display unit 17 by the transmission control unit 14 via the display control unit 16 with the feature information obtained from the reception control unit 22, and then the next image is displayed. The process of displaying and comparing is repeated, and specifications relating to image display and imaging are determined. The specifications and feature information are setting information.
　送受制御部１３は、送受準備状態にあるとき、表示部１７と撮像部２４との位置関係、表示部１７が表示した明るさと撮像部２４が受けた明るさとの関係、および表示部１７から撮像部２４へ伝達可能な最大解像度などを調べるための画像を生成し、表示制御部１６に与える。表示制御部１６は、送信制御部１４より受けた画像を表示部１７に与え、表示させる。表示部１７は、表示制御部１６より受けた画像を表示する。
　撮像部２４は、受信制御部２２の指示に従って表示部１７に表示された画像を撮像し、画像データに変換し、画像解析部２５に与える。画像解析部２５は、撮像部２４から受けた画像データから画像中の特徴情報を抽出し、受信制御部２２に与える。受信制御部２２は、画像解析部２５より受けた特徴情報を、通信部２１，１１を通じて送受制御部１３に与える。 When the transmission / reception control unit 13 is in a transmission / reception preparation state, the positional relationship between the display unit 17 and the imaging unit 24, the relationship between the brightness displayed by the display unit 17 and the brightness received by the imaging unit 24, and the imaging from the display unit 17. An image for examining the maximum resolution that can be transmitted to the unit 24 is generated and provided to the display control unit 16. The display control unit 16 gives the image received from the transmission control unit 14 to the display unit 17 for display. The display unit 17 displays the image received from the display control unit 16.
The imaging unit 24 captures an image displayed on the display unit 17 in accordance with an instruction from the reception control unit 22, converts the image into image data, and supplies the image data to the image analysis unit 25. The image analysis unit 25 extracts feature information in the image from the image data received from the imaging unit 24 and provides the feature information to the reception control unit 22. The reception control unit 22 gives the feature information received from the image analysis unit 25 to the transmission / reception control unit 13 through the communication units 21 and 11.
　ステップＳＴ２の送信状態において、表示装置１０は、設定情報に基づいて、設定情報の容量より大きい容量の伝送情報を画像に変換して表示する。伝送情報は、上述した画像処理プログラムである。諸元として確定した画像一枚あたりの容量より、伝送情報の容量のほうが大きい場合、伝送情報は複数の画像に変換される。 In the transmission state of step ST2, the display device 10 converts transmission information having a capacity larger than the capacity of the setting information into an image based on the setting information and displays the image. The transmission information is the above-described image processing program. If the capacity of transmission information is larger than the capacity per image determined as specifications, the transmission information is converted into a plurality of images.
　より具体的には、送信制御部１４は、送信情報蓄積部１５から伝送情報を取得し、諸元に従い画像に変換して、表示制御部１６に与える。表示制御部１６は、送信制御部１４より受けた画像を表示部１７に与え、表示させる。表示部１７は、表示制御部１６より受けた画像を表示する。 More specifically, the transmission control unit 14 acquires transmission information from the transmission information storage unit 15, converts it into an image according to specifications, and provides the image to the display control unit 16. The display control unit 16 gives the image received from the transmission control unit 14 to the display unit 17 for display. The display unit 17 displays the image received from the display control unit 16.
　ステップＳＴ３の受信状態において、撮像装置２０は、設定情報に基づいて、表示装置１０により表示された画像を撮像して伝送情報に復元する。 In the reception state of step ST3, the imaging device 20 captures an image displayed by the display device 10 based on the setting information and restores it to transmission information.
　より具体的には、撮像部２４は、表示部１７に表示された画像を撮像し、画像データに変換し、画像解析部２５に与える。画像解析部２５は、撮像部２４から受けた画像データを諸元に従い伝送情報に復元し、受信制御部２２に与える。受信制御部２２は、画像解析部２５から受けた伝送情報を受信情報蓄積部２３に与え、蓄積させる。 More specifically, the imaging unit 24 captures an image displayed on the display unit 17, converts the image into image data, and provides the image data to the image analysis unit 25. The image analysis unit 25 restores the image data received from the imaging unit 24 to transmission information according to the specifications, and provides the transmission information to the reception control unit 22. The reception control unit 22 gives the transmission information received from the image analysis unit 25 to the reception information storage unit 23 for storage.
　伝送情報を変換した画像が複数枚ある場合、表示装置１０と撮像装置２０は諸元に従いステップＳＴ２とステップＳＴ３とを複数回繰り返すことにより、複数枚の画像を伝送する。 When there are a plurality of images obtained by converting the transmission information, the display device 10 and the imaging device 20 transmit a plurality of images by repeating step ST2 and step ST3 a plurality of times according to the specifications.
　次に、ステップＳＴ１～ＳＴ３の詳細を説明する。 Next, details of steps ST1 to ST3 will be described.
　図５は、図４のステップＳＴ１の詳細を示すフローチャートである。
　ステップＳＴ１の送受準備状態には、ステップＳＴ１０の明るさ調整、ステップＳＴ２０の画像表示範囲調整、ステップＳＴ３０の画像階調調整、ステップＳＴ４０の画像解像度調整、およびステップＳＴ５０の応答速度調整が含まれる。ステップＳＴ１０～ＳＴ５０において送受制御部１３が通信路３０を経由して表示装置１０および撮像装置２０へ与える指示は、設定情報である。なお、ステップＳＴ１０～ＳＴ５０を実行する順序は、図５の順序に限定されない。 FIG. 5 is a flowchart showing details of step ST1 of FIG.
The transmission / reception preparation state in step ST1 includes brightness adjustment in step ST10, image display range adjustment in step ST20, image gradation adjustment in step ST30, image resolution adjustment in step ST40, and response speed adjustment in step ST50. The instructions given to the display device 10 and the imaging device 20 by the transmission / reception control unit 13 via the communication path 30 in steps ST10 to ST50 are setting information. The order in which steps ST10 to ST50 are executed is not limited to the order shown in FIG.
　図６は、図５のステップＳＴ１０の詳細を示すフローチャートである。
　ステップＳＴ１１において、送受制御部１３は、通信部１１，２１および受信制御部２２を通じて撮像部２４を制御し、シャッタ速度、絞りまたはＮＤ（Ｎｅｕｔｒａｌ　Ｄｅｎｓｉｔｙ）フィルタ等を所定の値に設定する。所定の値は、あらかじめ送受制御部１３に与えられているものとする。 FIG. 6 is a flowchart showing details of step ST10 of FIG.
In step ST11, the transmission / reception control unit 13 controls the imaging unit 24 through the communication units 11 and 21 and the reception control unit 22, and sets a shutter speed, an aperture, an ND (Neutral Density) filter, and the like to predetermined values. The predetermined value is assumed to be given to the transmission / reception control unit 13 in advance.
　ステップＳＴ１２において、送受制御部１３は、通信部１１、送信制御部１４および表示制御部１６を通じて、表示部１７の表示画面全体に特定の輝度を表示させ、その輝度を順次変更させる。また、送受制御部１３は、通信部１１，２１および受信制御部２２を通じて、撮像部２４に輝度ごとに撮像させ、画像解析部２５に画像中の所定の画素（例えば、画面中央の画素）が受けた輝度を取得させ、特徴情報として送受制御部１３へ送信させる。送受制御部１３は、表示部１７が表示した送信輝度と、撮像部２４が撮像した受信輝度との対応表を作成する。図７Ａ～図７Ｄは、送信輝度と受信輝度の対応表を示す図である。 In step ST12, the transmission / reception control unit 13 displays a specific luminance on the entire display screen of the display unit 17 through the communication unit 11, the transmission control unit 14, and the display control unit 16, and sequentially changes the luminance. The transmission / reception control unit 13 causes the imaging unit 24 to capture images for each luminance through the communication units 11 and 21 and the reception control unit 22, and the image analysis unit 25 has predetermined pixels (for example, a pixel at the center of the screen) in the image. The received luminance is acquired and transmitted to the transmission / reception control unit 13 as feature information. The transmission / reception control unit 13 creates a correspondence table between the transmission luminance displayed by the display unit 17 and the reception luminance captured by the imaging unit 24. 7A to 7D are diagrams showing correspondence tables between transmission luminance and reception luminance.
　ステップＳＴ１３において、送受制御部１３は、作成した対応表において、受信輝度の最低値から所定の範囲内（例えば、５％以内）に所定の数以上（例えば、１０％以上）の送信輝度サンプルが含まれる場合に、下側飽和と検知する。図７Ａのような対応表の場合、受信輝度の最低値から５％以内に、１０％以上の送信輝度サンプルが含まれているため、下側飽和と検知される。
　また、送受制御部１３は、受信輝度の最大値側に関しても同様に、上側飽和を検知する。図７Ｂのような対応表の場合、受信輝度の最高値から５％以内に、１０％以上の送信輝度サンプルが含まれているため、上側飽和と検知される。 In step ST13, the transmission / reception control unit 13 includes a predetermined number or more (for example, 10% or more) of transmission luminance samples within a predetermined range (for example, within 5%) from the lowest value of the reception luminance in the created correspondence table. If included, it is detected as lower saturation. In the case of the correspondence table as shown in FIG. 7A, since 10% or more of the transmission luminance samples are included within 5% from the lowest value of the reception luminance, it is detected as lower saturation.
Similarly, the transmission / reception control unit 13 detects upper side saturation on the maximum value side of the reception luminance. In the case of the correspondence table as shown in FIG. 7B, since 10% or more of transmission luminance samples are included within 5% from the maximum value of the reception luminance, upper saturation is detected.
　ステップＳＴ１４において、送受制御部１３は、例えば図７Ｃのように上側飽和および下側飽和を検知しなかった場合（ステップＳＴ１４“ＹＥＳ”）、明るさ調整を終了する。また、送受制御部１３は、上側飽和および下側飽和の両方を検知した場合であっても、図７Ｄのように上側と下側の飽和が同程度であれば（ステップＳＴ１４“ＹＥＳ”）、明るさ調整を終了する。
　一方、送受制御部１３は、例えば図７Ａまたは図７Ｂのように上側飽和もしくは下側飽和を検知した場合、または上側と下側とで飽和の程度が異なる場合（ステップＳＴ１４“ＮＯ”）、ステップＳＴ１５に進む。 In step ST14, the transmission / reception control unit 13 ends the brightness adjustment when the upper saturation and the lower saturation are not detected as shown in FIG. 7C, for example (step ST14 “YES”). Further, even if both the upper saturation and the lower saturation are detected, the transmission / reception control unit 13 has the same upper and lower saturations as shown in FIG. 7D (step ST14 “YES”). End brightness adjustment.
On the other hand, when the transmission / reception control unit 13 detects upper saturation or lower saturation as shown in FIG. 7A or 7B, for example, or when the degree of saturation is different between the upper side and the lower side (step ST14 “NO”), the step Proceed to ST15.
　ステップＳＴ１５において、送受制御部１３は、上側飽和のみある場合、または下側飽和に対して上側飽和が大きい場合、受信側の感度を下げる。一方、送受制御部１３は、下側飽和のみある場合、または上側飽和に対して下側飽和が大きい場合、受信側の感度を上げる。受信側の感度は、例えば撮像部２４のＮＤフィルタ等により調整可能である。
　そして、送受制御部１３は、再びステップＳＴ１１に戻り、ステップＳＴ１５で修正した受信感度に基づいて撮像部２４を制御する。 In step ST15, the transmission / reception control unit 13 decreases the sensitivity on the reception side when only the upper saturation is present or when the upper saturation is larger than the lower saturation. On the other hand, the transmission / reception control unit 13 increases the sensitivity on the reception side when there is only lower saturation or when the lower saturation is larger than the upper saturation. The sensitivity on the reception side can be adjusted by, for example, the ND filter of the imaging unit 24.
And the transmission / reception control part 13 returns to step ST11 again, and controls the imaging part 24 based on the reception sensitivity corrected by step ST15.
　なお、送受制御部１３は、上側飽和のみある場合、または下側飽和に対して上側飽和が大きい場合、送信側の輝度基準を下げてもよい。また、送受制御部１３は、下側飽和のみある場合、または上側飽和に対して下側飽和が大きい場合、送信側の輝度基準を上げてもよい。送信側の輝度基準は、例えば表示部１７のバックライト等により調整可能である。 Note that the transmission / reception control unit 13 may lower the luminance standard on the transmission side when only the upper saturation is present or when the upper saturation is larger than the lower saturation. Further, the transmission / reception control unit 13 may increase the luminance standard on the transmission side when only the lower saturation is present or when the lower saturation is greater than the upper saturation. The luminance reference on the transmission side can be adjusted by, for example, the backlight of the display unit 17 or the like.
　図８は、図５のステップＳＴ２０の詳細を示すフローチャートである。
　ステップＳＴ２１において、送受制御部１３は、通信部１１および送信制御部１４を通じて表示制御部１６を制御し、表示部１７に位置特定用の画像を表示させる。位置特定用の画像中には、画像処理により抽出可能な特徴点が一つまたは複数含まれている。送受制御部１３は、特徴点とその送信位置のリストを持つ。位置特定用の画像は、例えば、チェッカーフラッグ状の画像である。 FIG. 8 is a flowchart showing details of step ST20 in FIG.
In step ST21, the transmission / reception control unit 13 controls the display control unit 16 through the communication unit 11 and the transmission control unit 14, and causes the display unit 17 to display an image for specifying the position. One or more feature points that can be extracted by image processing are included in the position specifying image. The transmission / reception control unit 13 has a list of feature points and their transmission positions. The position specifying image is, for example, a checkered flag image.
　ステップＳＴ２２において、表示部１７の表示画面を撮像部２４が撮像して画像データにし、画像解析部２５がその画像データを画像処理し、特徴点の受信位置を抽出する。画像解析部２５は、特徴点とその受信位置を特徴情報として、受信制御部２２および通信部２１，１１を通じて送受制御部１３に与える。 In step ST22, the display screen of the display unit 17 is imaged by the imaging unit 24 and converted into image data, and the image analysis unit 25 performs image processing on the image data to extract the reception position of the feature point. The image analysis unit 25 gives the feature point and its reception position as feature information to the transmission / reception control unit 13 through the reception control unit 22 and the communication units 21 and 11.
　ステップＳＴ２３において、送受制御部１３は、特徴点とその送信位置のリストを、特徴情報である特徴点とその受信位置と比較して特徴点の対応付けを行い、全ての特徴点に関して送信位置と受信位置の離散的な位置関係を得る。そして、送受制御部１３は、得られた離散的な送受位置関係を用いて、表示画面全体における送受位置関係を表す変換式のパラメータを推定する。送受制御部１３は、例えば、送信位置と受信位置とが射影変換の関係にあると仮定して、最小自乗法により射影行列を推定する。
　また、送受制御部１３は、レンズの歪みが問題になる場合には、Ｔｓａｉの方法におけるカメラパラメータなど、レンズ歪係数を含む位置関係の変換式を使用してもよい。 In step ST23, the transmission / reception control unit 13 compares the feature points and their transmission positions with the feature points that are feature information and the reception positions, and associates the feature points with each other. A discrete positional relationship of reception positions is obtained. And the transmission / reception control part 13 estimates the parameter of the conversion type showing the transmission / reception positional relationship in the whole display screen using the obtained discrete transmission / reception positional relationship. For example, assuming that the transmission position and the reception position are in a projective transformation relationship, the transmission / reception control unit 13 estimates the projection matrix by the method of least squares.
Further, when lens distortion becomes a problem, the transmission / reception control unit 13 may use a positional relationship conversion formula including a lens distortion coefficient, such as a camera parameter in the Tsai method.
　ステップＳＴ２４において、送受制御部１３は、受信位置が抽出できなかった特徴点があった場合（ステップＳＴ２４“ＮＯ”）、ステップＳＴ２５に進む。あるいは、送受制御部１３は、送受位置関係を表す変換式のパラメータを推定するのに十分な特徴点サンプル数を抽出できなかった場合（ステップＳＴ２４“ＮＯ”）、ステップＳＴ２５に進む。それら以外の場合（ステップＳＴ２４“ＹＥＳ”）、送受制御部１３は、画像表示範囲調整を終了する。 In step ST24, when there is a feature point for which the reception position cannot be extracted (step ST24 “NO”), the transmission / reception control unit 13 proceeds to step ST25. Or the transmission / reception control part 13 progresses to step ST25, when the number of feature point samples sufficient to estimate the parameter of the conversion formula showing transmission / reception positional relationship cannot be extracted (step ST24 "NO"). In other cases (step ST24 “YES”), the transmission / reception control unit 13 ends the image display range adjustment.
　ステップＳＴ２５において、送受制御部１３は、受信位置が抽出できなかった特徴点の送信位置を表示画面のより内側に移動させたり、位置特定用の画像を縮小したりする。あるいは、送受制御部１３は、送受位置関係を表す変換式のパラメータを推定するのに十分な特徴点サンプル数を抽出できなかった場合、特徴点の送信位置を移動させる。
　そして、送受制御部１３は、再びステップＳＴ２１に戻り、ステップＳＴ２５で修正した位置特定用の画像を表示部１７に表示させる。 In step ST25, the transmission / reception control unit 13 moves the transmission position of the feature point for which the reception position could not be extracted to the inside of the display screen, or reduces the position specifying image. Or the transmission / reception control part 13 moves the transmission position of a feature point, when the feature point sample number enough to estimate the parameter of the transformation formula showing transmission / reception position relationship cannot be extracted.
Then, the transmission / reception control unit 13 returns to step ST21 again and causes the display unit 17 to display the position specifying image corrected in step ST25.
　ステップＳＴ２１～ＳＴ２５の処理により、送信位置と受信位置の関係が得られ、また、撮像範囲、つまり表示部１７に表示して撮像部２４で撮像される部分もわかる。送受制御部１３は、撮像範囲を送信範囲とし、送信範囲外は今後の処理では使用しない。
　これにより、表示装置１０と撮像装置２０の性能に応じた、最も大きい送信画像サイズを決定することができる。 Through the processing in steps ST21 to ST25, the relationship between the transmission position and the reception position is obtained, and the imaging range, that is, the part displayed on the display unit 17 and imaged by the imaging unit 24 is also known. The transmission / reception control unit 13 sets the imaging range as the transmission range, and does not use it outside the transmission range in future processing.
Thereby, the largest transmission image size according to the performance of the display device 10 and the imaging device 20 can be determined.
　図９は、図５のステップＳＴ３０の詳細を示すフローチャートである。これは、レンズおよび撮像角度などによる明るさムラを補正するための処理である。
　ステップＳＴ３１において、送受制御部１３は、図６のステップＳＴ１２のように表示部１７の輝度を順次変更させ、送信位置ごとの受信輝度を取得する。ただし、全ての送信画素ごとに本処理を行うのはコストがかかるため、ここでは、表示部１７の表示画面全体を格子状に区切り、格子ごとに送受輝度関係を得ることとする。以下では、複数の画素からなる格子を、ブロックと呼ぶ。 FIG. 9 is a flowchart showing details of step ST30 in FIG. This is a process for correcting brightness unevenness due to a lens and an imaging angle.
In step ST31, the transmission / reception control unit 13 sequentially changes the luminance of the display unit 17 as in step ST12 of FIG. 6, and acquires the reception luminance for each transmission position. However, since it is costly to perform this process for every transmission pixel, here, the entire display screen of the display unit 17 is divided into a lattice shape, and a transmission / reception luminance relationship is obtained for each lattice. Hereinafter, a grid composed of a plurality of pixels is referred to as a block.
　ステップＳＴ３２において、送受制御部１３は、ブロックごとに得られた送信輝度と受信輝度との関係を、受信輝度を基準に分割し、それぞれに対して代表の送信輝度を割り当てる。図１０は、送信輝度と受信輝度の対応表を示す図である。図１０の例では、受信輝度の最低値１０から最高値７０までの範囲が１０ずつ等分割されている。そして、分割した受信輝度範囲ごとに送信輝度の範囲を求め、各中心を代表送信輝度１３，３３，４６，５６，６５，７８とする。 In step ST32, the transmission / reception control unit 13 divides the relationship between the transmission luminance and the reception luminance obtained for each block with reference to the reception luminance, and assigns a representative transmission luminance to each. FIG. 10 is a diagram showing a correspondence table between transmission luminance and reception luminance. In the example of FIG. 10, the range from the lowest received luminance value 10 to the highest value 70 is equally divided by ten. Then, a transmission luminance range is obtained for each divided reception luminance range, and the respective centers are set as representative transmission luminances 13, 33, 46, 56, 65, 78.
　図１１は、図５のステップＳＴ４０の詳細を示すフローチャートである。
　ステップＳＴ４１において、送受制御部１３は、通信部１１および送信制御部１４を通じて表示制御部１６を制御し、表示部１７に解像度調整用の画像を表示させる。解像度調整用の画像は、送信側のブロックごとに代表送信輝度を表示するためのものである。 FIG. 11 is a flowchart showing details of step ST40 in FIG.
In step ST41, the transmission / reception control unit 13 controls the display control unit 16 through the communication unit 11 and the transmission control unit 14, and causes the display unit 17 to display an image for resolution adjustment. The resolution adjustment image is for displaying the representative transmission luminance for each block on the transmission side.
　ステップＳＴ４２において、表示部１７の表示画面を撮像部２４が撮像して画像データにし、画像解析部２５がその画像データを画像処理し、受信輝度を特徴情報として送受制御部１３に送信する。送受制御部１３は、特徴情報に基づいて、解像度調整用の画像におけるブロックごとの代表送信輝度に対応する受信輝度を抽出する。 In step ST42, the image capturing unit 24 captures the display screen of the display unit 17 into image data, and the image analysis unit 25 performs image processing on the image data, and transmits the received luminance to the transmission / reception control unit 13 as feature information. The transmission / reception control unit 13 extracts reception luminance corresponding to the representative transmission luminance for each block in the resolution adjustment image based on the feature information.
　ステップＳＴ４３において、送受制御部１３は、ブロックごとに、代表送信輝度と対応する受信輝度とが一致するか否かを判定する。ただし、連続する複数のブロック間で代表送信輝度が異なると、受信輝度はそれらのブロックの代表送信輝度が混色し、代表送信輝度と対応する受信輝度とが完全一致しない。そこで、送受制御部１３は、代表送信輝度と受信輝度とのずれがあらかじめ設定された許容範囲内である場合に一致と判定してもよい。 In step ST43, the transmission / reception control unit 13 determines, for each block, whether or not the representative transmission luminance matches the corresponding reception luminance. However, if the representative transmission luminance differs between a plurality of consecutive blocks, the reception luminance is mixed with the representative transmission luminance of those blocks, and the representative transmission luminance and the corresponding reception luminance do not completely match. Therefore, the transmission / reception control unit 13 may determine that they match when the difference between the representative transmission luminance and the reception luminance is within a preset allowable range.
　ステップＳＴ４４において、送受制御部１３は、代表送信輝度と受信輝度とが一致したブロックの、解像度調整用の画像の全ブロックに占める割合が、所定の割合（例えば、９０％以上）である場合（ステップＳＴ４４“ＹＥＳ”）、画像解像度調整を終了する。それ以外の場合（ステップＳＴ４４“ＮＯ”）、送受制御部１３は、ステップＳＴ４５に進む。例えば、画像が１０ブロックに分割されている場合、代表送信輝度と受信輝度とが一致するブロックが９以上あれば、画像解像度調整は終了する。なお、後述する受信状態において伝送情報を誤り訂正するため、ここではブロック一致の割合を１００％にしなくてもよい。 In step ST44, the transmission / reception control unit 13 has a predetermined ratio (for example, 90% or more) of the block in which the representative transmission luminance and the reception luminance match with respect to all the blocks of the resolution adjustment image (for example, 90% or more). In step ST44 “YES”), the image resolution adjustment is terminated. In other cases (step ST44 “NO”), the transmission / reception control unit 13 proceeds to step ST45. For example, if the image is divided into 10 blocks, the image resolution adjustment ends if there are 9 or more blocks whose representative transmission brightness and reception brightness match. Note that, in order to correct transmission information in a receiving state, which will be described later, the block matching ratio need not be 100%.
　ステップＳＴ４５において、送受制御部１３は、解像度調整用の画像の解像度を下げる、つまり一つのブロックに含まれる画素数を増やすことによって解像度調整用の画像に含まれるブロック数を減らす。
　そして、送受制御部１３は、再びステップＳＴ４１に戻り、ステップＳＴ４５で修正した解像度調整用の画像を表示部１７に表示させる。
　これにより、表示装置１０と撮像装置２０の性能に応じた、最も高い解像度を決定することができる。 In step ST45, the transmission / reception control unit 13 reduces the number of blocks included in the resolution adjustment image by lowering the resolution of the resolution adjustment image, that is, by increasing the number of pixels included in one block.
Then, the transmission / reception control unit 13 returns to step ST41 again and causes the display unit 17 to display the resolution adjustment image corrected in step ST45.
Thereby, the highest resolution according to the performance of the display device 10 and the imaging device 20 can be determined.
　図１２は、図５のステップＳＴ５０の詳細を示すフローチャートである。
　ステップＳＴ５１において、送受制御部１３は、通信部１１および送信制御部１４を通じて表示制御部１６を制御し、表示部１７に応答速度調整用の画像を表示させ、受信輝度を取得する。 FIG. 12 is a flowchart showing details of step ST50 in FIG.
In step ST51, the transmission / reception control unit 13 controls the display control unit 16 through the communication unit 11 and the transmission control unit 14, displays an image for adjusting the response speed on the display unit 17, and acquires the reception luminance.
　ステップＳＴ５２において、送受制御部１３は、通信部１１および送信制御部１４を通じて表示制御部１６を制御し、ステップＳＴ５１とは別の応答速度調整用の画像を表示部１７に表示させ、受信輝度を取得する。 In step ST52, the transmission / reception control unit 13 controls the display control unit 16 through the communication unit 11 and the transmission control unit 14, displays a response speed adjustment image different from that in step ST51 on the display unit 17, and sets the reception luminance. get.
　応答速度調整用の画像は、所定の代表送信輝度の画像である。送受制御部１３は、例えば、ステップＳＴ５１では白一色の画像を表示させ、ステップＳＴ５２では黒一色の画像を表示させる。 The response speed adjustment image is an image having a predetermined representative transmission luminance. For example, in step ST51, the transmission / reception control unit 13 displays a white color image, and in step ST52, displays a black color image.
　ステップＳＴ５３において、送受制御部１３は、ステップＳＴ５１における応答速度調整用の画像の代表送信輝度に対応する受信輝度から、ステップＳＴ５２における応答速度調整用の画像の代表送信輝度に対応する受信輝度になるまでの時間を計測して応答速度とし、計測した時間間隔を送信周期とする。
　これにより、表示装置１０と撮像装置２０の性能に応じた、最も短い送信周期を決定することができる。 In step ST53, the transmission / reception controller 13 changes the reception luminance corresponding to the representative transmission luminance of the response speed adjustment image in step ST52 from the reception luminance corresponding to the representative transmission luminance of the response speed adjustment image in step ST51. Is measured as a response speed, and the measured time interval is defined as a transmission cycle.
Thereby, the shortest transmission cycle according to the performance of the display device 10 and the imaging device 20 can be determined.
　送受制御部１３は、これらの処理により、送受準備状態において、送受位置対応関係と送信範囲、送受輝度対応関係と代表送信輝度、送信解像度、および送信周期からなる諸元を得る。その後、送受制御部１３は、通信部１１，２１を通じて、送信制御部１４を送信状態にするとともに受信制御部２２を受信状態にし、確定した諸元に従って伝送情報の送受を行わせる。また、送受制御部１３は、送信周期に従って、通信部１１および送信制御部１４を通じて表示制御部１６に対し、表示部１７に表示させる画像を次の画像に切り替える指示を与える。この指示は、設定情報である。さらに、送受制御部１３は、送信周期に従って、通信部１１，２１を通じて受信制御部２２に対し、撮像部２４に撮像させるタイミングの指示を与える。この指示も、設定情報である。 Through these processes, the transmission / reception control unit 13 obtains specifications including the transmission / reception position correspondence and the transmission range, the transmission / reception luminance correspondence and the representative transmission luminance, the transmission resolution, and the transmission cycle in the transmission / reception ready state. After that, the transmission / reception control unit 13 sets the transmission control unit 14 to the transmission state and the reception control unit 22 to the reception state through the communication units 11 and 21, and transmits and receives transmission information according to the determined specifications. Further, the transmission / reception control unit 13 gives an instruction to switch the image to be displayed on the display unit 17 to the next image to the display control unit 16 through the communication unit 11 and the transmission control unit 14 according to the transmission cycle. This instruction is setting information. Further, the transmission / reception control unit 13 instructs the reception control unit 22 through the communication units 11 and 21 according to the transmission cycle to the timing for causing the imaging unit 24 to capture an image. This instruction is also setting information.
　ステップＳＴ２の送信状態にあるとき、送信制御部１４は、送信範囲と送信解像度とから、送信に使用するデータ数Ｎを得る。データ数Ｎは、ブロック数に相当する。また、送信制御部１４は、送信輝度を代表送信輝度に分割したときの分割数Ｍとし、分割した代表送信輝度ごとに符号値を割り当てる。例えば、図１０の例では、受信輝度０～１０の範囲に対応する代表送信輝度１３に対して一つの符号値が割り当てられる。なお、送信制御部１４は、代表送信輝度とその符号値のリストをあらかじめ持つ。このリストは、設定情報として、通信部１１，２１および受信制御部２２を通じて画像解析部２５に送信される。 When in the transmission state of step ST2, the transmission control unit 14 obtains the number N of data used for transmission from the transmission range and the transmission resolution. The number of data N corresponds to the number of blocks. Also, the transmission control unit 14 assigns a code value for each divided representative transmission luminance, with the division number M when the transmission luminance is divided into the representative transmission luminance. For example, in the example of FIG. 10, one code value is assigned to the representative transmission luminance 13 corresponding to the range of the reception luminances 0 to 10. The transmission control unit 14 has a list of representative transmission luminances and their code values in advance. This list is transmitted as setting information to the image analysis unit 25 through the communication units 11 and 21 and the reception control unit 22.
　このとき、一枚の送信画像には、Ｍ進数Ｎ桁の符号値を含めることができる。これは、二進数で表すと、ｌｏｇ２ＭＮビットである。ただし、実施の形態１では、このビット列中に、伝送情報だけでなく、現在が何枚目の画像であるかを表すシーケンス番号などの制御情報と、伝送情報および制御情報の誤り訂正符号とを含めることとする。そのため、一枚の送信画像に含められる伝送情報の容量は、ｌｏｇ２ＭＮビットより小さくなる。 At this time, an M-digit N-digit code value can be included in one transmission image. This is expressed in binary, a log 2 M N bits. However, in the first embodiment, not only the transmission information but also control information such as a sequence number indicating the current image number, and transmission information and an error correction code of the control information are included in this bit string. Include. Therefore, the capacity of transmission information included in one transmission image is smaller than log 2 MN bits.
　送信制御部１４は、送信情報蓄積部１５から伝送情報を取得し、取得した伝送情報をｌｏｇ２ＭＮビットより小さい容量に分割し、一つ以上の分割伝送情報にする。そして、送信制御部１４は、各分割伝送情報に対して制御情報と誤り訂正符号とを付加する。図１３は、この発明の実施の形態１において一枚の送信画像に変換される伝送情報の例を示す図である。一枚の送信画像に変換される伝送情報７０には、制御情報７１、一つの分割伝送情報７２、および誤り訂正符号７３が含まれる。この伝送情報７０の容量は、ｌｏｇ２ＭＮビットである。 The transmission control unit 14 acquires transmission information from the transmission information storage unit 15, divides the acquired transmission information into a capacity smaller than log 2 MN bits, and makes one or more pieces of divided transmission information. Then, the transmission control unit 14 adds control information and an error correction code to each divided transmission information. FIG. 13 is a diagram showing an example of transmission information converted into one transmission image in the first embodiment of the present invention. The transmission information 70 converted into one transmission image includes control information 71, one piece of transmission information 72, and an error correction code 73. The capacity of this transmission information 70 is log 2 MN bits.
　送信制御部１４は、伝送情報７０をＭ進数Ｎ桁の符号値に変換し、一桁ごとに符号値に対応する代表送信輝度を決定し、一枚の送信画像を生成する。図１４は、この発明の実施の形態１における送信画像８０の例を示す図である。一枚の送信画像８０がＮ個のブロック８１に分割され、一つのブロック８１にはＭ階調のうちの一つの階調の輝度が割り当てられている。
　送信制御部１４は、通信部１１を通じた送受制御部１３からの指示タイミングに従い、生成した送信画像を順次表示制御部１６に与える。表示制御部１６は、送信制御部１４からの送信画像を順次表示部１７に表示させる。 The transmission control unit 14 converts the transmission information 70 into an M-ary N-digit code value, determines a representative transmission luminance corresponding to the code value for each digit, and generates one transmission image. FIG. 14 is a diagram showing an example of a transmission image 80 according to Embodiment 1 of the present invention. One transmission image 80 is divided into N blocks 81, and one block 81 is assigned a luminance of one of the M gradations.
The transmission control unit 14 sequentially provides the generated transmission images to the display control unit 16 according to the instruction timing from the transmission / reception control unit 13 through the communication unit 11. The display control unit 16 causes the display unit 17 to sequentially display the transmission images from the transmission control unit 14.
　ステップＳＴ３の受信状態にあるとき、撮像部２４は、通信部１１，２１および受信制御部２２を通じた送受制御部１３からの指示タイミングに従い、表示部１７に表示された送信画像を撮像し、画像データに変換し、画像解析部２５に与える。画像解析部２５は、送信画像の各ブロックに対応する各受信位置から受信輝度を抽出し、受信輝度に対応する代表送信輝度に割り当てられた符号値を得る。なお、画像解析部２５は、代表送信輝度とその符号値のリストを用いて、代表送信輝度に割り当てられた符号値を得ればよい。図１０の例において、画像解析部２５が抽出した受信輝度が３５だった場合、受信輝度３５を含む受信輝度３０～４０に対応する代表送信輝度４６に割り当てられた符号値が取得される。 When in the reception state of step ST3, the imaging unit 24 captures the transmission image displayed on the display unit 17 in accordance with the instruction timing from the transmission / reception control unit 13 through the communication units 11 and 21 and the reception control unit 22. The data is converted into data and given to the image analysis unit 25. The image analysis unit 25 extracts the reception luminance from each reception position corresponding to each block of the transmission image, and obtains a code value assigned to the representative transmission luminance corresponding to the reception luminance. Note that the image analysis unit 25 may obtain the code value assigned to the representative transmission luminance using the list of the representative transmission luminance and its code value. In the example of FIG. 10, when the reception luminance extracted by the image analysis unit 25 is 35, the code value assigned to the representative transmission luminance 46 corresponding to the reception luminances 30 to 40 including the reception luminance 35 is acquired.
　画像解析部２５は、一枚の送信画像から得た符号値Ｎ桁を二進数に変換し、誤り訂正を行って、制御情報と分割伝送情報とを復元する。この際、画像解析部２５は、誤り訂正符号を用いた誤り検出および誤り訂正も行う。 The image analysis unit 25 converts the code value N digits obtained from one transmission image into a binary number, performs error correction, and restores the control information and the divided transmission information. At this time, the image analysis unit 25 also performs error detection and error correction using an error correction code.
　受信制御部２２は、画像解析部２５により誤りが検出されなかった場合、または誤りが検出され訂正された場合、受信情報蓄積部２３における制御情報に対応する蓄積先に、復元した分割伝送情報を書き込む。一方、画像解析部２５により誤りが検出されたが訂正できなかった場合、つまり誤り訂正符号の情報量が足りず訂正能力が低い場合、受信制御部２２は、通信部２１，１１を通じて送信制御部１４に対し、送信画像の再送を要求する。 When no error is detected by the image analysis unit 25 or when an error is detected and corrected, the reception control unit 22 stores the restored divided transmission information in the storage destination corresponding to the control information in the reception information storage unit 23. Write. On the other hand, when an error is detected by the image analysis unit 25 but cannot be corrected, that is, when the information amount of the error correction code is insufficient and the correction capability is low, the reception control unit 22 transmits the transmission control unit through the communication units 21 and 11. 14 is requested to retransmit the transmission image.
　なお、図２の構成例では、入力部１２は表示装置１０に存在するが、通信路３０で接続された撮像装置２０内または車載装置４０内に存在してもよい。また、車載カメラシステム全体を制御する送受制御部１３は表示装置１０に存在するが、通信路３０で接続された撮像装置２０内または車載装置４０内に存在してもよい。即ち、入力部１２および送受制御部１３は、通信路３０を経由して表示装置１０および撮像装置２０との通信が可能であればよい。 In the configuration example of FIG. 2, the input unit 12 exists in the display device 10, but may exist in the imaging device 20 or the in-vehicle device 40 connected via the communication path 30. In addition, the transmission / reception control unit 13 that controls the entire in-vehicle camera system exists in the display device 10, but may exist in the imaging device 20 or the in-vehicle device 40 connected through the communication path 30. In other words, the input unit 12 and the transmission / reception control unit 13 only need to be able to communicate with the display device 10 and the imaging device 20 via the communication path 30.
　以上のように、実施の形態１に係る情報伝送方法は、撮像装置２０および表示装置１０が、撮像装置２０と表示装置１０とを接続する通信路３０を経由して設定情報を送受するステップと、表示装置１０が、設定情報に基づいて、設定情報の容量より大きい容量の伝送情報を一枚以上の画像に変換して表示するステップと、撮像装置２０が、設定情報に基づいて、表示装置１０により表示された一枚以上の画像を撮像して伝送情報に復元するステップとを備えるものである。通信路３０を経由した設定情報の送受によって撮像装置２０および表示装置１０の調整をすることで、最も大きい送信画像サイズ、最も高い解像度、および最も短い送信周期等による画像の送受が可能となる。したがって、一枚の画像に含めるデータ容量を大きくすることができ、伝送速度を大きくすることができる。 As described above, in the information transmission method according to the first embodiment, the imaging device 20 and the display device 10 transmit and receive setting information via the communication path 30 that connects the imaging device 20 and the display device 10. The display device 10 converts transmission information having a capacity larger than the capacity of the setting information into one or more images based on the setting information and displays the information, and the imaging device 20 displays the display device based on the setting information. And capturing one or more images displayed by 10 and restoring them to transmission information. By adjusting the imaging device 20 and the display device 10 by sending and receiving setting information via the communication path 30, it is possible to send and receive images with the largest transmission image size, the highest resolution, and the shortest transmission cycle. Therefore, the data capacity included in one image can be increased, and the transmission speed can be increased.
　また、実施の形態１によれば、撮像装置２０または表示装置１０の一方は、送受制御部１３を有する。そして、通信路３０を経由して設定情報を送受するステップＳＴ１において、送受制御部１３は、撮像された位置特定用の画像などに基づいて設定情報を調整して撮像装置２０または表示装置１０へ送信する。より具体的には、送受制御部１３が、表示装置１０へ設定情報を送信し、表示装置１０が、送受制御部１３により送信された設定情報に基づいた画像を表示し、撮像装置２０が、表示装置１０により表示された画像を撮像して特徴情報を生成して送受制御部１３へ送信し、送受制御部１３が、撮像装置２０により送信された画像の特徴情報に基づいて、調整が不十分と判断した場合に設定情報を調整して撮像装置２０または表示装置１０へ送信する。このように、撮像装置２０および表示装置１０が通信路３０を通じてネゴシエーションを行うため、撮像装置２０および表示装置１０の設定を自動化できる。そのため、画像処理プログラム更新時の表示装置１０の設置等が容易である。 Further, according to the first embodiment, one of the imaging device 20 or the display device 10 includes the transmission / reception control unit 13. And in step ST1 which transmits / receives setting information via the communication path 30, the transmission / reception control part 13 adjusts setting information based on the image for position specification etc. which were imaged, etc., to the imaging device 20 or the display apparatus 10. Send. More specifically, the transmission / reception control unit 13 transmits setting information to the display device 10, the display device 10 displays an image based on the setting information transmitted by the transmission / reception control unit 13, and the imaging device 20 An image displayed by the display device 10 is captured to generate feature information and transmitted to the transmission / reception control unit 13, and the transmission / reception control unit 13 has no adjustment based on the feature information of the image transmitted by the imaging device 20. When it is determined that the setting is sufficient, the setting information is adjusted and transmitted to the imaging device 20 or the display device 10. As described above, since the imaging device 20 and the display device 10 negotiate through the communication path 30, the settings of the imaging device 20 and the display device 10 can be automated. Therefore, it is easy to install the display device 10 when updating the image processing program.
　また、実施の形態１によれば、設定情報は、ステップＳＴ２において、表示装置１０に対して、次の画像に表示を切り替えるよう指示するものである。これにより、表示装置１０および撮像装置２０の位置を変えずに、複数の画像を伝送することができ、伝送の時間間隔を短くできる。
　一方、例えば特許文献１に係る発明では、二次元コードが印刷された紙、または二次元コードを読み込む携帯端末の位置を移動する必要があるため、伝送の時間間隔が長い。 Further, according to the first embodiment, the setting information instructs the display device 10 to switch the display to the next image in step ST2. Accordingly, a plurality of images can be transmitted without changing the positions of the display device 10 and the imaging device 20, and the transmission time interval can be shortened.
On the other hand, for example, in the invention according to Patent Document 1, since it is necessary to move the position of the paper on which the two-dimensional code is printed or the portable terminal that reads the two-dimensional code, the transmission time interval is long.
　また、実施の形態１によれば、設定情報は、ステップＳＴ１において、表示装置１０に対して、画像を表示する範囲、明るさ、解像度、階調、または画像の表示を切り替える周期のうちの少なくとも一つを指示するものである。これにより、通信路３０を通じてネゴシエーションを自動的に行うことができ、画像処理プログラム更新時の表示装置１０の設置等が容易である。 Further, according to the first embodiment, the setting information is at least one of the range for displaying the image, the brightness, the resolution, the gradation, or the cycle for switching the image display on the display device 10 in step ST1. One is instructed. Thereby, the negotiation can be automatically performed through the communication path 30, and the installation of the display device 10 when the image processing program is updated is easy.
　また、実施の形態１に係る車載カメラシステムは、表示装置１０と、車両に搭載されている撮像装置２０とを備える。表示装置１０は、撮像装置２０と表示装置１０とを接続する通信路３０を経由して送受される設定情報に基づいて、設定情報の容量より大きい容量の伝送情報を一枚以上の画像に変換して表示する。撮像装置２０は、通信路３０を経由して送受される設定情報に基づいて、表示装置１０により表示された一枚以上の画像を撮像して伝送情報に復元する。この構成により、通信路３０を経由した設定情報の送受によって一枚の画像に含めるデータ容量を大きくすることができ、伝送速度を大きくすることができる。 Further, the in-vehicle camera system according to Embodiment 1 includes a display device 10 and an imaging device 20 mounted on the vehicle. The display device 10 converts transmission information having a capacity larger than the capacity of the setting information into one or more images based on the setting information transmitted / received via the communication path 30 connecting the imaging device 20 and the display device 10. And display. The imaging device 20 captures one or more images displayed by the display device 10 based on the setting information transmitted / received via the communication path 30, and restores the transmission information. With this configuration, it is possible to increase the data capacity included in one image by transmitting / receiving setting information via the communication path 30 and increase the transmission speed.
　また、実施の形態１に係る車載カメラシステムは、撮像装置２０と表示装置１０との間に、撮像装置２０と表示装置１０との距離を短縮する光学装置６０を備える構成であってもよい。この構成によれば、車載カメラシステムを小型にすることができる。 Further, the in-vehicle camera system according to Embodiment 1 may be configured to include the optical device 60 that shortens the distance between the imaging device 20 and the display device 10 between the imaging device 20 and the display device 10. According to this structure, a vehicle-mounted camera system can be reduced in size.
　なお、本発明はその発明の範囲内において、実施の形態の任意の構成要素の変形、または実施の形態の任意の構成要素の省略が可能である。 In the present invention, any component of the embodiment can be modified or any component of the embodiment can be omitted within the scope of the invention.
　この発明に係る情報伝送方法は、低速な通信路で接続された表示装置から撮像装置へ、画像を用いて大量の情報を伝送するようにしたので、車載カメラシステムにおける撮像装置のプログラム更新などに用いるのに適している。 In the information transmission method according to the present invention, a large amount of information is transmitted using an image from a display device connected via a low-speed communication path to the imaging device. Suitable for use.
　１０　表示装置、１１　通信部、１２　入力部、１３　送受制御部、１４　送信制御部、１５　送信情報蓄積部、１６　表示制御部、１７　表示部、２０　撮像装置、２１　通信部、２２　受信制御部、２３　受信情報蓄積部、２４　撮像部、２５　画像解析部、３０　通信路、４０　車載装置、５０　固定具、６０　光学装置、７０　伝送情報、７１　制御情報、７２　分割伝送情報、７３　誤り訂正符号、８０　送信画像、８１　ブロック、１０１　ディスプレイ、１０２，２０２　通信装置、１０３，２０３　プロセッサ、１０４，２０４　メモリ、１０５　入力装置、２０１　カメラ。 10 display device, 11 communication unit, 12 input unit, 13 transmission / reception control unit, 14 transmission control unit, 15 transmission information storage unit, 16 display control unit, 17 display unit, 20 imaging device, 21 communication unit, 22 reception control unit, 23 reception information storage unit, 24 imaging unit, 25 image analysis unit, 30 communication path, 40 in-vehicle device, 50 fixture, 60 optical device, 70 transmission information, 71 control information, 72 divided transmission information, 73 error correction code, 80 Transmission image, 81 block, 101 display, 102, 202 communication device, 103, 203 processor, 104, 204 memory, 105 input device, 201 camera.

Claims (7)

  1. 　撮像装置および表示装置が、前記撮像装置と前記表示装置とを接続する通信路を経由して設定情報を送受するステップと、
    　前記表示装置が、前記設定情報に基づいて、前記設定情報の容量より大きい容量の伝送情報を一枚以上の画像に変換して表示するステップと、
    　前記撮像装置が、前記設定情報に基づいて、前記表示装置により表示された前記一枚以上の画像を撮像して前記伝送情報に復元するステップとを備える情報伝送方法。     An imaging device and a display device transmitting and receiving setting information via a communication path connecting the imaging device and the display device;
    The display device, based on the setting information, converting transmission information having a capacity larger than the capacity of the setting information into one or more images and displaying the information;
    An information transmission method comprising: the imaging device capturing the one or more images displayed by the display device based on the setting information and restoring the images to the transmission information.
  2. 　前記撮像装置または前記表示装置の一方は、送受制御部を有し、
    　前記通信路を経由して前記設定情報を送受する場合に、前記送受制御部が、撮像された画像に基づいて前記設定情報を調整して前記撮像装置または前記表示装置へ送信することを特徴とする請求項１記載の情報伝送方法。     One of the imaging device or the display device has a transmission / reception control unit,
    When transmitting / receiving the setting information via the communication path, the transmission / reception control unit adjusts the setting information based on a captured image and transmits the adjusted setting information to the imaging device or the display device. The information transmission method according to claim 1.
  3. 　前記通信路を経由して前記設定情報を送受する場合に、
    　前記送受制御部が、前記表示装置へ前記設定情報を送信し、
    　前記表示装置が、前記送受制御部により送信された前記設定情報に基づいた画像を表示し、
    　前記撮像装置が、前記表示装置により表示された前記画像を撮像して前記画像の特徴情報を生成して前記送受制御部へ送信し、
    　前記送受制御部が、前記撮像装置により送信された前記画像の特徴情報に基づいて、調整が不十分と判断した場合に前記設定情報を調整して前記撮像装置または前記表示装置へ送信することを特徴とする請求項２記載の情報伝送方法。     When sending and receiving the setting information via the communication path,
    The transmission / reception control unit transmits the setting information to the display device,
    The display device displays an image based on the setting information transmitted by the transmission / reception control unit;
    The imaging device captures the image displayed by the display device, generates feature information of the image, and transmits the feature information to the transmission / reception control unit,
    When the transmission / reception control unit determines that the adjustment is insufficient based on the feature information of the image transmitted by the imaging device, the setting information is adjusted and transmitted to the imaging device or the display device. The information transmission method according to claim 2, wherein:
  4. 　前記設定情報は、前記表示装置に対して、次の画像に表示を切り替えるよう指示するものであることを特徴とする請求項１記載の情報伝送方法。 The information transmission method according to claim 1, wherein the setting information instructs the display device to switch the display to the next image.
  5. 　前記設定情報は、前記表示装置に対して、画像を表示する範囲、明るさ、解像度、階調、または画像の表示を切り替える周期のうちの少なくとも一つを指示するものであることを特徴とする請求項１記載の情報伝送方法。 The setting information instructs the display device at least one of an image display range, brightness, resolution, gradation, or a cycle for switching image display. The information transmission method according to claim 1.
  6. 　表示装置と、車両に搭載されている撮像装置とを備え、
    　前記表示装置は、前記撮像装置と前記表示装置とを接続する通信路を経由して送受される設定情報に基づいて、前記設定情報の容量より大きい容量の伝送情報を一枚以上の画像に変換して表示し、
    　前記撮像装置は、前記通信路を経由して送受される前記設定情報に基づいて、前記表示装置により表示された前記一枚以上の画像を撮像して前記伝送情報に復元することを特徴とする車載カメラシステム。     A display device and an imaging device mounted on the vehicle;
    The display device converts transmission information having a capacity larger than the capacity of the setting information into one or more images based on setting information transmitted / received via a communication path connecting the imaging device and the display device. And display
    The imaging device captures the one or more images displayed by the display device based on the setting information transmitted / received via the communication path and restores the transmission information to the transmission information. In-vehicle camera system.
  7. 　前記撮像装置と前記表示装置との間に、前記撮像装置と前記表示装置との距離を短縮する光学装置を備えることを特徴とする請求項６記載の車載カメラシステム。 The in-vehicle camera system according to claim 6, further comprising an optical device that shortens a distance between the imaging device and the display device between the imaging device and the display device.
PCT/JP2016/085330 2016-11-29 2016-11-29 Information transmission method and on-board camera system WO2018100614A1 (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
PCT/JP2016/085330 WO2018100614A1 (en) 2016-11-29 2016-11-29 Information transmission method and on-board camera system

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
PCT/JP2016/085330 WO2018100614A1 (en) 2016-11-29 2016-11-29 Information transmission method and on-board camera system

Publications (1)

Publication Number Publication Date
WO2018100614A1 true WO2018100614A1 (en) 2018-06-07

Family

ID=62242387

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/JP2016/085330 WO2018100614A1 (en) 2016-11-29 2016-11-29 Information transmission method and on-board camera system

Country Status (1)

Country Link
WO (1) WO2018100614A1 (en)

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2023181206A1 (en) * 2022-03-23 2023-09-28 ファナック株式会社 Robot programming system and robot control device

Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2005309756A (en) * 2004-04-21 2005-11-04 Mitsubishi Electric Corp Information transfer system, information conversion apparatus, information reproduction device and display device
JP2007028575A (en) * 2005-07-19 2007-02-01 Vimicro Corp Two-dimensional code image transmission system and two-dimensional code image transmission rate control method
JP2007034625A (en) * 2005-07-26 2007-02-08 Aruze Corp Information display device
JP2009163632A (en) * 2008-01-09 2009-07-23 Aplix Corp Data providing system, data providing apparatus, and content manufacturing method
JP2014216734A (en) * 2013-04-24 2014-11-17 日立マクセル株式会社 Imaging apparatus and imaging system

Patent Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2005309756A (en) * 2004-04-21 2005-11-04 Mitsubishi Electric Corp Information transfer system, information conversion apparatus, information reproduction device and display device
JP2007028575A (en) * 2005-07-19 2007-02-01 Vimicro Corp Two-dimensional code image transmission system and two-dimensional code image transmission rate control method
JP2007034625A (en) * 2005-07-26 2007-02-08 Aruze Corp Information display device
JP2009163632A (en) * 2008-01-09 2009-07-23 Aplix Corp Data providing system, data providing apparatus, and content manufacturing method
JP2014216734A (en) * 2013-04-24 2014-11-17 日立マクセル株式会社 Imaging apparatus and imaging system

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2023181206A1 (en) * 2022-03-23 2023-09-28 ファナック株式会社 Robot programming system and robot control device

Similar Documents

Publication Publication Date Title
US10554880B2 (en) Image processing system, imaging apparatus, image processing method, and computer-readable storage medium
US8493467B2 (en) Camera control apparatus, camera control method, and camera system
CN107786813B (en) Multifunction camera imaging control system
JP5414910B2 (en) Display unit, imaging unit, and display system apparatus
US20110050927A1 (en) Information processing apparatus and control method therefor
CN101340566A (en) Image processing system and method
CN111083458B (en) Brightness correction method, system, equipment and computer readable storage medium
CN109905594B (en) Method of providing image and electronic device for supporting the same
US8996577B2 (en) Object information provision device, object information provision system, terminal, and object information provision method
US20030156073A1 (en) Apparatus for adjusting proximate video monitors to output substantially identical video images and corresponding methods therefor
JP4793449B2 (en) Network video composition display system
WO2018100614A1 (en) Information transmission method and on-board camera system
JP2020194998A (en) Control arrangement, projection system, control method, program and storage medium
CN105354813A (en) Method and device for driving pan-tilt-zoom (PTZ) to generate spliced image
US8848237B2 (en) Wireless scanning device and method for scanning and transmitting scan data
US20190073558A1 (en) Information processing apparatus, information processing method, and computer program
JP6091133B2 (en) Projection type display device, control method used therefor, and program
CN107147901A (en) A kind of sensor calibration method, device, equipment and storage medium
US11064103B2 (en) Video image transmission apparatus, information processing apparatus, system, information processing method, and recording medium
CN108174058B (en) A kind of multifunction camera image formation control method
JP2008244950A (en) Remote operation apparatus and video display system
WO2018066161A1 (en) Display device, control device, and multi-display system
JP2020184724A (en) Communication system, mobile terminal, on-vehicle device and communication program
CN115909427A (en) Page display method and device, integrated circuit and equipment
JP2020088430A (en) Image display system, server, display device, control method of server, and control method of display device

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 16922895

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

NENP Non-entry into the national phase

Ref country code: JP

122 Ep: pct application non-entry in european phase

Ref document number: 16922895

Country of ref document: EP

Kind code of ref document: A1