WO2023058465A1 - 情報処理システムおよび情報処理方法 - Google Patents
情報処理システムおよび情報処理方法 Download PDFInfo
- Publication number
- WO2023058465A1 WO2023058465A1 PCT/JP2022/035333 JP2022035333W WO2023058465A1 WO 2023058465 A1 WO2023058465 A1 WO 2023058465A1 JP 2022035333 W JP2022035333 W JP 2022035333W WO 2023058465 A1 WO2023058465 A1 WO 2023058465A1
- Authority
- WO
- WIPO (PCT)
- Prior art keywords
- unit
- vertical blanking
- video
- period
- control
- Prior art date
Links
- 230000010365 information processing Effects 0.000 title claims abstract description 65
- 238000003672 processing method Methods 0.000 title claims abstract description 8
- 238000003384 imaging method Methods 0.000 claims description 61
- 238000000034 method Methods 0.000 claims description 50
- 238000005096 rolling process Methods 0.000 claims description 8
- 239000011159 matrix material Substances 0.000 claims description 7
- 238000005516 engineering process Methods 0.000 abstract description 19
- 238000012545 processing Methods 0.000 description 96
- 238000010586 diagram Methods 0.000 description 65
- 230000005540 biological transmission Effects 0.000 description 25
- 238000004891 communication Methods 0.000 description 22
- 238000009826 distribution Methods 0.000 description 14
- 238000003491 array Methods 0.000 description 11
- 230000006870 function Effects 0.000 description 7
- 238000003860 storage Methods 0.000 description 6
- 230000007274 generation of a signal involved in cell-cell signaling Effects 0.000 description 5
- 238000007796 conventional method Methods 0.000 description 4
- 230000003287 optical effect Effects 0.000 description 4
- 238000004519 manufacturing process Methods 0.000 description 3
- 230000004044 response Effects 0.000 description 3
- 230000001360 synchronised effect Effects 0.000 description 3
- 230000006866 deterioration Effects 0.000 description 2
- 230000000694 effects Effects 0.000 description 2
- 239000004065 semiconductor Substances 0.000 description 2
- 241000872198 Serjania polyphylla Species 0.000 description 1
- 230000000295 complement effect Effects 0.000 description 1
- 238000012937 correction Methods 0.000 description 1
- 230000007423 decrease Effects 0.000 description 1
- 229910044991 metal oxide Inorganic materials 0.000 description 1
- 150000004706 metal oxides Chemical class 0.000 description 1
- 238000012986 modification Methods 0.000 description 1
- 230000004048 modification Effects 0.000 description 1
- 230000000750 progressive effect Effects 0.000 description 1
- 238000004904 shortening Methods 0.000 description 1
- 230000000007 visual effect Effects 0.000 description 1
Images
Classifications
-
- G—PHYSICS
- G09—EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
- G09G—ARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION
- G09G5/00—Control arrangements or circuits for visual indicators common to cathode-ray tube indicators and other visual indicators
- G09G5/12—Synchronisation between the display unit and other units, e.g. other display units, video-disc players
-
- G—PHYSICS
- G09—EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
- G09G—ARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION
- G09G3/00—Control arrangements or circuits, of interest only in connection with visual indicators other than cathode-ray tubes
- G09G3/20—Control arrangements or circuits, of interest only in connection with visual indicators other than cathode-ray tubes for presentation of an assembly of a number of characters, e.g. a page, by composing the assembly by combination of individual elements arranged in a matrix no fixed position being assigned to or needed to be assigned to the individual characters or partial characters
-
- G—PHYSICS
- G09—EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
- G09G—ARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION
- G09G3/00—Control arrangements or circuits, of interest only in connection with visual indicators other than cathode-ray tubes
- G09G3/20—Control arrangements or circuits, of interest only in connection with visual indicators other than cathode-ray tubes for presentation of an assembly of a number of characters, e.g. a page, by composing the assembly by combination of individual elements arranged in a matrix no fixed position being assigned to or needed to be assigned to the individual characters or partial characters
- G09G3/22—Control arrangements or circuits, of interest only in connection with visual indicators other than cathode-ray tubes for presentation of an assembly of a number of characters, e.g. a page, by composing the assembly by combination of individual elements arranged in a matrix no fixed position being assigned to or needed to be assigned to the individual characters or partial characters using controlled light sources
- G09G3/30—Control arrangements or circuits, of interest only in connection with visual indicators other than cathode-ray tubes for presentation of an assembly of a number of characters, e.g. a page, by composing the assembly by combination of individual elements arranged in a matrix no fixed position being assigned to or needed to be assigned to the individual characters or partial characters using controlled light sources using electroluminescent panels
- G09G3/32—Control arrangements or circuits, of interest only in connection with visual indicators other than cathode-ray tubes for presentation of an assembly of a number of characters, e.g. a page, by composing the assembly by combination of individual elements arranged in a matrix no fixed position being assigned to or needed to be assigned to the individual characters or partial characters using controlled light sources using electroluminescent panels semiconductive, e.g. using light-emitting diodes [LED]
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
- H04N23/60—Control of cameras or camera modules
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
- H04N23/70—Circuitry for compensating brightness variation in the scene
- H04N23/73—Circuitry for compensating brightness variation in the scene by influencing the exposure time
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N5/00—Details of television systems
- H04N5/222—Studio circuitry; Studio devices; Studio equipment
- H04N5/262—Studio circuits, e.g. for mixing, switching-over, change of character of image, other special effects ; Cameras specially adapted for the electronic generation of special effects
- H04N5/272—Means for inserting a foreground image in a background image, i.e. inlay, outlay
-
- G—PHYSICS
- G09—EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
- G09G—ARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION
- G09G2300/00—Aspects of the constitution of display devices
- G09G2300/02—Composition of display devices
- G09G2300/026—Video wall, i.e. juxtaposition of a plurality of screens to create a display screen of bigger dimensions
-
- G—PHYSICS
- G09—EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
- G09G—ARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION
- G09G2310/00—Command of the display device
- G09G2310/08—Details of timing specific for flat panels, other than clock recovery
Definitions
- the present technology relates to an information processing system and an information processing method, and more particularly to an information processing system and an information processing method that can prevent the occurrence of a black band when capturing an image of a display unit.
- a black belt is a belt-like area with lower luminance than other areas, and the color of the black belt is black with various densities.
- An information processing system is an information processing system including a control unit that controls a vertical blanking period of an image displayed on a display unit based on an exposure time of an image capturing unit that captures an image of the display unit. .
- the information processing system may be an independent device, may be a module incorporated in another device, or may be composed of a plurality of devices.
- FIG. 3 is a block diagram showing a detailed configuration example of a display unit;
- FIG. FIG. 4 is a diagram showing a configuration example of an LED array; It is a figure explaining the light emission operation
- FIG. 4 is a diagram for explaining the light emission cycle of an LED array; It is a figure explaining the cause which a black belt generate
- FIG. 10 is a diagram showing an example of a re-captured video in which black bars have occurred; It is a figure explaining control of the refresh rate by a control part.
- FIG. 5 is a flowchart for explaining imaging processing of the video camera of FIG. 4;
- FIG. 5 is a flowchart for explaining imaging processing of the video camera of FIG. 4;
- FIG. 5 is a flowchart for explaining imaging processing of the video camera of FIG. 4;
- FIG. 10 is a diagram illustrating an example of a re-capturing system that reduces the visibility of a black band using a conventional method
- FIG. 10 is a diagram showing an example of a re-captured image in which visibility of a black belt is lowered
- FIG. 11 is a diagram illustrating a configuration example of a second embodiment of a re-capturing system to which the present technology is applied
- 4 is a block diagram showing a configuration example of a vertical blanking period control unit;
- FIG. 10 is a diagram illustrating an example of a re-capturing system that reduces the visibility of a black band using a conventional method
- FIG. 10 is a diagram showing an example of a re-captured image in which visibility of a black belt is lowered
- FIG. 11 is a diagram illustrating a configuration example of a second embodiment of a re-capturing system to which the present technology is applied
- 4 is a block diagram showing a configuration example of a vertical blanking period control unit;
- First Embodiment Configuration Example of Re-shooting System Controlling Refresh Rate
- Second embodiment configuration example of a re-imaging system that also controls the vertical blanking period
- Third Embodiment Configuration example of a re-imaging system considering the case where the vertical blanking period is included in the exposure period
- the re-capturing system 10 (information processing system) includes a video camera 11, a video wall 12, a video server 61, a PC (personal computer) 62, and a video wall controller 63.
- the video wall 12 is a large LED display in which n (n is a positive integer) display units (cabinets) 41-1 to 41-n are arranged in a tiled manner.
- FIG. 3 illustrates the case where n is 6 ⁇ 24.
- the display units 41-1 to 41-n are simply referred to as the display unit 41 when there is no need to distinguish them individually.
- the display unit 41 includes m (m is a positive integer) LED arrays 51-1 to 51-m in which LEDs (not shown) corresponding to each pixel are arranged in a matrix (two-dimensional array). It is configured by arranging it in a tile shape.
- FIG. 3 illustrates a case where m is 4 ⁇ 3.
- the LED arrays 51-1 to 51-m are simply referred to as the LED array 51 when there is no need to distinguish them individually.
- Each display unit 41 of the video wall 12 is connected to the video wall controller 63. Based on the frame-by-frame video signal supplied from the video wall controller 63 and the display control signal for controlling the display of the video wall 12, the video wall 12 displays the video corresponding to the video signal in frame units. Specifically, the video signal supplied to each display unit 41 is a video signal corresponding to the position of the display unit 41 on the video wall 12 . Each display unit 41 displays an image based on the image signal according to the display control signal, thereby displaying one frame of image on the entire video wall 12 .
- the video server 61 is composed of, for example, a server computer, and supplies the video wall controller 63 with frame-by-frame video signals such as video content.
- a recording medium such as a PC or a BD (Blu-ray Disc) (registered trademark) may provide the video wall controller 63 with a frame-by-frame video signal.
- the PC 62 (information processing system) is a general-purpose computer.
- the PC 62 controls the video wall controller 63 by generating control commands for controlling the video wall controller 63 and transmitting them to the video wall controller 63 .
- the PC 62 acquires the exposure time transmitted from the video camera 11.
- the PC 62 determines the refresh rate of the video wall 12 so that the exposure time and the light emission cycle of the LEDs of the video wall 12 correspond.
- the refresh rate is the number of times an LED emits light in one second.
- the PC 62 controls the refresh rate by sending a refresh rate command, which is a control command representing the determined refresh rate, to the video wall controller 63 .
- the video wall controller 63 and the video wall 12 may be integrated, or may be a display device in which they are integrated.
- the PC 62, the video wall controller 63, and the video wall 12 may have an integrated configuration, or may be a display device in which these are integrated.
- the video camera 11 in FIG. 4 is composed of an input section 81, a setting section 82, a driving section 83, an optical system 84, a photographing section 85, a signal processing section 86, a monitor 87, an image output section 88, and a memory 89.
- the setting unit 82 Based on the input signal from the input unit 81, the setting unit 82 sets shooting information, which is various information related to shooting such as the exposure time represented by the input signal.
- the setting unit 82 supplies shooting information to the drive unit 83 and also transmits the exposure time in the shooting information to the PC 62 via a cable such as a coaxial cable.
- the optical system 84 is configured with one or more lenses, guides light (incident light) from a subject or the like to the photographing unit 85, and forms an image on the light receiving surface of the photographing unit 85.
- the imaging unit 85 is configured by a CMOS (Complementary Metal Oxide Semiconductor) image sensor or the like.
- the photographing unit 85 drives each pixel unit according to the driving signal supplied from the driving unit 83, and performs photographing by the rolling shutter method. Specifically, the imaging unit 85 outputs an electric signal corresponding to the charge accumulated in each pixel unit in units of rows according to the driving signal supplied from the driving unit 83 . Then, the imaging unit 85 starts accumulating electric charges corresponding to the light incident on each pixel unit via the optical system 84 on a row-by-row basis.
- CMOS Complementary Metal Oxide Semiconductor
- the photographing unit 85 reads, row by row, electrical signals corresponding to the charges accumulated for the exposure time set by the setting unit 82 in accordance with the driving signal supplied from the driving unit 83, and transmits the electric signals to the signal processing unit 86 in units of columns. Forward. As described above, the imaging unit 85 performs imaging with the exposure time set by the setting unit 82 .
- the signal processing unit 86 performs various kinds of signal processing on the electric signal corresponding to the electric charge transferred from the imaging unit 85, and converts it into a frame-by-frame video signal in a predetermined digital video format.
- This frame-by-frame video signal is supplied to the monitor 87 and the video output unit 88, or supplied to the memory 89 to be stored (recorded).
- the monitor 87 displays video in units of frames based on the video signal in units of frames supplied from the signal processing unit 86 .
- the video output unit 88 outputs the frame-by-frame video signal supplied from the signal processing unit 86 to the outside of the video camera 11 .
- FIG. 5 is a block diagram showing a hardware configuration example of the PC 62 in FIG.
- a CPU Central Processing Unit
- ROM Read Only Memory
- RAM Random Access Memory
- An input/output interface 105 is further connected to the bus 104 .
- Input unit 106 , output unit 107 , storage unit 108 , communication unit 109 , and drive 110 are connected to input/output interface 105 .
- the input unit 106 consists of a keyboard, mouse, microphone, and the like.
- the output unit 107 includes a display, a speaker, and the like.
- the storage unit 108 is composed of a hard disk, a nonvolatile memory, or the like.
- a communication unit 109 includes a network interface and the like.
- a drive 110 drives a removable medium 111 such as a magnetic disk, optical disk, magneto-optical disk, or semiconductor memory.
- the CPU 101 loads, for example, a program stored in the storage unit 108 into the RAM 103 via the input/output interface 105 and the bus 104 and executes it, thereby performing various processes. I do.
- the CPU 101 performs refresh rate control processing to control the communication unit 109 to generate a refresh rate command and transmit the refresh rate to the video wall controller 63 .
- the program executed by the PC 62 can be provided by being recorded on removable media 111 such as package media, for example. Also, the program can be provided via a wired or wireless transmission medium such as a local area network, the Internet, or digital satellite broadcasting.
- the program can be installed in the storage unit 108 via the input/output interface 105 by mounting the removable medium 111 in the drive 110 . Also, the program can be received by the communication unit 109 and installed in the storage unit 108 via a wired or wireless transmission medium. In addition, the program can be installed in the ROM 102 or the storage unit 108 in advance.
- the program executed by the PC 62 may be a program that is processed in chronological order according to the order described in this specification, or may be executed in parallel or at a necessary timing such as when a call is made. It may be a program in which processing is performed.
- FIG. 6 is a block diagram showing a functional configuration example of the CPU 101 in FIG. 5 when the CPU 101 performs refresh rate control processing.
- the refresh rate control unit 130 is composed of an acquisition unit 131 , a control unit 132 and a transmission control unit 133 .
- the acquisition unit 131 acquires the exposure time transmitted from the setting unit 82 of the video camera 11 and received via the communication unit 109 .
- the acquisition unit 131 supplies the exposure time to the control unit 132 .
- the transmission control unit 133 supplies the refresh rate command supplied from the control unit 132 to the communication unit 109 and instructs transmission of the refresh rate command to the video wall controller 63 .
- the communication unit 109 transmits (outputs) the refresh rate command to the video wall controller 63 via a cable such as a LAN (Local Area Network) cable.
- the video wall controller 63 includes a LAN terminal 151, an HDMI (High Definition Multimedia Interface) (registered trademark) terminal 152, a DP (Display Port) terminal 153, a DVI (Digital Visual Interface) terminal 154, a network IF (Interface) 155, an MPU ( 156, a signal input IF 157, a signal processing section 158, a DRAM (Dynamic Random Access Memory) 159, a distribution section 160, and signal output IFs 161-1 to 161-n.
- HDMI High Definition Multimedia Interface
- DP Display Port
- DVI Digital Visual Interface
- MPU 156
- a signal input IF 157 a signal processing section 158
- DRAM Dynamic Random Access Memory
- the MPU 156 generates a display control signal according to the refresh rate command supplied via the network IF 155.
- the MPU 156 also generates a video adjustment signal for instructing adjustment of the video signal according to a video adjustment command, which is a control command relating to adjustment of the video signal supplied via the network IF 155 .
- the MPU 156 supplies the display control signal and adjustment signal to the signal processing section 158 .
- the video server 61 and the HDMI terminal 152 are connected, but the HDMI terminal 152, the DP terminal 153, and the DVI terminal 154 are all different only in standards, and are basically the same. Since they are provided with functions, one of them is selected and connected as required.
- the signal input IF 157 converts the frame-by-frame video signal supplied from the HDMI terminal 152 into a frame-by-frame video signal in a predetermined video format, and supplies the frame-by-frame video signal to the signal processing unit 158 .
- the signal processing unit 158 While exchanging data with the DRAM 159 as necessary, the signal processing unit 158 converts the frame-by-frame video signal supplied via the signal input IF 157 into a video signal based on the video adjustment signal supplied from the MPU 156 . Perform the necessary signal processing for the entire wall 12 . Specifically, the signal processing unit 158 adjusts the color temperature, contrast, brightness, etc. of the video signal based on the video adjustment signal. The signal processing unit 158 supplies the adjusted frame-by-frame video signal and the display control signal supplied from the MPU 156 to the distribution unit 160 .
- control command is automatically transmitted from the PC 62 , it may be transmitted in response to a request from the video wall controller 63 .
- FIG. 8 is a block diagram showing a detailed configuration example of the display unit 41. As shown in FIG. 8
- the signal input IF 211 receives frame-by-frame video signals and display control signals transmitted from the video wall controller 63 and supplies them to the signal processing unit 212 .
- the signal output IF 214 transmits the display signal and the display control signal supplied from the signal processing section 212 to the LED block 192 .
- the LED block 192 is composed of LED drivers 221-1 to 221-m and LED arrays 51-1 to 51-m.
- the LED drivers 221-1 to 221-m are connected to the signal output IFs 214-1 to 214-m of the driver control section 191, respectively, and are also connected to the LED arrays 51-1 to 51-m, respectively.
- the LED drivers 221-1 through 221-m are simply referred to as the LED drivers 221 when there is no need to distinguish them individually.
- the LED driver 221 controls the light emission of each LED constituting the LED array 51 connected to itself by PWM (Pulse Width Modulation). By doing so, each LED 241 is driven.
- the LED driver 221 is a digital signal such that each LED 241 of the LED array 51 emits light at a refresh rate represented by the display control signal per second with an intensity based on the display signal corresponding to that LED 241 .
- a PWM signal is generated and supplied to each LED 241 .
- an image corresponding to the position of the LED array 51 on the video wall 12 is displayed on the LED array 51 among the images corresponding to the frame-by-frame video signal output from the video server 61 .
- FIG. 9 is a diagram showing a configuration example of the LED array 51 of FIG.
- light emission of the LED array 51 is controlled by a passive matrix driving method.
- a luminance control wiring 251 is provided for each column of the LEDs 241, and the same luminance control wiring 251 is connected to the LEDs 241 in each column.
- a row selection wiring 252 is provided for each row of the LEDs 241, and the same row selection wiring 252 is connected to the LEDs 241 in each row.
- the LED driver 221 Based on the display control signal supplied from the signal output IF 214, the LED driver 221 adjusts the light emission timing of the LEDs 241 in each row so that the LEDs 241 emit light in each row at a light emission cycle corresponding to the refresh rate represented by the display control signal. to control.
- the LED driver 221 Based on the frame-by-frame display signal supplied from the signal output IF 214 , the LED driver 221 also outputs the PWM signal of each LED 241 in each row at the light emission timing of the LED 241 in each row to the luminance control wiring corresponding to the column of the LED 241 . Enter 251.
- each LED 241 in each row emits light with luminance based on the display signal of that LED 241 at the light emission timing of the LEDs 241 in each row.
- the image corresponding to the image signal is displayed row by row in order from the top row, and this image is refreshed (updated) by the refresh rate per second.
- the LED drivers 221 control the LEDs 241 in the first row from the top to emit light with luminance corresponding to the display signal.
- the LEDs 241 in the second row from the top emit light with a luminance corresponding to the display signal.
- the row of LEDs 241 to be illuminated descends in order, and as shown in FIG.
- the video corresponding to the position of the LED array 51 on the video wall 12 is displayed on the LED array 51 among the video corresponding to the video signal for one frame. This is referred to herein as one scan.
- the LEDs 241 in the first row from the top again emit light with a luminance corresponding to the display signal, as shown in A of FIG. After that, the light emission of the LEDs 241 in row units is repeated in the same manner, and scanning is performed at the refresh rate in one second.
- the refresh rate represented by the display control signal is 3840 Hz and the frame rate of the video signal is 60p (60 frames/second of the progressive system, ie, 60 Hz)
- FIG. 11 is a diagram for explaining the light emission period of the LED array 51. As shown in FIG. 11
- the LED array 51 is composed of 15 ⁇ 15 LEDs 241 .
- the horizontal axis represents the elapsed time since the display on the video wall 12 started, and the vertical axis represents the rows of the LED array 51 .
- the i-th row from the top of the LED array 51 is written as row #i.
- the rectangles in the graph of FIG. 11 indicate that the LEDs 241 in the row corresponding to the vertical position emit light with the luminance corresponding to the display signal during the elapsed time corresponding to the horizontal position of the rectangle.
- the LED array 51 As shown in FIG. 11, in the LED array 51, light is emitted row by row in order from the LEDs 241 in the upper row.
- the cycle of this one scan is the light emission cycle of the LED 241, which is the reciprocal of the refresh rate. For example, if the refresh rate is 3840Hz, the light emission period is 1/3840 seconds.
- 12A and 12B are diagrams for explaining the cause of occurrence of black bands in images re-captured by the re-capture system when the exposure time is not an integral multiple of the light emission period of the LED.
- the horizontal axis represents the elapsed time since the display started
- the vertical axis represents the row of LEDs
- the number of rows of LEDs forming the LED array is 15, and three LED arrays arranged in the row direction (vertical direction) are shown.
- the patterned squares indicate that the LEDs in the row corresponding to the vertical position of the square emit light during the elapsed time corresponding to the horizontal position of the square.
- the pattern of the squares is different for each LED array that includes LEDs in rows corresponding to the squares.
- each LED array As shown in Fig. 12, first, the LEDs in the first row from the top of each LED array emit light. Next, the second row of LEDs from the top of each LED array emits light. Likewise, the LEDs in each LED array emit light in row units in order from the top row, and when the LED in the last row emits light, each LED array completes the first scan. Each LED array starts a second scan after finishing the first scan.
- the exposure time of the video camera does not correspond to the light emission period (scan period) of the LED, that is, when the exposure time is not an integral multiple of the light emission period of the LED, the number of scans within the exposure period (the number of scans of the LED The number of times of light emission) may not be uniform.
- the LED in the row whose exposure period is within the rectangle 261, the LED emits light only once within the exposure period, but in the row whose exposure period is outside the rectangle 261, the LED emits light twice during the exposure period. luminous.
- the brightness of the pixels in the rows whose exposure period is within the rectangle 261 is lower than the brightness of the pixels in the rows whose exposure period is outside the rectangle 261 .
- the video in the row whose exposure period is within the range of the rectangle 261 becomes a black belt.
- FIG. 13 is a diagram showing an example of a re-captured image in which a black band has occurred due to the cause explained with reference to FIG. 12 .
- the control unit 132 determines the refresh rate so that the exposure time of the video camera 11 corresponds to the light emission period. Specifically, for example, the control unit 132 synchronizes the exposure start time and the scan start time, and controls the refresh rate so that the exposure time is an integral multiple of the light emission cycle.
- the refresh rate is controlled to be higher than in the example of FIG. may be controlled to be lower than
- FIG. 15 is a flow chart for explaining the photographing process of the video camera 11. As shown in FIG. This photographing process is started, for example, when the photographer 21 operates the input unit 81 to input an instruction to start photographing.
- step S10 of FIG. 15 the input unit 81 receives an input of an instruction to start shooting from the photographer 21, generates an input signal indicating the start of shooting, and supplies it to the drive unit 83.
- step S15 the signal processing unit 86 supplies the frame-by-frame video signal obtained as a result of the processing in step S14 to the monitor 87, thereby displaying the frame-by-frame video corresponding to the video signal.
- the signal processing unit 86 also supplies the video signal in units of frames obtained as a result of the processing in step S14 to the video output unit 88 as necessary, and causes the video output unit 88 to output the video signal to the outside of the video camera 11 .
- step S ⁇ b>17 the input unit 81 determines whether or not the input of the photography end instruction from the photographer 21 has been received. If it is determined in step S17 that the input of the photographing end instruction has not yet been received, the process proceeds to step S18.
- step S18 the setting unit 82 determines whether the exposure time has been changed. Specifically, the setting unit 82 determines whether an input signal representing a new exposure time has been supplied from the input unit 81 . When the input signal representing the new exposure time is supplied from the input unit 81, the setting unit 82 determines that the exposure time has been changed in step S18. Then, the setting unit 82 sets the exposure time as a new exposure time, returns the process to step S11, and repeats the subsequent processes.
- step S17 If it is determined in step S17 that the input of the shooting end instruction has been received, the shooting process ends.
- FIG. 16 is a flowchart for explaining refresh rate control processing of the refresh rate control unit 130 of FIG. This refresh rate control process is started, for example, when the exposure time is transmitted from the setting unit 82 of the video camera 11 by the process of step S11 in FIG.
- step S31 of FIG. 16 the acquisition unit 131 acquires the exposure time transmitted from the setting unit 82 and received via the communication unit 109, and supplies the exposure time to the control unit 132.
- step S32 the control unit 132 determines the refresh rate of the video wall 12 based on the exposure time supplied from the acquisition unit 131 in step S31 so that the exposure time corresponds to the light emission period of the LEDs 241.
- the control unit 132 generates a refresh rate command representing the refresh rate and supplies it to the transmission control unit 133 .
- step S33 the transmission control unit 133 supplies the communication unit 109 with the refresh rate command supplied from the control unit 132 in step S32, and instructs transmission to the video wall controller 63, thereby transmitting the refresh rate command to the video wall. It is made to transmit to the controller 63 . Then the process ends.
- step S ⁇ b>52 the signal input IF 157 converts the frame-by-frame video signal received in step S ⁇ b>51 into a frame-by-frame video signal in a predetermined video format, and supplies the frame-by-frame video signal to the signal processing unit 158 .
- step S53 the MPU 156 determines whether a video adjustment command has been received from the communication section 109 of the PC 62 via the LAN terminal 151 and the network IF 155. If the MPU 156 determines in step S53 that the video adjustment command has not yet been received, it waits until it receives the video adjustment command.
- step S53 determines in step S53 that it has received a video adjustment command
- the process proceeds to step S54.
- step S ⁇ b>54 the MPU 156 generates a video adjustment signal according to the video adjustment command and supplies it to the signal processing section 158 .
- step S55 the signal processing unit 158 performs signal processing necessary for the entire video wall 12 on the frame-by-frame video signal based on the video adjustment signal while exchanging data with the DRAM 159 as necessary.
- the signal processing unit 158 supplies the adjusted frame-by-frame video signal to the distribution unit 160 .
- step S56 the distribution unit 160 distributes the frame-based video signal supplied from the signal processing unit 158 in step S55 to each signal output IF 161.
- FIG. 18 is a flowchart for explaining display control signal generation processing of the video wall controller 63 .
- This display control signal generation process is started, for example, when a frame-by-frame video signal is transmitted from the video server 61 .
- step S71 of Fig. 18 the MPU 156 determines whether or not a refresh rate command has been received from the communication section 109 of the PC 62 via the LAN terminal 151 and the network IF 155. If it is determined in step S71 that the refresh rate command has been received, the MPU 156 advances the process to step S72.
- step S72 the MPU 156 generates a display control signal according to the received refresh rate command, and supplies the display control signal to the distribution section 160 via the signal processing section 158. Then, the process proceeds to step S74.
- step S73 the MPU 156 generates a display control signal representing a predetermined refresh rate, and sends the display control signal to the signal processor 158. is supplied to the distribution unit 160 via the . Then, the process proceeds to step S74.
- step S74 the distribution unit 160 supplies the display control signal to each signal output IF 161.
- step S75 each signal output IF 161 transmits the display control signal supplied from the distribution section 160 in step S74 to the display unit 41 connected thereto. Then, the display control signal generation process ends.
- FIG. 19 is a flowchart for explaining the display processing of each display unit 41. As shown in FIG. This display process is started, for example, when a video signal is transmitted by the process of step S57 of FIG. 17 and a display control signal is transmitted by the process of step S75 of FIG.
- step S91 of FIG. 19 the signal input IF 211 receives the frame-by-frame video signal and the display control signal transmitted from the video wall controller 63 and supplies them to the signal processing section 212.
- step S93 the signal processing unit 212 divides the signal-processed frame-by-frame video signal into m parts according to the position of each LED array 51 on its own display unit 41.
- step S94 the signal processing unit 212 generates, for each LED array 51, a display signal for each LED constituting the LED array 51 on a frame-by-frame basis, based on the frame-by-frame video signal after the signal processing.
- step S95 the signal processing unit 212 supplies the display signal of each LED array 51 to the signal output IF 214 corresponding to the LED array 51, and outputs the display control signal supplied from the signal input IF 211 in the process of step S91. It supplies to each signal output IF214.
- each signal output IF 214 transmits a video signal and a display control signal to the LED driver 221 connected thereto.
- each LED driver 221 receives the display signal and the display control signal transmitted from the signal output IF 214 connected thereto.
- each LED driver 221 drives each LED 241 by PWM-controlling light emission of each LED 241 constituting the LED array 51 connected to itself based on the display signal and the display control signal.
- each LED array 51 displays an image corresponding to the position of the LED array 51 on the video wall 12 among the images corresponding to the frame-by-frame video signal output from the video server 61 .
- the PC 62 controls the refresh rate of the video wall 12 so that the exposure time of the video camera 11 that captures the video wall 12 corresponds to the light emission period of the LED 241. Therefore, when the video wall 12 is re-captured, the occurrence of black bands can be prevented.
- the PC 62 acquires the exposure time and controls the refresh rate based on the exposure time. Therefore, even if the exposure time changes, the refresh rate can be easily controlled based on the changed exposure time. , the occurrence of black bands can be prevented.
- FIG. 20 is a diagram illustrating an example of a re-capturing system that reduces the visibility of a black band using a conventional method.
- the horizontal axis represents the elapsed time since the start of display on the video wall
- the vertical axis represents the rows of the LED array.
- the i-th row from the top of the LED array is denoted as row #i.
- the rectangles in the graph of FIG. 20 indicate that the LEDs in the row corresponding to the vertical position emit light during the elapsed time corresponding to the horizontal position of the rectangle.
- the number of scans in one frame section is 64
- the difference in the number of times a row emits light from another row is -1
- the luminance of that row is higher than the luminance of the other rows. reduced by 1/64 (approximately 1.56%).
- the refresh rate is doubled and the number of scans in one frame section is 128, when the difference in the number of times of light emission between a row and another row is -1, The brightness is only 1/128 (approximately 0.78%) lower than the brightness of the other rows.
- FIG. 21 is a diagram showing an example of a re-captured video in which the visibility of black bars is reduced by the re-capturing system described in FIG.
- the black belt does not disappear.
- the frequency of the reference clock used for PWM control of the LED driver must be increased, or the number of rows of LEDs that emit light in one scan must be increased. need to be reduced.
- the frequency f [Hz] of the reference clock is obtained from the following formula (1 ).
- the refresh rate is 3840 Hz
- the display gradation accuracy is 12 bits
- the number of rows of LEDs that emit light in one scan is 16
- the reference clock frequency is approximately 251.7 MHz.
- the refresh rate is double 3840 Hz to 7680 Hz
- the frequency of the reference clock is also doubled to about 503.3 MHz when the refresh rate is 3840 Hz.
- the frequency (operating frequency) of the reference clock of the LED driver increases, the power consumption of the LED driver and the cost associated with changing the manufacturing process of the LED driver increase.
- the refresh rate can be increased while maintaining the frequency of the reference clock and the number of rows of LEDs that emit light in one scan. It is also possible to raise it.
- the refresh rate can be doubled by reducing the display gradation precision by 1 bit.
- the quality of the re-captured video is lowered.
- slightly increasing the frequency of the reference clock it is possible to suppress the deterioration of display gradation accuracy, but in any case, the quality of the re-captured image deteriorates.
- the user may control the refresh rate without the refresh rate control unit 130 controlling the refresh rate.
- the exposure time is not transmitted from the video camera 11, and the user determines the refresh rate so that the exposure time corresponds to the light emission cycle of the LED 241, and inputs the refresh rate to the PC 62 using the input unit 106.
- the PC 62 then generates a display control signal representing the refresh rate or the like input by the user.
- the exposure time is transmitted from the video camera 11 to the PC 62.
- the user operates the input unit 106 to input the exposure time of the video camera 11, and the refresh rate control unit 130 controls the exposure time. may be obtained.
- the refresh rate is controlled so that the exposure time of the video camera 11 is an integer multiple of the light emission period of the LED 241.
- vertical blanking of each frame is performed based on the exposure time. Periods may also need to be controlled.
- a re-imaging system that also controls the vertical blanking period will be described below as a second embodiment.
- FIG. 22 is a diagram illustrating a configuration example of a second embodiment of a re-capturing system including an information processing system to which the present technology is applied.
- the re-imaging system 400 of FIG. 22 differs from the re-imaging system 10 in that the PC 62, video wall controller 63, and video wall 12 are replaced with the PC 401, video wall controller 402, and video wall 403. 10 are configured in the same manner.
- the PC 401 performs refresh rate control processing in the same manner as the PC 62 in FIG. Also, the PC 401 determines the vertical blanking period of the video displayed on the video wall 403 so that the exposure time is an integral multiple of the light emission cycle (subframe) of the LED 241 . Specifically, the PC 401 transmits a vertical blanking period command, which is a control command representing a vertical blanking period based on the refresh rate determined by the refresh rate control process, to the video wall controller 402 to perform vertical blanking. Control duration.
- the video wall controller 402 is configured similarly to the video wall controller 63 of FIG. 7, but differs in information represented by the display control signal. Specifically, like the video wall controller 63 , the video wall controller 402 performs predetermined signal processing on the frame-by-frame video signal supplied from the video server 61 , divides the video signal, and transmits the divided signals to each display unit 411 . . The video wall controller 402 also sends to each display unit 411 a display control signal representing the refresh rate represented by the refresh rate command supplied from the PC 401, the vertical blanking period represented by the vertical blanking period command, and the like.
- the display unit 411 includes m LED arrays 51 arranged in tiles.
- Each display unit 411 of video wall 403 is connected to video wall controller 402 .
- the video wall 403 Based on the frame-by-frame video signal and the display control signal supplied from the video wall controller 402, the video wall 403 displays the video corresponding to the video signal in frame units.
- the video signal supplied to each display unit 411 is a video signal corresponding to the position of that display unit 411 on the video wall 403 .
- Each display unit 411 displays an image based on the image signal according to the display control signal, thereby displaying one frame of image on the entire video wall 403 .
- each device is frame-synchronized by a genlock signal.
- FIG. 23 is a block diagram showing a functional configuration example of the CPU when the CPU of the PC 401 in FIG. 22 performs vertical blanking period control processing for controlling the vertical blanking period.
- the control unit 422 determines the vertical blanking period based on the refresh rate supplied from the acquisition unit 421. Control unit 422 controls the vertical blanking interval by generating a vertical blanking interval command representing the vertical blanking interval. The control section 422 outputs the vertical blanking period command to the transmission control section 423 .
- the transmission control unit 423 supplies the vertical blanking period command supplied from the control unit 422 to the communication unit of the PC 401 and instructs transmission of the vertical blanking period command to the video wall controller 402 . Accordingly, the communication unit transmits (outputs) the vertical blanking period command to the video wall controller 402 via a wire such as a LAN cable.
- FIG. 24 is a block diagram showing a detailed configuration example of the display unit 411 of FIG.
- a display unit 411 in FIG. 24 is different from the display unit 41 in that an LED block 441 is provided instead of the LED block 192, and is configured similarly to the display unit 41 in other respects.
- the LED block 441 differs from the LED block 192 in that LED drivers 461-1 to 461-m are provided instead of the LED drivers 221-1 to 221-m. ing.
- the LED driver 461 PWM-controls the light emission of each LED 241 constituting the LED array 51 connected to itself, so that each LED 241 to drive.
- the LED driver 461 generates a PWM signal so that each LED 241 of the LED array 51 emits light at a refresh rate indicated by the display control signal per second with an intensity based on the display signal corresponding to the LED 241. do. LED driver 461 supplies its PWM signal to each LED 241 .
- the LED array 51 displays the image corresponding to the position of the LED array 51 on the video wall 403 among the images corresponding to the frame-based video signal output from the video server 61 .
- the LED driver 461 Based on the display control signal, the LED driver 461 also controls the vertical blanking period so that the vertical blanking period represented by the display control signal is provided for each frame.
- FIG. 25 is a diagram for explaining the vertical blanking period of the video displayed on the video wall 403. As shown in FIG.
- the horizontal axis represents the light emission time.
- the top row represents the vertical synchronization signal (V-Sync) of the video displayed on the video wall 403 .
- the second and subsequent rows from the top represent the light emission timing of each row of the LEDs 241 for 30 rows from the top of the video wall 403.
- the i-th row from the top is denoted as Line #i.
- the number of rows of LEDs 241 forming the LED array 51 is 15, and the number of scans in one frame section is 32 times. These things are the same also in FIG. 27 mentioned later.
- each LED driver 461 supplies the display signal (for example, 0 to 2048 image data) is generated and supplied to each LED 241 .
- the LEDs 241 in the top row of the LED arrays 51 start to emit light in order.
- the LEDs 241 on the 1st and 16th rows from the top of the video wall 12 start emitting light simultaneously.
- the LEDs 241 in the bottom row of each LED array 51 finish emitting light, that is, when one scan ends, scanning is performed again. is done.
- scanning is performed 32 times.
- the LED driver 461 generates a PWM signal with the same PWM width for each LED 241 32 times. After that, the vertical blanking period starts until the vertical synchronization signal for the next frame is generated, and all the LEDs 241 stop emitting light.
- 26A and 26B are diagrams for explaining the cause of occurrence of black bands in images re-captured by the re-capture system when the exposure time is not an integer multiple of the light emission cycle of the LED.
- the horizontal axis represents the light emission time.
- the top row represents the vertical sync signal for the video displayed on the video wall.
- the second and subsequent rows from the top represent the light emission timing of each row of LEDs for 30 rows from the top of the video wall, and in FIG. 26, the i-th row from the top is denoted as Line #i.
- the number of rows of LEDs forming the LED array is 15, and the number of scans in one frame section is 32 times.
- the scanning is the same as in the case of FIG. 25, so the explanation is omitted.
- the video camera performs rolling shutter photography with a predetermined exposure time. Therefore, each row is exposed to light from the LEDs in order from the top row, and each row has a different exposure start timing. Since frame synchronization is established in each device of the re-imaging system, the exposure start time and the display start time of one frame are synchronized.
- the light emission period within the exposure period may not be uniform in each row.
- the entire period of the first light emission is included in the exposure period 481 in the first and second rows from the top.
- the exposure period 481 does not include a period 482 that is half (0.5) times the entire period of the first light emission.
- the exposure period 481 does not include a period 483 that is 0.8 times the entire period of the first light emission.
- the brightness of the pixels in the 15th and 16th rows from the top, re-captured by the video camera is lower than the brightness of the pixels in the 1st and 2nd rows from the top.
- the luminance of the pixels in the 15th row from the top is 0.5 when the luminance of the pixels in the 1st and 2nd rows from the top is 1, and the luminance of the pixels in the 16th row from the top is , is 0.2 when the brightness of the pixels in the first and second rows from the top is 1.
- the images in the 15th and 16th rows from the top become black bars.
- a similar situation occurs periodically in the subsequent rows, so that the images re-captured by the video camera periodically appear bright and dark.
- FIG. 27 is a diagram for explaining control by the PC 401. As shown in FIG.
- the control unit 132 of the PC 401 determines the refresh rate so that the exposure time of the video camera 11 corresponds to the light emission cycle. Specifically, for example, the control unit 132 synchronizes the exposure start time and the scan start time, and controls the refresh rate so that the exposure time is an integral multiple of the light emission cycle.
- the control unit 132 determines the refresh rate so that the exposure time is one time the light emission period.
- the scanning speed becomes faster than in the case of FIG. 26, and the number of times of scanning within the exposure period becomes one for all rows.
- the exposure period 481 includes the entire period of the first light emission.
- the exposure period 481 includes a partial period 491 of the entire period of the first light emission and a partial period 492 of the entire period of the second light emission. .
- the sum of period 491 and period 492 is the entire period of one light emission. Therefore, the luminance of all rows of pixels re-captured by the video camera 11 will be the same.
- no row of pixels with low brightness occurs and no black band occurs.
- the end time of the final 32nd scan is earlier than the case of FIG. Therefore, the period 493 from the end of the last scan to the start of display of the next frame is longer than the case of FIG. 26 by the period 494, and the vertical blanking period must be lengthened by the period 494. . That is, it is necessary to control the vertical blanking period based on the refresh rate.
- the control unit 422 of FIG. 23 sets the period from when the number of scans in one frame section corresponding to the refresh rate to the start of the display of the next frame is performed. Calculate and determine the vertical blanking interval. If the vertical blanking period is long, the luminance may become dark.
- the refresh rate is controlled to be higher than in the example of FIG. may be controlled to be lower than
- FIG. 28 is a flowchart for explaining vertical blanking period control processing of the vertical blanking period control unit 420 in FIG. This vertical blanking period control process is started, for example, when the refresh rate is determined by the control section 132 of the refresh rate control section 130 .
- step S202 based on the refresh rate supplied from the acquisition unit 421 in step S201, the control unit 422 scans the next frame after the number of scans in one frame section corresponding to the refresh rate. Calculate the period until the display starts and determine the vertical blanking period.
- the control unit 422 generates a vertical blanking interval command representing the vertical blanking interval and supplies it to the transmission control unit 423 .
- step S203 the transmission control unit 423 supplies the vertical blanking interval command supplied from the control unit 422 in step S202 to the communication unit 109, and instructs transmission to the video wall controller 402, whereby the vertical blanking interval Causes the command to be sent to the video wall controller 402 . Then the process ends.
- the recapture system 400 controls the vertical blanking period of the video displayed on the video wall 403 based on the exposure time. Specifically, the re-imaging system 400 determines the refresh rate based on the exposure time so that the exposure time is an integral multiple of the light emission cycle, and controls the vertical blanking period based on the refresh rate. Therefore, when re-capturing the video wall 403, it is possible to prevent the occurrence of black bands.
- the exposure period is within the display period of one frame of video, but depending on the exposure time, the exposure period may extend over the display period of two frames of video. There is That is, the exposure period may include a vertical blanking period. In this case, the number of vertical blanking periods included in the exposure period differs from row to row, and thus black bands may occur. A re-capturing system that prevents the occurrence of such black bands will be described below as a third embodiment.
- FIG. 29 is a diagram illustrating a configuration example of a third embodiment of a re-capturing system including an information processing system to which the present technology is applied.
- the PC 501 (information processing system) is a general-purpose computer.
- the PC 501 controls the video wall controller 502 by generating control commands for controlling the video wall controller 502 and transmitting them to the video wall controller 502 .
- the PC 501 sets a control mode for controlling the vertical blanking period of the video displayed on the video wall 503 based on the exposure time and curtain speed of the video camera 11, and issues a control mode command representing the control mode. It controls the vertical blanking interval by sending it to the video wall controller 502 .
- the curtain speed of the video camera 11 is input by the user.
- the video wall controller 502 is configured similarly to the video wall controller 63 in FIG. 7, but differs in information represented by the display control signal. Specifically, similar to the video wall controller 63 , the video wall controller 502 performs predetermined signal processing on the frame-based video signal supplied from the video server 61 , divides the video signal, and transmits the divided signals to each display unit 511 . . The video wall controller 502 also transmits to each display unit 511 a display control signal indicating the control mode indicated by the control mode command supplied from the PC 501 .
- the video wall 503 (display unit) is a large-sized LED display in which n display units 511-1 to 511-n are arranged in tiles.
- FIG. 29 illustrates the case where n is 6 ⁇ 24. Note that the display units 511-1 to 511-n are hereinafter simply referred to as the display unit 511 when there is no need to distinguish them individually.
- the display unit 511 includes m LED arrays 51 arranged in tiles.
- Each display unit 511 of video wall 503 is connected to video wall controller 502 .
- the video wall 503 Based on the frame-by-frame video signal and the display control signal supplied from the video wall controller 502, the video wall 503 displays the video corresponding to the video signal in frame units.
- the video signal supplied to each display unit 511 is the video signal corresponding to the position of that display unit 511 on the video wall 503 .
- Each display unit 511 displays an image based on the image signal according to the display control signal, thereby displaying one frame of image on the entire video wall 503 .
- each device is frame-synchronized by a genlock signal.
- the video wall controller 502 and the video wall 503 may have an integrated configuration, or may be a display device in which they are integrated.
- the PC 501, the video wall controller 502, and the video wall 503 may be integrated, or may be a display device in which these are integrated.
- FIG. 30 is a block diagram showing a functional configuration example of the CPU when the CPU of the PC 501 in FIG. 29 performs vertical blanking period control processing for controlling the vertical blanking period.
- the acquisition unit 521 acquires the exposure time transmitted from the setting unit 82 of the video camera 11 and received via the communication unit of the PC 501 .
- the acquisition unit 521 supplies the exposure time to the control unit 522 .
- the control unit 522 sets the control mode for the vertical blanking period based on the exposure time supplied from the acquisition unit 521 and the curtain speed of the video camera 11 .
- Control unit 522 controls the vertical blanking interval by generating a control mode command representing the control mode.
- the control section 522 outputs the control mode command to the transmission control section 523 .
- the transmission control unit 523 supplies the control mode command supplied from the control unit 522 to the communication unit of the PC 501 and instructs transmission of the control mode command to the video wall controller 502 .
- the communication unit transmits (outputs) the control mode command to the video wall controller 502 via a cable such as a LAN cable.
- FIG. 31 is a block diagram showing a detailed configuration example of the display unit 511 of FIG.
- a display unit 511 in FIG. 31 is different from the display unit 41 in that an LED block 541 is provided instead of the LED block 192, and is configured similarly to the display unit 41 in other respects.
- the LED block 541 differs from the LED block 192 in that LED drivers 561-1 to 561-m are provided instead of the LED drivers 221-1 to 221-m. ing.
- the LED driver 561 controls the light emission start timing of each frame based on the control mode represented by the display control signal.
- the LED driver 561 generates a PWM signal so that each LED 241 of the LED array 51 emits light at a predetermined refresh rate per second with an intensity based on the display signal corresponding to the LED 241 , and supplies the PWM signal to each LED 241 .
- the LED array 51 displays the image corresponding to the position of the LED array 51 on the video wall 503 among the images corresponding to the frame-by-frame video signal output from the video server 61 .
- the upper diagram in FIG. 32 shows the light emission timing of the LEDs 241 in each of the 1st to 135th rows from the top of the video wall 503 .
- the horizontal axis represents the light emission time
- the vertical axis represents each row of the LEDs 241 .
- the frame rate of the video wall 503 is 120 Hz and one frame period is 1/119.88 seconds.
- the number of rows of the LEDs 241 forming the LED array 51 is 15 rows.
- the diagram at the bottom of FIG. 32 shows the light emission timing of the LED 241 in the 135th row by lines.
- one frame section is provided with a vertical blanking period (V-blanking) after the end of all scans.
- V-blanking the interval between diagonal lines connecting the light emission timings of each row is the time of one scan.
- FIG. 33 is a diagram for explaining the exposure time and vertical blanking period.
- the image corresponding to the light used for exposure of the video camera 11 can be from 0 to 2 frames. That is, an exposure period can include 0 to 2 vertical blanking periods.
- the horizontal axis of FIG. 34 represents the display time of the image, and the vertical axis represents the number of rows of pixels on the light receiving surface of the imaging unit corresponding to the image displayed at the display time.
- the frame rate of the video wall is 120 Hz and the frame rate of the video camera is 60 Hz.
- the exposure period 571 when the open angle is 270 degrees, the exposure period 571 includes one vertical blanking period in the rows above the L-th row of the light receiving surface of the photographing unit, but In the bottom row, the exposure period 571 includes two vertical blanking periods.
- the vertical blanking period is not included in the exposure period 571 for the rows above the L-th row of the light receiving surface of the photographing unit 85, but the exposure period for the rows below the L-th row is One vertical blanking period is included in period 571 .
- the opening angle when the opening angle is 180 degrees, one vertical blanking period is included in the exposure period 571 for all rows of the light receiving surface of the imaging unit.
- the exposure period 571 when the opening angle is 360 degrees, the exposure period 571 includes two vertical blanking periods in all rows of the light receiving surface of the imaging unit 85 . Therefore, when the opening angle is 180 degrees or 360 degrees, no black band occurs.
- the horizontal axis in FIGS. 35 and 36 represents the image display time, and the vertical axis represents the row of pixels on the light-receiving surface of the photographing unit 85 exposed to the light corresponding to the image displayed at the display time. represents the number of rows in In the example of FIGS. 35 and 36, the frame rate of video wall 503 is 120 Hz and the frame rate of video camera 11 is 60 Hz.
- the opening angle is 90 degrees
- the exposure period of some rows of the imaging unit 85 does not straddle the vertical blanking period
- the exposure period of the remaining rows is one vertical blanking.
- the control unit 522 sets the control mode to the first mode in which the exposure periods of all rows of the imaging unit 85 do not include the vertical blanking periods of even-numbered frames.
- the LED driver 561 emits light in an even frame (second frame) next to one odd frame (first frame) among adjacent frames.
- the start timing image display start time
- the vertical blanking period of the odd-numbered frames is deleted.
- the display period 581 of the odd-numbered frames is shortened by the vertical blanking period
- the display period 582 of the even-numbered frames is extended by the vertical blanking period.
- the vertical blanking period of the odd-numbered frames is deleted, the exposure of the first row from the top of the photographing unit 85 is started, and then the exposure of the last row is finished (the shutter is released).
- the vertical blanking period is no longer included in the period T up to, ie, the sum of the curtain speed and the exposure time. Therefore, the vertical blanking period is not included in the exposure period of all rows of the photographing unit 85 .
- the frame-by-frame video signal re-captured by the video camera 11 no row of pixels with low brightness occurs and no black band occurs.
- the opening angle is 270 degrees
- the exposure period for some rows of the photographing unit 85 straddles one vertical blanking period
- the exposure period for the remaining rows is two times.
- the control unit 522 sets the control mode to the second mode in which the exposure period of all rows of the imaging unit 85 includes the vertical blanking period of even-numbered frames.
- the LED driver 561 deletes the vertical blanking period of odd-numbered frames as in the first mode.
- the display period 591 of the odd-numbered frames is shortened by the vertical blanking period, and the display period 592 of the even-numbered frames is extended by the vertical blanking period.
- the light emission start time (display start time) of all frames is changed to be later by time D so that the vertical blanking period of even frames is included in the exposure period 571 of all rows of the photographing unit 85 . .
- the exposure periods 571 of all rows of the imaging unit 85 include vertical blanking periods of even-numbered frames.
- the frame-by-frame video signal re-captured by the video camera 11 no row of pixels with low brightness occurs and no black band occurs.
- the light emission start times of all frames can be shifted, for example, by one frame interval.
- the frame rate is 120 Hz
- the light emission start times of all frames can be shifted up to 1/120 second.
- the control unit 522 determines whether the exposure period of only some rows of the photographing unit 85 spans one vertical blanking period or spans two vertical blanking periods. do. Then, when the control unit 522 determines that the exposure period of only some rows straddles one vertical blanking period, it sets the control mode to the first mode. The control unit 522 sets the control mode to the second mode when determining that the exposure period of only some rows straddles two vertical blanking periods.
- FIG. 37 is a flowchart for explaining vertical blanking period control processing of the vertical blanking period control unit 520 of FIG. This vertical blanking period control process is started, for example, when the exposure time is transmitted from the setting unit 82 of the video camera 11 .
- step S331 of FIG. 37 the acquisition unit 521 acquires the exposure time transmitted from the setting unit 82 and received via the communication unit of the PC 501, and supplies the exposure time to the control unit 522.
- step S332 the control unit 522 determines whether or not it is necessary to delete the vertical blanking period based on the exposure time and the shutter speed of the video camera 11 supplied from the acquisition unit 521 in the process of step S331. . Specifically, the control unit 522 determines whether or not the vertical blanking periods included in the exposure periods of all rows of the imaging unit 85 are the same based on the exposure time and curtain speed. If the control unit 522 determines that the vertical blanking periods included in the exposure periods of all rows are not the same, it determines that the vertical blanking periods need to be deleted, and advances the process to step S33.
- step S333 the control unit 522 sets the control mode based on the exposure time and curtain speed. Specifically, based on the exposure time and curtain speed, the control unit 522 determines that the exposure period of some rows of the photographing unit 85 does not straddle the vertical blanking period, and that the exposure period of the remaining rows is one time. It is determined whether or not the vertical blanking period is straddled. When the control unit 522 determines that the exposure period of some rows does not span the vertical blanking period and the exposure period of the remaining rows spans one vertical blanking period, the control unit 522 sets the control mode to the first mode.
- control unit 522 sets the control mode to the second mode.
- the control unit 522 controls the vertical blanking period by generating a control mode command representing the set control mode.
- the control section 522 outputs the control mode command to the transmission control section 523 .
- step S334 the transmission control unit 523 supplies the control mode command supplied from the control unit 522 in step S333 to the communication unit of the PC 501, and instructs the video wall controller 502 to transmit the control mode command to the video wall controller 502. Send to wall controller 502 . Then the process ends.
- step S332 determines in step S332 that the vertical blanking periods included in the exposure periods of all rows are the same, the process ends.
- the recapture system 500 controls the vertical blanking period of the video displayed on the video wall 503 based on the exposure time. Therefore, when re-capturing the video wall 503, it is possible to prevent the occurrence of black bands.
- the re-imaging system 500 does not perform refresh rate control processing, it may perform refresh rate control processing. In this case, the refresh rate control process differs depending on whether the vertical blanking period is included in the exposure period.
- the refresh rate control processing will be described below.
- ⁇ Description of refresh rate control processing> 38 and 39 are diagrams for explaining refresh rate control processing when the re-capturing system 500 performs refresh rate control processing.
- the horizontal axis represents the light emission time.
- the top row represents the vertical synchronization signal for the video displayed on the video wall 503 .
- the second and subsequent rows from the top represent the light emission timing of each row of the LEDs 241 for 30 rows from the top of the video wall 503, and in FIGS. ing. 38 and 39, the number of rows of the LEDs 241 forming the LED array 51 is 15 rows.
- the exposure time is seven times the light emission period.
- the PC 501 sets the exposure time to an integral multiple (N times) of the light emission period of the LED 241, as shown in FIG.
- a refresh rate is determined so as to be the sum of one vertical blanking period.
- the exposure time is the sum of 34 times the light emission period and one vertical blanking period, and the number of scans in one frame section is 32 times.
- the refresh rate is adjusted so that the exposure time is the sum of an integer multiple of the light emission period of the LED 241 and two vertical blanking periods. is determined.
- the vertical blanking period may be further controlled based on the refresh rate as in the second embodiment.
- FIG. 40 is a diagram illustrating control of the vertical blanking period based on the refresh rate by the PC 501 in this case.
- the horizontal axis represents the light emission time.
- the top row represents the vertical synchronization signal for the video displayed on the video wall 503 .
- the second and subsequent rows from the top represent the light emission timing of each row of the LEDs 241 for 30 rows from the top of the video wall 503.
- the i-th row from the top is denoted as Line #i.
- the number of rows of LEDs 241 forming the LED array 51 is 15 rows.
- the PC 501 sets the exposure period to be the sum of an integral multiple of the light emission period of the LED 241 and one vertical blanking period. controls the vertical blanking interval.
- the PC 501 determines the refresh rate so that the exposure period is the sum of an integral multiple of the light emission period of the LED 241 and one vertical blanking period.
- the PC 501 determines the refresh rate so that the exposure time is the sum of 33 times the light emission period and one vertical blanking period.
- the number of scans within the exposure period is 33 for all rows.
- the exposure period 611 includes a partial period 621 of the entire initial light emission period and a partial period 622 of the final light emission entire period.
- the sum of period 621 and period 622 is the entire period of one light emission. Therefore, the luminance of all rows of pixels re-captured by the video camera 11 will be the same.
- no row of pixels with low brightness occurs and no black band occurs.
- the PC 501 calculates a period 623 from the end of the last scan in one frame period to the start of display (emission) of the next frame, and Vertical blanking is controlled by determining 623 to be the vertical blanking interval.
- the vertical blanking period is set so that the exposure period is an integral multiple of the light emission period of the LED 241.
- the PC 401 controls vertical blanking based on the refresh rate determined so that the exposure period is an integral multiple of the light emission cycle of the LED 241 .
- the maximum number of vertical blanking periods included in the exposure period is two, but this number is not limited to two. Even if the maximum number of vertical blanking periods included in the exposure period is two or more, the same processing as in the case of two times can be performed to prevent the occurrence of black bands.
- the exposure time is transmitted from the video camera 11 to the PC 401 (501).
- the refresh rate control section 130 (the vertical blanking period control section 520) may acquire the exposure time.
- the PC 401 (501) controls the refresh rate and vertical blanking period, but the video camera 11 transmits the exposure time to the video wall controller 402 (502) and the video wall 403 (503). At least part of the video wall controller 402 (502) and the video wall 403 (503) may function as the refresh rate controller 130 and the vertical blanking period controller 420 (520).
- the PC 62 (401, 501) exchanges signals with the video camera 11 via a cable such as a coaxial cable, but may be exchanged by wireless communication.
- the PC 62 (401, 501) exchanges signals with the video wall controller 63 (402, 502) via a cable such as a LAN cable, but it may be exchanged by wireless communication.
- the re-capturing system 10 (400, 500) is provided with a plurality of video wall controllers 63 (402, 502), and each video wall controller 63 (402, 502) divides and controls the video wall 12 (403, 503). You may do so. If the video wall 12 (403, 503) consists of one display unit 41 (411, 511), the video wall controller 63 (402, 502) may not be provided. In this case, the frame-by-frame video signal output from the video server 61 and the control command output from the PC 62 (401, 501) are directly input to the video wall 12 (403, 503).
- a system means a set of multiple components (devices, modules (parts), processes, etc.), and it does not matter whether all the components are in the same housing. Therefore, a plurality of devices housed in separate housings and connected via a network, a single device housing a plurality of modules in one housing, and a processing unit that performs a plurality of processes are , are both systems.
- this technology can take the configuration of cloud computing in which one function is shared by multiple devices via a network and processed jointly.
- each step described in the flowchart above can be executed by a single device, or can be shared by a plurality of devices.
- one step includes multiple processes
- the multiple processes included in the one step can be executed by one device or shared by multiple devices.
- An information processing system comprising: a control unit that controls a vertical blanking period of an image displayed on the display unit, based on an exposure time of an image capturing unit that captures an image of the display unit.
- the control unit is configured to delete the vertical blanking period of a first frame, which is one of two adjacent frames of the video, based on the exposure time.
- the information processing system according to .
- the control unit is configured to delete the vertical blanking period of the first frame by advancing the display start time of the second frame, which is the next frame of the first frame.
- control unit is configured to extend the vertical blanking period of the second frame by the vertical blanking period of the first frame.
- the control unit adjusts the vertical blanking period of the second frame within the exposure period of all rows of the video by changing display start times of all frames of the video based on the exposure time.
- the control unit is configured to include the vertical blanking period of the second frame in the exposure period of all rows of the image based on the shutter speed of the imaging unit and the exposure time.
- the control unit sets the current mode based on the curtain speed of the imaging unit and the exposure time so that the vertical blanking period of the second frame is not included in the exposure period of all rows of the image.
- (6) above configured to set to a first mode or a second mode in which the vertical blanking period of the second frame is included in the exposure period of all rows of the image.
- information processing system. configured to include the vertical blanking period of the second frame in the exposure period of all rows of the image when the current mode is set to the second mode.
- the information processing system according to (7) above. (9) The information processing system according to (1), wherein the control unit is configured to control the vertical blanking period so that the exposure time is an integral multiple of the light emission cycle of the display unit.
- the control unit controls the vertical blanking period so that the exposure time is an integral multiple of the light emission period of the display unit.
- the information processing system according to (9) above which is configured as: (11)
- the control unit determines a refresh rate of the display unit so that the exposure time is an integral multiple of a light emission cycle of the display unit, and the refresh rate is determined.
- the information processing system according to (10) above configured to control the vertical blanking interval based on a rate.
- the control unit controls the vertical blanking period so that the exposure time is the sum of an integral multiple of the light emission period of the display unit and the vertical blanking period.
- the control unit determines the refresh rate so that the exposure time is the sum of an integral multiple of the light emission period of the display unit and the vertical blanking period.
Landscapes
- Engineering & Computer Science (AREA)
- Multimedia (AREA)
- Signal Processing (AREA)
- Physics & Mathematics (AREA)
- Computer Hardware Design (AREA)
- General Physics & Mathematics (AREA)
- Theoretical Computer Science (AREA)
- Control Of Indicators Other Than Cathode Ray Tubes (AREA)
- Studio Devices (AREA)
- Facsimiles In General (AREA)
- Details Of Television Scanning (AREA)
Abstract
Description
1.第1実施の形態(リフレッシュレートを制御する再撮システムの構成例)
2.第2実施の形態(垂直ブランキング期間も制御する再撮システムの構成例)
3.第3実施の形態(露光期間に垂直ブランキング期間が含まれる場合も考慮した再撮システムの構成例)
<再撮システムの概要>
図1は、本技術を適用した情報処理システムを含む再撮システムの第1実施の形態の概要を説明する図である。
図2は、図1のビデオカメラ11により再撮された映像を示す図である。
図3は、再撮システム10の構成例を示す図である。
図4は、図3のビデオカメラ11の構成例を示すブロック図である。
図5は、図3のPC62のハードウエアの構成例を示すブロック図である。
図6は、図5のCPU101がリフレッシュレート制御処理を行う場合の、CPU101の機能的構成例を示すブロック図である。
図7は、図3のビデオウォールコントローラ63の構成例を示すブロック図である。
図8は、表示ユニット41の詳細構成例を示すブロック図である。
図9は、図8のLEDアレイ51の構成例を示す図である。
図10は、LEDアレイ51の発光動作を説明する図である。
図11は、LEDアレイ51の発光周期を説明する図である。
図12は、露光時間がLEDの発光周期の整数倍ではない場合に再撮システムで再撮される映像において黒帯が発生する原因を説明する図である。
図13は、図12で説明した原因により黒帯が発生した再撮映像の例を示す図である。
図14は、図6の制御部132によるリフレッシュレートの制御を説明する図である。
図15は、ビデオカメラ11の撮影処理を説明するフローチャートである。この撮影処理は、例えば、撮影者21が入力部81を操作して撮影開始指示を入力したとき、開始される。
図16は、図6のリフレッシュレート制御部130のリフレッシュレート制御処理を説明するフローチャートである。このリフレッシュレート制御処理は、例えば、図15のステップS11の処理により、ビデオカメラ11の設定部82から露光時間が送信されてきたとき、開始される。
図17は、ビデオウォールコントローラ63の映像信号処理を説明するフローチャートである。この映像信号処理は、例えば、ビデオサーバ61からフレーム単位の映像信号が送信されてきたとき、開始される。
図18は、ビデオウォールコントローラ63の表示制御信号生成処理を説明するフローチャートである。この表示制御信号生成処理は、例えば、ビデオサーバ61からフレーム単位の映像信号が送信されてきたとき、開始される。
図19は、各表示ユニット41の表示処理を説明するフローチャートである。この表示処理は、例えば、図17のステップS57の処理により映像信号が送信され、図18のステップS75の処理により表示制御信号が送信されてきたとき、開始される。
図20は、従来の方法で黒帯の視認性を低下させる再撮システムの一例を説明する図である。
<再撮システムの構成例>
図22は、本技術を適用した情報処理システムを含む再撮システムの第2実施の形態の構成例を示す図である。
図22のPC401のハードウエア構成は、図5のPC62のハードウエア構成と同様であるので、説明は省略する。
図24は、図22の表示ユニット411の詳細構成例を示すブロック図である。
図25は、ビデオウォール403に表示される映像の垂直ブランキング期間を説明する図である。
図26は、露光時間がLEDの発光周期の整数倍ではない場合に再撮システムで再撮される映像において黒帯が発生する原因を説明する図である。
図27は、PC401による制御を説明する図である。
図28は、図23の垂直ブランキング期間制御部420の垂直ブランキング期間制御処理を説明するフローチャートである。この垂直ブランキング期間制御処理は、例えば、リフレッシュレート制御部130の制御部132によりリフレッシュレートが決定されたとき、開始される。
<再撮システムの構成例>
図29は、本技術を適用した情報処理システムを含む再撮システムの第3実施の形態の構成例を示す図である。
図29のPC501のハードウエア構成は、図5のPC62のハードウエア構成と同様であるので、説明は省略する。
図31は、図29の表示ユニット511の詳細構成例を示すブロック図である。
図32は、ビデオウォール503に表示される映像の垂直ブランキング期間を説明する図である。
図33は、露光時間と垂直ブランキング期間を説明する図である。
図34は、垂直ブランキング期間が制御されない場合に再撮システムで再撮される映像において黒帯が発生する原因を説明する図である。
図35および図36は、制御モードを説明する図である。
図37は、図30の垂直ブランキング期間制御部520の垂直ブランキング期間制御処理を説明するフローチャートである。この垂直ブランキング期間制御処理は、例えば、ビデオカメラ11の設定部82から露光時間が送信されてきたとき、開始される。
図38および図39は、再撮システム500がリフレッシュレート制御処理を行う場合のリフレッシュレート制御処理を説明する図である。
図40は、この場合のPC501によるリフレッシュレートに基づく垂直ブランキング期間の制御を説明する図である。
(1)
表示部を撮影する撮影部の露光時間に基づいて、前記表示部に表示される映像の垂直ブランキング期間を制御する制御部
を備える情報処理システム。
(2)
前記制御部は、前記露光時間に基づいて、前記映像の隣接する2つのフレームのうちの一方のフレームである第1のフレームの前記垂直ブランキング期間を削除する
ように構成された
前記(1)に記載の情報処理システム。
(3)
前記制御部は、前記第1のフレームの次のフレームである第2のフレームの表示開始時刻を早めることにより、前記第1のフレームの前記垂直ブランキング期間を削除する
ように構成された
前記(2)に記載の情報処理システム。
(4)
前記制御部は、前記第2のフレームの前記垂直ブランキング期間を前記第1のフレームの前記垂直ブランキング期間だけ延長する
ように構成された
前記(3)に記載の情報処理システム。
(5)
前記制御部は、前記露光時間に基づいて、前記映像の全フレームの表示開始時刻を変更することにより、前記映像の全ての行の露光期間内に前記第2のフレームの前記垂直ブランキング期間を含める
ように構成された
前記(3)または(4)に記載の情報処理システム。
(6)
前記制御部は、前記撮影部の幕速と前記露光時間に基づいて、前記映像の全ての行の前記露光期間内に前記第2のフレームの前記垂直ブランキング期間を含める
ように構成された
前記(5)に記載の情報処理システム。
(7)
前記制御部は、前記撮影部の幕速と前記露光時間に基づいて、現在のモードを、前記映像の全ての行の前記露光期間内に前記第2のフレームの前記垂直ブランキング期間を含めない第1のモード、または、前記映像の全ての行の前記露光期間内に前記第2のフレームの前記垂直ブランキング期間を含める第2のモードに設定する
ように構成された
前記(6)に記載の情報処理システム。
(8)
前記制御部は、前記現在のモードを前記第2のモードに設定した場合、前記映像の全ての行の前記露光期間内に前記第2のフレームの前記垂直ブランキング期間を含める
ように構成された
前記(7)に記載の情報処理システム。
(9)
前記制御部は、前記露光時間が前記表示部の発光周期の整数倍となるように前記垂直ブランキング期間を制御する
ように構成された
前記(1)に記載の情報処理システム。
(10)
前記制御部は、前記撮影部の露光期間内に前記垂直ブランキング期間が含まれない場合、前記露光時間が前記表示部の発光周期の整数倍となるように前記垂直ブランキング期間を制御する
ように構成された
前記(9)に記載の情報処理システム。
(11)
前記制御部は、前記露光期間内に前記垂直ブランキング期間が含まれない場合、前記露光時間が前記表示部の発光周期の整数倍となるように前記表示部のリフレッシュレートを決定し、前記リフレッシュレートに基づいて前記垂直ブランキング期間を制御する
ように構成された
前記(10)に記載の情報処理システム。
(12)
前記制御部は、前記撮影部の露光期間内に前記垂直ブランキング期間が含まれる場合、前記露光時間が前記表示部の発光周期の整数倍と前記垂直ブランキング期間の和となるように前記垂直ブランキング期間を制御する
ように構成された
前記(9)または(10)に記載の情報処理システム。
(13)
前記制御部は、前記露光期間内に前記垂直ブランキング期間が含まれる場合、前記露光時間が前記表示部の発光周期の整数倍と前記垂直ブランキング期間の和となるようにリフレッシュレートを決定し、前記リフレッシュレートに基づいて前記垂直ブランキング期間を制御する
ように構成された
前記(12)に記載の情報処理システム。
(14)
前記露光時間を取得する取得部
をさらに備える
前記(1)乃至(13)のいずれかに記載の情報処理システム。
(15)
複数の表示ユニットから構成される前記表示部に表示するための映像信号を取得する入力部と、
前記映像信号を、前記表示部のそれぞれの表示ユニットに表示するための映像信号へ分割する分割部と、
前記垂直ブランキング期間を制御する制御信号と分割された前記映像信号を前記表示ユニットに出力する出力部と
をさらに備え、
前記制御部は、前記制御信号を生成することにより、前記垂直ブランキング期間を制御する
ように構成された
前記(1)乃至(14)のいずれかに記載の情報処理システム。
(16)
前記制御部は、第1の機器上に設けられ、
前記入力部、前記分割部、および前記出力部は、前記第1の機器とは異なる第2の機器上に設けられ、
前記制御部は、前記第2の機器に前記制御信号を出力する
ように構成された
前記(15)に記載の情報処理システム。
(17)
前記制御部、前記入力部、前記分割部、および前記出力部は、同一の機器上に設けられる
ように構成された
前記(15)に記載の情報処理システム。
(18)
前記制御部による前記垂直ブランキング期間の制御にしたがって駆動するように構成された前記表示部
をさらに備える
前記(1)乃至(17)のいずれかに記載の情報処理システム。
(19)
前記表示部は、パッシブマトリクス駆動方式で発光し、
前記撮影部は、ローリングシャッタ方式で撮影を行う
ように構成された
前記(1)乃至(18)のいずれかに記載の情報処理システム。
(20)
情報処理システムが、
表示部を撮影する撮影部の露光時間に基づいて、前記表示部に表示される映像の垂直ブランキング期間を制御する制御ステップ
を含む情報処理方法。
Claims (20)
- 表示部を撮影する撮影部の露光時間に基づいて、前記表示部に表示される映像の垂直ブランキング期間を制御する制御部
を備える情報処理システム。 - 前記制御部は、前記露光時間に基づいて、前記映像の隣接する2つのフレームのうちの一方のフレームである第1のフレームの前記垂直ブランキング期間を削除する
ように構成された
請求項1に記載の情報処理システム。 - 前記制御部は、前記第1のフレームの次のフレームである第2のフレームの表示開始時刻を早めることにより、前記第1のフレームの前記垂直ブランキング期間を削除する
ように構成された
請求項2に記載の情報処理システム。 - 前記制御部は、前記第2のフレームの前記垂直ブランキング期間を前記第1のフレームの前記垂直ブランキング期間だけ延長する
ように構成された
請求項3に記載の情報処理システム。 - 前記制御部は、前記露光時間に基づいて、前記映像の全フレームの表示開始時刻を変更することにより、前記撮影部の全ての行の露光期間内に前記第2のフレームの前記垂直ブランキング期間を含める
ように構成された
請求項3に記載の情報処理システム。 - 前記制御部は、前記撮影部の幕速と前記露光時間に基づいて、前記撮影部の全ての行の前記露光期間内に前記第2のフレームの前記垂直ブランキング期間を含める
ように構成された
請求項5に記載の情報処理システム。 - 前記制御部は、前記撮影部の幕速と前記露光時間に基づいて、現在のモードを、前記撮影部の全ての行の前記露光期間内に前記第2のフレームの前記垂直ブランキング期間を含めない第1のモード、または、前記撮影部の全ての行の前記露光期間内に前記第2のフレームの前記垂直ブランキング期間を含める第2のモードに設定する
ように構成された
請求項6に記載の情報処理システム。 - 前記制御部は、前記現在のモードを前記第2のモードに設定した場合、前記撮影部の全ての行の前記露光期間内に前記第2のフレームの前記垂直ブランキング期間を含める
ように構成された
請求項7に記載の情報処理システム。 - 前記制御部は、前記露光時間が前記表示部の発光周期の整数倍となるように前記垂直ブランキング期間を制御する
ように構成された
請求項1に記載の情報処理システム。 - 前記制御部は、前記撮影部の露光期間内に前記垂直ブランキング期間が含まれない場合、前記露光時間が前記表示部の発光周期の整数倍となるように前記垂直ブランキング期間を制御する
ように構成された
請求項9に記載の情報処理システム。 - 前記制御部は、前記露光期間内に前記垂直ブランキング期間が含まれない場合、前記露光時間が前記表示部の発光周期の整数倍となるように前記表示部のリフレッシュレートを決定し、前記リフレッシュレートに基づいて前記垂直ブランキング期間を制御する
ように構成された
請求項10に記載の情報処理システム。 - 前記制御部は、前記撮影部の露光期間内に前記垂直ブランキング期間が含まれる場合、前記露光時間が前記表示部の発光周期の整数倍と前記垂直ブランキング期間の和となるように前記垂直ブランキング期間を制御する
ように構成された
請求項9に記載の情報処理システム。 - 前記制御部は、前記露光期間内に前記垂直ブランキング期間が含まれる場合、前記露光時間が前記表示部の発光周期の整数倍と前記垂直ブランキング期間の和となるようにリフレッシュレートを決定し、前記リフレッシュレートに基づいて前記垂直ブランキング期間を制御する
ように構成された
請求項12に記載の情報処理システム。 - 前記露光時間を取得する取得部
をさらに備える
請求項1に記載の情報処理システム。 - 複数の表示ユニットから構成される前記表示部に表示するための映像信号を取得する入力部と、
前記映像信号を、前記表示部のそれぞれの表示ユニットに表示するための映像信号へ分割する分割部と、
前記垂直ブランキング期間を制御する制御信号と分割された前記映像信号を前記表示ユニットに出力する出力部と
をさらに備え、
前記制御部は、前記制御信号を生成することにより、前記垂直ブランキング期間を制御する
ように構成された
請求項1に記載の情報処理システム。 - 前記制御部は、第1の機器上に設けられ、
前記入力部、前記分割部、および前記出力部は、前記第1の機器とは異なる第2の機器上に設けられ、
前記制御部は、前記第2の機器に前記制御信号を出力する
ように構成された
請求項15に記載の情報処理システム。 - 前記制御部、前記入力部、前記分割部、および前記出力部は、同一の機器上に設けられる
ように構成された
請求項15に記載の情報処理システム。 - 前記制御部による前記垂直ブランキング期間の制御にしたがって駆動するように構成された前記表示部
をさらに備える
請求項1に記載の情報処理システム。 - 前記表示部は、パッシブマトリクス駆動方式で発光し、
前記撮影部は、ローリングシャッタ方式で撮影を行う
ように構成された
請求項1に記載の情報処理システム。 - 情報処理システムが、
表示部を撮影する撮影部の露光時間に基づいて、前記表示部に表示される映像の垂直ブランキング期間を制御する制御ステップ
を含む情報処理方法。
Priority Applications (4)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CA3230091A CA3230091A1 (en) | 2021-10-04 | 2022-09-22 | Information processing system and information processing method |
JP2023552794A JPWO2023058465A1 (ja) | 2021-10-04 | 2022-09-22 | |
KR1020247009183A KR20240073868A (ko) | 2021-10-04 | 2022-09-22 | 정보 처리 시스템 및 정보 처리 방법 |
CN202280066068.2A CN118043877A (zh) | 2021-10-04 | 2022-09-22 | 信息处理***和信息处理方法 |
Applications Claiming Priority (2)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
JP2021-163394 | 2021-10-04 | ||
JP2021163394 | 2021-10-04 |
Publications (1)
Publication Number | Publication Date |
---|---|
WO2023058465A1 true WO2023058465A1 (ja) | 2023-04-13 |
Family
ID=85804193
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
PCT/JP2022/035333 WO2023058465A1 (ja) | 2021-10-04 | 2022-09-22 | 情報処理システムおよび情報処理方法 |
Country Status (6)
Country | Link |
---|---|
JP (1) | JPWO2023058465A1 (ja) |
KR (1) | KR20240073868A (ja) |
CN (1) | CN118043877A (ja) |
CA (1) | CA3230091A1 (ja) |
TW (1) | TW202319825A (ja) |
WO (1) | WO2023058465A1 (ja) |
Citations (5)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
JPH11184445A (ja) * | 1997-12-24 | 1999-07-09 | Hitachi Ltd | ディスプレイ装置の表示画像撮像方法及び画像表示性能検査方法とその装置 |
JP2017083788A (ja) * | 2015-10-30 | 2017-05-18 | キヤノン株式会社 | 表示装置及び表示装置の制御方法 |
WO2018164105A1 (ja) | 2017-03-06 | 2018-09-13 | ソニーセミコンダクタソリューションズ株式会社 | 駆動装置および表示装置 |
JP2019134206A (ja) * | 2018-01-29 | 2019-08-08 | キヤノン株式会社 | 投影装置および投影装置の制御方法 |
CN112565620A (zh) * | 2020-11-26 | 2021-03-26 | 京东方科技集团股份有限公司 | 显示屏幕的光学补偿方法、装置、存储介质及电子设备 |
-
2022
- 2022-09-08 TW TW111134054A patent/TW202319825A/zh unknown
- 2022-09-22 JP JP2023552794A patent/JPWO2023058465A1/ja active Pending
- 2022-09-22 CN CN202280066068.2A patent/CN118043877A/zh active Pending
- 2022-09-22 CA CA3230091A patent/CA3230091A1/en active Pending
- 2022-09-22 KR KR1020247009183A patent/KR20240073868A/ko unknown
- 2022-09-22 WO PCT/JP2022/035333 patent/WO2023058465A1/ja active Application Filing
Patent Citations (5)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
JPH11184445A (ja) * | 1997-12-24 | 1999-07-09 | Hitachi Ltd | ディスプレイ装置の表示画像撮像方法及び画像表示性能検査方法とその装置 |
JP2017083788A (ja) * | 2015-10-30 | 2017-05-18 | キヤノン株式会社 | 表示装置及び表示装置の制御方法 |
WO2018164105A1 (ja) | 2017-03-06 | 2018-09-13 | ソニーセミコンダクタソリューションズ株式会社 | 駆動装置および表示装置 |
JP2019134206A (ja) * | 2018-01-29 | 2019-08-08 | キヤノン株式会社 | 投影装置および投影装置の制御方法 |
CN112565620A (zh) * | 2020-11-26 | 2021-03-26 | 京东方科技集团股份有限公司 | 显示屏幕的光学补偿方法、装置、存储介质及电子设备 |
Also Published As
Publication number | Publication date |
---|---|
TW202319825A (zh) | 2023-05-16 |
JPWO2023058465A1 (ja) | 2023-04-13 |
CN118043877A (zh) | 2024-05-14 |
CA3230091A1 (en) | 2023-04-13 |
KR20240073868A (ko) | 2024-05-27 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
US10547794B2 (en) | Solid-state imaging apparatus and method of operating solid-state imaging apparatus to set a pluratlity of charge accumulation periods in accordance with a flicker period | |
US5408268A (en) | Video imaging system and method using a single full frame sensor and sequential color object illumination | |
JP4948090B2 (ja) | 撮像装置及び駆動制御方法 | |
US20170329208A1 (en) | Information processing apparatus and method | |
US7889238B2 (en) | Multicamera system, image pickup apparatus, controller, image pickup control method, image pickup apparatus control method, and image pickup method | |
JP6950698B2 (ja) | 撮像制御装置、撮像制御方法および撮像装置 | |
JP2010114834A (ja) | 撮像装置 | |
WO2019225071A1 (ja) | 信号処理装置及び信号処理方法、並びに撮像装置 | |
JP2014032159A (ja) | 投影撮像システム及び投影撮像システムの制御方法 | |
US20170142383A1 (en) | Projection apparatus, method for controlling the same, and projection system | |
WO2023058465A1 (ja) | 情報処理システムおよび情報処理方法 | |
WO2023047641A1 (ja) | 情報処理システムおよび情報処理方法 | |
JP2009135792A (ja) | 撮像装置および画像信号処理方法 | |
US9407822B2 (en) | Image capturing apparatus capable of reducing time taken to display image on display and method of controlling the same | |
WO2023100680A1 (ja) | 情報処理システムおよび情報処理方法 | |
JP2011176622A (ja) | 撮像装置 | |
JP7234015B2 (ja) | 撮像装置およびその制御方法 | |
JP7209195B2 (ja) | 表示装置および表示方法 | |
JP2002244633A (ja) | 大型映像表示装置 | |
JP2016096551A (ja) | 撮像装置 | |
US20240203322A1 (en) | Drive Control Device, Drive Control Method, Information Processing System, And Information Processing Method For Information Processing System | |
JP2000165752A (ja) | 固体撮像装置の信号処理方法及び固体撮像装置 | |
JP2012039231A (ja) | 撮像装置 | |
JP2023136450A (ja) | 画像補正装置、撮像システム、制御方法、並びにプログラム | |
JP5846277B2 (ja) | 撮像装置 |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
121 | Ep: the epo has been informed by wipo that ep was designated in this application |
Ref document number: 22878336 Country of ref document: EP Kind code of ref document: A1 |
|
WWE | Wipo information: entry into national phase |
Ref document number: 3230091 Country of ref document: CA |
|
WWE | Wipo information: entry into national phase |
Ref document number: 2023552794 Country of ref document: JP |
|
WWE | Wipo information: entry into national phase |
Ref document number: 2022878336 Country of ref document: EP |
|
NENP | Non-entry into the national phase |
Ref country code: DE |
|
ENP | Entry into the national phase |
Ref document number: 2022878336 Country of ref document: EP Effective date: 20240506 |